2023-02-10 19:02:38,741 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.mapred.TestTableSnapshotInputFormat timeout: 13 mins 2023-02-10 19:02:38,784 INFO [Time-limited test] hbase.ResourceChecker(147): before: mapred.TestTableSnapshotInputFormat#testWithMapReduceMultiRegion Thread=7, OpenFileDescriptor=242, MaxFileDescriptor=60000, SystemLoadAverage=180, ProcessCount=169, AvailableMemoryMB=4759 2023-02-10 19:02:39,122 DEBUG [Time-limited test] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/df59ff2b-dcbe-75a4-cab6-314b30c9ac42 2023-02-10 19:02:39,128 INFO [Time-limited test] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=2, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=true, createWALDir=false} 2023-02-10 19:02:39,129 INFO [Time-limited test] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/df59ff2b-dcbe-75a4-cab6-314b30c9ac42/cluster_62645702-7f4c-8040-e3dd-93ad81c2f524, deleteOnExit=true 2023-02-10 19:02:39,129 INFO [Time-limited test] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-02-10 19:02:39,130 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/df59ff2b-dcbe-75a4-cab6-314b30c9ac42/test.cache.data in system properties and HBase conf 2023-02-10 19:02:39,130 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/df59ff2b-dcbe-75a4-cab6-314b30c9ac42/hadoop.tmp.dir in system properties and HBase conf 2023-02-10 19:02:39,130 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/df59ff2b-dcbe-75a4-cab6-314b30c9ac42/hadoop.log.dir in system properties and HBase conf 2023-02-10 19:02:39,131 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/df59ff2b-dcbe-75a4-cab6-314b30c9ac42/mapreduce.cluster.local.dir in system properties and HBase conf 2023-02-10 19:02:39,131 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/df59ff2b-dcbe-75a4-cab6-314b30c9ac42/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-02-10 19:02:39,131 INFO [Time-limited test] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-02-10 19:02:39,255 WARN [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2023-02-10 19:02:39,631 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-02-10 19:02:39,635 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/df59ff2b-dcbe-75a4-cab6-314b30c9ac42/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-02-10 19:02:39,636 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/df59ff2b-dcbe-75a4-cab6-314b30c9ac42/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-02-10 19:02:39,636 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/df59ff2b-dcbe-75a4-cab6-314b30c9ac42/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-02-10 19:02:39,636 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/df59ff2b-dcbe-75a4-cab6-314b30c9ac42/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-10 19:02:39,637 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/df59ff2b-dcbe-75a4-cab6-314b30c9ac42/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-02-10 19:02:39,637 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/df59ff2b-dcbe-75a4-cab6-314b30c9ac42/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-02-10 19:02:39,638 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/df59ff2b-dcbe-75a4-cab6-314b30c9ac42/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-10 19:02:39,638 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/df59ff2b-dcbe-75a4-cab6-314b30c9ac42/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-10 19:02:39,638 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/df59ff2b-dcbe-75a4-cab6-314b30c9ac42/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-02-10 19:02:39,639 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/df59ff2b-dcbe-75a4-cab6-314b30c9ac42/nfs.dump.dir in system properties and HBase conf 2023-02-10 19:02:39,639 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/df59ff2b-dcbe-75a4-cab6-314b30c9ac42/java.io.tmpdir in system properties and HBase conf 2023-02-10 19:02:39,640 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/df59ff2b-dcbe-75a4-cab6-314b30c9ac42/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-10 19:02:39,640 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/df59ff2b-dcbe-75a4-cab6-314b30c9ac42/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-02-10 19:02:39,641 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/df59ff2b-dcbe-75a4-cab6-314b30c9ac42/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-02-10 19:02:40,137 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-10 19:02:40,142 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-10 19:02:40,402 WARN [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 2023-02-10 19:02:40,539 INFO [Time-limited test] log.Slf4jLog(67): Logging to org.slf4j.impl.Reload4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2023-02-10 19:02:40,551 WARN [Time-limited test] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-10 19:02:40,584 INFO [Time-limited test] log.Slf4jLog(67): jetty-6.1.26 2023-02-10 19:02:40,615 INFO [Time-limited test] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/df59ff2b-dcbe-75a4-cab6-314b30c9ac42/java.io.tmpdir/Jetty_localhost_37569_hdfs____.hm4bk2/webapp 2023-02-10 19:02:40,761 INFO [Time-limited test] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:37569 2023-02-10 19:02:40,773 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-10 19:02:40,774 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-10 19:02:41,261 WARN [Listener at localhost/46001] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-10 19:02:41,379 WARN [Listener at localhost/46001] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-10 19:02:41,402 WARN [Listener at localhost/46001] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-10 19:02:41,409 INFO [Listener at localhost/46001] log.Slf4jLog(67): jetty-6.1.26 2023-02-10 19:02:41,415 INFO [Listener at localhost/46001] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/df59ff2b-dcbe-75a4-cab6-314b30c9ac42/java.io.tmpdir/Jetty_localhost_33401_datanode____.aq55ms/webapp 2023-02-10 19:02:41,540 INFO [Listener at localhost/46001] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:33401 2023-02-10 19:02:41,998 WARN [Listener at localhost/39417] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-10 19:02:42,025 WARN [Listener at localhost/39417] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-10 19:02:42,028 WARN [Listener at localhost/39417] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-10 19:02:42,030 INFO [Listener at localhost/39417] log.Slf4jLog(67): jetty-6.1.26 2023-02-10 19:02:42,037 INFO [Listener at localhost/39417] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/df59ff2b-dcbe-75a4-cab6-314b30c9ac42/java.io.tmpdir/Jetty_localhost_36097_datanode____.r1zki6/webapp 2023-02-10 19:02:42,168 INFO [Listener at localhost/39417] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:36097 2023-02-10 19:02:42,177 WARN [Listener at localhost/32909] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-10 19:02:42,541 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x93646a1c30bda377: Processing first storage report for DS-802e527c-b937-4a6c-a362-39fb62541dc8 from datanode e1db60ba-1d64-4a4b-bddf-16e85b09a2bc 2023-02-10 19:02:42,542 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x93646a1c30bda377: from storage DS-802e527c-b937-4a6c-a362-39fb62541dc8 node DatanodeRegistration(127.0.0.1:38733, datanodeUuid=e1db60ba-1d64-4a4b-bddf-16e85b09a2bc, infoPort=42599, infoSecurePort=0, ipcPort=39417, storageInfo=lv=-57;cid=testClusterID;nsid=1962810863;c=1676055760209), blocks: 0, hasStaleStorage: true, processing time: 1 msecs, invalidatedBlocks: 0 2023-02-10 19:02:42,542 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x38dd5aaa1035d520: Processing first storage report for DS-807935e8-2c4e-4d22-882e-5349980e674f from datanode 6fe54ac5-2638-422d-8594-9057a6fea5c0 2023-02-10 19:02:42,543 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x38dd5aaa1035d520: from storage DS-807935e8-2c4e-4d22-882e-5349980e674f node DatanodeRegistration(127.0.0.1:43865, datanodeUuid=6fe54ac5-2638-422d-8594-9057a6fea5c0, infoPort=43965, infoSecurePort=0, ipcPort=32909, storageInfo=lv=-57;cid=testClusterID;nsid=1962810863;c=1676055760209), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-10 19:02:42,543 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x93646a1c30bda377: Processing first storage report for DS-b56fa707-a988-412c-88ab-6688b364c0b6 from datanode e1db60ba-1d64-4a4b-bddf-16e85b09a2bc 2023-02-10 19:02:42,543 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x93646a1c30bda377: from storage DS-b56fa707-a988-412c-88ab-6688b364c0b6 node DatanodeRegistration(127.0.0.1:38733, datanodeUuid=e1db60ba-1d64-4a4b-bddf-16e85b09a2bc, infoPort=42599, infoSecurePort=0, ipcPort=39417, storageInfo=lv=-57;cid=testClusterID;nsid=1962810863;c=1676055760209), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-10 19:02:42,543 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x38dd5aaa1035d520: Processing first storage report for DS-30f50e8f-6fd9-4462-a34e-e6acdd1ccd1d from datanode 6fe54ac5-2638-422d-8594-9057a6fea5c0 2023-02-10 19:02:42,543 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x38dd5aaa1035d520: from storage DS-30f50e8f-6fd9-4462-a34e-e6acdd1ccd1d node DatanodeRegistration(127.0.0.1:43865, datanodeUuid=6fe54ac5-2638-422d-8594-9057a6fea5c0, infoPort=43965, infoSecurePort=0, ipcPort=32909, storageInfo=lv=-57;cid=testClusterID;nsid=1962810863;c=1676055760209), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-10 19:02:42,592 DEBUG [Listener at localhost/32909] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/df59ff2b-dcbe-75a4-cab6-314b30c9ac42 2023-02-10 19:02:42,676 INFO [Listener at localhost/32909] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/df59ff2b-dcbe-75a4-cab6-314b30c9ac42/cluster_62645702-7f4c-8040-e3dd-93ad81c2f524/zookeeper_0, clientPort=63334, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/df59ff2b-dcbe-75a4-cab6-314b30c9ac42/cluster_62645702-7f4c-8040-e3dd-93ad81c2f524/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/df59ff2b-dcbe-75a4-cab6-314b30c9ac42/cluster_62645702-7f4c-8040-e3dd-93ad81c2f524/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-02-10 19:02:42,694 INFO [Listener at localhost/32909] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=63334 2023-02-10 19:02:42,706 INFO [Listener at localhost/32909] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-10 19:02:42,709 INFO [Listener at localhost/32909] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-10 19:02:43,468 INFO [Listener at localhost/32909] util.FSUtils(479): Created version file at hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75 with version=8 2023-02-10 19:02:43,468 INFO [Listener at localhost/32909] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-10 19:02:43,471 INFO [Listener at localhost/32909] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-10 19:02:43,474 INFO [Listener at localhost/32909] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:46001/user/jenkins/test-data/e38f8928-0bc5-63bf-a015-81024004f54e/hbase-staging 2023-02-10 19:02:43,824 INFO [Listener at localhost/32909] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2023-02-10 19:02:44,379 INFO [Listener at localhost/32909] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-02-10 19:02:44,412 INFO [Listener at localhost/32909] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-10 19:02:44,413 INFO [Listener at localhost/32909] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-10 19:02:44,413 INFO [Listener at localhost/32909] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-10 19:02:44,413 INFO [Listener at localhost/32909] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-10 19:02:44,413 INFO [Listener at localhost/32909] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-10 19:02:44,571 INFO [Listener at localhost/32909] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-02-10 19:02:44,644 DEBUG [Listener at localhost/32909] util.ClassSize(228): Using Unsafe to estimate memory layout 2023-02-10 19:02:44,738 INFO [Listener at localhost/32909] ipc.NettyRpcServer(120): Bind to /172.31.14.131:41145 2023-02-10 19:02:44,748 INFO [Listener at localhost/32909] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-10 19:02:44,751 INFO [Listener at localhost/32909] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-10 19:02:44,773 INFO [Listener at localhost/32909] zookeeper.RecoverableZooKeeper(93): Process identifier=master:41145 connecting to ZooKeeper ensemble=127.0.0.1:63334 2023-02-10 19:02:44,817 DEBUG [Listener at localhost/32909-EventThread] zookeeper.ZKWatcher(600): master:411450x0, quorum=127.0.0.1:63334, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-10 19:02:44,819 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): master:41145-0x1003f9d40a30000 connected 2023-02-10 19:02:44,845 DEBUG [Listener at localhost/32909] zookeeper.ZKUtil(164): master:41145-0x1003f9d40a30000, quorum=127.0.0.1:63334, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-10 19:02:44,846 DEBUG [Listener at localhost/32909] zookeeper.ZKUtil(164): master:41145-0x1003f9d40a30000, quorum=127.0.0.1:63334, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-10 19:02:44,850 DEBUG [Listener at localhost/32909] zookeeper.ZKUtil(164): master:41145-0x1003f9d40a30000, quorum=127.0.0.1:63334, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-10 19:02:44,857 DEBUG [Listener at localhost/32909] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=41145 2023-02-10 19:02:44,858 DEBUG [Listener at localhost/32909] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=41145 2023-02-10 19:02:44,858 DEBUG [Listener at localhost/32909] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=41145 2023-02-10 19:02:44,858 DEBUG [Listener at localhost/32909] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=41145 2023-02-10 19:02:44,859 DEBUG [Listener at localhost/32909] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=41145 2023-02-10 19:02:44,865 INFO [Listener at localhost/32909] master.HMaster(439): hbase.rootdir=hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75, hbase.cluster.distributed=false 2023-02-10 19:02:44,937 INFO [Listener at localhost/32909] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-10 19:02:44,937 INFO [Listener at localhost/32909] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-10 19:02:44,938 INFO [Listener at localhost/32909] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-10 19:02:44,938 INFO [Listener at localhost/32909] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-10 19:02:44,938 INFO [Listener at localhost/32909] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-10 19:02:44,938 INFO [Listener at localhost/32909] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-10 19:02:44,943 INFO [Listener at localhost/32909] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-10 19:02:44,946 INFO [Listener at localhost/32909] ipc.NettyRpcServer(120): Bind to /172.31.14.131:43623 2023-02-10 19:02:44,948 INFO [Listener at localhost/32909] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-10 19:02:44,955 DEBUG [Listener at localhost/32909] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-10 19:02:44,956 INFO [Listener at localhost/32909] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-10 19:02:44,958 INFO [Listener at localhost/32909] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-10 19:02:44,960 INFO [Listener at localhost/32909] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:43623 connecting to ZooKeeper ensemble=127.0.0.1:63334 2023-02-10 19:02:44,964 DEBUG [Listener at localhost/32909-EventThread] zookeeper.ZKWatcher(600): regionserver:436230x0, quorum=127.0.0.1:63334, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-10 19:02:44,966 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:43623-0x1003f9d40a30001 connected 2023-02-10 19:02:44,966 DEBUG [Listener at localhost/32909] zookeeper.ZKUtil(164): regionserver:43623-0x1003f9d40a30001, quorum=127.0.0.1:63334, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-10 19:02:44,967 DEBUG [Listener at localhost/32909] zookeeper.ZKUtil(164): regionserver:43623-0x1003f9d40a30001, quorum=127.0.0.1:63334, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-10 19:02:44,968 DEBUG [Listener at localhost/32909] zookeeper.ZKUtil(164): regionserver:43623-0x1003f9d40a30001, quorum=127.0.0.1:63334, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-10 19:02:44,972 DEBUG [Listener at localhost/32909] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=43623 2023-02-10 19:02:44,972 DEBUG [Listener at localhost/32909] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=43623 2023-02-10 19:02:44,972 DEBUG [Listener at localhost/32909] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=43623 2023-02-10 19:02:44,973 DEBUG [Listener at localhost/32909] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=43623 2023-02-10 19:02:44,973 DEBUG [Listener at localhost/32909] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=43623 2023-02-10 19:02:44,987 INFO [Listener at localhost/32909] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-10 19:02:44,987 INFO [Listener at localhost/32909] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-10 19:02:44,988 INFO [Listener at localhost/32909] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-10 19:02:44,988 INFO [Listener at localhost/32909] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-10 19:02:44,989 INFO [Listener at localhost/32909] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-10 19:02:44,989 INFO [Listener at localhost/32909] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-10 19:02:44,989 INFO [Listener at localhost/32909] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-10 19:02:44,993 INFO [Listener at localhost/32909] ipc.NettyRpcServer(120): Bind to /172.31.14.131:43337 2023-02-10 19:02:44,993 INFO [Listener at localhost/32909] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-10 19:02:44,994 DEBUG [Listener at localhost/32909] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-10 19:02:44,995 INFO [Listener at localhost/32909] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-10 19:02:44,998 INFO [Listener at localhost/32909] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-10 19:02:45,000 INFO [Listener at localhost/32909] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:43337 connecting to ZooKeeper ensemble=127.0.0.1:63334 2023-02-10 19:02:45,004 DEBUG [Listener at localhost/32909-EventThread] zookeeper.ZKWatcher(600): regionserver:433370x0, quorum=127.0.0.1:63334, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-10 19:02:45,005 DEBUG [Listener at localhost/32909] zookeeper.ZKUtil(164): regionserver:433370x0, quorum=127.0.0.1:63334, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-10 19:02:45,006 DEBUG [Listener at localhost/32909] zookeeper.ZKUtil(164): regionserver:433370x0, quorum=127.0.0.1:63334, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-10 19:02:45,007 DEBUG [Listener at localhost/32909] zookeeper.ZKUtil(164): regionserver:433370x0, quorum=127.0.0.1:63334, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-10 19:02:45,008 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:43337-0x1003f9d40a30002 connected 2023-02-10 19:02:45,008 DEBUG [Listener at localhost/32909] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=43337 2023-02-10 19:02:45,009 DEBUG [Listener at localhost/32909] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=43337 2023-02-10 19:02:45,009 DEBUG [Listener at localhost/32909] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=43337 2023-02-10 19:02:45,009 DEBUG [Listener at localhost/32909] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=43337 2023-02-10 19:02:45,010 DEBUG [Listener at localhost/32909] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=43337 2023-02-10 19:02:45,016 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2158): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,41145,1676055763642 2023-02-10 19:02:45,025 DEBUG [Listener at localhost/32909-EventThread] zookeeper.ZKWatcher(600): master:41145-0x1003f9d40a30000, quorum=127.0.0.1:63334, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-10 19:02:45,027 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:41145-0x1003f9d40a30000, quorum=127.0.0.1:63334, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,41145,1676055763642 2023-02-10 19:02:45,045 DEBUG [Listener at localhost/32909-EventThread] zookeeper.ZKWatcher(600): regionserver:43623-0x1003f9d40a30001, quorum=127.0.0.1:63334, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-10 19:02:45,045 DEBUG [Listener at localhost/32909-EventThread] zookeeper.ZKWatcher(600): regionserver:43337-0x1003f9d40a30002, quorum=127.0.0.1:63334, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-10 19:02:45,045 DEBUG [Listener at localhost/32909-EventThread] zookeeper.ZKWatcher(600): master:41145-0x1003f9d40a30000, quorum=127.0.0.1:63334, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-10 19:02:45,046 DEBUG [Listener at localhost/32909-EventThread] zookeeper.ZKWatcher(600): master:41145-0x1003f9d40a30000, quorum=127.0.0.1:63334, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-10 19:02:45,046 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:41145-0x1003f9d40a30000, quorum=127.0.0.1:63334, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-10 19:02:45,048 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(224): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,41145,1676055763642 from backup master directory 2023-02-10 19:02:45,048 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:41145-0x1003f9d40a30000, quorum=127.0.0.1:63334, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-10 19:02:45,052 DEBUG [Listener at localhost/32909-EventThread] zookeeper.ZKWatcher(600): master:41145-0x1003f9d40a30000, quorum=127.0.0.1:63334, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,41145,1676055763642 2023-02-10 19:02:45,052 DEBUG [Listener at localhost/32909-EventThread] zookeeper.ZKWatcher(600): master:41145-0x1003f9d40a30000, quorum=127.0.0.1:63334, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-10 19:02:45,053 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-10 19:02:45,053 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(234): Registered as active master=jenkins-hbase4.apache.org,41145,1676055763642 2023-02-10 19:02:45,056 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating data MemStoreChunkPool with chunk size 2 MB, max count 352, initial count 0 2023-02-10 19:02:45,057 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 391, initial count 0 2023-02-10 19:02:45,143 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(628): Created cluster ID file at hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/hbase.id with ID: a8929120-3c76-4f7e-a4c6-5bc18525d6b5 2023-02-10 19:02:45,182 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-10 19:02:45,199 DEBUG [Listener at localhost/32909-EventThread] zookeeper.ZKWatcher(600): master:41145-0x1003f9d40a30000, quorum=127.0.0.1:63334, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-10 19:02:45,247 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x6cf7b80a to 127.0.0.1:63334 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-10 19:02:45,286 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1b0028ac, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-10 19:02:45,309 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-10 19:02:45,311 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-02-10 19:02:45,330 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(264): ClientProtocol::create wrong number of arguments, should be hadoop 3.2 or below 2023-02-10 19:02:45,331 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(270): ClientProtocol::create wrong number of arguments, should be hadoop 2.x 2023-02-10 19:02:45,332 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(279): can not find SHOULD_REPLICATE flag, should be hadoop 2.x java.lang.IllegalArgumentException: No enum constant org.apache.hadoop.fs.CreateFlag.SHOULD_REPLICATE at java.lang.Enum.valueOf(Enum.java:238) at org.apache.hadoop.fs.CreateFlag.valueOf(CreateFlag.java:63) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.loadShouldReplicateFlag(FanOutOneBlockAsyncDFSOutputHelper.java:277) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.(FanOutOneBlockAsyncDFSOutputHelper.java:304) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:139) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:849) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2178) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:523) at java.lang.Thread.run(Thread.java:750) 2023-02-10 19:02:45,336 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(243): No decryptEncryptedDataEncryptionKey method in DFSClient, should be hadoop version with HDFS-12396 java.lang.NoSuchMethodException: org.apache.hadoop.hdfs.DFSClient.decryptEncryptedDataEncryptionKey(org.apache.hadoop.fs.FileEncryptionInfo) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelperWithoutHDFS12396(FanOutOneBlockAsyncDFSOutputSaslHelper.java:182) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelper(FanOutOneBlockAsyncDFSOutputSaslHelper.java:241) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.(FanOutOneBlockAsyncDFSOutputSaslHelper.java:252) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:140) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:849) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2178) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:523) at java.lang.Thread.run(Thread.java:750) 2023-02-10 19:02:45,337 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-10 19:02:45,373 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7689): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/MasterData/data/master/store-tmp 2023-02-10 19:02:45,407 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-10 19:02:45,408 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-10 19:02:45,408 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-10 19:02:45,408 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-10 19:02:45,408 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-10 19:02:45,408 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-10 19:02:45,408 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-10 19:02:45,408 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1676055765407Disabling compacts and flushes for region at 1676055765408 (+1 ms)Disabling writes for close at 1676055765408Writing region close event to WAL at 1676055765408Closed at 1676055765408 2023-02-10 19:02:45,410 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/MasterData/WALs/jenkins-hbase4.apache.org,41145,1676055763642 2023-02-10 19:02:45,431 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C41145%2C1676055763642, suffix=, logDir=hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/MasterData/WALs/jenkins-hbase4.apache.org,41145,1676055763642, archiveDir=hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/MasterData/oldWALs, maxLogs=10 2023-02-10 19:02:45,490 DEBUG [RS-EventLoopGroup-4-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43865,DS-807935e8-2c4e-4d22-882e-5349980e674f,DISK] 2023-02-10 19:02:45,490 DEBUG [RS-EventLoopGroup-4-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38733,DS-802e527c-b937-4a6c-a362-39fb62541dc8,DISK] 2023-02-10 19:02:45,499 DEBUG [RS-EventLoopGroup-4-3] asyncfs.ProtobufDecoder(123): Hadoop 3.2 and below use unshaded protobuf. java.lang.ClassNotFoundException: org.apache.hadoop.thirdparty.protobuf.MessageLite at java.net.URLClassLoader.findClass(URLClassLoader.java:387) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.io.asyncfs.ProtobufDecoder.(ProtobufDecoder.java:118) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.processWriteBlockResponse(FanOutOneBlockAsyncDFSOutputHelper.java:340) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$100(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$4.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:424) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:557) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.addListener(DefaultPromise.java:185) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.initialize(FanOutOneBlockAsyncDFSOutputHelper.java:418) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$300(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:476) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:471) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setSuccess0(DefaultPromise.java:625) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:105) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPromise.trySuccess(DefaultChannelPromise.java:84) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:653) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:691) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-02-10 19:02:45,559 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/MasterData/WALs/jenkins-hbase4.apache.org,41145,1676055763642/jenkins-hbase4.apache.org%2C41145%2C1676055763642.1676055765441 2023-02-10 19:02:45,560 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:43865,DS-807935e8-2c4e-4d22-882e-5349980e674f,DISK], DatanodeInfoWithStorage[127.0.0.1:38733,DS-802e527c-b937-4a6c-a362-39fb62541dc8,DISK]] 2023-02-10 19:02:45,560 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7850): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-02-10 19:02:45,561 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-10 19:02:45,564 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7890): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-02-10 19:02:45,566 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7893): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-02-10 19:02:45,629 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-02-10 19:02:45,636 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-02-10 19:02:45,664 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-02-10 19:02:45,676 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-10 19:02:45,681 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-10 19:02:45,683 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-10 19:02:45,697 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1054): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-02-10 19:02:45,702 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-10 19:02:45,703 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1071): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67375857, jitterRate=0.003978505730628967}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-10 19:02:45,703 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(964): Region open journal for 1595e783b53d99cd5eef43b6debb2682: Writing region info on filesystem at 1676055765596Initializing all the Stores at 1676055765599 (+3 ms)Instantiating store for column family {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676055765600 (+1 ms)Cleaning up temporary data from old regions at 1676055765689 (+89 ms)Cleaning up detritus from prior splits at 1676055765689Region opened successfully at 1676055765703 (+14 ms) 2023-02-10 19:02:45,705 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-02-10 19:02:45,726 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-02-10 19:02:45,726 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-02-10 19:02:45,728 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-02-10 19:02:45,730 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 1 msec 2023-02-10 19:02:45,766 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 35 msec 2023-02-10 19:02:45,766 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(95): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-02-10 19:02:45,801 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-02-10 19:02:45,807 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-02-10 19:02:45,841 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-02-10 19:02:45,848 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-02-10 19:02:45,850 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:41145-0x1003f9d40a30000, quorum=127.0.0.1:63334, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-02-10 19:02:45,858 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-02-10 19:02:45,863 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:41145-0x1003f9d40a30000, quorum=127.0.0.1:63334, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-02-10 19:02:45,866 DEBUG [Listener at localhost/32909-EventThread] zookeeper.ZKWatcher(600): master:41145-0x1003f9d40a30000, quorum=127.0.0.1:63334, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-10 19:02:45,868 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:41145-0x1003f9d40a30000, quorum=127.0.0.1:63334, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-02-10 19:02:45,869 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:41145-0x1003f9d40a30000, quorum=127.0.0.1:63334, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-02-10 19:02:45,884 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:41145-0x1003f9d40a30000, quorum=127.0.0.1:63334, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-02-10 19:02:45,891 DEBUG [Listener at localhost/32909-EventThread] zookeeper.ZKWatcher(600): regionserver:43623-0x1003f9d40a30001, quorum=127.0.0.1:63334, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-10 19:02:45,891 DEBUG [Listener at localhost/32909-EventThread] zookeeper.ZKWatcher(600): regionserver:43337-0x1003f9d40a30002, quorum=127.0.0.1:63334, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-10 19:02:45,891 DEBUG [Listener at localhost/32909-EventThread] zookeeper.ZKWatcher(600): master:41145-0x1003f9d40a30000, quorum=127.0.0.1:63334, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-10 19:02:45,891 DEBUG [Listener at localhost/32909-EventThread] zookeeper.ZKWatcher(600): master:41145-0x1003f9d40a30000, quorum=127.0.0.1:63334, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-10 19:02:45,892 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(739): Active/primary master=jenkins-hbase4.apache.org,41145,1676055763642, sessionid=0x1003f9d40a30000, setting cluster-up flag (Was=false) 2023-02-10 19:02:45,913 DEBUG [Listener at localhost/32909-EventThread] zookeeper.ZKWatcher(600): master:41145-0x1003f9d40a30000, quorum=127.0.0.1:63334, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-10 19:02:45,921 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-02-10 19:02:45,924 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,41145,1676055763642 2023-02-10 19:02:45,930 DEBUG [Listener at localhost/32909-EventThread] zookeeper.ZKWatcher(600): master:41145-0x1003f9d40a30000, quorum=127.0.0.1:63334, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-10 19:02:45,937 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-02-10 19:02:45,940 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,41145,1676055763642 2023-02-10 19:02:45,944 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/.hbase-snapshot/.tmp 2023-02-10 19:02:46,014 INFO [RS:0;jenkins-hbase4:43623] regionserver.HRegionServer(952): ClusterId : a8929120-3c76-4f7e-a4c6-5bc18525d6b5 2023-02-10 19:02:46,014 INFO [RS:1;jenkins-hbase4:43337] regionserver.HRegionServer(952): ClusterId : a8929120-3c76-4f7e-a4c6-5bc18525d6b5 2023-02-10 19:02:46,022 DEBUG [RS:0;jenkins-hbase4:43623] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-10 19:02:46,022 DEBUG [RS:1;jenkins-hbase4:43337] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-10 19:02:46,034 DEBUG [RS:1;jenkins-hbase4:43337] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-10 19:02:46,034 DEBUG [RS:0;jenkins-hbase4:43623] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-10 19:02:46,034 DEBUG [RS:1;jenkins-hbase4:43337] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-10 19:02:46,034 DEBUG [RS:0;jenkins-hbase4:43623] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-10 19:02:46,038 DEBUG [RS:0;jenkins-hbase4:43623] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-10 19:02:46,038 DEBUG [RS:1;jenkins-hbase4:43337] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-10 19:02:46,040 DEBUG [RS:1;jenkins-hbase4:43337] zookeeper.ReadOnlyZKClient(139): Connect 0x327befac to 127.0.0.1:63334 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-10 19:02:46,040 DEBUG [RS:0;jenkins-hbase4:43623] zookeeper.ReadOnlyZKClient(139): Connect 0x40450016 to 127.0.0.1:63334 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-10 19:02:46,057 DEBUG [RS:1;jenkins-hbase4:43337] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7b9cfc2, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-10 19:02:46,057 DEBUG [RS:0;jenkins-hbase4:43623] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3aaebd66, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-10 19:02:46,058 DEBUG [RS:1;jenkins-hbase4:43337] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4a6d2501, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-10 19:02:46,058 DEBUG [RS:0;jenkins-hbase4:43623] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4b6d207c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-10 19:02:46,081 DEBUG [RS:0;jenkins-hbase4:43623] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:43623 2023-02-10 19:02:46,082 DEBUG [RS:1;jenkins-hbase4:43337] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:43337 2023-02-10 19:02:46,086 INFO [RS:0;jenkins-hbase4:43623] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-10 19:02:46,086 INFO [RS:1;jenkins-hbase4:43337] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-10 19:02:46,087 INFO [RS:1;jenkins-hbase4:43337] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-10 19:02:46,087 INFO [RS:0;jenkins-hbase4:43623] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-10 19:02:46,087 DEBUG [RS:1;jenkins-hbase4:43337] regionserver.HRegionServer(1023): About to register with Master. 2023-02-10 19:02:46,087 DEBUG [RS:0;jenkins-hbase4:43623] regionserver.HRegionServer(1023): About to register with Master. 2023-02-10 19:02:46,090 INFO [RS:1;jenkins-hbase4:43337] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,41145,1676055763642 with isa=jenkins-hbase4.apache.org/172.31.14.131:43337, startcode=1676055764986 2023-02-10 19:02:46,090 INFO [RS:0;jenkins-hbase4:43623] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,41145,1676055763642 with isa=jenkins-hbase4.apache.org/172.31.14.131:43623, startcode=1676055764936 2023-02-10 19:02:46,103 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-02-10 19:02:46,108 DEBUG [RS:1;jenkins-hbase4:43337] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-10 19:02:46,108 DEBUG [RS:0;jenkins-hbase4:43623] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-10 19:02:46,118 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-10 19:02:46,118 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-10 19:02:46,119 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-10 19:02:46,119 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-10 19:02:46,119 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-02-10 19:02:46,119 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-10 19:02:46,119 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-10 19:02:46,119 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-10 19:02:46,121 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1676055796120 2023-02-10 19:02:46,123 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-02-10 19:02:46,135 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-02-10 19:02:46,135 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-02-10 19:02:46,135 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-02-10 19:02:46,142 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-10 19:02:46,144 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-02-10 19:02:46,145 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-02-10 19:02:46,146 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-02-10 19:02:46,146 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-02-10 19:02:46,146 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-10 19:02:46,148 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-02-10 19:02:46,150 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-02-10 19:02:46,151 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-02-10 19:02:46,154 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-02-10 19:02:46,155 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-02-10 19:02:46,157 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676055766157,5,FailOnTimeoutGroup] 2023-02-10 19:02:46,159 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676055766157,5,FailOnTimeoutGroup] 2023-02-10 19:02:46,159 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-10 19:02:46,159 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1451): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-02-10 19:02:46,161 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-02-10 19:02:46,161 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-02-10 19:02:46,173 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:57293, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.1 (auth:SIMPLE), service=RegionServerStatusService 2023-02-10 19:02:46,173 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49513, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=RegionServerStatusService 2023-02-10 19:02:46,189 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41145] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,43337,1676055764986 2023-02-10 19:02:46,189 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-10 19:02:46,189 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41145] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,43623,1676055764936 2023-02-10 19:02:46,191 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-10 19:02:46,191 INFO [PEWorker-1] regionserver.HRegion(7671): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75 2023-02-10 19:02:46,208 DEBUG [RS:1;jenkins-hbase4:43337] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75 2023-02-10 19:02:46,208 DEBUG [RS:0;jenkins-hbase4:43623] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75 2023-02-10 19:02:46,209 DEBUG [RS:1;jenkins-hbase4:43337] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:46001 2023-02-10 19:02:46,209 DEBUG [RS:0;jenkins-hbase4:43623] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:46001 2023-02-10 19:02:46,210 DEBUG [RS:1;jenkins-hbase4:43337] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-10 19:02:46,210 DEBUG [RS:0;jenkins-hbase4:43623] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-10 19:02:46,217 DEBUG [PEWorker-1] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-10 19:02:46,219 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-10 19:02:46,220 DEBUG [Listener at localhost/32909-EventThread] zookeeper.ZKWatcher(600): master:41145-0x1003f9d40a30000, quorum=127.0.0.1:63334, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-10 19:02:46,221 DEBUG [RS:1;jenkins-hbase4:43337] zookeeper.ZKUtil(162): regionserver:43337-0x1003f9d40a30002, quorum=127.0.0.1:63334, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,43337,1676055764986 2023-02-10 19:02:46,221 DEBUG [RS:0;jenkins-hbase4:43623] zookeeper.ZKUtil(162): regionserver:43623-0x1003f9d40a30001, quorum=127.0.0.1:63334, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,43623,1676055764936 2023-02-10 19:02:46,221 WARN [RS:1;jenkins-hbase4:43337] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-10 19:02:46,222 WARN [RS:0;jenkins-hbase4:43623] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-10 19:02:46,222 INFO [RS:1;jenkins-hbase4:43337] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-10 19:02:46,223 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/data/hbase/meta/1588230740/info 2023-02-10 19:02:46,222 INFO [RS:0;jenkins-hbase4:43623] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-10 19:02:46,223 DEBUG [RS:1;jenkins-hbase4:43337] regionserver.HRegionServer(1947): logDir=hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/WALs/jenkins-hbase4.apache.org,43337,1676055764986 2023-02-10 19:02:46,223 DEBUG [RS:0;jenkins-hbase4:43623] regionserver.HRegionServer(1947): logDir=hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/WALs/jenkins-hbase4.apache.org,43623,1676055764936 2023-02-10 19:02:46,224 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,43337,1676055764986] 2023-02-10 19:02:46,224 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,43623,1676055764936] 2023-02-10 19:02:46,224 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-10 19:02:46,227 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-10 19:02:46,228 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-10 19:02:46,231 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/data/hbase/meta/1588230740/rep_barrier 2023-02-10 19:02:46,231 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-10 19:02:46,232 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-10 19:02:46,232 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-10 19:02:46,234 DEBUG [RS:1;jenkins-hbase4:43337] zookeeper.ZKUtil(162): regionserver:43337-0x1003f9d40a30002, quorum=127.0.0.1:63334, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,43623,1676055764936 2023-02-10 19:02:46,234 DEBUG [RS:0;jenkins-hbase4:43623] zookeeper.ZKUtil(162): regionserver:43623-0x1003f9d40a30001, quorum=127.0.0.1:63334, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,43623,1676055764936 2023-02-10 19:02:46,235 DEBUG [RS:1;jenkins-hbase4:43337] zookeeper.ZKUtil(162): regionserver:43337-0x1003f9d40a30002, quorum=127.0.0.1:63334, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,43337,1676055764986 2023-02-10 19:02:46,235 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/data/hbase/meta/1588230740/table 2023-02-10 19:02:46,235 DEBUG [RS:0;jenkins-hbase4:43623] zookeeper.ZKUtil(162): regionserver:43623-0x1003f9d40a30001, quorum=127.0.0.1:63334, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,43337,1676055764986 2023-02-10 19:02:46,236 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-10 19:02:46,237 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-10 19:02:46,240 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/data/hbase/meta/1588230740 2023-02-10 19:02:46,241 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/data/hbase/meta/1588230740 2023-02-10 19:02:46,245 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-10 19:02:46,248 DEBUG [RS:0;jenkins-hbase4:43623] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-10 19:02:46,248 DEBUG [RS:1;jenkins-hbase4:43337] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-10 19:02:46,248 DEBUG [PEWorker-1] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-10 19:02:46,252 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-10 19:02:46,253 INFO [PEWorker-1] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74118802, jitterRate=0.10445621609687805}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-10 19:02:46,253 DEBUG [PEWorker-1] regionserver.HRegion(964): Region open journal for 1588230740: Writing region info on filesystem at 1676055766217Initializing all the Stores at 1676055766218 (+1 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676055766218Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676055766218Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676055766218Cleaning up temporary data from old regions at 1676055766243 (+25 ms)Cleaning up detritus from prior splits at 1676055766244 (+1 ms)Region opened successfully at 1676055766253 (+9 ms) 2023-02-10 19:02:46,254 DEBUG [PEWorker-1] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-10 19:02:46,254 INFO [PEWorker-1] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-10 19:02:46,254 DEBUG [PEWorker-1] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-10 19:02:46,254 DEBUG [PEWorker-1] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-10 19:02:46,254 DEBUG [PEWorker-1] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-10 19:02:46,255 INFO [PEWorker-1] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-10 19:02:46,255 DEBUG [PEWorker-1] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1676055766254Disabling compacts and flushes for region at 1676055766254Disabling writes for close at 1676055766254Writing region close event to WAL at 1676055766255 (+1 ms)Closed at 1676055766255 2023-02-10 19:02:46,260 INFO [RS:0;jenkins-hbase4:43623] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-10 19:02:46,260 INFO [RS:1;jenkins-hbase4:43337] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-10 19:02:46,260 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-02-10 19:02:46,260 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-02-10 19:02:46,269 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-02-10 19:02:46,281 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-02-10 19:02:46,283 INFO [RS:1;jenkins-hbase4:43337] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-10 19:02:46,283 INFO [RS:0;jenkins-hbase4:43623] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-10 19:02:46,284 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-02-10 19:02:46,288 INFO [RS:1;jenkins-hbase4:43337] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-10 19:02:46,288 INFO [RS:0;jenkins-hbase4:43623] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-10 19:02:46,289 INFO [RS:1;jenkins-hbase4:43337] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-10 19:02:46,289 INFO [RS:0;jenkins-hbase4:43623] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-10 19:02:46,291 INFO [RS:1;jenkins-hbase4:43337] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-10 19:02:46,291 INFO [RS:0;jenkins-hbase4:43623] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-10 19:02:46,299 INFO [RS:0;jenkins-hbase4:43623] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-10 19:02:46,299 INFO [RS:1;jenkins-hbase4:43337] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-10 19:02:46,300 DEBUG [RS:0;jenkins-hbase4:43623] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-10 19:02:46,300 DEBUG [RS:1;jenkins-hbase4:43337] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-10 19:02:46,300 DEBUG [RS:0;jenkins-hbase4:43623] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-10 19:02:46,300 DEBUG [RS:1;jenkins-hbase4:43337] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-10 19:02:46,300 DEBUG [RS:0;jenkins-hbase4:43623] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-10 19:02:46,300 DEBUG [RS:1;jenkins-hbase4:43337] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-10 19:02:46,300 DEBUG [RS:0;jenkins-hbase4:43623] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-10 19:02:46,300 DEBUG [RS:1;jenkins-hbase4:43337] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-10 19:02:46,300 DEBUG [RS:0;jenkins-hbase4:43623] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-10 19:02:46,300 DEBUG [RS:1;jenkins-hbase4:43337] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-10 19:02:46,301 DEBUG [RS:0;jenkins-hbase4:43623] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-10 19:02:46,301 DEBUG [RS:1;jenkins-hbase4:43337] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-10 19:02:46,301 DEBUG [RS:0;jenkins-hbase4:43623] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-10 19:02:46,301 DEBUG [RS:1;jenkins-hbase4:43337] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-10 19:02:46,301 DEBUG [RS:0;jenkins-hbase4:43623] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-10 19:02:46,301 DEBUG [RS:1;jenkins-hbase4:43337] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-10 19:02:46,301 DEBUG [RS:0;jenkins-hbase4:43623] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-10 19:02:46,301 DEBUG [RS:1;jenkins-hbase4:43337] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-10 19:02:46,301 DEBUG [RS:0;jenkins-hbase4:43623] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-10 19:02:46,301 DEBUG [RS:1;jenkins-hbase4:43337] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-10 19:02:46,302 INFO [RS:1;jenkins-hbase4:43337] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-10 19:02:46,302 INFO [RS:0;jenkins-hbase4:43623] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-10 19:02:46,302 INFO [RS:1;jenkins-hbase4:43337] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-10 19:02:46,303 INFO [RS:0;jenkins-hbase4:43623] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-10 19:02:46,303 INFO [RS:1;jenkins-hbase4:43337] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-10 19:02:46,303 INFO [RS:0;jenkins-hbase4:43623] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-10 19:02:46,318 INFO [RS:0;jenkins-hbase4:43623] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-10 19:02:46,318 INFO [RS:1;jenkins-hbase4:43337] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-10 19:02:46,322 INFO [RS:0;jenkins-hbase4:43623] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,43623,1676055764936-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-10 19:02:46,322 INFO [RS:1;jenkins-hbase4:43337] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,43337,1676055764986-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-10 19:02:46,340 INFO [RS:0;jenkins-hbase4:43623] regionserver.Replication(203): jenkins-hbase4.apache.org,43623,1676055764936 started 2023-02-10 19:02:46,340 INFO [RS:0;jenkins-hbase4:43623] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,43623,1676055764936, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:43623, sessionid=0x1003f9d40a30001 2023-02-10 19:02:46,340 DEBUG [RS:0;jenkins-hbase4:43623] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-10 19:02:46,340 DEBUG [RS:0;jenkins-hbase4:43623] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,43623,1676055764936 2023-02-10 19:02:46,340 DEBUG [RS:0;jenkins-hbase4:43623] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,43623,1676055764936' 2023-02-10 19:02:46,340 DEBUG [RS:0;jenkins-hbase4:43623] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-10 19:02:46,341 DEBUG [RS:0;jenkins-hbase4:43623] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-10 19:02:46,341 INFO [RS:1;jenkins-hbase4:43337] regionserver.Replication(203): jenkins-hbase4.apache.org,43337,1676055764986 started 2023-02-10 19:02:46,341 INFO [RS:1;jenkins-hbase4:43337] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,43337,1676055764986, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:43337, sessionid=0x1003f9d40a30002 2023-02-10 19:02:46,342 DEBUG [RS:1;jenkins-hbase4:43337] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-10 19:02:46,342 DEBUG [RS:1;jenkins-hbase4:43337] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,43337,1676055764986 2023-02-10 19:02:46,342 DEBUG [RS:0;jenkins-hbase4:43623] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-10 19:02:46,342 DEBUG [RS:1;jenkins-hbase4:43337] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,43337,1676055764986' 2023-02-10 19:02:46,342 DEBUG [RS:0;jenkins-hbase4:43623] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-10 19:02:46,343 DEBUG [RS:1;jenkins-hbase4:43337] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-10 19:02:46,343 DEBUG [RS:0;jenkins-hbase4:43623] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,43623,1676055764936 2023-02-10 19:02:46,343 DEBUG [RS:0;jenkins-hbase4:43623] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,43623,1676055764936' 2023-02-10 19:02:46,343 DEBUG [RS:0;jenkins-hbase4:43623] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-10 19:02:46,343 DEBUG [RS:1;jenkins-hbase4:43337] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-10 19:02:46,343 DEBUG [RS:0;jenkins-hbase4:43623] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-10 19:02:46,344 DEBUG [RS:1;jenkins-hbase4:43337] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-10 19:02:46,344 DEBUG [RS:0;jenkins-hbase4:43623] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-10 19:02:46,344 DEBUG [RS:1;jenkins-hbase4:43337] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-10 19:02:46,344 INFO [RS:0;jenkins-hbase4:43623] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-10 19:02:46,344 DEBUG [RS:1;jenkins-hbase4:43337] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,43337,1676055764986 2023-02-10 19:02:46,344 DEBUG [RS:1;jenkins-hbase4:43337] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,43337,1676055764986' 2023-02-10 19:02:46,345 DEBUG [RS:1;jenkins-hbase4:43337] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-10 19:02:46,344 INFO [RS:0;jenkins-hbase4:43623] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-10 19:02:46,345 DEBUG [RS:1;jenkins-hbase4:43337] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-10 19:02:46,345 DEBUG [RS:1;jenkins-hbase4:43337] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-10 19:02:46,346 INFO [RS:1;jenkins-hbase4:43337] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-10 19:02:46,346 INFO [RS:1;jenkins-hbase4:43337] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-10 19:02:46,437 DEBUG [jenkins-hbase4:41145] assignment.AssignmentManager(2178): Processing assignQueue; systemServersCount=2, allServersCount=2 2023-02-10 19:02:46,441 DEBUG [jenkins-hbase4:41145] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-10 19:02:46,447 DEBUG [jenkins-hbase4:41145] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-10 19:02:46,447 DEBUG [jenkins-hbase4:41145] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-10 19:02:46,447 DEBUG [jenkins-hbase4:41145] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-10 19:02:46,450 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,43623,1676055764936, state=OPENING 2023-02-10 19:02:46,457 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-02-10 19:02:46,460 DEBUG [Listener at localhost/32909-EventThread] zookeeper.ZKWatcher(600): master:41145-0x1003f9d40a30000, quorum=127.0.0.1:63334, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-10 19:02:46,461 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-10 19:02:46,466 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,43623,1676055764936}] 2023-02-10 19:02:46,652 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,43623,1676055764936 2023-02-10 19:02:46,654 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-10 19:02:46,659 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54254, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-10 19:02:46,671 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:meta,,1.1588230740 2023-02-10 19:02:46,671 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-10 19:02:46,674 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C43623%2C1676055764936.meta, suffix=.meta, logDir=hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/WALs/jenkins-hbase4.apache.org,43623,1676055764936, archiveDir=hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/oldWALs, maxLogs=32 2023-02-10 19:02:46,700 DEBUG [RS-EventLoopGroup-4-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38733,DS-802e527c-b937-4a6c-a362-39fb62541dc8,DISK] 2023-02-10 19:02:46,700 DEBUG [RS-EventLoopGroup-4-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43865,DS-807935e8-2c4e-4d22-882e-5349980e674f,DISK] 2023-02-10 19:02:46,704 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/WALs/jenkins-hbase4.apache.org,43623,1676055764936/jenkins-hbase4.apache.org%2C43623%2C1676055764936.meta.1676055766678.meta 2023-02-10 19:02:46,708 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:38733,DS-802e527c-b937-4a6c-a362-39fb62541dc8,DISK], DatanodeInfoWithStorage[127.0.0.1:43865,DS-807935e8-2c4e-4d22-882e-5349980e674f,DISK]] 2023-02-10 19:02:46,708 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-02-10 19:02:46,710 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-02-10 19:02:46,760 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8546): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-02-10 19:02:46,767 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-02-10 19:02:46,785 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-02-10 19:02:46,785 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-10 19:02:46,786 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 1588230740 2023-02-10 19:02:46,786 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 1588230740 2023-02-10 19:02:46,814 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-10 19:02:46,820 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/data/hbase/meta/1588230740/info 2023-02-10 19:02:46,820 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/data/hbase/meta/1588230740/info 2023-02-10 19:02:46,823 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-10 19:02:46,827 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-10 19:02:46,827 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-10 19:02:46,829 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/data/hbase/meta/1588230740/rep_barrier 2023-02-10 19:02:46,829 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/data/hbase/meta/1588230740/rep_barrier 2023-02-10 19:02:46,830 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-10 19:02:46,831 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-10 19:02:46,831 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-10 19:02:46,832 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/data/hbase/meta/1588230740/table 2023-02-10 19:02:46,833 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/data/hbase/meta/1588230740/table 2023-02-10 19:02:46,833 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-10 19:02:46,834 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-10 19:02:46,836 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/data/hbase/meta/1588230740 2023-02-10 19:02:46,840 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/data/hbase/meta/1588230740 2023-02-10 19:02:46,844 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-10 19:02:46,848 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-10 19:02:46,850 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63374499, jitterRate=-0.0556463748216629}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-10 19:02:46,851 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 1588230740: Running coprocessor pre-open hook at 1676055766786Writing region info on filesystem at 1676055766786Initializing all the Stores at 1676055766801 (+15 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676055766801Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676055766810 (+9 ms)Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676055766810Cleaning up temporary data from old regions at 1676055766842 (+32 ms)Cleaning up detritus from prior splits at 1676055766843 (+1 ms)Running coprocessor post-open hooks at 1676055766850 (+7 ms)Region opened successfully at 1676055766851 (+1 ms) 2023-02-10 19:02:46,861 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1676055766644 2023-02-10 19:02:46,882 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:meta,,1.1588230740 2023-02-10 19:02:46,884 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:meta,,1.1588230740 2023-02-10 19:02:46,885 INFO [PEWorker-4] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,43623,1676055764936, state=OPEN 2023-02-10 19:02:46,889 DEBUG [Listener at localhost/32909-EventThread] zookeeper.ZKWatcher(600): master:41145-0x1003f9d40a30000, quorum=127.0.0.1:63334, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-02-10 19:02:46,889 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-10 19:02:46,894 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-02-10 19:02:46,894 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,43623,1676055764936 in 423 msec 2023-02-10 19:02:46,900 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-02-10 19:02:46,900 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 626 msec 2023-02-10 19:02:46,905 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 878 msec 2023-02-10 19:02:46,906 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(946): Master startup: status=Wait for region servers to report in, state=RUNNING, startTime=1676055765041, completionTime=-1 2023-02-10 19:02:46,906 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=2; waited=0ms, expected min=2 server(s), max=2 server(s), master is running 2023-02-10 19:02:46,906 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1519): Joining cluster... 2023-02-10 19:02:46,976 DEBUG [hconnection-0xc022050-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-10 19:02:46,980 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54256, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-10 19:02:46,999 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1531): Number of RegionServers=2 2023-02-10 19:02:46,999 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1676055826999 2023-02-10 19:02:46,999 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1676055886999 2023-02-10 19:02:46,999 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1538): Joined the cluster in 92 msec 2023-02-10 19:02:47,029 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,41145,1676055763642-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-10 19:02:47,030 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,41145,1676055763642-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-10 19:02:47,030 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,41145,1676055763642-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-10 19:02:47,033 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:41145, period=300000, unit=MILLISECONDS is enabled. 2023-02-10 19:02:47,033 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-02-10 19:02:47,040 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-02-10 19:02:47,054 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-02-10 19:02:47,056 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2138): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-10 19:02:47,069 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-02-10 19:02:47,072 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-02-10 19:02:47,075 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-10 19:02:47,097 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/.tmp/data/hbase/namespace/286c590596b53e18c86a9d4f2113eb8c 2023-02-10 19:02:47,100 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/.tmp/data/hbase/namespace/286c590596b53e18c86a9d4f2113eb8c empty. 2023-02-10 19:02:47,101 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/.tmp/data/hbase/namespace/286c590596b53e18c86a9d4f2113eb8c 2023-02-10 19:02:47,101 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-02-10 19:02:47,127 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-02-10 19:02:47,129 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7671): creating {ENCODED => 286c590596b53e18c86a9d4f2113eb8c, NAME => 'hbase:namespace,,1676055767055.286c590596b53e18c86a9d4f2113eb8c.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/.tmp 2023-02-10 19:02:47,149 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676055767055.286c590596b53e18c86a9d4f2113eb8c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-10 19:02:47,149 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1603): Closing 286c590596b53e18c86a9d4f2113eb8c, disabling compactions & flushes 2023-02-10 19:02:47,150 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676055767055.286c590596b53e18c86a9d4f2113eb8c. 2023-02-10 19:02:47,150 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676055767055.286c590596b53e18c86a9d4f2113eb8c. 2023-02-10 19:02:47,150 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676055767055.286c590596b53e18c86a9d4f2113eb8c. after waiting 0 ms 2023-02-10 19:02:47,150 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676055767055.286c590596b53e18c86a9d4f2113eb8c. 2023-02-10 19:02:47,150 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676055767055.286c590596b53e18c86a9d4f2113eb8c. 2023-02-10 19:02:47,150 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1557): Region close journal for 286c590596b53e18c86a9d4f2113eb8c: Waiting for close lock at 1676055767149Disabling compacts and flushes for region at 1676055767149Disabling writes for close at 1676055767150 (+1 ms)Writing region close event to WAL at 1676055767150Closed at 1676055767150 2023-02-10 19:02:47,156 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-02-10 19:02:47,175 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1676055767055.286c590596b53e18c86a9d4f2113eb8c.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676055767159"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676055767159"}]},"ts":"1676055767159"} 2023-02-10 19:02:47,210 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-10 19:02:47,213 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-10 19:02:47,217 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676055767213"}]},"ts":"1676055767213"} 2023-02-10 19:02:47,223 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-02-10 19:02:47,227 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-10 19:02:47,229 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-10 19:02:47,229 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-10 19:02:47,229 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-10 19:02:47,232 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=286c590596b53e18c86a9d4f2113eb8c, ASSIGN}] 2023-02-10 19:02:47,235 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=286c590596b53e18c86a9d4f2113eb8c, ASSIGN 2023-02-10 19:02:47,238 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=286c590596b53e18c86a9d4f2113eb8c, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43623,1676055764936; forceNewPlan=false, retain=false 2023-02-10 19:02:47,356 INFO [RS:1;jenkins-hbase4:43337] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C43337%2C1676055764986, suffix=, logDir=hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/WALs/jenkins-hbase4.apache.org,43337,1676055764986, archiveDir=hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/oldWALs, maxLogs=32 2023-02-10 19:02:47,356 INFO [RS:0;jenkins-hbase4:43623] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C43623%2C1676055764936, suffix=, logDir=hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/WALs/jenkins-hbase4.apache.org,43623,1676055764936, archiveDir=hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/oldWALs, maxLogs=32 2023-02-10 19:02:47,378 DEBUG [RS-EventLoopGroup-4-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43865,DS-807935e8-2c4e-4d22-882e-5349980e674f,DISK] 2023-02-10 19:02:47,378 DEBUG [RS-EventLoopGroup-4-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38733,DS-802e527c-b937-4a6c-a362-39fb62541dc8,DISK] 2023-02-10 19:02:47,378 DEBUG [RS-EventLoopGroup-4-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43865,DS-807935e8-2c4e-4d22-882e-5349980e674f,DISK] 2023-02-10 19:02:47,378 DEBUG [RS-EventLoopGroup-4-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38733,DS-802e527c-b937-4a6c-a362-39fb62541dc8,DISK] 2023-02-10 19:02:47,388 INFO [RS:1;jenkins-hbase4:43337] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/WALs/jenkins-hbase4.apache.org,43337,1676055764986/jenkins-hbase4.apache.org%2C43337%2C1676055764986.1676055767358 2023-02-10 19:02:47,388 DEBUG [RS:1;jenkins-hbase4:43337] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:43865,DS-807935e8-2c4e-4d22-882e-5349980e674f,DISK], DatanodeInfoWithStorage[127.0.0.1:38733,DS-802e527c-b937-4a6c-a362-39fb62541dc8,DISK]] 2023-02-10 19:02:47,391 INFO [jenkins-hbase4:41145] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-10 19:02:47,392 INFO [RS:0;jenkins-hbase4:43623] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/WALs/jenkins-hbase4.apache.org,43623,1676055764936/jenkins-hbase4.apache.org%2C43623%2C1676055764936.1676055767358 2023-02-10 19:02:47,393 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=286c590596b53e18c86a9d4f2113eb8c, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43623,1676055764936 2023-02-10 19:02:47,393 DEBUG [RS:0;jenkins-hbase4:43623] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:38733,DS-802e527c-b937-4a6c-a362-39fb62541dc8,DISK], DatanodeInfoWithStorage[127.0.0.1:43865,DS-807935e8-2c4e-4d22-882e-5349980e674f,DISK]] 2023-02-10 19:02:47,393 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1676055767055.286c590596b53e18c86a9d4f2113eb8c.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676055767392"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676055767392"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676055767392"}]},"ts":"1676055767392"} 2023-02-10 19:02:47,398 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 286c590596b53e18c86a9d4f2113eb8c, server=jenkins-hbase4.apache.org,43623,1676055764936}] 2023-02-10 19:02:47,560 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:namespace,,1676055767055.286c590596b53e18c86a9d4f2113eb8c. 2023-02-10 19:02:47,560 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 286c590596b53e18c86a9d4f2113eb8c, NAME => 'hbase:namespace,,1676055767055.286c590596b53e18c86a9d4f2113eb8c.', STARTKEY => '', ENDKEY => ''} 2023-02-10 19:02:47,561 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 286c590596b53e18c86a9d4f2113eb8c 2023-02-10 19:02:47,561 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676055767055.286c590596b53e18c86a9d4f2113eb8c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-10 19:02:47,561 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 286c590596b53e18c86a9d4f2113eb8c 2023-02-10 19:02:47,562 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 286c590596b53e18c86a9d4f2113eb8c 2023-02-10 19:02:47,564 INFO [StoreOpener-286c590596b53e18c86a9d4f2113eb8c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 286c590596b53e18c86a9d4f2113eb8c 2023-02-10 19:02:47,567 DEBUG [StoreOpener-286c590596b53e18c86a9d4f2113eb8c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/data/hbase/namespace/286c590596b53e18c86a9d4f2113eb8c/info 2023-02-10 19:02:47,567 DEBUG [StoreOpener-286c590596b53e18c86a9d4f2113eb8c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/data/hbase/namespace/286c590596b53e18c86a9d4f2113eb8c/info 2023-02-10 19:02:47,567 INFO [StoreOpener-286c590596b53e18c86a9d4f2113eb8c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 286c590596b53e18c86a9d4f2113eb8c columnFamilyName info 2023-02-10 19:02:47,568 INFO [StoreOpener-286c590596b53e18c86a9d4f2113eb8c-1] regionserver.HStore(310): Store=286c590596b53e18c86a9d4f2113eb8c/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-10 19:02:47,570 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/data/hbase/namespace/286c590596b53e18c86a9d4f2113eb8c 2023-02-10 19:02:47,571 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/data/hbase/namespace/286c590596b53e18c86a9d4f2113eb8c 2023-02-10 19:02:47,577 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 286c590596b53e18c86a9d4f2113eb8c 2023-02-10 19:02:47,580 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/data/hbase/namespace/286c590596b53e18c86a9d4f2113eb8c/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-10 19:02:47,581 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 286c590596b53e18c86a9d4f2113eb8c; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63348241, jitterRate=-0.056037649512290955}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-10 19:02:47,582 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 286c590596b53e18c86a9d4f2113eb8c: Running coprocessor pre-open hook at 1676055767562Writing region info on filesystem at 1676055767562Initializing all the Stores at 1676055767563 (+1 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676055767564 (+1 ms)Cleaning up temporary data from old regions at 1676055767572 (+8 ms)Cleaning up detritus from prior splits at 1676055767573 (+1 ms)Running coprocessor post-open hooks at 1676055767582 (+9 ms)Region opened successfully at 1676055767582 2023-02-10 19:02:47,585 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:namespace,,1676055767055.286c590596b53e18c86a9d4f2113eb8c., pid=6, masterSystemTime=1676055767553 2023-02-10 19:02:47,590 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:namespace,,1676055767055.286c590596b53e18c86a9d4f2113eb8c. 2023-02-10 19:02:47,590 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:namespace,,1676055767055.286c590596b53e18c86a9d4f2113eb8c. 2023-02-10 19:02:47,591 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=286c590596b53e18c86a9d4f2113eb8c, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43623,1676055764936 2023-02-10 19:02:47,592 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1676055767055.286c590596b53e18c86a9d4f2113eb8c.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676055767591"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676055767591"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676055767591"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676055767591"}]},"ts":"1676055767591"} 2023-02-10 19:02:47,600 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-02-10 19:02:47,600 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 286c590596b53e18c86a9d4f2113eb8c, server=jenkins-hbase4.apache.org,43623,1676055764936 in 198 msec 2023-02-10 19:02:47,604 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-02-10 19:02:47,605 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=286c590596b53e18c86a9d4f2113eb8c, ASSIGN in 368 msec 2023-02-10 19:02:47,606 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-10 19:02:47,606 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676055767606"}]},"ts":"1676055767606"} 2023-02-10 19:02:47,611 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-02-10 19:02:47,614 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-02-10 19:02:47,616 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 557 msec 2023-02-10 19:02:47,673 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:41145-0x1003f9d40a30000, quorum=127.0.0.1:63334, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-02-10 19:02:47,675 DEBUG [Listener at localhost/32909-EventThread] zookeeper.ZKWatcher(600): master:41145-0x1003f9d40a30000, quorum=127.0.0.1:63334, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-02-10 19:02:47,675 DEBUG [Listener at localhost/32909-EventThread] zookeeper.ZKWatcher(600): master:41145-0x1003f9d40a30000, quorum=127.0.0.1:63334, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-10 19:02:47,712 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-02-10 19:02:47,732 DEBUG [Listener at localhost/32909-EventThread] zookeeper.ZKWatcher(600): master:41145-0x1003f9d40a30000, quorum=127.0.0.1:63334, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-10 19:02:47,739 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 34 msec 2023-02-10 19:02:47,745 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-02-10 19:02:47,757 DEBUG [Listener at localhost/32909-EventThread] zookeeper.ZKWatcher(600): master:41145-0x1003f9d40a30000, quorum=127.0.0.1:63334, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-10 19:02:47,762 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 15 msec 2023-02-10 19:02:47,773 DEBUG [Listener at localhost/32909-EventThread] zookeeper.ZKWatcher(600): master:41145-0x1003f9d40a30000, quorum=127.0.0.1:63334, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-02-10 19:02:47,776 DEBUG [Listener at localhost/32909-EventThread] zookeeper.ZKWatcher(600): master:41145-0x1003f9d40a30000, quorum=127.0.0.1:63334, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-02-10 19:02:47,776 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1077): Master has completed initialization 2.723sec 2023-02-10 19:02:47,779 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-02-10 19:02:47,780 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-02-10 19:02:47,780 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-02-10 19:02:47,781 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,41145,1676055763642-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-02-10 19:02:47,783 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,41145,1676055763642-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-02-10 19:02:47,791 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1166): Balancer post startup initialization complete, took 0 seconds 2023-02-10 19:02:47,819 DEBUG [Listener at localhost/32909] zookeeper.ReadOnlyZKClient(139): Connect 0x2e05c909 to 127.0.0.1:63334 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-10 19:02:47,825 DEBUG [Listener at localhost/32909] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5a711c8e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-10 19:02:47,871 DEBUG [hconnection-0x284341f6-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-10 19:02:47,883 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54270, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-10 19:02:47,894 INFO [Listener at localhost/32909] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,41145,1676055763642 2023-02-10 19:02:47,895 DEBUG [Listener at localhost/32909] mapreduce.TableSnapshotInputFormatTestBase(193): Ensuring table doesn't exist. 2023-02-10 19:02:47,904 DEBUG [Listener at localhost/32909] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-10 19:02:47,907 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38120, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-10 19:02:47,912 INFO [Listener at localhost/32909] client.HBaseAdmin$15(890): Started disable of testWithMapReduce 2023-02-10 19:02:47,917 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41145] master.HMaster$11(2405): Client=jenkins//172.31.14.131 disable testWithMapReduce 2023-02-10 19:02:47,917 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41145] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.TableNotFoundException: testWithMapReduce at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.checkTableModifiable(AbstractStateMachineTableProcedure.java:125) at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.preflightChecks(AbstractStateMachineTableProcedure.java:157) at org.apache.hadoop.hbase.master.procedure.DisableTableProcedure.(DisableTableProcedure.java:78) at org.apache.hadoop.hbase.master.HMaster$11.run(HMaster.java:2416) at org.apache.hadoop.hbase.master.procedure.MasterProcedureUtil.submitProcedure(MasterProcedureUtil.java:132) at org.apache.hadoop.hbase.master.HMaster.disableTable(HMaster.java:2400) at org.apache.hadoop.hbase.master.MasterRpcServices.disableTable(MasterRpcServices.java:784) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-02-10 19:02:47,918 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41145] ipc.CallRunner(144): callId: 2 service: MasterService methodName: DisableTable size: 76 connection: 172.31.14.131:38120 deadline: 1676055827915, exception=org.apache.hadoop.hbase.TableNotFoundException: testWithMapReduce 2023-02-10 19:02:47,936 INFO [Listener at localhost/32909] mapreduce.TableSnapshotInputFormatTestBase(199): creating table 'testWithMapReduce' 2023-02-10 19:02:47,949 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41145] master.HMaster$4(2102): Client=jenkins//172.31.14.131 create 'testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-10 19:02:47,952 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41145] procedure2.ProcedureExecutor(1029): Stored pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testWithMapReduce 2023-02-10 19:02:47,954 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_PRE_OPERATION 2023-02-10 19:02:47,956 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-10 19:02:47,959 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41145] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testWithMapReduce" procId is: 10 2023-02-10 19:02:47,973 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41145] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-10 19:02:47,979 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/.tmp/data/default/testWithMapReduce/813b88c1d27659129f4a12d3c70b79c7 2023-02-10 19:02:47,979 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/.tmp/data/default/testWithMapReduce/ea671e7088d3fe84e68b3d345289fe97 2023-02-10 19:02:47,979 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/.tmp/data/default/testWithMapReduce/b5248077ace761a2c5d43c344f646651 2023-02-10 19:02:47,980 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/.tmp/data/default/testWithMapReduce/0b68bcec2ca2391d28b6290c561e3332 2023-02-10 19:02:47,980 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/.tmp/data/default/testWithMapReduce/2abc519a8c9fd6a76400a0e9294c9317 2023-02-10 19:02:47,980 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/.tmp/data/default/testWithMapReduce/ea671e7088d3fe84e68b3d345289fe97 empty. 2023-02-10 19:02:47,980 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/.tmp/data/default/testWithMapReduce/053dc7037d94e17f3f72f5ea563ab135 2023-02-10 19:02:47,981 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/.tmp/data/default/testWithMapReduce/52e916374c45f2d5119804d8db34ffe7 2023-02-10 19:02:47,981 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/.tmp/data/default/testWithMapReduce/07dbe2f766a0b8b265d0439c26307ef7 2023-02-10 19:02:47,981 DEBUG [HFileArchiver-5] backup.HFileArchiver(153): Directory hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/.tmp/data/default/testWithMapReduce/0b68bcec2ca2391d28b6290c561e3332 empty. 2023-02-10 19:02:47,981 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/.tmp/data/default/testWithMapReduce/b5248077ace761a2c5d43c344f646651 empty. 2023-02-10 19:02:47,981 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/.tmp/data/default/testWithMapReduce/813b88c1d27659129f4a12d3c70b79c7 empty. 2023-02-10 19:02:47,982 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/.tmp/data/default/testWithMapReduce/52e916374c45f2d5119804d8db34ffe7 empty. 2023-02-10 19:02:47,983 DEBUG [HFileArchiver-6] backup.HFileArchiver(153): Directory hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/.tmp/data/default/testWithMapReduce/053dc7037d94e17f3f72f5ea563ab135 empty. 2023-02-10 19:02:47,983 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/.tmp/data/default/testWithMapReduce/ea671e7088d3fe84e68b3d345289fe97 2023-02-10 19:02:47,984 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/.tmp/data/default/testWithMapReduce/cca73b62b14aebcd72ce9f0317bde286 2023-02-10 19:02:47,984 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/.tmp/data/default/testWithMapReduce/2abc519a8c9fd6a76400a0e9294c9317 empty. 2023-02-10 19:02:47,984 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/.tmp/data/default/testWithMapReduce/52e916374c45f2d5119804d8db34ffe7 2023-02-10 19:02:47,984 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/.tmp/data/default/testWithMapReduce/05d2a877c2d90362a1d4209daff5b54a 2023-02-10 19:02:47,984 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/.tmp/data/default/testWithMapReduce/813b88c1d27659129f4a12d3c70b79c7 2023-02-10 19:02:47,984 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/.tmp/data/default/testWithMapReduce/cca73b62b14aebcd72ce9f0317bde286 empty. 2023-02-10 19:02:47,984 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/.tmp/data/default/testWithMapReduce/b5248077ace761a2c5d43c344f646651 2023-02-10 19:02:47,985 DEBUG [HFileArchiver-5] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/.tmp/data/default/testWithMapReduce/0b68bcec2ca2391d28b6290c561e3332 2023-02-10 19:02:47,985 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/.tmp/data/default/testWithMapReduce/05d2a877c2d90362a1d4209daff5b54a empty. 2023-02-10 19:02:47,985 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/.tmp/data/default/testWithMapReduce/cca73b62b14aebcd72ce9f0317bde286 2023-02-10 19:02:47,986 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/.tmp/data/default/testWithMapReduce/05d2a877c2d90362a1d4209daff5b54a 2023-02-10 19:02:47,988 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/.tmp/data/default/testWithMapReduce/07dbe2f766a0b8b265d0439c26307ef7 empty. 2023-02-10 19:02:47,988 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/.tmp/data/default/testWithMapReduce/2abc519a8c9fd6a76400a0e9294c9317 2023-02-10 19:02:47,988 DEBUG [HFileArchiver-6] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/.tmp/data/default/testWithMapReduce/053dc7037d94e17f3f72f5ea563ab135 2023-02-10 19:02:47,989 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/.tmp/data/default/testWithMapReduce/07dbe2f766a0b8b265d0439c26307ef7 2023-02-10 19:02:47,989 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testWithMapReduce regions 2023-02-10 19:02:48,017 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/.tmp/data/default/testWithMapReduce/.tabledesc/.tableinfo.0000000001 2023-02-10 19:02:48,021 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(7671): creating {ENCODED => ea671e7088d3fe84e68b3d345289fe97, NAME => 'testWithMapReduce,aaa,1676055767944.ea671e7088d3fe84e68b3d345289fe97.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/.tmp 2023-02-10 19:02:48,021 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(7671): creating {ENCODED => 813b88c1d27659129f4a12d3c70b79c7, NAME => 'testWithMapReduce,,1676055767944.813b88c1d27659129f4a12d3c70b79c7.', STARTKEY => '', ENDKEY => 'aaa'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/.tmp 2023-02-10 19:02:48,021 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(7671): creating {ENCODED => b5248077ace761a2c5d43c344f646651, NAME => 'testWithMapReduce,d\x84\x84,1676055767944.b5248077ace761a2c5d43c344f646651.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/.tmp 2023-02-10 19:02:48,062 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676055767944.813b88c1d27659129f4a12d3c70b79c7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-10 19:02:48,063 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1603): Closing 813b88c1d27659129f4a12d3c70b79c7, disabling compactions & flushes 2023-02-10 19:02:48,063 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676055767944.813b88c1d27659129f4a12d3c70b79c7. 2023-02-10 19:02:48,063 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676055767944.813b88c1d27659129f4a12d3c70b79c7. 2023-02-10 19:02:48,064 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676055767944.813b88c1d27659129f4a12d3c70b79c7. after waiting 0 ms 2023-02-10 19:02:48,064 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676055767944.813b88c1d27659129f4a12d3c70b79c7. 2023-02-10 19:02:48,064 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,,1676055767944.813b88c1d27659129f4a12d3c70b79c7. 2023-02-10 19:02:48,064 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1557): Region close journal for 813b88c1d27659129f4a12d3c70b79c7: Waiting for close lock at 1676055768063Disabling compacts and flushes for region at 1676055768063Disabling writes for close at 1676055768064 (+1 ms)Writing region close event to WAL at 1676055768064Closed at 1676055768064 2023-02-10 19:02:48,065 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(7671): creating {ENCODED => 0b68bcec2ca2391d28b6290c561e3332, NAME => 'testWithMapReduce,g\xA7\xA7,1676055767944.0b68bcec2ca2391d28b6290c561e3332.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/.tmp 2023-02-10 19:02:48,065 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,aaa,1676055767944.ea671e7088d3fe84e68b3d345289fe97.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-10 19:02:48,065 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,d\x84\x84,1676055767944.b5248077ace761a2c5d43c344f646651.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-10 19:02:48,067 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1603): Closing ea671e7088d3fe84e68b3d345289fe97, disabling compactions & flushes 2023-02-10 19:02:48,067 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1603): Closing b5248077ace761a2c5d43c344f646651, disabling compactions & flushes 2023-02-10 19:02:48,067 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,aaa,1676055767944.ea671e7088d3fe84e68b3d345289fe97. 2023-02-10 19:02:48,067 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,d\x84\x84,1676055767944.b5248077ace761a2c5d43c344f646651. 2023-02-10 19:02:48,067 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,aaa,1676055767944.ea671e7088d3fe84e68b3d345289fe97. 2023-02-10 19:02:48,068 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,d\x84\x84,1676055767944.b5248077ace761a2c5d43c344f646651. 2023-02-10 19:02:48,068 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,aaa,1676055767944.ea671e7088d3fe84e68b3d345289fe97. after waiting 0 ms 2023-02-10 19:02:48,068 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,d\x84\x84,1676055767944.b5248077ace761a2c5d43c344f646651. after waiting 0 ms 2023-02-10 19:02:48,068 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,aaa,1676055767944.ea671e7088d3fe84e68b3d345289fe97. 2023-02-10 19:02:48,068 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,d\x84\x84,1676055767944.b5248077ace761a2c5d43c344f646651. 2023-02-10 19:02:48,068 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,aaa,1676055767944.ea671e7088d3fe84e68b3d345289fe97. 2023-02-10 19:02:48,068 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,d\x84\x84,1676055767944.b5248077ace761a2c5d43c344f646651. 2023-02-10 19:02:48,068 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1557): Region close journal for ea671e7088d3fe84e68b3d345289fe97: Waiting for close lock at 1676055768066Disabling compacts and flushes for region at 1676055768066Disabling writes for close at 1676055768068 (+2 ms)Writing region close event to WAL at 1676055768068Closed at 1676055768068 2023-02-10 19:02:48,068 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1557): Region close journal for b5248077ace761a2c5d43c344f646651: Waiting for close lock at 1676055768067Disabling compacts and flushes for region at 1676055768067Disabling writes for close at 1676055768068 (+1 ms)Writing region close event to WAL at 1676055768068Closed at 1676055768068 2023-02-10 19:02:48,069 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(7671): creating {ENCODED => 053dc7037d94e17f3f72f5ea563ab135, NAME => 'testWithMapReduce,j\xCA\xCA,1676055767944.053dc7037d94e17f3f72f5ea563ab135.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/.tmp 2023-02-10 19:02:48,069 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(7671): creating {ENCODED => 2abc519a8c9fd6a76400a0e9294c9317, NAME => 'testWithMapReduce,m\xED\xED,1676055767944.2abc519a8c9fd6a76400a0e9294c9317.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/.tmp 2023-02-10 19:02:48,080 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41145] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-10 19:02:48,129 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,g\xA7\xA7,1676055767944.0b68bcec2ca2391d28b6290c561e3332.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-10 19:02:48,129 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1603): Closing 0b68bcec2ca2391d28b6290c561e3332, disabling compactions & flushes 2023-02-10 19:02:48,129 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,g\xA7\xA7,1676055767944.0b68bcec2ca2391d28b6290c561e3332. 2023-02-10 19:02:48,129 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,g\xA7\xA7,1676055767944.0b68bcec2ca2391d28b6290c561e3332. 2023-02-10 19:02:48,129 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,g\xA7\xA7,1676055767944.0b68bcec2ca2391d28b6290c561e3332. after waiting 0 ms 2023-02-10 19:02:48,129 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,g\xA7\xA7,1676055767944.0b68bcec2ca2391d28b6290c561e3332. 2023-02-10 19:02:48,129 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,g\xA7\xA7,1676055767944.0b68bcec2ca2391d28b6290c561e3332. 2023-02-10 19:02:48,130 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1557): Region close journal for 0b68bcec2ca2391d28b6290c561e3332: Waiting for close lock at 1676055768129Disabling compacts and flushes for region at 1676055768129Disabling writes for close at 1676055768129Writing region close event to WAL at 1676055768129Closed at 1676055768129 2023-02-10 19:02:48,130 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(7671): creating {ENCODED => 07dbe2f766a0b8b265d0439c26307ef7, NAME => 'testWithMapReduce,q\x11\x10,1676055767944.07dbe2f766a0b8b265d0439c26307ef7.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/.tmp 2023-02-10 19:02:48,139 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,j\xCA\xCA,1676055767944.053dc7037d94e17f3f72f5ea563ab135.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-10 19:02:48,139 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1603): Closing 053dc7037d94e17f3f72f5ea563ab135, disabling compactions & flushes 2023-02-10 19:02:48,139 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,j\xCA\xCA,1676055767944.053dc7037d94e17f3f72f5ea563ab135. 2023-02-10 19:02:48,139 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,j\xCA\xCA,1676055767944.053dc7037d94e17f3f72f5ea563ab135. 2023-02-10 19:02:48,139 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,j\xCA\xCA,1676055767944.053dc7037d94e17f3f72f5ea563ab135. after waiting 0 ms 2023-02-10 19:02:48,139 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,j\xCA\xCA,1676055767944.053dc7037d94e17f3f72f5ea563ab135. 2023-02-10 19:02:48,139 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,j\xCA\xCA,1676055767944.053dc7037d94e17f3f72f5ea563ab135. 2023-02-10 19:02:48,140 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1557): Region close journal for 053dc7037d94e17f3f72f5ea563ab135: Waiting for close lock at 1676055768139Disabling compacts and flushes for region at 1676055768139Disabling writes for close at 1676055768139Writing region close event to WAL at 1676055768139Closed at 1676055768139 2023-02-10 19:02:48,140 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(7671): creating {ENCODED => 52e916374c45f2d5119804d8db34ffe7, NAME => 'testWithMapReduce,t43,1676055767944.52e916374c45f2d5119804d8db34ffe7.', STARTKEY => 't43', ENDKEY => 'wWV'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/.tmp 2023-02-10 19:02:48,148 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,q\x11\x10,1676055767944.07dbe2f766a0b8b265d0439c26307ef7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-10 19:02:48,148 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1603): Closing 07dbe2f766a0b8b265d0439c26307ef7, disabling compactions & flushes 2023-02-10 19:02:48,148 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,q\x11\x10,1676055767944.07dbe2f766a0b8b265d0439c26307ef7. 2023-02-10 19:02:48,148 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,q\x11\x10,1676055767944.07dbe2f766a0b8b265d0439c26307ef7. 2023-02-10 19:02:48,148 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,q\x11\x10,1676055767944.07dbe2f766a0b8b265d0439c26307ef7. after waiting 0 ms 2023-02-10 19:02:48,148 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,q\x11\x10,1676055767944.07dbe2f766a0b8b265d0439c26307ef7. 2023-02-10 19:02:48,148 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,q\x11\x10,1676055767944.07dbe2f766a0b8b265d0439c26307ef7. 2023-02-10 19:02:48,148 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1557): Region close journal for 07dbe2f766a0b8b265d0439c26307ef7: Waiting for close lock at 1676055768148Disabling compacts and flushes for region at 1676055768148Disabling writes for close at 1676055768148Writing region close event to WAL at 1676055768148Closed at 1676055768148 2023-02-10 19:02:48,149 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(7671): creating {ENCODED => cca73b62b14aebcd72ce9f0317bde286, NAME => 'testWithMapReduce,wWV,1676055767944.cca73b62b14aebcd72ce9f0317bde286.', STARTKEY => 'wWV', ENDKEY => 'zz{'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/.tmp 2023-02-10 19:02:48,158 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,t43,1676055767944.52e916374c45f2d5119804d8db34ffe7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-10 19:02:48,158 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1603): Closing 52e916374c45f2d5119804d8db34ffe7, disabling compactions & flushes 2023-02-10 19:02:48,158 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,t43,1676055767944.52e916374c45f2d5119804d8db34ffe7. 2023-02-10 19:02:48,158 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,t43,1676055767944.52e916374c45f2d5119804d8db34ffe7. 2023-02-10 19:02:48,158 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,t43,1676055767944.52e916374c45f2d5119804d8db34ffe7. after waiting 0 ms 2023-02-10 19:02:48,158 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,t43,1676055767944.52e916374c45f2d5119804d8db34ffe7. 2023-02-10 19:02:48,159 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,t43,1676055767944.52e916374c45f2d5119804d8db34ffe7. 2023-02-10 19:02:48,159 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1557): Region close journal for 52e916374c45f2d5119804d8db34ffe7: Waiting for close lock at 1676055768158Disabling compacts and flushes for region at 1676055768158Disabling writes for close at 1676055768158Writing region close event to WAL at 1676055768159 (+1 ms)Closed at 1676055768159 2023-02-10 19:02:48,159 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(7671): creating {ENCODED => 05d2a877c2d90362a1d4209daff5b54a, NAME => 'testWithMapReduce,zz{,1676055767944.05d2a877c2d90362a1d4209daff5b54a.', STARTKEY => 'zz{', ENDKEY => ''}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/.tmp 2023-02-10 19:02:48,166 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,wWV,1676055767944.cca73b62b14aebcd72ce9f0317bde286.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-10 19:02:48,167 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1603): Closing cca73b62b14aebcd72ce9f0317bde286, disabling compactions & flushes 2023-02-10 19:02:48,167 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,wWV,1676055767944.cca73b62b14aebcd72ce9f0317bde286. 2023-02-10 19:02:48,167 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,wWV,1676055767944.cca73b62b14aebcd72ce9f0317bde286. 2023-02-10 19:02:48,167 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,wWV,1676055767944.cca73b62b14aebcd72ce9f0317bde286. after waiting 0 ms 2023-02-10 19:02:48,167 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,wWV,1676055767944.cca73b62b14aebcd72ce9f0317bde286. 2023-02-10 19:02:48,167 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,wWV,1676055767944.cca73b62b14aebcd72ce9f0317bde286. 2023-02-10 19:02:48,167 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1557): Region close journal for cca73b62b14aebcd72ce9f0317bde286: Waiting for close lock at 1676055768167Disabling compacts and flushes for region at 1676055768167Disabling writes for close at 1676055768167Writing region close event to WAL at 1676055768167Closed at 1676055768167 2023-02-10 19:02:48,176 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,zz{,1676055767944.05d2a877c2d90362a1d4209daff5b54a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-10 19:02:48,177 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1603): Closing 05d2a877c2d90362a1d4209daff5b54a, disabling compactions & flushes 2023-02-10 19:02:48,177 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,zz{,1676055767944.05d2a877c2d90362a1d4209daff5b54a. 2023-02-10 19:02:48,177 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,zz{,1676055767944.05d2a877c2d90362a1d4209daff5b54a. 2023-02-10 19:02:48,177 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,zz{,1676055767944.05d2a877c2d90362a1d4209daff5b54a. after waiting 0 ms 2023-02-10 19:02:48,177 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,zz{,1676055767944.05d2a877c2d90362a1d4209daff5b54a. 2023-02-10 19:02:48,177 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,zz{,1676055767944.05d2a877c2d90362a1d4209daff5b54a. 2023-02-10 19:02:48,177 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1557): Region close journal for 05d2a877c2d90362a1d4209daff5b54a: Waiting for close lock at 1676055768177Disabling compacts and flushes for region at 1676055768177Disabling writes for close at 1676055768177Writing region close event to WAL at 1676055768177Closed at 1676055768177 2023-02-10 19:02:48,287 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41145] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-10 19:02:48,535 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,m\xED\xED,1676055767944.2abc519a8c9fd6a76400a0e9294c9317.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-10 19:02:48,535 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1603): Closing 2abc519a8c9fd6a76400a0e9294c9317, disabling compactions & flushes 2023-02-10 19:02:48,535 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,m\xED\xED,1676055767944.2abc519a8c9fd6a76400a0e9294c9317. 2023-02-10 19:02:48,535 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,m\xED\xED,1676055767944.2abc519a8c9fd6a76400a0e9294c9317. 2023-02-10 19:02:48,535 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,m\xED\xED,1676055767944.2abc519a8c9fd6a76400a0e9294c9317. after waiting 0 ms 2023-02-10 19:02:48,535 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,m\xED\xED,1676055767944.2abc519a8c9fd6a76400a0e9294c9317. 2023-02-10 19:02:48,535 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,m\xED\xED,1676055767944.2abc519a8c9fd6a76400a0e9294c9317. 2023-02-10 19:02:48,536 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1557): Region close journal for 2abc519a8c9fd6a76400a0e9294c9317: Waiting for close lock at 1676055768535Disabling compacts and flushes for region at 1676055768535Disabling writes for close at 1676055768535Writing region close event to WAL at 1676055768535Closed at 1676055768535 2023-02-10 19:02:48,542 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_ADD_TO_META 2023-02-10 19:02:48,544 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,,1676055767944.813b88c1d27659129f4a12d3c70b79c7.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676055768544"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676055768544"}]},"ts":"1676055768544"} 2023-02-10 19:02:48,545 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,aaa,1676055767944.ea671e7088d3fe84e68b3d345289fe97.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676055768544"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676055768544"}]},"ts":"1676055768544"} 2023-02-10 19:02:48,545 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,d\\x84\\x84,1676055767944.b5248077ace761a2c5d43c344f646651.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676055768544"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676055768544"}]},"ts":"1676055768544"} 2023-02-10 19:02:48,545 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,g\\xA7\\xA7,1676055767944.0b68bcec2ca2391d28b6290c561e3332.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676055768544"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676055768544"}]},"ts":"1676055768544"} 2023-02-10 19:02:48,545 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,j\\xCA\\xCA,1676055767944.053dc7037d94e17f3f72f5ea563ab135.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676055768544"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676055768544"}]},"ts":"1676055768544"} 2023-02-10 19:02:48,545 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,q\\x11\\x10,1676055767944.07dbe2f766a0b8b265d0439c26307ef7.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676055768544"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676055768544"}]},"ts":"1676055768544"} 2023-02-10 19:02:48,546 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,t43,1676055767944.52e916374c45f2d5119804d8db34ffe7.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676055768544"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676055768544"}]},"ts":"1676055768544"} 2023-02-10 19:02:48,546 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,wWV,1676055767944.cca73b62b14aebcd72ce9f0317bde286.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676055768544"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676055768544"}]},"ts":"1676055768544"} 2023-02-10 19:02:48,546 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,zz{,1676055767944.05d2a877c2d90362a1d4209daff5b54a.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676055768544"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676055768544"}]},"ts":"1676055768544"} 2023-02-10 19:02:48,546 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,m\\xED\\xED,1676055767944.2abc519a8c9fd6a76400a0e9294c9317.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676055768544"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676055768544"}]},"ts":"1676055768544"} 2023-02-10 19:02:48,589 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41145] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-10 19:02:48,601 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 10 regions to meta. 2023-02-10 19:02:48,603 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-10 19:02:48,603 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676055768603"}]},"ts":"1676055768603"} 2023-02-10 19:02:48,606 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=ENABLING in hbase:meta 2023-02-10 19:02:48,609 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-10 19:02:48,621 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-10 19:02:48,621 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-10 19:02:48,621 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-10 19:02:48,622 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=813b88c1d27659129f4a12d3c70b79c7, ASSIGN}, {pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=ea671e7088d3fe84e68b3d345289fe97, ASSIGN}, {pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=b5248077ace761a2c5d43c344f646651, ASSIGN}, {pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=0b68bcec2ca2391d28b6290c561e3332, ASSIGN}, {pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=053dc7037d94e17f3f72f5ea563ab135, ASSIGN}, {pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=2abc519a8c9fd6a76400a0e9294c9317, ASSIGN}, {pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=07dbe2f766a0b8b265d0439c26307ef7, ASSIGN}, {pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=52e916374c45f2d5119804d8db34ffe7, ASSIGN}, {pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=cca73b62b14aebcd72ce9f0317bde286, ASSIGN}, {pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=05d2a877c2d90362a1d4209daff5b54a, ASSIGN}] 2023-02-10 19:02:48,625 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=b5248077ace761a2c5d43c344f646651, ASSIGN 2023-02-10 19:02:48,625 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=ea671e7088d3fe84e68b3d345289fe97, ASSIGN 2023-02-10 19:02:48,626 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=0b68bcec2ca2391d28b6290c561e3332, ASSIGN 2023-02-10 19:02:48,626 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=813b88c1d27659129f4a12d3c70b79c7, ASSIGN 2023-02-10 19:02:48,627 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=b5248077ace761a2c5d43c344f646651, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43337,1676055764986; forceNewPlan=false, retain=false 2023-02-10 19:02:48,628 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=ea671e7088d3fe84e68b3d345289fe97, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43623,1676055764936; forceNewPlan=false, retain=false 2023-02-10 19:02:48,628 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=0b68bcec2ca2391d28b6290c561e3332, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43623,1676055764936; forceNewPlan=false, retain=false 2023-02-10 19:02:48,628 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=813b88c1d27659129f4a12d3c70b79c7, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43337,1676055764986; forceNewPlan=false, retain=false 2023-02-10 19:02:48,628 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=05d2a877c2d90362a1d4209daff5b54a, ASSIGN 2023-02-10 19:02:48,632 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=cca73b62b14aebcd72ce9f0317bde286, ASSIGN 2023-02-10 19:02:48,632 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=52e916374c45f2d5119804d8db34ffe7, ASSIGN 2023-02-10 19:02:48,632 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=05d2a877c2d90362a1d4209daff5b54a, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43337,1676055764986; forceNewPlan=false, retain=false 2023-02-10 19:02:48,632 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=07dbe2f766a0b8b265d0439c26307ef7, ASSIGN 2023-02-10 19:02:48,632 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=2abc519a8c9fd6a76400a0e9294c9317, ASSIGN 2023-02-10 19:02:48,633 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=cca73b62b14aebcd72ce9f0317bde286, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43623,1676055764936; forceNewPlan=false, retain=false 2023-02-10 19:02:48,633 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=52e916374c45f2d5119804d8db34ffe7, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43337,1676055764986; forceNewPlan=false, retain=false 2023-02-10 19:02:48,633 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=2abc519a8c9fd6a76400a0e9294c9317, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43623,1676055764936; forceNewPlan=false, retain=false 2023-02-10 19:02:48,633 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=07dbe2f766a0b8b265d0439c26307ef7, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43623,1676055764936; forceNewPlan=false, retain=false 2023-02-10 19:02:48,633 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=053dc7037d94e17f3f72f5ea563ab135, ASSIGN 2023-02-10 19:02:48,635 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=053dc7037d94e17f3f72f5ea563ab135, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43337,1676055764986; forceNewPlan=false, retain=false 2023-02-10 19:02:48,778 INFO [jenkins-hbase4:41145] balancer.BaseLoadBalancer(1545): Reassigned 10 regions. 10 retained the pre-restart assignment. 2023-02-10 19:02:48,781 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=0b68bcec2ca2391d28b6290c561e3332, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43623,1676055764936 2023-02-10 19:02:48,781 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=17 updating hbase:meta row=07dbe2f766a0b8b265d0439c26307ef7, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43623,1676055764936 2023-02-10 19:02:48,781 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=19 updating hbase:meta row=cca73b62b14aebcd72ce9f0317bde286, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43623,1676055764936 2023-02-10 19:02:48,781 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=2abc519a8c9fd6a76400a0e9294c9317, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43623,1676055764936 2023-02-10 19:02:48,781 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=12 updating hbase:meta row=ea671e7088d3fe84e68b3d345289fe97, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43623,1676055764936 2023-02-10 19:02:48,781 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,q\\x11\\x10,1676055767944.07dbe2f766a0b8b265d0439c26307ef7.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676055768781"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676055768781"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676055768781"}]},"ts":"1676055768781"} 2023-02-10 19:02:48,781 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,g\\xA7\\xA7,1676055767944.0b68bcec2ca2391d28b6290c561e3332.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676055768781"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676055768781"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676055768781"}]},"ts":"1676055768781"} 2023-02-10 19:02:48,781 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,aaa,1676055767944.ea671e7088d3fe84e68b3d345289fe97.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676055768781"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676055768781"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676055768781"}]},"ts":"1676055768781"} 2023-02-10 19:02:48,781 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,m\\xED\\xED,1676055767944.2abc519a8c9fd6a76400a0e9294c9317.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676055768781"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676055768781"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676055768781"}]},"ts":"1676055768781"} 2023-02-10 19:02:48,781 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,wWV,1676055767944.cca73b62b14aebcd72ce9f0317bde286.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676055768781"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676055768781"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676055768781"}]},"ts":"1676055768781"} 2023-02-10 19:02:48,784 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=21, ppid=17, state=RUNNABLE; OpenRegionProcedure 07dbe2f766a0b8b265d0439c26307ef7, server=jenkins-hbase4.apache.org,43623,1676055764936}] 2023-02-10 19:02:48,786 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=22, ppid=14, state=RUNNABLE; OpenRegionProcedure 0b68bcec2ca2391d28b6290c561e3332, server=jenkins-hbase4.apache.org,43623,1676055764936}] 2023-02-10 19:02:48,788 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=23, ppid=12, state=RUNNABLE; OpenRegionProcedure ea671e7088d3fe84e68b3d345289fe97, server=jenkins-hbase4.apache.org,43623,1676055764936}] 2023-02-10 19:02:48,789 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=24, ppid=16, state=RUNNABLE; OpenRegionProcedure 2abc519a8c9fd6a76400a0e9294c9317, server=jenkins-hbase4.apache.org,43623,1676055764936}] 2023-02-10 19:02:48,790 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=18 updating hbase:meta row=52e916374c45f2d5119804d8db34ffe7, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43337,1676055764986 2023-02-10 19:02:48,790 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,t43,1676055767944.52e916374c45f2d5119804d8db34ffe7.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676055768790"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676055768790"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676055768790"}]},"ts":"1676055768790"} 2023-02-10 19:02:48,790 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=25, ppid=19, state=RUNNABLE; OpenRegionProcedure cca73b62b14aebcd72ce9f0317bde286, server=jenkins-hbase4.apache.org,43623,1676055764936}] 2023-02-10 19:02:48,792 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=05d2a877c2d90362a1d4209daff5b54a, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43337,1676055764986 2023-02-10 19:02:48,792 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,zz{,1676055767944.05d2a877c2d90362a1d4209daff5b54a.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676055768792"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676055768792"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676055768792"}]},"ts":"1676055768792"} 2023-02-10 19:02:48,794 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=26, ppid=18, state=RUNNABLE; OpenRegionProcedure 52e916374c45f2d5119804d8db34ffe7, server=jenkins-hbase4.apache.org,43337,1676055764986}] 2023-02-10 19:02:48,794 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=053dc7037d94e17f3f72f5ea563ab135, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43337,1676055764986 2023-02-10 19:02:48,795 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,j\\xCA\\xCA,1676055767944.053dc7037d94e17f3f72f5ea563ab135.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676055768794"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676055768794"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676055768794"}]},"ts":"1676055768794"} 2023-02-10 19:02:48,796 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=b5248077ace761a2c5d43c344f646651, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43337,1676055764986 2023-02-10 19:02:48,796 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,d\\x84\\x84,1676055767944.b5248077ace761a2c5d43c344f646651.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676055768796"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676055768796"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676055768796"}]},"ts":"1676055768796"} 2023-02-10 19:02:48,796 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=27, ppid=20, state=RUNNABLE; OpenRegionProcedure 05d2a877c2d90362a1d4209daff5b54a, server=jenkins-hbase4.apache.org,43337,1676055764986}] 2023-02-10 19:02:48,797 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=28, ppid=15, state=RUNNABLE; OpenRegionProcedure 053dc7037d94e17f3f72f5ea563ab135, server=jenkins-hbase4.apache.org,43337,1676055764986}] 2023-02-10 19:02:48,801 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=29, ppid=13, state=RUNNABLE; OpenRegionProcedure b5248077ace761a2c5d43c344f646651, server=jenkins-hbase4.apache.org,43337,1676055764986}] 2023-02-10 19:02:48,805 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=813b88c1d27659129f4a12d3c70b79c7, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43337,1676055764986 2023-02-10 19:02:48,805 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,,1676055767944.813b88c1d27659129f4a12d3c70b79c7.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676055768804"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676055768804"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676055768804"}]},"ts":"1676055768804"} 2023-02-10 19:02:48,808 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=30, ppid=11, state=RUNNABLE; OpenRegionProcedure 813b88c1d27659129f4a12d3c70b79c7, server=jenkins-hbase4.apache.org,43337,1676055764986}] 2023-02-10 19:02:48,944 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,q\x11\x10,1676055767944.07dbe2f766a0b8b265d0439c26307ef7. 2023-02-10 19:02:48,945 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 07dbe2f766a0b8b265d0439c26307ef7, NAME => 'testWithMapReduce,q\x11\x10,1676055767944.07dbe2f766a0b8b265d0439c26307ef7.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'} 2023-02-10 19:02:48,945 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 07dbe2f766a0b8b265d0439c26307ef7 2023-02-10 19:02:48,945 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,q\x11\x10,1676055767944.07dbe2f766a0b8b265d0439c26307ef7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-10 19:02:48,945 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 07dbe2f766a0b8b265d0439c26307ef7 2023-02-10 19:02:48,945 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 07dbe2f766a0b8b265d0439c26307ef7 2023-02-10 19:02:48,947 INFO [StoreOpener-07dbe2f766a0b8b265d0439c26307ef7-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 07dbe2f766a0b8b265d0439c26307ef7 2023-02-10 19:02:48,949 DEBUG [StoreOpener-07dbe2f766a0b8b265d0439c26307ef7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/data/default/testWithMapReduce/07dbe2f766a0b8b265d0439c26307ef7/f1 2023-02-10 19:02:48,949 DEBUG [StoreOpener-07dbe2f766a0b8b265d0439c26307ef7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/data/default/testWithMapReduce/07dbe2f766a0b8b265d0439c26307ef7/f1 2023-02-10 19:02:48,950 INFO [StoreOpener-07dbe2f766a0b8b265d0439c26307ef7-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 07dbe2f766a0b8b265d0439c26307ef7 columnFamilyName f1 2023-02-10 19:02:48,951 INFO [StoreOpener-07dbe2f766a0b8b265d0439c26307ef7-1] regionserver.HStore(310): Store=07dbe2f766a0b8b265d0439c26307ef7/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-10 19:02:48,951 INFO [StoreOpener-07dbe2f766a0b8b265d0439c26307ef7-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 07dbe2f766a0b8b265d0439c26307ef7 2023-02-10 19:02:48,953 DEBUG [StoreOpener-07dbe2f766a0b8b265d0439c26307ef7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/data/default/testWithMapReduce/07dbe2f766a0b8b265d0439c26307ef7/f2 2023-02-10 19:02:48,953 DEBUG [StoreOpener-07dbe2f766a0b8b265d0439c26307ef7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/data/default/testWithMapReduce/07dbe2f766a0b8b265d0439c26307ef7/f2 2023-02-10 19:02:48,954 INFO [StoreOpener-07dbe2f766a0b8b265d0439c26307ef7-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 07dbe2f766a0b8b265d0439c26307ef7 columnFamilyName f2 2023-02-10 19:02:48,954 INFO [StoreOpener-07dbe2f766a0b8b265d0439c26307ef7-1] regionserver.HStore(310): Store=07dbe2f766a0b8b265d0439c26307ef7/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-10 19:02:48,955 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,43337,1676055764986 2023-02-10 19:02:48,956 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-10 19:02:48,957 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/data/default/testWithMapReduce/07dbe2f766a0b8b265d0439c26307ef7 2023-02-10 19:02:48,958 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/data/default/testWithMapReduce/07dbe2f766a0b8b265d0439c26307ef7 2023-02-10 19:02:48,959 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41032, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-10 19:02:48,962 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-10 19:02:48,964 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 07dbe2f766a0b8b265d0439c26307ef7 2023-02-10 19:02:48,966 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,zz{,1676055767944.05d2a877c2d90362a1d4209daff5b54a. 2023-02-10 19:02:48,966 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 05d2a877c2d90362a1d4209daff5b54a, NAME => 'testWithMapReduce,zz{,1676055767944.05d2a877c2d90362a1d4209daff5b54a.', STARTKEY => 'zz{', ENDKEY => ''} 2023-02-10 19:02:48,966 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 05d2a877c2d90362a1d4209daff5b54a 2023-02-10 19:02:48,966 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,zz{,1676055767944.05d2a877c2d90362a1d4209daff5b54a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-10 19:02:48,966 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 05d2a877c2d90362a1d4209daff5b54a 2023-02-10 19:02:48,966 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 05d2a877c2d90362a1d4209daff5b54a 2023-02-10 19:02:48,968 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/data/default/testWithMapReduce/07dbe2f766a0b8b265d0439c26307ef7/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-10 19:02:48,968 INFO [StoreOpener-05d2a877c2d90362a1d4209daff5b54a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 05d2a877c2d90362a1d4209daff5b54a 2023-02-10 19:02:48,969 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 07dbe2f766a0b8b265d0439c26307ef7; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59820451, jitterRate=-0.10860581696033478}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-10 19:02:48,969 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 07dbe2f766a0b8b265d0439c26307ef7: Running coprocessor pre-open hook at 1676055768946Writing region info on filesystem at 1676055768946Initializing all the Stores at 1676055768947 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676055768947Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676055768947Cleaning up temporary data from old regions at 1676055768960 (+13 ms)Cleaning up detritus from prior splits at 1676055768960Running coprocessor post-open hooks at 1676055768969 (+9 ms)Region opened successfully at 1676055768969 2023-02-10 19:02:48,970 DEBUG [StoreOpener-05d2a877c2d90362a1d4209daff5b54a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/data/default/testWithMapReduce/05d2a877c2d90362a1d4209daff5b54a/f1 2023-02-10 19:02:48,970 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,q\x11\x10,1676055767944.07dbe2f766a0b8b265d0439c26307ef7., pid=21, masterSystemTime=1676055768937 2023-02-10 19:02:48,970 DEBUG [StoreOpener-05d2a877c2d90362a1d4209daff5b54a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/data/default/testWithMapReduce/05d2a877c2d90362a1d4209daff5b54a/f1 2023-02-10 19:02:48,971 INFO [StoreOpener-05d2a877c2d90362a1d4209daff5b54a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 05d2a877c2d90362a1d4209daff5b54a columnFamilyName f1 2023-02-10 19:02:48,972 INFO [StoreOpener-05d2a877c2d90362a1d4209daff5b54a-1] regionserver.HStore(310): Store=05d2a877c2d90362a1d4209daff5b54a/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-10 19:02:48,972 INFO [StoreOpener-05d2a877c2d90362a1d4209daff5b54a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 05d2a877c2d90362a1d4209daff5b54a 2023-02-10 19:02:48,973 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,q\x11\x10,1676055767944.07dbe2f766a0b8b265d0439c26307ef7. 2023-02-10 19:02:48,974 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,q\x11\x10,1676055767944.07dbe2f766a0b8b265d0439c26307ef7. 2023-02-10 19:02:48,974 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,g\xA7\xA7,1676055767944.0b68bcec2ca2391d28b6290c561e3332. 2023-02-10 19:02:48,974 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 0b68bcec2ca2391d28b6290c561e3332, NAME => 'testWithMapReduce,g\xA7\xA7,1676055767944.0b68bcec2ca2391d28b6290c561e3332.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'} 2023-02-10 19:02:48,974 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 0b68bcec2ca2391d28b6290c561e3332 2023-02-10 19:02:48,975 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,g\xA7\xA7,1676055767944.0b68bcec2ca2391d28b6290c561e3332.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-10 19:02:48,975 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 0b68bcec2ca2391d28b6290c561e3332 2023-02-10 19:02:48,975 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 0b68bcec2ca2391d28b6290c561e3332 2023-02-10 19:02:48,975 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=17 updating hbase:meta row=07dbe2f766a0b8b265d0439c26307ef7, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43623,1676055764936 2023-02-10 19:02:48,975 DEBUG [StoreOpener-05d2a877c2d90362a1d4209daff5b54a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/data/default/testWithMapReduce/05d2a877c2d90362a1d4209daff5b54a/f2 2023-02-10 19:02:48,975 DEBUG [StoreOpener-05d2a877c2d90362a1d4209daff5b54a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/data/default/testWithMapReduce/05d2a877c2d90362a1d4209daff5b54a/f2 2023-02-10 19:02:48,975 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,q\\x11\\x10,1676055767944.07dbe2f766a0b8b265d0439c26307ef7.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676055768975"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676055768975"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676055768975"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676055768975"}]},"ts":"1676055768975"} 2023-02-10 19:02:48,976 INFO [StoreOpener-05d2a877c2d90362a1d4209daff5b54a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 05d2a877c2d90362a1d4209daff5b54a columnFamilyName f2 2023-02-10 19:02:48,977 INFO [StoreOpener-05d2a877c2d90362a1d4209daff5b54a-1] regionserver.HStore(310): Store=05d2a877c2d90362a1d4209daff5b54a/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-10 19:02:48,977 INFO [StoreOpener-0b68bcec2ca2391d28b6290c561e3332-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 0b68bcec2ca2391d28b6290c561e3332 2023-02-10 19:02:48,979 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/data/default/testWithMapReduce/05d2a877c2d90362a1d4209daff5b54a 2023-02-10 19:02:48,980 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/data/default/testWithMapReduce/05d2a877c2d90362a1d4209daff5b54a 2023-02-10 19:02:48,982 DEBUG [StoreOpener-0b68bcec2ca2391d28b6290c561e3332-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/data/default/testWithMapReduce/0b68bcec2ca2391d28b6290c561e3332/f1 2023-02-10 19:02:48,982 DEBUG [StoreOpener-0b68bcec2ca2391d28b6290c561e3332-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/data/default/testWithMapReduce/0b68bcec2ca2391d28b6290c561e3332/f1 2023-02-10 19:02:48,982 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=21, resume processing ppid=17 2023-02-10 19:02:48,982 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=21, ppid=17, state=SUCCESS; OpenRegionProcedure 07dbe2f766a0b8b265d0439c26307ef7, server=jenkins-hbase4.apache.org,43623,1676055764936 in 195 msec 2023-02-10 19:02:48,983 INFO [StoreOpener-0b68bcec2ca2391d28b6290c561e3332-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0b68bcec2ca2391d28b6290c561e3332 columnFamilyName f1 2023-02-10 19:02:48,983 INFO [StoreOpener-0b68bcec2ca2391d28b6290c561e3332-1] regionserver.HStore(310): Store=0b68bcec2ca2391d28b6290c561e3332/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-10 19:02:48,984 INFO [StoreOpener-0b68bcec2ca2391d28b6290c561e3332-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 0b68bcec2ca2391d28b6290c561e3332 2023-02-10 19:02:48,984 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-10 19:02:48,986 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=07dbe2f766a0b8b265d0439c26307ef7, ASSIGN in 360 msec 2023-02-10 19:02:48,986 DEBUG [StoreOpener-0b68bcec2ca2391d28b6290c561e3332-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/data/default/testWithMapReduce/0b68bcec2ca2391d28b6290c561e3332/f2 2023-02-10 19:02:48,986 DEBUG [StoreOpener-0b68bcec2ca2391d28b6290c561e3332-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/data/default/testWithMapReduce/0b68bcec2ca2391d28b6290c561e3332/f2 2023-02-10 19:02:48,987 INFO [StoreOpener-0b68bcec2ca2391d28b6290c561e3332-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0b68bcec2ca2391d28b6290c561e3332 columnFamilyName f2 2023-02-10 19:02:48,987 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 05d2a877c2d90362a1d4209daff5b54a 2023-02-10 19:02:48,987 INFO [StoreOpener-0b68bcec2ca2391d28b6290c561e3332-1] regionserver.HStore(310): Store=0b68bcec2ca2391d28b6290c561e3332/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-10 19:02:48,989 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/data/default/testWithMapReduce/0b68bcec2ca2391d28b6290c561e3332 2023-02-10 19:02:48,990 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/data/default/testWithMapReduce/0b68bcec2ca2391d28b6290c561e3332 2023-02-10 19:02:48,991 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/data/default/testWithMapReduce/05d2a877c2d90362a1d4209daff5b54a/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-10 19:02:48,992 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 05d2a877c2d90362a1d4209daff5b54a; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67560415, jitterRate=0.006728634238243103}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-10 19:02:48,992 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 05d2a877c2d90362a1d4209daff5b54a: Running coprocessor pre-open hook at 1676055768967Writing region info on filesystem at 1676055768967Initializing all the Stores at 1676055768968 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676055768968Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676055768968Cleaning up temporary data from old regions at 1676055768982 (+14 ms)Cleaning up detritus from prior splits at 1676055768983 (+1 ms)Running coprocessor post-open hooks at 1676055768992 (+9 ms)Region opened successfully at 1676055768992 2023-02-10 19:02:48,993 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-10 19:02:48,994 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,zz{,1676055767944.05d2a877c2d90362a1d4209daff5b54a., pid=27, masterSystemTime=1676055768954 2023-02-10 19:02:48,997 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 0b68bcec2ca2391d28b6290c561e3332 2023-02-10 19:02:48,997 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,zz{,1676055767944.05d2a877c2d90362a1d4209daff5b54a. 2023-02-10 19:02:48,998 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,zz{,1676055767944.05d2a877c2d90362a1d4209daff5b54a. 2023-02-10 19:02:48,998 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,t43,1676055767944.52e916374c45f2d5119804d8db34ffe7. 2023-02-10 19:02:48,998 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 52e916374c45f2d5119804d8db34ffe7, NAME => 'testWithMapReduce,t43,1676055767944.52e916374c45f2d5119804d8db34ffe7.', STARTKEY => 't43', ENDKEY => 'wWV'} 2023-02-10 19:02:48,998 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 52e916374c45f2d5119804d8db34ffe7 2023-02-10 19:02:48,998 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,t43,1676055767944.52e916374c45f2d5119804d8db34ffe7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-10 19:02:48,998 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=05d2a877c2d90362a1d4209daff5b54a, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43337,1676055764986 2023-02-10 19:02:48,998 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 52e916374c45f2d5119804d8db34ffe7 2023-02-10 19:02:48,999 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 52e916374c45f2d5119804d8db34ffe7 2023-02-10 19:02:48,999 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,zz{,1676055767944.05d2a877c2d90362a1d4209daff5b54a.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676055768998"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676055768998"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676055768998"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676055768998"}]},"ts":"1676055768998"} 2023-02-10 19:02:49,000 INFO [StoreOpener-52e916374c45f2d5119804d8db34ffe7-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 52e916374c45f2d5119804d8db34ffe7 2023-02-10 19:02:49,001 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/data/default/testWithMapReduce/0b68bcec2ca2391d28b6290c561e3332/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-10 19:02:49,002 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 0b68bcec2ca2391d28b6290c561e3332; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72505191, jitterRate=0.08041153848171234}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-10 19:02:49,003 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 0b68bcec2ca2391d28b6290c561e3332: Running coprocessor pre-open hook at 1676055768975Writing region info on filesystem at 1676055768975Initializing all the Stores at 1676055768976 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676055768976Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676055768977 (+1 ms)Cleaning up temporary data from old regions at 1676055768992 (+15 ms)Cleaning up detritus from prior splits at 1676055768992Running coprocessor post-open hooks at 1676055769003 (+11 ms)Region opened successfully at 1676055769003 2023-02-10 19:02:49,003 DEBUG [StoreOpener-52e916374c45f2d5119804d8db34ffe7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/data/default/testWithMapReduce/52e916374c45f2d5119804d8db34ffe7/f1 2023-02-10 19:02:49,003 DEBUG [StoreOpener-52e916374c45f2d5119804d8db34ffe7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/data/default/testWithMapReduce/52e916374c45f2d5119804d8db34ffe7/f1 2023-02-10 19:02:49,004 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,g\xA7\xA7,1676055767944.0b68bcec2ca2391d28b6290c561e3332., pid=22, masterSystemTime=1676055768937 2023-02-10 19:02:49,005 INFO [StoreOpener-52e916374c45f2d5119804d8db34ffe7-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 52e916374c45f2d5119804d8db34ffe7 columnFamilyName f1 2023-02-10 19:02:49,005 INFO [StoreOpener-52e916374c45f2d5119804d8db34ffe7-1] regionserver.HStore(310): Store=52e916374c45f2d5119804d8db34ffe7/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-10 19:02:49,006 INFO [StoreOpener-52e916374c45f2d5119804d8db34ffe7-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 52e916374c45f2d5119804d8db34ffe7 2023-02-10 19:02:49,007 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,g\xA7\xA7,1676055767944.0b68bcec2ca2391d28b6290c561e3332. 2023-02-10 19:02:49,007 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,g\xA7\xA7,1676055767944.0b68bcec2ca2391d28b6290c561e3332. 2023-02-10 19:02:49,008 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,aaa,1676055767944.ea671e7088d3fe84e68b3d345289fe97. 2023-02-10 19:02:49,008 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=27, resume processing ppid=20 2023-02-10 19:02:49,008 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => ea671e7088d3fe84e68b3d345289fe97, NAME => 'testWithMapReduce,aaa,1676055767944.ea671e7088d3fe84e68b3d345289fe97.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'} 2023-02-10 19:02:49,008 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce ea671e7088d3fe84e68b3d345289fe97 2023-02-10 19:02:49,008 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,aaa,1676055767944.ea671e7088d3fe84e68b3d345289fe97.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-10 19:02:49,009 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for ea671e7088d3fe84e68b3d345289fe97 2023-02-10 19:02:49,009 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for ea671e7088d3fe84e68b3d345289fe97 2023-02-10 19:02:49,008 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=27, ppid=20, state=SUCCESS; OpenRegionProcedure 05d2a877c2d90362a1d4209daff5b54a, server=jenkins-hbase4.apache.org,43337,1676055764986 in 206 msec 2023-02-10 19:02:49,009 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=0b68bcec2ca2391d28b6290c561e3332, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43623,1676055764936 2023-02-10 19:02:49,009 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,g\\xA7\\xA7,1676055767944.0b68bcec2ca2391d28b6290c561e3332.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676055769009"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676055769009"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676055769009"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676055769009"}]},"ts":"1676055769009"} 2023-02-10 19:02:49,011 INFO [StoreOpener-ea671e7088d3fe84e68b3d345289fe97-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region ea671e7088d3fe84e68b3d345289fe97 2023-02-10 19:02:49,011 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=20, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=05d2a877c2d90362a1d4209daff5b54a, ASSIGN in 386 msec 2023-02-10 19:02:49,015 DEBUG [StoreOpener-52e916374c45f2d5119804d8db34ffe7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/data/default/testWithMapReduce/52e916374c45f2d5119804d8db34ffe7/f2 2023-02-10 19:02:49,015 DEBUG [StoreOpener-52e916374c45f2d5119804d8db34ffe7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/data/default/testWithMapReduce/52e916374c45f2d5119804d8db34ffe7/f2 2023-02-10 19:02:49,017 DEBUG [StoreOpener-ea671e7088d3fe84e68b3d345289fe97-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/data/default/testWithMapReduce/ea671e7088d3fe84e68b3d345289fe97/f1 2023-02-10 19:02:49,017 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=22, resume processing ppid=14 2023-02-10 19:02:49,017 DEBUG [StoreOpener-ea671e7088d3fe84e68b3d345289fe97-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/data/default/testWithMapReduce/ea671e7088d3fe84e68b3d345289fe97/f1 2023-02-10 19:02:49,017 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=22, ppid=14, state=SUCCESS; OpenRegionProcedure 0b68bcec2ca2391d28b6290c561e3332, server=jenkins-hbase4.apache.org,43623,1676055764936 in 227 msec 2023-02-10 19:02:49,018 INFO [StoreOpener-52e916374c45f2d5119804d8db34ffe7-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 52e916374c45f2d5119804d8db34ffe7 columnFamilyName f2 2023-02-10 19:02:49,019 INFO [StoreOpener-ea671e7088d3fe84e68b3d345289fe97-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ea671e7088d3fe84e68b3d345289fe97 columnFamilyName f1 2023-02-10 19:02:49,019 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=14, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=0b68bcec2ca2391d28b6290c561e3332, ASSIGN in 395 msec 2023-02-10 19:02:49,021 INFO [StoreOpener-52e916374c45f2d5119804d8db34ffe7-1] regionserver.HStore(310): Store=52e916374c45f2d5119804d8db34ffe7/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-10 19:02:49,022 INFO [StoreOpener-ea671e7088d3fe84e68b3d345289fe97-1] regionserver.HStore(310): Store=ea671e7088d3fe84e68b3d345289fe97/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-10 19:02:49,023 INFO [StoreOpener-ea671e7088d3fe84e68b3d345289fe97-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region ea671e7088d3fe84e68b3d345289fe97 2023-02-10 19:02:49,024 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/data/default/testWithMapReduce/52e916374c45f2d5119804d8db34ffe7 2023-02-10 19:02:49,024 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/data/default/testWithMapReduce/52e916374c45f2d5119804d8db34ffe7 2023-02-10 19:02:49,025 DEBUG [StoreOpener-ea671e7088d3fe84e68b3d345289fe97-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/data/default/testWithMapReduce/ea671e7088d3fe84e68b3d345289fe97/f2 2023-02-10 19:02:49,025 DEBUG [StoreOpener-ea671e7088d3fe84e68b3d345289fe97-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/data/default/testWithMapReduce/ea671e7088d3fe84e68b3d345289fe97/f2 2023-02-10 19:02:49,025 INFO [StoreOpener-ea671e7088d3fe84e68b3d345289fe97-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ea671e7088d3fe84e68b3d345289fe97 columnFamilyName f2 2023-02-10 19:02:49,026 INFO [StoreOpener-ea671e7088d3fe84e68b3d345289fe97-1] regionserver.HStore(310): Store=ea671e7088d3fe84e68b3d345289fe97/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-10 19:02:49,030 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/data/default/testWithMapReduce/ea671e7088d3fe84e68b3d345289fe97 2023-02-10 19:02:49,031 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-10 19:02:49,031 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/data/default/testWithMapReduce/ea671e7088d3fe84e68b3d345289fe97 2023-02-10 19:02:49,033 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 52e916374c45f2d5119804d8db34ffe7 2023-02-10 19:02:49,035 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-10 19:02:49,037 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/data/default/testWithMapReduce/52e916374c45f2d5119804d8db34ffe7/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-10 19:02:49,037 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 52e916374c45f2d5119804d8db34ffe7; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71359181, jitterRate=0.06333465874195099}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-10 19:02:49,037 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 52e916374c45f2d5119804d8db34ffe7: Running coprocessor pre-open hook at 1676055768999Writing region info on filesystem at 1676055768999Initializing all the Stores at 1676055769000 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676055769000Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676055769000Cleaning up temporary data from old regions at 1676055769027 (+27 ms)Cleaning up detritus from prior splits at 1676055769029 (+2 ms)Running coprocessor post-open hooks at 1676055769037 (+8 ms)Region opened successfully at 1676055769037 2023-02-10 19:02:49,038 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for ea671e7088d3fe84e68b3d345289fe97 2023-02-10 19:02:49,039 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,t43,1676055767944.52e916374c45f2d5119804d8db34ffe7., pid=26, masterSystemTime=1676055768954 2023-02-10 19:02:49,041 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,t43,1676055767944.52e916374c45f2d5119804d8db34ffe7. 2023-02-10 19:02:49,041 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,t43,1676055767944.52e916374c45f2d5119804d8db34ffe7. 2023-02-10 19:02:49,041 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/data/default/testWithMapReduce/ea671e7088d3fe84e68b3d345289fe97/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-10 19:02:49,041 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,j\xCA\xCA,1676055767944.053dc7037d94e17f3f72f5ea563ab135. 2023-02-10 19:02:49,042 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 053dc7037d94e17f3f72f5ea563ab135, NAME => 'testWithMapReduce,j\xCA\xCA,1676055767944.053dc7037d94e17f3f72f5ea563ab135.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'} 2023-02-10 19:02:49,042 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=18 updating hbase:meta row=52e916374c45f2d5119804d8db34ffe7, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43337,1676055764986 2023-02-10 19:02:49,042 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 053dc7037d94e17f3f72f5ea563ab135 2023-02-10 19:02:49,042 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,j\xCA\xCA,1676055767944.053dc7037d94e17f3f72f5ea563ab135.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-10 19:02:49,042 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 053dc7037d94e17f3f72f5ea563ab135 2023-02-10 19:02:49,042 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,t43,1676055767944.52e916374c45f2d5119804d8db34ffe7.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676055769042"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676055769042"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676055769042"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676055769042"}]},"ts":"1676055769042"} 2023-02-10 19:02:49,042 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened ea671e7088d3fe84e68b3d345289fe97; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72910390, jitterRate=0.08644947409629822}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-10 19:02:49,042 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for ea671e7088d3fe84e68b3d345289fe97: Running coprocessor pre-open hook at 1676055769009Writing region info on filesystem at 1676055769009Initializing all the Stores at 1676055769011 (+2 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676055769011Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676055769011Cleaning up temporary data from old regions at 1676055769032 (+21 ms)Cleaning up detritus from prior splits at 1676055769033 (+1 ms)Running coprocessor post-open hooks at 1676055769042 (+9 ms)Region opened successfully at 1676055769042 2023-02-10 19:02:49,042 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 053dc7037d94e17f3f72f5ea563ab135 2023-02-10 19:02:49,044 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,aaa,1676055767944.ea671e7088d3fe84e68b3d345289fe97., pid=23, masterSystemTime=1676055768937 2023-02-10 19:02:49,046 INFO [StoreOpener-053dc7037d94e17f3f72f5ea563ab135-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 053dc7037d94e17f3f72f5ea563ab135 2023-02-10 19:02:49,047 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,aaa,1676055767944.ea671e7088d3fe84e68b3d345289fe97. 2023-02-10 19:02:49,047 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,aaa,1676055767944.ea671e7088d3fe84e68b3d345289fe97. 2023-02-10 19:02:49,047 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,m\xED\xED,1676055767944.2abc519a8c9fd6a76400a0e9294c9317. 2023-02-10 19:02:49,047 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 2abc519a8c9fd6a76400a0e9294c9317, NAME => 'testWithMapReduce,m\xED\xED,1676055767944.2abc519a8c9fd6a76400a0e9294c9317.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'} 2023-02-10 19:02:49,047 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 2abc519a8c9fd6a76400a0e9294c9317 2023-02-10 19:02:49,047 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,m\xED\xED,1676055767944.2abc519a8c9fd6a76400a0e9294c9317.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-10 19:02:49,048 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 2abc519a8c9fd6a76400a0e9294c9317 2023-02-10 19:02:49,048 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 2abc519a8c9fd6a76400a0e9294c9317 2023-02-10 19:02:49,048 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=12 updating hbase:meta row=ea671e7088d3fe84e68b3d345289fe97, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43623,1676055764936 2023-02-10 19:02:49,048 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,aaa,1676055767944.ea671e7088d3fe84e68b3d345289fe97.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676055769048"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676055769048"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676055769048"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676055769048"}]},"ts":"1676055769048"} 2023-02-10 19:02:49,049 DEBUG [StoreOpener-053dc7037d94e17f3f72f5ea563ab135-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/data/default/testWithMapReduce/053dc7037d94e17f3f72f5ea563ab135/f1 2023-02-10 19:02:49,049 DEBUG [StoreOpener-053dc7037d94e17f3f72f5ea563ab135-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/data/default/testWithMapReduce/053dc7037d94e17f3f72f5ea563ab135/f1 2023-02-10 19:02:49,049 INFO [StoreOpener-053dc7037d94e17f3f72f5ea563ab135-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 053dc7037d94e17f3f72f5ea563ab135 columnFamilyName f1 2023-02-10 19:02:49,049 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=26, resume processing ppid=18 2023-02-10 19:02:49,049 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=26, ppid=18, state=SUCCESS; OpenRegionProcedure 52e916374c45f2d5119804d8db34ffe7, server=jenkins-hbase4.apache.org,43337,1676055764986 in 251 msec 2023-02-10 19:02:49,050 INFO [StoreOpener-2abc519a8c9fd6a76400a0e9294c9317-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 2abc519a8c9fd6a76400a0e9294c9317 2023-02-10 19:02:49,050 INFO [StoreOpener-053dc7037d94e17f3f72f5ea563ab135-1] regionserver.HStore(310): Store=053dc7037d94e17f3f72f5ea563ab135/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-10 19:02:49,051 INFO [StoreOpener-053dc7037d94e17f3f72f5ea563ab135-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 053dc7037d94e17f3f72f5ea563ab135 2023-02-10 19:02:49,052 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=18, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=52e916374c45f2d5119804d8db34ffe7, ASSIGN in 428 msec 2023-02-10 19:02:49,052 DEBUG [StoreOpener-2abc519a8c9fd6a76400a0e9294c9317-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/data/default/testWithMapReduce/2abc519a8c9fd6a76400a0e9294c9317/f1 2023-02-10 19:02:49,052 DEBUG [StoreOpener-2abc519a8c9fd6a76400a0e9294c9317-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/data/default/testWithMapReduce/2abc519a8c9fd6a76400a0e9294c9317/f1 2023-02-10 19:02:49,052 INFO [StoreOpener-2abc519a8c9fd6a76400a0e9294c9317-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2abc519a8c9fd6a76400a0e9294c9317 columnFamilyName f1 2023-02-10 19:02:49,053 DEBUG [StoreOpener-053dc7037d94e17f3f72f5ea563ab135-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/data/default/testWithMapReduce/053dc7037d94e17f3f72f5ea563ab135/f2 2023-02-10 19:02:49,053 DEBUG [StoreOpener-053dc7037d94e17f3f72f5ea563ab135-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/data/default/testWithMapReduce/053dc7037d94e17f3f72f5ea563ab135/f2 2023-02-10 19:02:49,053 INFO [StoreOpener-2abc519a8c9fd6a76400a0e9294c9317-1] regionserver.HStore(310): Store=2abc519a8c9fd6a76400a0e9294c9317/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-10 19:02:49,053 INFO [StoreOpener-053dc7037d94e17f3f72f5ea563ab135-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 053dc7037d94e17f3f72f5ea563ab135 columnFamilyName f2 2023-02-10 19:02:49,053 INFO [StoreOpener-2abc519a8c9fd6a76400a0e9294c9317-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 2abc519a8c9fd6a76400a0e9294c9317 2023-02-10 19:02:49,054 INFO [StoreOpener-053dc7037d94e17f3f72f5ea563ab135-1] regionserver.HStore(310): Store=053dc7037d94e17f3f72f5ea563ab135/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-10 19:02:49,054 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=23, resume processing ppid=12 2023-02-10 19:02:49,054 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=23, ppid=12, state=SUCCESS; OpenRegionProcedure ea671e7088d3fe84e68b3d345289fe97, server=jenkins-hbase4.apache.org,43623,1676055764936 in 264 msec 2023-02-10 19:02:49,056 DEBUG [StoreOpener-2abc519a8c9fd6a76400a0e9294c9317-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/data/default/testWithMapReduce/2abc519a8c9fd6a76400a0e9294c9317/f2 2023-02-10 19:02:49,056 DEBUG [StoreOpener-2abc519a8c9fd6a76400a0e9294c9317-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/data/default/testWithMapReduce/2abc519a8c9fd6a76400a0e9294c9317/f2 2023-02-10 19:02:49,056 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/data/default/testWithMapReduce/053dc7037d94e17f3f72f5ea563ab135 2023-02-10 19:02:49,057 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/data/default/testWithMapReduce/053dc7037d94e17f3f72f5ea563ab135 2023-02-10 19:02:49,057 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=12, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=ea671e7088d3fe84e68b3d345289fe97, ASSIGN in 432 msec 2023-02-10 19:02:49,057 INFO [StoreOpener-2abc519a8c9fd6a76400a0e9294c9317-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2abc519a8c9fd6a76400a0e9294c9317 columnFamilyName f2 2023-02-10 19:02:49,058 INFO [StoreOpener-2abc519a8c9fd6a76400a0e9294c9317-1] regionserver.HStore(310): Store=2abc519a8c9fd6a76400a0e9294c9317/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-10 19:02:49,060 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/data/default/testWithMapReduce/2abc519a8c9fd6a76400a0e9294c9317 2023-02-10 19:02:49,061 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/data/default/testWithMapReduce/2abc519a8c9fd6a76400a0e9294c9317 2023-02-10 19:02:49,064 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-10 19:02:49,066 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 2abc519a8c9fd6a76400a0e9294c9317 2023-02-10 19:02:49,066 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-10 19:02:49,069 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 053dc7037d94e17f3f72f5ea563ab135 2023-02-10 19:02:49,073 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/data/default/testWithMapReduce/2abc519a8c9fd6a76400a0e9294c9317/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-10 19:02:49,073 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/data/default/testWithMapReduce/053dc7037d94e17f3f72f5ea563ab135/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-10 19:02:49,073 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 2abc519a8c9fd6a76400a0e9294c9317; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64404561, jitterRate=-0.0402972549200058}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-10 19:02:49,074 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 2abc519a8c9fd6a76400a0e9294c9317: Running coprocessor pre-open hook at 1676055769048Writing region info on filesystem at 1676055769048Initializing all the Stores at 1676055769049 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676055769049Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676055769049Cleaning up temporary data from old regions at 1676055769062 (+13 ms)Cleaning up detritus from prior splits at 1676055769063 (+1 ms)Running coprocessor post-open hooks at 1676055769074 (+11 ms)Region opened successfully at 1676055769074 2023-02-10 19:02:49,074 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 053dc7037d94e17f3f72f5ea563ab135; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72552327, jitterRate=0.08111391961574554}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-10 19:02:49,074 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 053dc7037d94e17f3f72f5ea563ab135: Running coprocessor pre-open hook at 1676055769043Writing region info on filesystem at 1676055769043Initializing all the Stores at 1676055769045 (+2 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676055769045Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676055769045Cleaning up temporary data from old regions at 1676055769058 (+13 ms)Cleaning up detritus from prior splits at 1676055769059 (+1 ms)Running coprocessor post-open hooks at 1676055769074 (+15 ms)Region opened successfully at 1676055769074 2023-02-10 19:02:49,075 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,m\xED\xED,1676055767944.2abc519a8c9fd6a76400a0e9294c9317., pid=24, masterSystemTime=1676055768937 2023-02-10 19:02:49,076 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,j\xCA\xCA,1676055767944.053dc7037d94e17f3f72f5ea563ab135., pid=28, masterSystemTime=1676055768954 2023-02-10 19:02:49,077 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,m\xED\xED,1676055767944.2abc519a8c9fd6a76400a0e9294c9317. 2023-02-10 19:02:49,077 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,m\xED\xED,1676055767944.2abc519a8c9fd6a76400a0e9294c9317. 2023-02-10 19:02:49,078 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,wWV,1676055767944.cca73b62b14aebcd72ce9f0317bde286. 2023-02-10 19:02:49,078 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => cca73b62b14aebcd72ce9f0317bde286, NAME => 'testWithMapReduce,wWV,1676055767944.cca73b62b14aebcd72ce9f0317bde286.', STARTKEY => 'wWV', ENDKEY => 'zz{'} 2023-02-10 19:02:49,078 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce cca73b62b14aebcd72ce9f0317bde286 2023-02-10 19:02:49,078 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,wWV,1676055767944.cca73b62b14aebcd72ce9f0317bde286.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-10 19:02:49,078 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for cca73b62b14aebcd72ce9f0317bde286 2023-02-10 19:02:49,078 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for cca73b62b14aebcd72ce9f0317bde286 2023-02-10 19:02:49,081 INFO [StoreOpener-cca73b62b14aebcd72ce9f0317bde286-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region cca73b62b14aebcd72ce9f0317bde286 2023-02-10 19:02:49,081 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,j\xCA\xCA,1676055767944.053dc7037d94e17f3f72f5ea563ab135. 2023-02-10 19:02:49,081 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,j\xCA\xCA,1676055767944.053dc7037d94e17f3f72f5ea563ab135. 2023-02-10 19:02:49,081 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,d\x84\x84,1676055767944.b5248077ace761a2c5d43c344f646651. 2023-02-10 19:02:49,081 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => b5248077ace761a2c5d43c344f646651, NAME => 'testWithMapReduce,d\x84\x84,1676055767944.b5248077ace761a2c5d43c344f646651.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'} 2023-02-10 19:02:49,081 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=2abc519a8c9fd6a76400a0e9294c9317, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43623,1676055764936 2023-02-10 19:02:49,081 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce b5248077ace761a2c5d43c344f646651 2023-02-10 19:02:49,082 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,m\\xED\\xED,1676055767944.2abc519a8c9fd6a76400a0e9294c9317.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676055769081"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676055769081"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676055769081"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676055769081"}]},"ts":"1676055769081"} 2023-02-10 19:02:49,082 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,d\x84\x84,1676055767944.b5248077ace761a2c5d43c344f646651.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-10 19:02:49,082 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for b5248077ace761a2c5d43c344f646651 2023-02-10 19:02:49,082 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for b5248077ace761a2c5d43c344f646651 2023-02-10 19:02:49,082 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=053dc7037d94e17f3f72f5ea563ab135, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43337,1676055764986 2023-02-10 19:02:49,082 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,j\\xCA\\xCA,1676055767944.053dc7037d94e17f3f72f5ea563ab135.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676055769082"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676055769082"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676055769082"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676055769082"}]},"ts":"1676055769082"} 2023-02-10 19:02:49,083 DEBUG [StoreOpener-cca73b62b14aebcd72ce9f0317bde286-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/data/default/testWithMapReduce/cca73b62b14aebcd72ce9f0317bde286/f1 2023-02-10 19:02:49,084 DEBUG [StoreOpener-cca73b62b14aebcd72ce9f0317bde286-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/data/default/testWithMapReduce/cca73b62b14aebcd72ce9f0317bde286/f1 2023-02-10 19:02:49,084 INFO [StoreOpener-cca73b62b14aebcd72ce9f0317bde286-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region cca73b62b14aebcd72ce9f0317bde286 columnFamilyName f1 2023-02-10 19:02:49,085 INFO [StoreOpener-cca73b62b14aebcd72ce9f0317bde286-1] regionserver.HStore(310): Store=cca73b62b14aebcd72ce9f0317bde286/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-10 19:02:49,085 INFO [StoreOpener-cca73b62b14aebcd72ce9f0317bde286-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region cca73b62b14aebcd72ce9f0317bde286 2023-02-10 19:02:49,085 INFO [StoreOpener-b5248077ace761a2c5d43c344f646651-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region b5248077ace761a2c5d43c344f646651 2023-02-10 19:02:49,088 DEBUG [StoreOpener-cca73b62b14aebcd72ce9f0317bde286-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/data/default/testWithMapReduce/cca73b62b14aebcd72ce9f0317bde286/f2 2023-02-10 19:02:49,088 DEBUG [StoreOpener-cca73b62b14aebcd72ce9f0317bde286-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/data/default/testWithMapReduce/cca73b62b14aebcd72ce9f0317bde286/f2 2023-02-10 19:02:49,089 INFO [StoreOpener-cca73b62b14aebcd72ce9f0317bde286-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region cca73b62b14aebcd72ce9f0317bde286 columnFamilyName f2 2023-02-10 19:02:49,089 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=24, resume processing ppid=16 2023-02-10 19:02:49,089 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=24, ppid=16, state=SUCCESS; OpenRegionProcedure 2abc519a8c9fd6a76400a0e9294c9317, server=jenkins-hbase4.apache.org,43623,1676055764936 in 296 msec 2023-02-10 19:02:49,089 INFO [StoreOpener-cca73b62b14aebcd72ce9f0317bde286-1] regionserver.HStore(310): Store=cca73b62b14aebcd72ce9f0317bde286/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-10 19:02:49,092 DEBUG [StoreOpener-b5248077ace761a2c5d43c344f646651-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/data/default/testWithMapReduce/b5248077ace761a2c5d43c344f646651/f1 2023-02-10 19:02:49,092 DEBUG [StoreOpener-b5248077ace761a2c5d43c344f646651-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/data/default/testWithMapReduce/b5248077ace761a2c5d43c344f646651/f1 2023-02-10 19:02:49,092 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/data/default/testWithMapReduce/cca73b62b14aebcd72ce9f0317bde286 2023-02-10 19:02:49,092 INFO [StoreOpener-b5248077ace761a2c5d43c344f646651-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b5248077ace761a2c5d43c344f646651 columnFamilyName f1 2023-02-10 19:02:49,092 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/data/default/testWithMapReduce/cca73b62b14aebcd72ce9f0317bde286 2023-02-10 19:02:49,093 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41145] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-10 19:02:49,093 INFO [StoreOpener-b5248077ace761a2c5d43c344f646651-1] regionserver.HStore(310): Store=b5248077ace761a2c5d43c344f646651/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-10 19:02:49,093 INFO [StoreOpener-b5248077ace761a2c5d43c344f646651-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region b5248077ace761a2c5d43c344f646651 2023-02-10 19:02:49,094 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=28, resume processing ppid=15 2023-02-10 19:02:49,094 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=28, ppid=15, state=SUCCESS; OpenRegionProcedure 053dc7037d94e17f3f72f5ea563ab135, server=jenkins-hbase4.apache.org,43337,1676055764986 in 290 msec 2023-02-10 19:02:49,094 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=2abc519a8c9fd6a76400a0e9294c9317, ASSIGN in 467 msec 2023-02-10 19:02:49,096 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-10 19:02:49,096 DEBUG [StoreOpener-b5248077ace761a2c5d43c344f646651-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/data/default/testWithMapReduce/b5248077ace761a2c5d43c344f646651/f2 2023-02-10 19:02:49,096 DEBUG [StoreOpener-b5248077ace761a2c5d43c344f646651-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/data/default/testWithMapReduce/b5248077ace761a2c5d43c344f646651/f2 2023-02-10 19:02:49,096 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=15, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=053dc7037d94e17f3f72f5ea563ab135, ASSIGN in 472 msec 2023-02-10 19:02:49,097 INFO [StoreOpener-b5248077ace761a2c5d43c344f646651-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b5248077ace761a2c5d43c344f646651 columnFamilyName f2 2023-02-10 19:02:49,098 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for cca73b62b14aebcd72ce9f0317bde286 2023-02-10 19:02:49,098 INFO [StoreOpener-b5248077ace761a2c5d43c344f646651-1] regionserver.HStore(310): Store=b5248077ace761a2c5d43c344f646651/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-10 19:02:49,100 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/data/default/testWithMapReduce/b5248077ace761a2c5d43c344f646651 2023-02-10 19:02:49,101 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/data/default/testWithMapReduce/cca73b62b14aebcd72ce9f0317bde286/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-10 19:02:49,101 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/data/default/testWithMapReduce/b5248077ace761a2c5d43c344f646651 2023-02-10 19:02:49,102 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened cca73b62b14aebcd72ce9f0317bde286; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67526460, jitterRate=0.006222665309906006}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-10 19:02:49,102 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for cca73b62b14aebcd72ce9f0317bde286: Running coprocessor pre-open hook at 1676055769078Writing region info on filesystem at 1676055769078Initializing all the Stores at 1676055769079 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676055769080 (+1 ms)Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676055769080Cleaning up temporary data from old regions at 1676055769094 (+14 ms)Cleaning up detritus from prior splits at 1676055769095 (+1 ms)Running coprocessor post-open hooks at 1676055769102 (+7 ms)Region opened successfully at 1676055769102 2023-02-10 19:02:49,103 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,wWV,1676055767944.cca73b62b14aebcd72ce9f0317bde286., pid=25, masterSystemTime=1676055768937 2023-02-10 19:02:49,105 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-10 19:02:49,106 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,wWV,1676055767944.cca73b62b14aebcd72ce9f0317bde286. 2023-02-10 19:02:49,106 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,wWV,1676055767944.cca73b62b14aebcd72ce9f0317bde286. 2023-02-10 19:02:49,107 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=19 updating hbase:meta row=cca73b62b14aebcd72ce9f0317bde286, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43623,1676055764936 2023-02-10 19:02:49,107 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,wWV,1676055767944.cca73b62b14aebcd72ce9f0317bde286.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676055769107"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676055769107"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676055769107"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676055769107"}]},"ts":"1676055769107"} 2023-02-10 19:02:49,109 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for b5248077ace761a2c5d43c344f646651 2023-02-10 19:02:49,113 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/data/default/testWithMapReduce/b5248077ace761a2c5d43c344f646651/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-10 19:02:49,113 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=25, resume processing ppid=19 2023-02-10 19:02:49,114 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=25, ppid=19, state=SUCCESS; OpenRegionProcedure cca73b62b14aebcd72ce9f0317bde286, server=jenkins-hbase4.apache.org,43623,1676055764936 in 319 msec 2023-02-10 19:02:49,114 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened b5248077ace761a2c5d43c344f646651; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74645979, jitterRate=0.11231176555156708}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-10 19:02:49,114 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for b5248077ace761a2c5d43c344f646651: Running coprocessor pre-open hook at 1676055769082Writing region info on filesystem at 1676055769082Initializing all the Stores at 1676055769084 (+2 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676055769084Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676055769085 (+1 ms)Cleaning up temporary data from old regions at 1676055769103 (+18 ms)Cleaning up detritus from prior splits at 1676055769104 (+1 ms)Running coprocessor post-open hooks at 1676055769114 (+10 ms)Region opened successfully at 1676055769114 2023-02-10 19:02:49,115 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,d\x84\x84,1676055767944.b5248077ace761a2c5d43c344f646651., pid=29, masterSystemTime=1676055768954 2023-02-10 19:02:49,116 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=19, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=cca73b62b14aebcd72ce9f0317bde286, ASSIGN in 492 msec 2023-02-10 19:02:49,118 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,d\x84\x84,1676055767944.b5248077ace761a2c5d43c344f646651. 2023-02-10 19:02:49,118 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,d\x84\x84,1676055767944.b5248077ace761a2c5d43c344f646651. 2023-02-10 19:02:49,118 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,,1676055767944.813b88c1d27659129f4a12d3c70b79c7. 2023-02-10 19:02:49,118 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 813b88c1d27659129f4a12d3c70b79c7, NAME => 'testWithMapReduce,,1676055767944.813b88c1d27659129f4a12d3c70b79c7.', STARTKEY => '', ENDKEY => 'aaa'} 2023-02-10 19:02:49,119 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 813b88c1d27659129f4a12d3c70b79c7 2023-02-10 19:02:49,119 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676055767944.813b88c1d27659129f4a12d3c70b79c7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-10 19:02:49,119 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=b5248077ace761a2c5d43c344f646651, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43337,1676055764986 2023-02-10 19:02:49,119 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 813b88c1d27659129f4a12d3c70b79c7 2023-02-10 19:02:49,119 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 813b88c1d27659129f4a12d3c70b79c7 2023-02-10 19:02:49,119 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,d\\x84\\x84,1676055767944.b5248077ace761a2c5d43c344f646651.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676055769119"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676055769119"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676055769119"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676055769119"}]},"ts":"1676055769119"} 2023-02-10 19:02:49,124 INFO [StoreOpener-813b88c1d27659129f4a12d3c70b79c7-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 813b88c1d27659129f4a12d3c70b79c7 2023-02-10 19:02:49,125 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=29, resume processing ppid=13 2023-02-10 19:02:49,125 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=29, ppid=13, state=SUCCESS; OpenRegionProcedure b5248077ace761a2c5d43c344f646651, server=jenkins-hbase4.apache.org,43337,1676055764986 in 321 msec 2023-02-10 19:02:49,126 DEBUG [StoreOpener-813b88c1d27659129f4a12d3c70b79c7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/data/default/testWithMapReduce/813b88c1d27659129f4a12d3c70b79c7/f1 2023-02-10 19:02:49,126 DEBUG [StoreOpener-813b88c1d27659129f4a12d3c70b79c7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/data/default/testWithMapReduce/813b88c1d27659129f4a12d3c70b79c7/f1 2023-02-10 19:02:49,127 INFO [StoreOpener-813b88c1d27659129f4a12d3c70b79c7-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 813b88c1d27659129f4a12d3c70b79c7 columnFamilyName f1 2023-02-10 19:02:49,128 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=13, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=b5248077ace761a2c5d43c344f646651, ASSIGN in 503 msec 2023-02-10 19:02:49,128 INFO [StoreOpener-813b88c1d27659129f4a12d3c70b79c7-1] regionserver.HStore(310): Store=813b88c1d27659129f4a12d3c70b79c7/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-10 19:02:49,128 INFO [StoreOpener-813b88c1d27659129f4a12d3c70b79c7-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 813b88c1d27659129f4a12d3c70b79c7 2023-02-10 19:02:49,130 DEBUG [StoreOpener-813b88c1d27659129f4a12d3c70b79c7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/data/default/testWithMapReduce/813b88c1d27659129f4a12d3c70b79c7/f2 2023-02-10 19:02:49,130 DEBUG [StoreOpener-813b88c1d27659129f4a12d3c70b79c7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/data/default/testWithMapReduce/813b88c1d27659129f4a12d3c70b79c7/f2 2023-02-10 19:02:49,130 INFO [StoreOpener-813b88c1d27659129f4a12d3c70b79c7-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 813b88c1d27659129f4a12d3c70b79c7 columnFamilyName f2 2023-02-10 19:02:49,131 INFO [StoreOpener-813b88c1d27659129f4a12d3c70b79c7-1] regionserver.HStore(310): Store=813b88c1d27659129f4a12d3c70b79c7/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-10 19:02:49,133 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/data/default/testWithMapReduce/813b88c1d27659129f4a12d3c70b79c7 2023-02-10 19:02:49,134 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/data/default/testWithMapReduce/813b88c1d27659129f4a12d3c70b79c7 2023-02-10 19:02:49,136 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-10 19:02:49,138 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 813b88c1d27659129f4a12d3c70b79c7 2023-02-10 19:02:49,141 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/data/default/testWithMapReduce/813b88c1d27659129f4a12d3c70b79c7/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-10 19:02:49,142 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 813b88c1d27659129f4a12d3c70b79c7; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67918950, jitterRate=0.012071222066879272}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-10 19:02:49,143 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 813b88c1d27659129f4a12d3c70b79c7: Running coprocessor pre-open hook at 1676055769120Writing region info on filesystem at 1676055769120Initializing all the Stores at 1676055769121 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676055769121Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676055769124 (+3 ms)Cleaning up temporary data from old regions at 1676055769135 (+11 ms)Cleaning up detritus from prior splits at 1676055769135Running coprocessor post-open hooks at 1676055769143 (+8 ms)Region opened successfully at 1676055769143 2023-02-10 19:02:49,144 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,,1676055767944.813b88c1d27659129f4a12d3c70b79c7., pid=30, masterSystemTime=1676055768954 2023-02-10 19:02:49,146 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,,1676055767944.813b88c1d27659129f4a12d3c70b79c7. 2023-02-10 19:02:49,146 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,,1676055767944.813b88c1d27659129f4a12d3c70b79c7. 2023-02-10 19:02:49,147 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=813b88c1d27659129f4a12d3c70b79c7, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43337,1676055764986 2023-02-10 19:02:49,147 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,,1676055767944.813b88c1d27659129f4a12d3c70b79c7.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676055769147"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676055769147"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676055769147"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676055769147"}]},"ts":"1676055769147"} 2023-02-10 19:02:49,153 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=30, resume processing ppid=11 2023-02-10 19:02:49,153 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=30, ppid=11, state=SUCCESS; OpenRegionProcedure 813b88c1d27659129f4a12d3c70b79c7, server=jenkins-hbase4.apache.org,43337,1676055764986 in 342 msec 2023-02-10 19:02:49,156 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-02-10 19:02:49,156 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=813b88c1d27659129f4a12d3c70b79c7, ASSIGN in 531 msec 2023-02-10 19:02:49,157 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-10 19:02:49,157 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676055769157"}]},"ts":"1676055769157"} 2023-02-10 19:02:49,159 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=ENABLED in hbase:meta 2023-02-10 19:02:49,163 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_POST_OPERATION 2023-02-10 19:02:49,166 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=10, state=SUCCESS; CreateTableProcedure table=testWithMapReduce in 1.2140 sec 2023-02-10 19:02:50,095 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41145] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-10 19:02:50,095 INFO [Listener at localhost/32909] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testWithMapReduce, procId: 10 completed 2023-02-10 19:02:50,096 DEBUG [Listener at localhost/32909] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testWithMapReduce get assigned. Timeout = 60000ms 2023-02-10 19:02:50,098 INFO [Listener at localhost/32909] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-10 19:02:50,109 INFO [Listener at localhost/32909] hbase.HBaseTestingUtility(3484): All regions for table testWithMapReduce assigned to meta. Checking AM states. 2023-02-10 19:02:50,110 INFO [Listener at localhost/32909] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-10 19:02:50,110 INFO [Listener at localhost/32909] hbase.HBaseTestingUtility(3504): All regions for table testWithMapReduce assigned. 2023-02-10 19:02:50,110 INFO [Listener at localhost/32909] mapreduce.TableSnapshotInputFormatTestBase(207): put some stuff in the table 2023-02-10 19:02:50,237 DEBUG [hconnection-0x284341f6-shared-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-10 19:02:50,303 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41044, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-10 19:02:50,341 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43337] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 6084 Client: jenkins//172.31.14.131 first region in multi=testWithMapReduce,d\x84\x84,1676055767944.b5248077ace761a2c5d43c344f646651. 2023-02-10 19:02:50,349 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43623] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 11492 Client: jenkins//172.31.14.131 first region in multi=testWithMapReduce,aaa,1676055767944.ea671e7088d3fe84e68b3d345289fe97. 2023-02-10 19:02:50,642 INFO [Listener at localhost/32909] mapreduce.TableSnapshotInputFormatTestBase(214): snapshot 2023-02-10 19:02:50,645 INFO [Listener at localhost/32909] snapshot.SnapshotTestingUtils(396): taking snapshot. 2023-02-10 19:02:50,656 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41145] master.MasterRpcServices(1580): Client=jenkins//172.31.14.131 snapshot request for:{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-10 19:02:50,656 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41145] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1676055770656 (current time:1676055770656). 2023-02-10 19:02:50,657 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41145] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-02-10 19:02:50,657 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41145] zookeeper.ReadOnlyZKClient(139): Connect 0x580e5455 to 127.0.0.1:63334 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-10 19:02:50,670 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41145] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7e146074, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-10 19:02:50,676 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41145] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-10 19:02:50,679 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54284, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-10 19:02:50,681 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41145] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x580e5455 to 127.0.0.1:63334 2023-02-10 19:02:50,681 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41145] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-10 19:02:50,684 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41145] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-02-10 19:02:50,685 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41145] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-10 19:02:50,713 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41145] procedure2.ProcedureExecutor(1029): Stored pid=31, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-10 19:02:50,714 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=31, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-10 19:02:50,716 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=31, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE; timeout=600000, timestamp=1676056370716 2023-02-10 19:02:50,716 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41145] snapshot.SnapshotManager(653): Started snapshot: { ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-10 19:02:50,719 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot testWithMapReduceMultiRegion C_M_SNAPSHOT_TABLE on table testWithMapReduce 2023-02-10 19:02:50,721 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=31, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-10 19:02:50,723 DEBUG [Listener at localhost/32909] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-02-10 19:02:50,723 DEBUG [Listener at localhost/32909] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-02-10 19:02:50,724 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-10 19:02:50,725 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=31, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE in 18 msec 2023-02-10 19:02:50,726 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-10 19:02:50,727 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=32, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED; timeout=600000, timestamp=1676056370727 2023-02-10 19:02:50,770 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure testWithMapReduceMultiRegion 2023-02-10 19:02:50,776 INFO [(jenkins-hbase4.apache.org,41145,1676055763642)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMapReduceMultiRegion' 2023-02-10 19:02:50,776 DEBUG [(jenkins-hbase4.apache.org,41145,1676055763642)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-10 19:02:50,777 DEBUG [(jenkins-hbase4.apache.org,41145,1676055763642)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMapReduceMultiRegion' starting 'acquire' 2023-02-10 19:02:50,777 DEBUG [(jenkins-hbase4.apache.org,41145,1676055763642)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMapReduceMultiRegion', kicking off acquire phase on members. 2023-02-10 19:02:50,786 DEBUG [(jenkins-hbase4.apache.org,41145,1676055763642)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41145-0x1003f9d40a30000, quorum=127.0.0.1:63334, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-10 19:02:50,786 DEBUG [(jenkins-hbase4.apache.org,41145,1676055763642)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion 2023-02-10 19:02:50,789 DEBUG [Listener at localhost/32909-EventThread] zookeeper.ZKWatcher(600): regionserver:43623-0x1003f9d40a30001, quorum=127.0.0.1:63334, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-10 19:02:50,789 DEBUG [Listener at localhost/32909-EventThread] zookeeper.ZKWatcher(600): regionserver:43337-0x1003f9d40a30002, quorum=127.0.0.1:63334, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-10 19:02:50,789 DEBUG [(jenkins-hbase4.apache.org,41145,1676055763642)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,43337,1676055764986 2023-02-10 19:02:50,789 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-10 19:02:50,789 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-10 19:02:50,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-10 19:02:50,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-10 19:02:50,790 DEBUG [(jenkins-hbase4.apache.org,41145,1676055763642)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41145-0x1003f9d40a30000, quorum=127.0.0.1:63334, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,43337,1676055764986 2023-02-10 19:02:50,790 DEBUG [(jenkins-hbase4.apache.org,41145,1676055763642)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,43623,1676055764936 2023-02-10 19:02:50,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMapReduceMultiRegion 2023-02-10 19:02:50,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMapReduceMultiRegion 2023-02-10 19:02:50,790 DEBUG [(jenkins-hbase4.apache.org,41145,1676055763642)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41145-0x1003f9d40a30000, quorum=127.0.0.1:63334, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,43623,1676055764936 2023-02-10 19:02:50,790 DEBUG [(jenkins-hbase4.apache.org,41145,1676055763642)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-10 19:02:50,790 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43623-0x1003f9d40a30001, quorum=127.0.0.1:63334, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-10 19:02:50,790 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43337-0x1003f9d40a30002, quorum=127.0.0.1:63334, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-10 19:02:50,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 66 2023-02-10 19:02:50,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 66 2023-02-10 19:02:50,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion 2023-02-10 19:02:50,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion 2023-02-10 19:02:50,791 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMapReduceMultiRegion from table testWithMapReduce type FLUSH 2023-02-10 19:02:50,791 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMapReduceMultiRegion from table testWithMapReduce type FLUSH 2023-02-10 19:02:50,794 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduceMultiRegion 2023-02-10 19:02:50,794 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduceMultiRegion 2023-02-10 19:02:50,795 DEBUG [member: 'jenkins-hbase4.apache.org,43337,1676055764986' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduceMultiRegion' with timeout 300000ms 2023-02-10 19:02:50,795 DEBUG [member: 'jenkins-hbase4.apache.org,43337,1676055764986' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-10 19:02:50,795 DEBUG [member: 'jenkins-hbase4.apache.org,43623,1676055764936' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduceMultiRegion' with timeout 300000ms 2023-02-10 19:02:50,795 DEBUG [member: 'jenkins-hbase4.apache.org,43337,1676055764986' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduceMultiRegion' starting 'acquire' stage 2023-02-10 19:02:50,795 DEBUG [member: 'jenkins-hbase4.apache.org,43623,1676055764936' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-10 19:02:50,795 DEBUG [member: 'jenkins-hbase4.apache.org,43337,1676055764986' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduceMultiRegion' locally acquired 2023-02-10 19:02:50,796 DEBUG [member: 'jenkins-hbase4.apache.org,43337,1676055764986' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43337,1676055764986' joining acquired barrier for procedure (testWithMapReduceMultiRegion) in zk 2023-02-10 19:02:50,796 DEBUG [member: 'jenkins-hbase4.apache.org,43623,1676055764936' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduceMultiRegion' starting 'acquire' stage 2023-02-10 19:02:50,796 DEBUG [member: 'jenkins-hbase4.apache.org,43623,1676055764936' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduceMultiRegion' locally acquired 2023-02-10 19:02:50,796 DEBUG [member: 'jenkins-hbase4.apache.org,43623,1676055764936' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43623,1676055764936' joining acquired barrier for procedure (testWithMapReduceMultiRegion) in zk 2023-02-10 19:02:50,798 DEBUG [member: 'jenkins-hbase4.apache.org,43337,1676055764986' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-10 19:02:50,798 DEBUG [Listener at localhost/32909-EventThread] zookeeper.ZKWatcher(600): master:41145-0x1003f9d40a30000, quorum=127.0.0.1:63334, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,43337,1676055764986 2023-02-10 19:02:50,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,43337,1676055764986 2023-02-10 19:02:50,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-10 19:02:50,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-10 19:02:50,799 DEBUG [Listener at localhost/32909-EventThread] zookeeper.ZKWatcher(600): master:41145-0x1003f9d40a30000, quorum=127.0.0.1:63334, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,43623,1676055764936 2023-02-10 19:02:50,799 DEBUG [member: 'jenkins-hbase4.apache.org,43623,1676055764936' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-10 19:02:50,799 DEBUG [member: 'jenkins-hbase4.apache.org,43337,1676055764986' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43337-0x1003f9d40a30002, quorum=127.0.0.1:63334, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-10 19:02:50,799 DEBUG [member: 'jenkins-hbase4.apache.org,43337,1676055764986' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduceMultiRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-10 19:02:50,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-10 19:02:50,799 DEBUG [member: 'jenkins-hbase4.apache.org,43623,1676055764936' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43623-0x1003f9d40a30001, quorum=127.0.0.1:63334, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-10 19:02:50,799 DEBUG [member: 'jenkins-hbase4.apache.org,43623,1676055764936' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduceMultiRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-10 19:02:50,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-10 19:02:50,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-10 19:02:50,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43623,1676055764936 2023-02-10 19:02:50,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43337,1676055764986 2023-02-10 19:02:50,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-10 19:02:50,802 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43337,1676055764986' joining acquired barrier for procedure 'testWithMapReduceMultiRegion' on coordinator 2023-02-10 19:02:50,802 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6a5fe95c[Count = 1] remaining members to acquire global barrier 2023-02-10 19:02:50,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,43623,1676055764936 2023-02-10 19:02:50,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-10 19:02:50,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-10 19:02:50,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-10 19:02:50,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-10 19:02:50,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-10 19:02:50,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43623,1676055764936 2023-02-10 19:02:50,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43337,1676055764986 2023-02-10 19:02:50,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-10 19:02:50,804 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43623,1676055764936' joining acquired barrier for procedure 'testWithMapReduceMultiRegion' on coordinator 2023-02-10 19:02:50,804 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6a5fe95c[Count = 0] remaining members to acquire global barrier 2023-02-10 19:02:50,805 DEBUG [(jenkins-hbase4.apache.org,41145,1676055763642)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMapReduceMultiRegion' starting 'in-barrier' execution. 2023-02-10 19:02:50,805 DEBUG [(jenkins-hbase4.apache.org,41145,1676055763642)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-10 19:02:50,806 DEBUG [Listener at localhost/32909-EventThread] zookeeper.ZKWatcher(600): regionserver:43337-0x1003f9d40a30002, quorum=127.0.0.1:63334, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-10 19:02:50,806 DEBUG [Listener at localhost/32909-EventThread] zookeeper.ZKWatcher(600): regionserver:43623-0x1003f9d40a30001, quorum=127.0.0.1:63334, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-10 19:02:50,806 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-10 19:02:50,807 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-10 19:02:50,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-10 19:02:50,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-10 19:02:50,807 DEBUG [member: 'jenkins-hbase4.apache.org,43623,1676055764936' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduceMultiRegion' received 'reached' from coordinator. 2023-02-10 19:02:50,807 DEBUG [(jenkins-hbase4.apache.org,41145,1676055763642)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41145-0x1003f9d40a30000, quorum=127.0.0.1:63334, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,43337,1676055764986 2023-02-10 19:02:50,807 DEBUG [(jenkins-hbase4.apache.org,41145,1676055763642)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41145-0x1003f9d40a30000, quorum=127.0.0.1:63334, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,43623,1676055764936 2023-02-10 19:02:50,808 DEBUG [(jenkins-hbase4.apache.org,41145,1676055763642)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-10 19:02:50,808 DEBUG [member: 'jenkins-hbase4.apache.org,43337,1676055764986' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduceMultiRegion' received 'reached' from coordinator. 2023-02-10 19:02:50,808 DEBUG [rs(jenkins-hbase4.apache.org,43623,1676055764936)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,q\x11\x10,1676055767944.07dbe2f766a0b8b265d0439c26307ef7. 2023-02-10 19:02:50,809 DEBUG [rs(jenkins-hbase4.apache.org,43337,1676055764986)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,d\x84\x84,1676055767944.b5248077ace761a2c5d43c344f646651. 2023-02-10 19:02:50,809 DEBUG [rs(jenkins-hbase4.apache.org,43623,1676055764936)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,wWV,1676055767944.cca73b62b14aebcd72ce9f0317bde286. 2023-02-10 19:02:50,809 DEBUG [member: 'jenkins-hbase4.apache.org,43623,1676055764936' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 5 regions 2023-02-10 19:02:50,809 DEBUG [member: 'jenkins-hbase4.apache.org,43623,1676055764936' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-10 19:02:50,809 DEBUG [rs(jenkins-hbase4.apache.org,43623,1676055764936)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,wWV,1676055767944.cca73b62b14aebcd72ce9f0317bde286. started... 2023-02-10 19:02:50,809 DEBUG [rs(jenkins-hbase4.apache.org,43337,1676055764986)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,d\x84\x84,1676055767944.b5248077ace761a2c5d43c344f646651. started... 2023-02-10 19:02:50,809 DEBUG [rs(jenkins-hbase4.apache.org,43623,1676055764936)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,q\x11\x10,1676055767944.07dbe2f766a0b8b265d0439c26307ef7. started... 2023-02-10 19:02:50,809 DEBUG [rs(jenkins-hbase4.apache.org,43337,1676055764986)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,j\xCA\xCA,1676055767944.053dc7037d94e17f3f72f5ea563ab135. 2023-02-10 19:02:50,810 DEBUG [rs(jenkins-hbase4.apache.org,43337,1676055764986)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,j\xCA\xCA,1676055767944.053dc7037d94e17f3f72f5ea563ab135. started... 2023-02-10 19:02:50,810 DEBUG [member: 'jenkins-hbase4.apache.org,43337,1676055764986' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 5 regions 2023-02-10 19:02:50,810 DEBUG [member: 'jenkins-hbase4.apache.org,43337,1676055764986' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-10 19:02:50,810 DEBUG [rs(jenkins-hbase4.apache.org,43337,1676055764986)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,,1676055767944.813b88c1d27659129f4a12d3c70b79c7. 2023-02-10 19:02:50,811 DEBUG [rs(jenkins-hbase4.apache.org,43623,1676055764936)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,m\xED\xED,1676055767944.2abc519a8c9fd6a76400a0e9294c9317. 2023-02-10 19:02:50,811 INFO [rs(jenkins-hbase4.apache.org,43337,1676055764986)-snapshot-pool-1] regionserver.HRegion(2744): Flushing 053dc7037d94e17f3f72f5ea563ab135 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-10 19:02:50,811 INFO [rs(jenkins-hbase4.apache.org,43623,1676055764936)-snapshot-pool-1] regionserver.HRegion(2744): Flushing cca73b62b14aebcd72ce9f0317bde286 2/2 column families, dataSize=158.44 KB heapSize=549.75 KB 2023-02-10 19:02:50,811 DEBUG [rs(jenkins-hbase4.apache.org,43337,1676055764986)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,,1676055767944.813b88c1d27659129f4a12d3c70b79c7. started... 2023-02-10 19:02:50,812 INFO [rs(jenkins-hbase4.apache.org,43337,1676055764986)-snapshot-pool-0] regionserver.HRegion(2744): Flushing b5248077ace761a2c5d43c344f646651 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-10 19:02:50,811 DEBUG [rs(jenkins-hbase4.apache.org,43623,1676055764936)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,m\xED\xED,1676055767944.2abc519a8c9fd6a76400a0e9294c9317. started... 2023-02-10 19:02:50,812 INFO [rs(jenkins-hbase4.apache.org,43623,1676055764936)-snapshot-pool-0] regionserver.HRegion(2744): Flushing 07dbe2f766a0b8b265d0439c26307ef7 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-10 19:02:50,813 INFO [rs(jenkins-hbase4.apache.org,43623,1676055764936)-snapshot-pool-2] regionserver.HRegion(2744): Flushing 2abc519a8c9fd6a76400a0e9294c9317 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-10 19:02:50,815 DEBUG [rs(jenkins-hbase4.apache.org,43337,1676055764986)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for 813b88c1d27659129f4a12d3c70b79c7: 2023-02-10 19:02:50,816 DEBUG [rs(jenkins-hbase4.apache.org,43337,1676055764986)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,,1676055767944.813b88c1d27659129f4a12d3c70b79c7.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-10 19:02:50,822 DEBUG [rs(jenkins-hbase4.apache.org,43337,1676055764986)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-10 19:02:50,823 DEBUG [Listener at localhost/32909] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-10 19:02:50,828 DEBUG [rs(jenkins-hbase4.apache.org,43337,1676055764986)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-10 19:02:50,828 DEBUG [rs(jenkins-hbase4.apache.org,43337,1676055764986)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-10 19:02:50,829 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41145] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-10 19:02:50,831 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41145] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-10 19:02:50,831 DEBUG [Listener at localhost/32909] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-02-10 19:02:50,849 DEBUG [rs(jenkins-hbase4.apache.org,43337,1676055764986)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,,1676055767944.813b88c1d27659129f4a12d3c70b79c7. completed. 2023-02-10 19:02:50,850 DEBUG [rs(jenkins-hbase4.apache.org,43337,1676055764986)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,,1676055767944.813b88c1d27659129f4a12d3c70b79c7. 2023-02-10 19:02:50,851 DEBUG [rs(jenkins-hbase4.apache.org,43337,1676055764986)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,zz{,1676055767944.05d2a877c2d90362a1d4209daff5b54a. 2023-02-10 19:02:50,851 DEBUG [member: 'jenkins-hbase4.apache.org,43337,1676055764986' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/5 local region snapshots. 2023-02-10 19:02:50,851 DEBUG [rs(jenkins-hbase4.apache.org,43337,1676055764986)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,zz{,1676055767944.05d2a877c2d90362a1d4209daff5b54a. started... 2023-02-10 19:02:50,851 DEBUG [rs(jenkins-hbase4.apache.org,43337,1676055764986)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for 05d2a877c2d90362a1d4209daff5b54a: 2023-02-10 19:02:50,852 DEBUG [rs(jenkins-hbase4.apache.org,43337,1676055764986)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,zz{,1676055767944.05d2a877c2d90362a1d4209daff5b54a.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-10 19:02:50,852 DEBUG [rs(jenkins-hbase4.apache.org,43337,1676055764986)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-10 19:02:50,852 DEBUG [rs(jenkins-hbase4.apache.org,43337,1676055764986)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-10 19:02:50,852 DEBUG [rs(jenkins-hbase4.apache.org,43337,1676055764986)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-10 19:02:50,882 DEBUG [rs(jenkins-hbase4.apache.org,43337,1676055764986)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,zz{,1676055767944.05d2a877c2d90362a1d4209daff5b54a. completed. 2023-02-10 19:02:50,882 DEBUG [rs(jenkins-hbase4.apache.org,43337,1676055764986)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,zz{,1676055767944.05d2a877c2d90362a1d4209daff5b54a. 2023-02-10 19:02:50,882 DEBUG [rs(jenkins-hbase4.apache.org,43337,1676055764986)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,t43,1676055767944.52e916374c45f2d5119804d8db34ffe7. 2023-02-10 19:02:50,883 DEBUG [member: 'jenkins-hbase4.apache.org,43337,1676055764986' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 2/5 local region snapshots. 2023-02-10 19:02:50,883 DEBUG [rs(jenkins-hbase4.apache.org,43337,1676055764986)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,t43,1676055767944.52e916374c45f2d5119804d8db34ffe7. started... 2023-02-10 19:02:50,883 INFO [rs(jenkins-hbase4.apache.org,43337,1676055764986)-snapshot-pool-2] regionserver.HRegion(2744): Flushing 52e916374c45f2d5119804d8db34ffe7 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-10 19:02:51,032 DEBUG [Listener at localhost/32909] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-10 19:02:51,033 INFO [rs(jenkins-hbase4.apache.org,43623,1676055764936)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/data/default/testWithMapReduce/cca73b62b14aebcd72ce9f0317bde286/.tmp/f1/4cfcead0fcb24e6598b31b611cdd39bf 2023-02-10 19:02:51,034 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41145] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-10 19:02:51,034 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41145] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-10 19:02:51,034 DEBUG [Listener at localhost/32909] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-02-10 19:02:51,040 INFO [rs(jenkins-hbase4.apache.org,43337,1676055764986)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/data/default/testWithMapReduce/053dc7037d94e17f3f72f5ea563ab135/.tmp/f1/504d267354704aa1887fe95c8317e485 2023-02-10 19:02:51,047 INFO [rs(jenkins-hbase4.apache.org,43623,1676055764936)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/data/default/testWithMapReduce/2abc519a8c9fd6a76400a0e9294c9317/.tmp/f1/253de5c7eb7e4d3d9eb98c4c28bf4117 2023-02-10 19:02:51,047 INFO [rs(jenkins-hbase4.apache.org,43337,1676055764986)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/data/default/testWithMapReduce/b5248077ace761a2c5d43c344f646651/.tmp/f1/fb0ff4da36be4e70b3c8085cf63149b8 2023-02-10 19:02:51,049 INFO [rs(jenkins-hbase4.apache.org,43623,1676055764936)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/data/default/testWithMapReduce/07dbe2f766a0b8b265d0439c26307ef7/.tmp/f1/7f2eeb0ade74437c8e98b1f9c6e4998f 2023-02-10 19:02:51,190 INFO [rs(jenkins-hbase4.apache.org,43623,1676055764936)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/data/default/testWithMapReduce/cca73b62b14aebcd72ce9f0317bde286/.tmp/f2/94a02f29869d405ab4270bd8fffe2c6d 2023-02-10 19:02:51,195 INFO [rs(jenkins-hbase4.apache.org,43337,1676055764986)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/data/default/testWithMapReduce/053dc7037d94e17f3f72f5ea563ab135/.tmp/f2/871880a6275949d4800f26e30c4edeb8 2023-02-10 19:02:51,195 INFO [rs(jenkins-hbase4.apache.org,43337,1676055764986)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/data/default/testWithMapReduce/b5248077ace761a2c5d43c344f646651/.tmp/f2/a897301323734c9b82ef09fe533f9dc0 2023-02-10 19:02:51,199 INFO [rs(jenkins-hbase4.apache.org,43623,1676055764936)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/data/default/testWithMapReduce/07dbe2f766a0b8b265d0439c26307ef7/.tmp/f2/ce63b0110ef64f13adedf84c456454a1 2023-02-10 19:02:51,209 DEBUG [rs(jenkins-hbase4.apache.org,43623,1676055764936)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/data/default/testWithMapReduce/cca73b62b14aebcd72ce9f0317bde286/.tmp/f1/4cfcead0fcb24e6598b31b611cdd39bf as hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/data/default/testWithMapReduce/cca73b62b14aebcd72ce9f0317bde286/f1/4cfcead0fcb24e6598b31b611cdd39bf 2023-02-10 19:02:51,209 DEBUG [rs(jenkins-hbase4.apache.org,43337,1676055764986)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/data/default/testWithMapReduce/053dc7037d94e17f3f72f5ea563ab135/.tmp/f1/504d267354704aa1887fe95c8317e485 as hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/data/default/testWithMapReduce/053dc7037d94e17f3f72f5ea563ab135/f1/504d267354704aa1887fe95c8317e485 2023-02-10 19:02:51,211 DEBUG [rs(jenkins-hbase4.apache.org,43337,1676055764986)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/data/default/testWithMapReduce/b5248077ace761a2c5d43c344f646651/.tmp/f1/fb0ff4da36be4e70b3c8085cf63149b8 as hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/data/default/testWithMapReduce/b5248077ace761a2c5d43c344f646651/f1/fb0ff4da36be4e70b3c8085cf63149b8 2023-02-10 19:02:51,214 INFO [rs(jenkins-hbase4.apache.org,43623,1676055764936)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/data/default/testWithMapReduce/2abc519a8c9fd6a76400a0e9294c9317/.tmp/f2/6e0c81a35f164756ba1801d4b22b31e8 2023-02-10 19:02:51,216 DEBUG [rs(jenkins-hbase4.apache.org,43623,1676055764936)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/data/default/testWithMapReduce/07dbe2f766a0b8b265d0439c26307ef7/.tmp/f1/7f2eeb0ade74437c8e98b1f9c6e4998f as hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/data/default/testWithMapReduce/07dbe2f766a0b8b265d0439c26307ef7/f1/7f2eeb0ade74437c8e98b1f9c6e4998f 2023-02-10 19:02:51,226 DEBUG [rs(jenkins-hbase4.apache.org,43623,1676055764936)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/data/default/testWithMapReduce/2abc519a8c9fd6a76400a0e9294c9317/.tmp/f1/253de5c7eb7e4d3d9eb98c4c28bf4117 as hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/data/default/testWithMapReduce/2abc519a8c9fd6a76400a0e9294c9317/f1/253de5c7eb7e4d3d9eb98c4c28bf4117 2023-02-10 19:02:51,228 INFO [rs(jenkins-hbase4.apache.org,43623,1676055764936)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/data/default/testWithMapReduce/cca73b62b14aebcd72ce9f0317bde286/f1/4cfcead0fcb24e6598b31b611cdd39bf, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-10 19:02:51,230 DEBUG [rs(jenkins-hbase4.apache.org,43623,1676055764936)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/data/default/testWithMapReduce/cca73b62b14aebcd72ce9f0317bde286/.tmp/f2/94a02f29869d405ab4270bd8fffe2c6d as hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/data/default/testWithMapReduce/cca73b62b14aebcd72ce9f0317bde286/f2/94a02f29869d405ab4270bd8fffe2c6d 2023-02-10 19:02:51,233 INFO [rs(jenkins-hbase4.apache.org,43337,1676055764986)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/data/default/testWithMapReduce/053dc7037d94e17f3f72f5ea563ab135/f1/504d267354704aa1887fe95c8317e485, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-10 19:02:51,234 INFO [rs(jenkins-hbase4.apache.org,43337,1676055764986)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/data/default/testWithMapReduce/b5248077ace761a2c5d43c344f646651/f1/fb0ff4da36be4e70b3c8085cf63149b8, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-10 19:02:51,238 DEBUG [rs(jenkins-hbase4.apache.org,43337,1676055764986)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/data/default/testWithMapReduce/b5248077ace761a2c5d43c344f646651/.tmp/f2/a897301323734c9b82ef09fe533f9dc0 as hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/data/default/testWithMapReduce/b5248077ace761a2c5d43c344f646651/f2/a897301323734c9b82ef09fe533f9dc0 2023-02-10 19:02:51,241 DEBUG [rs(jenkins-hbase4.apache.org,43337,1676055764986)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/data/default/testWithMapReduce/053dc7037d94e17f3f72f5ea563ab135/.tmp/f2/871880a6275949d4800f26e30c4edeb8 as hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/data/default/testWithMapReduce/053dc7037d94e17f3f72f5ea563ab135/f2/871880a6275949d4800f26e30c4edeb8 2023-02-10 19:02:51,247 INFO [rs(jenkins-hbase4.apache.org,43623,1676055764936)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/data/default/testWithMapReduce/07dbe2f766a0b8b265d0439c26307ef7/f1/7f2eeb0ade74437c8e98b1f9c6e4998f, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-10 19:02:51,248 DEBUG [rs(jenkins-hbase4.apache.org,43623,1676055764936)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/data/default/testWithMapReduce/07dbe2f766a0b8b265d0439c26307ef7/.tmp/f2/ce63b0110ef64f13adedf84c456454a1 as hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/data/default/testWithMapReduce/07dbe2f766a0b8b265d0439c26307ef7/f2/ce63b0110ef64f13adedf84c456454a1 2023-02-10 19:02:51,249 INFO [rs(jenkins-hbase4.apache.org,43623,1676055764936)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/data/default/testWithMapReduce/cca73b62b14aebcd72ce9f0317bde286/f2/94a02f29869d405ab4270bd8fffe2c6d, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-10 19:02:51,249 INFO [rs(jenkins-hbase4.apache.org,43337,1676055764986)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/data/default/testWithMapReduce/b5248077ace761a2c5d43c344f646651/f2/a897301323734c9b82ef09fe533f9dc0, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-10 19:02:51,251 INFO [rs(jenkins-hbase4.apache.org,43623,1676055764936)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/data/default/testWithMapReduce/2abc519a8c9fd6a76400a0e9294c9317/f1/253de5c7eb7e4d3d9eb98c4c28bf4117, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-10 19:02:51,252 INFO [rs(jenkins-hbase4.apache.org,43623,1676055764936)-snapshot-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~158.44 KB/162240, heapSize ~549.72 KB/562912, currentSize=0 B/0 for cca73b62b14aebcd72ce9f0317bde286 in 441ms, sequenceid=5, compaction requested=false 2023-02-10 19:02:51,252 INFO [rs(jenkins-hbase4.apache.org,43337,1676055764986)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for b5248077ace761a2c5d43c344f646651 in 441ms, sequenceid=5, compaction requested=false 2023-02-10 19:02:51,253 DEBUG [rs(jenkins-hbase4.apache.org,43623,1676055764936)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/data/default/testWithMapReduce/2abc519a8c9fd6a76400a0e9294c9317/.tmp/f2/6e0c81a35f164756ba1801d4b22b31e8 as hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/data/default/testWithMapReduce/2abc519a8c9fd6a76400a0e9294c9317/f2/6e0c81a35f164756ba1801d4b22b31e8 2023-02-10 19:02:51,254 DEBUG [rs(jenkins-hbase4.apache.org,43623,1676055764936)-snapshot-pool-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testWithMapReduce' 2023-02-10 19:02:51,256 DEBUG [rs(jenkins-hbase4.apache.org,43623,1676055764936)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for cca73b62b14aebcd72ce9f0317bde286: 2023-02-10 19:02:51,256 DEBUG [rs(jenkins-hbase4.apache.org,43623,1676055764936)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,wWV,1676055767944.cca73b62b14aebcd72ce9f0317bde286.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-10 19:02:51,256 DEBUG [rs(jenkins-hbase4.apache.org,43623,1676055764936)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-10 19:02:51,256 DEBUG [rs(jenkins-hbase4.apache.org,43623,1676055764936)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/data/default/testWithMapReduce/cca73b62b14aebcd72ce9f0317bde286/f1/4cfcead0fcb24e6598b31b611cdd39bf] hfiles 2023-02-10 19:02:51,256 DEBUG [rs(jenkins-hbase4.apache.org,43623,1676055764936)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/data/default/testWithMapReduce/cca73b62b14aebcd72ce9f0317bde286/f1/4cfcead0fcb24e6598b31b611cdd39bf for snapshot=testWithMapReduceMultiRegion 2023-02-10 19:02:51,257 INFO [rs(jenkins-hbase4.apache.org,43623,1676055764936)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/data/default/testWithMapReduce/07dbe2f766a0b8b265d0439c26307ef7/f2/ce63b0110ef64f13adedf84c456454a1, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-10 19:02:51,258 INFO [rs(jenkins-hbase4.apache.org,43623,1676055764936)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 07dbe2f766a0b8b265d0439c26307ef7 in 446ms, sequenceid=5, compaction requested=false 2023-02-10 19:02:51,260 DEBUG [rs(jenkins-hbase4.apache.org,43623,1676055764936)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 07dbe2f766a0b8b265d0439c26307ef7: 2023-02-10 19:02:51,260 DEBUG [rs(jenkins-hbase4.apache.org,43337,1676055764986)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testWithMapReduce' 2023-02-10 19:02:51,260 DEBUG [rs(jenkins-hbase4.apache.org,43337,1676055764986)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for b5248077ace761a2c5d43c344f646651: 2023-02-10 19:02:51,260 DEBUG [rs(jenkins-hbase4.apache.org,43623,1676055764936)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,q\x11\x10,1676055767944.07dbe2f766a0b8b265d0439c26307ef7.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-10 19:02:51,260 DEBUG [rs(jenkins-hbase4.apache.org,43623,1676055764936)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-10 19:02:51,260 DEBUG [rs(jenkins-hbase4.apache.org,43337,1676055764986)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,d\x84\x84,1676055767944.b5248077ace761a2c5d43c344f646651.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-10 19:02:51,260 DEBUG [rs(jenkins-hbase4.apache.org,43623,1676055764936)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/data/default/testWithMapReduce/07dbe2f766a0b8b265d0439c26307ef7/f1/7f2eeb0ade74437c8e98b1f9c6e4998f] hfiles 2023-02-10 19:02:51,260 DEBUG [rs(jenkins-hbase4.apache.org,43337,1676055764986)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-10 19:02:51,260 DEBUG [rs(jenkins-hbase4.apache.org,43337,1676055764986)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/data/default/testWithMapReduce/b5248077ace761a2c5d43c344f646651/f1/fb0ff4da36be4e70b3c8085cf63149b8] hfiles 2023-02-10 19:02:51,260 DEBUG [rs(jenkins-hbase4.apache.org,43337,1676055764986)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/data/default/testWithMapReduce/b5248077ace761a2c5d43c344f646651/f1/fb0ff4da36be4e70b3c8085cf63149b8 for snapshot=testWithMapReduceMultiRegion 2023-02-10 19:02:51,260 DEBUG [rs(jenkins-hbase4.apache.org,43623,1676055764936)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/data/default/testWithMapReduce/07dbe2f766a0b8b265d0439c26307ef7/f1/7f2eeb0ade74437c8e98b1f9c6e4998f for snapshot=testWithMapReduceMultiRegion 2023-02-10 19:02:51,262 DEBUG [rs(jenkins-hbase4.apache.org,43337,1676055764986)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/data/default/testWithMapReduce/b5248077ace761a2c5d43c344f646651/f2/a897301323734c9b82ef09fe533f9dc0] hfiles 2023-02-10 19:02:51,262 DEBUG [rs(jenkins-hbase4.apache.org,43623,1676055764936)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/data/default/testWithMapReduce/cca73b62b14aebcd72ce9f0317bde286/f2/94a02f29869d405ab4270bd8fffe2c6d] hfiles 2023-02-10 19:02:51,262 DEBUG [rs(jenkins-hbase4.apache.org,43623,1676055764936)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/data/default/testWithMapReduce/07dbe2f766a0b8b265d0439c26307ef7/f2/ce63b0110ef64f13adedf84c456454a1] hfiles 2023-02-10 19:02:51,262 INFO [rs(jenkins-hbase4.apache.org,43337,1676055764986)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/data/default/testWithMapReduce/053dc7037d94e17f3f72f5ea563ab135/f2/871880a6275949d4800f26e30c4edeb8, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-10 19:02:51,262 DEBUG [rs(jenkins-hbase4.apache.org,43623,1676055764936)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/data/default/testWithMapReduce/cca73b62b14aebcd72ce9f0317bde286/f2/94a02f29869d405ab4270bd8fffe2c6d for snapshot=testWithMapReduceMultiRegion 2023-02-10 19:02:51,262 DEBUG [rs(jenkins-hbase4.apache.org,43337,1676055764986)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/data/default/testWithMapReduce/b5248077ace761a2c5d43c344f646651/f2/a897301323734c9b82ef09fe533f9dc0 for snapshot=testWithMapReduceMultiRegion 2023-02-10 19:02:51,262 DEBUG [rs(jenkins-hbase4.apache.org,43623,1676055764936)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/data/default/testWithMapReduce/07dbe2f766a0b8b265d0439c26307ef7/f2/ce63b0110ef64f13adedf84c456454a1 for snapshot=testWithMapReduceMultiRegion 2023-02-10 19:02:51,265 INFO [rs(jenkins-hbase4.apache.org,43337,1676055764986)-snapshot-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 053dc7037d94e17f3f72f5ea563ab135 in 454ms, sequenceid=5, compaction requested=false 2023-02-10 19:02:51,266 DEBUG [rs(jenkins-hbase4.apache.org,43337,1676055764986)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for 053dc7037d94e17f3f72f5ea563ab135: 2023-02-10 19:02:51,267 DEBUG [rs(jenkins-hbase4.apache.org,43337,1676055764986)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,j\xCA\xCA,1676055767944.053dc7037d94e17f3f72f5ea563ab135.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-10 19:02:51,267 DEBUG [rs(jenkins-hbase4.apache.org,43337,1676055764986)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-10 19:02:51,267 DEBUG [rs(jenkins-hbase4.apache.org,43337,1676055764986)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/data/default/testWithMapReduce/053dc7037d94e17f3f72f5ea563ab135/f1/504d267354704aa1887fe95c8317e485] hfiles 2023-02-10 19:02:51,269 DEBUG [rs(jenkins-hbase4.apache.org,43337,1676055764986)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/data/default/testWithMapReduce/053dc7037d94e17f3f72f5ea563ab135/f1/504d267354704aa1887fe95c8317e485 for snapshot=testWithMapReduceMultiRegion 2023-02-10 19:02:51,269 DEBUG [rs(jenkins-hbase4.apache.org,43337,1676055764986)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/data/default/testWithMapReduce/053dc7037d94e17f3f72f5ea563ab135/f2/871880a6275949d4800f26e30c4edeb8] hfiles 2023-02-10 19:02:51,269 DEBUG [rs(jenkins-hbase4.apache.org,43337,1676055764986)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/data/default/testWithMapReduce/053dc7037d94e17f3f72f5ea563ab135/f2/871880a6275949d4800f26e30c4edeb8 for snapshot=testWithMapReduceMultiRegion 2023-02-10 19:02:51,272 INFO [rs(jenkins-hbase4.apache.org,43623,1676055764936)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/data/default/testWithMapReduce/2abc519a8c9fd6a76400a0e9294c9317/f2/6e0c81a35f164756ba1801d4b22b31e8, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-10 19:02:51,274 INFO [rs(jenkins-hbase4.apache.org,43623,1676055764936)-snapshot-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 2abc519a8c9fd6a76400a0e9294c9317 in 461ms, sequenceid=5, compaction requested=false 2023-02-10 19:02:51,274 DEBUG [rs(jenkins-hbase4.apache.org,43623,1676055764936)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for 2abc519a8c9fd6a76400a0e9294c9317: 2023-02-10 19:02:51,275 DEBUG [rs(jenkins-hbase4.apache.org,43623,1676055764936)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,m\xED\xED,1676055767944.2abc519a8c9fd6a76400a0e9294c9317.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-10 19:02:51,275 DEBUG [rs(jenkins-hbase4.apache.org,43623,1676055764936)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-10 19:02:51,275 DEBUG [rs(jenkins-hbase4.apache.org,43623,1676055764936)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/data/default/testWithMapReduce/2abc519a8c9fd6a76400a0e9294c9317/f1/253de5c7eb7e4d3d9eb98c4c28bf4117] hfiles 2023-02-10 19:02:51,275 DEBUG [rs(jenkins-hbase4.apache.org,43623,1676055764936)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/data/default/testWithMapReduce/2abc519a8c9fd6a76400a0e9294c9317/f1/253de5c7eb7e4d3d9eb98c4c28bf4117 for snapshot=testWithMapReduceMultiRegion 2023-02-10 19:02:51,275 DEBUG [rs(jenkins-hbase4.apache.org,43623,1676055764936)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/data/default/testWithMapReduce/2abc519a8c9fd6a76400a0e9294c9317/f2/6e0c81a35f164756ba1801d4b22b31e8] hfiles 2023-02-10 19:02:51,275 DEBUG [rs(jenkins-hbase4.apache.org,43623,1676055764936)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/data/default/testWithMapReduce/2abc519a8c9fd6a76400a0e9294c9317/f2/6e0c81a35f164756ba1801d4b22b31e8 for snapshot=testWithMapReduceMultiRegion 2023-02-10 19:02:51,297 DEBUG [rs(jenkins-hbase4.apache.org,43623,1676055764936)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,wWV,1676055767944.cca73b62b14aebcd72ce9f0317bde286. completed. 2023-02-10 19:02:51,297 DEBUG [rs(jenkins-hbase4.apache.org,43623,1676055764936)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,wWV,1676055767944.cca73b62b14aebcd72ce9f0317bde286. 2023-02-10 19:02:51,297 DEBUG [rs(jenkins-hbase4.apache.org,43623,1676055764936)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,aaa,1676055767944.ea671e7088d3fe84e68b3d345289fe97. 2023-02-10 19:02:51,297 DEBUG [member: 'jenkins-hbase4.apache.org,43623,1676055764936' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/5 local region snapshots. 2023-02-10 19:02:51,297 DEBUG [rs(jenkins-hbase4.apache.org,43623,1676055764936)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,aaa,1676055767944.ea671e7088d3fe84e68b3d345289fe97. started... 2023-02-10 19:02:51,300 INFO [rs(jenkins-hbase4.apache.org,43623,1676055764936)-snapshot-pool-1] regionserver.HRegion(2744): Flushing ea671e7088d3fe84e68b3d345289fe97 2/2 column families, dataSize=158.44 KB heapSize=549.75 KB 2023-02-10 19:02:51,301 DEBUG [rs(jenkins-hbase4.apache.org,43337,1676055764986)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,d\x84\x84,1676055767944.b5248077ace761a2c5d43c344f646651. completed. 2023-02-10 19:02:51,302 DEBUG [rs(jenkins-hbase4.apache.org,43337,1676055764986)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,d\x84\x84,1676055767944.b5248077ace761a2c5d43c344f646651. 2023-02-10 19:02:51,302 DEBUG [member: 'jenkins-hbase4.apache.org,43337,1676055764986' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 3/5 local region snapshots. 2023-02-10 19:02:51,303 DEBUG [rs(jenkins-hbase4.apache.org,43623,1676055764936)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,q\x11\x10,1676055767944.07dbe2f766a0b8b265d0439c26307ef7. completed. 2023-02-10 19:02:51,303 DEBUG [rs(jenkins-hbase4.apache.org,43623,1676055764936)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,q\x11\x10,1676055767944.07dbe2f766a0b8b265d0439c26307ef7. 2023-02-10 19:02:51,303 DEBUG [rs(jenkins-hbase4.apache.org,43623,1676055764936)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,g\xA7\xA7,1676055767944.0b68bcec2ca2391d28b6290c561e3332. 2023-02-10 19:02:51,303 DEBUG [member: 'jenkins-hbase4.apache.org,43623,1676055764936' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 2/5 local region snapshots. 2023-02-10 19:02:51,303 DEBUG [rs(jenkins-hbase4.apache.org,43623,1676055764936)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,g\xA7\xA7,1676055767944.0b68bcec2ca2391d28b6290c561e3332. started... 2023-02-10 19:02:51,304 INFO [rs(jenkins-hbase4.apache.org,43623,1676055764936)-snapshot-pool-0] regionserver.HRegion(2744): Flushing 0b68bcec2ca2391d28b6290c561e3332 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-10 19:02:51,308 DEBUG [rs(jenkins-hbase4.apache.org,43623,1676055764936)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,m\xED\xED,1676055767944.2abc519a8c9fd6a76400a0e9294c9317. completed. 2023-02-10 19:02:51,308 DEBUG [rs(jenkins-hbase4.apache.org,43623,1676055764936)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,m\xED\xED,1676055767944.2abc519a8c9fd6a76400a0e9294c9317. 2023-02-10 19:02:51,308 DEBUG [member: 'jenkins-hbase4.apache.org,43623,1676055764936' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 3/5 local region snapshots. 2023-02-10 19:02:51,309 DEBUG [rs(jenkins-hbase4.apache.org,43337,1676055764986)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,j\xCA\xCA,1676055767944.053dc7037d94e17f3f72f5ea563ab135. completed. 2023-02-10 19:02:51,309 DEBUG [rs(jenkins-hbase4.apache.org,43337,1676055764986)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,j\xCA\xCA,1676055767944.053dc7037d94e17f3f72f5ea563ab135. 2023-02-10 19:02:51,309 DEBUG [member: 'jenkins-hbase4.apache.org,43337,1676055764986' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 4/5 local region snapshots. 2023-02-10 19:02:51,334 DEBUG [Listener at localhost/32909] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-10 19:02:51,337 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41145] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-10 19:02:51,337 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41145] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-10 19:02:51,337 DEBUG [Listener at localhost/32909] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-02-10 19:02:51,416 INFO [rs(jenkins-hbase4.apache.org,43623,1676055764936)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/data/default/testWithMapReduce/ea671e7088d3fe84e68b3d345289fe97/.tmp/f1/1cb1c69f1d034168966cde09a17b098e 2023-02-10 19:02:51,440 INFO [rs(jenkins-hbase4.apache.org,43337,1676055764986)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/data/default/testWithMapReduce/52e916374c45f2d5119804d8db34ffe7/.tmp/f1/7046e04cad38425f93b18e9cdf97792a 2023-02-10 19:02:51,449 INFO [rs(jenkins-hbase4.apache.org,43623,1676055764936)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/data/default/testWithMapReduce/ea671e7088d3fe84e68b3d345289fe97/.tmp/f2/905d6e0f39194973bc5d4ae34b4d908f 2023-02-10 19:02:51,458 DEBUG [rs(jenkins-hbase4.apache.org,43623,1676055764936)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/data/default/testWithMapReduce/ea671e7088d3fe84e68b3d345289fe97/.tmp/f1/1cb1c69f1d034168966cde09a17b098e as hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/data/default/testWithMapReduce/ea671e7088d3fe84e68b3d345289fe97/f1/1cb1c69f1d034168966cde09a17b098e 2023-02-10 19:02:51,466 INFO [rs(jenkins-hbase4.apache.org,43623,1676055764936)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/data/default/testWithMapReduce/ea671e7088d3fe84e68b3d345289fe97/f1/1cb1c69f1d034168966cde09a17b098e, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-10 19:02:51,468 DEBUG [rs(jenkins-hbase4.apache.org,43623,1676055764936)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/data/default/testWithMapReduce/ea671e7088d3fe84e68b3d345289fe97/.tmp/f2/905d6e0f39194973bc5d4ae34b4d908f as hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/data/default/testWithMapReduce/ea671e7088d3fe84e68b3d345289fe97/f2/905d6e0f39194973bc5d4ae34b4d908f 2023-02-10 19:02:51,475 INFO [rs(jenkins-hbase4.apache.org,43337,1676055764986)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/data/default/testWithMapReduce/52e916374c45f2d5119804d8db34ffe7/.tmp/f2/9cd807e0a98e4c4091980728d6f09bfa 2023-02-10 19:02:51,477 INFO [rs(jenkins-hbase4.apache.org,43623,1676055764936)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/data/default/testWithMapReduce/ea671e7088d3fe84e68b3d345289fe97/f2/905d6e0f39194973bc5d4ae34b4d908f, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-10 19:02:51,479 INFO [rs(jenkins-hbase4.apache.org,43623,1676055764936)-snapshot-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~158.44 KB/162240, heapSize ~549.72 KB/562912, currentSize=0 B/0 for ea671e7088d3fe84e68b3d345289fe97 in 179ms, sequenceid=5, compaction requested=false 2023-02-10 19:02:51,479 DEBUG [rs(jenkins-hbase4.apache.org,43623,1676055764936)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for ea671e7088d3fe84e68b3d345289fe97: 2023-02-10 19:02:51,480 DEBUG [rs(jenkins-hbase4.apache.org,43623,1676055764936)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,aaa,1676055767944.ea671e7088d3fe84e68b3d345289fe97.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-10 19:02:51,481 DEBUG [rs(jenkins-hbase4.apache.org,43623,1676055764936)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-10 19:02:51,482 DEBUG [rs(jenkins-hbase4.apache.org,43623,1676055764936)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/data/default/testWithMapReduce/ea671e7088d3fe84e68b3d345289fe97/f1/1cb1c69f1d034168966cde09a17b098e] hfiles 2023-02-10 19:02:51,482 DEBUG [rs(jenkins-hbase4.apache.org,43623,1676055764936)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/data/default/testWithMapReduce/ea671e7088d3fe84e68b3d345289fe97/f1/1cb1c69f1d034168966cde09a17b098e for snapshot=testWithMapReduceMultiRegion 2023-02-10 19:02:51,482 DEBUG [rs(jenkins-hbase4.apache.org,43623,1676055764936)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/data/default/testWithMapReduce/ea671e7088d3fe84e68b3d345289fe97/f2/905d6e0f39194973bc5d4ae34b4d908f] hfiles 2023-02-10 19:02:51,482 DEBUG [rs(jenkins-hbase4.apache.org,43623,1676055764936)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/data/default/testWithMapReduce/ea671e7088d3fe84e68b3d345289fe97/f2/905d6e0f39194973bc5d4ae34b4d908f for snapshot=testWithMapReduceMultiRegion 2023-02-10 19:02:51,492 DEBUG [rs(jenkins-hbase4.apache.org,43337,1676055764986)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/data/default/testWithMapReduce/52e916374c45f2d5119804d8db34ffe7/.tmp/f1/7046e04cad38425f93b18e9cdf97792a as hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/data/default/testWithMapReduce/52e916374c45f2d5119804d8db34ffe7/f1/7046e04cad38425f93b18e9cdf97792a 2023-02-10 19:02:51,495 DEBUG [rs(jenkins-hbase4.apache.org,43623,1676055764936)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,aaa,1676055767944.ea671e7088d3fe84e68b3d345289fe97. completed. 2023-02-10 19:02:51,495 DEBUG [rs(jenkins-hbase4.apache.org,43623,1676055764936)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,aaa,1676055767944.ea671e7088d3fe84e68b3d345289fe97. 2023-02-10 19:02:51,495 DEBUG [member: 'jenkins-hbase4.apache.org,43623,1676055764936' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 4/5 local region snapshots. 2023-02-10 19:02:51,501 INFO [rs(jenkins-hbase4.apache.org,43337,1676055764986)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/data/default/testWithMapReduce/52e916374c45f2d5119804d8db34ffe7/f1/7046e04cad38425f93b18e9cdf97792a, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-10 19:02:51,502 DEBUG [rs(jenkins-hbase4.apache.org,43337,1676055764986)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/data/default/testWithMapReduce/52e916374c45f2d5119804d8db34ffe7/.tmp/f2/9cd807e0a98e4c4091980728d6f09bfa as hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/data/default/testWithMapReduce/52e916374c45f2d5119804d8db34ffe7/f2/9cd807e0a98e4c4091980728d6f09bfa 2023-02-10 19:02:51,512 INFO [rs(jenkins-hbase4.apache.org,43337,1676055764986)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/data/default/testWithMapReduce/52e916374c45f2d5119804d8db34ffe7/f2/9cd807e0a98e4c4091980728d6f09bfa, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-10 19:02:51,513 INFO [rs(jenkins-hbase4.apache.org,43337,1676055764986)-snapshot-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 52e916374c45f2d5119804d8db34ffe7 in 630ms, sequenceid=5, compaction requested=false 2023-02-10 19:02:51,513 DEBUG [rs(jenkins-hbase4.apache.org,43337,1676055764986)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for 52e916374c45f2d5119804d8db34ffe7: 2023-02-10 19:02:51,513 DEBUG [rs(jenkins-hbase4.apache.org,43337,1676055764986)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,t43,1676055767944.52e916374c45f2d5119804d8db34ffe7.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-10 19:02:51,513 DEBUG [rs(jenkins-hbase4.apache.org,43337,1676055764986)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-10 19:02:51,513 DEBUG [rs(jenkins-hbase4.apache.org,43337,1676055764986)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/data/default/testWithMapReduce/52e916374c45f2d5119804d8db34ffe7/f1/7046e04cad38425f93b18e9cdf97792a] hfiles 2023-02-10 19:02:51,513 DEBUG [rs(jenkins-hbase4.apache.org,43337,1676055764986)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/data/default/testWithMapReduce/52e916374c45f2d5119804d8db34ffe7/f1/7046e04cad38425f93b18e9cdf97792a for snapshot=testWithMapReduceMultiRegion 2023-02-10 19:02:51,513 DEBUG [rs(jenkins-hbase4.apache.org,43337,1676055764986)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/data/default/testWithMapReduce/52e916374c45f2d5119804d8db34ffe7/f2/9cd807e0a98e4c4091980728d6f09bfa] hfiles 2023-02-10 19:02:51,513 DEBUG [rs(jenkins-hbase4.apache.org,43337,1676055764986)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/data/default/testWithMapReduce/52e916374c45f2d5119804d8db34ffe7/f2/9cd807e0a98e4c4091980728d6f09bfa for snapshot=testWithMapReduceMultiRegion 2023-02-10 19:02:51,815 INFO [rs(jenkins-hbase4.apache.org,43623,1676055764936)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/data/default/testWithMapReduce/0b68bcec2ca2391d28b6290c561e3332/.tmp/f1/d13fb7a00ef748458b03332cd6a3c8d6 2023-02-10 19:02:51,838 DEBUG [Listener at localhost/32909] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-10 19:02:51,840 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41145] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-10 19:02:51,840 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41145] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-10 19:02:51,840 INFO [rs(jenkins-hbase4.apache.org,43623,1676055764936)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/data/default/testWithMapReduce/0b68bcec2ca2391d28b6290c561e3332/.tmp/f2/62c542c2d8914d098b3c5d2ac43084a1 2023-02-10 19:02:51,840 DEBUG [Listener at localhost/32909] client.HBaseAdmin(2428): (#5) Sleeping: 1000ms while waiting for snapshot completion. 2023-02-10 19:02:51,848 DEBUG [rs(jenkins-hbase4.apache.org,43623,1676055764936)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/data/default/testWithMapReduce/0b68bcec2ca2391d28b6290c561e3332/.tmp/f1/d13fb7a00ef748458b03332cd6a3c8d6 as hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/data/default/testWithMapReduce/0b68bcec2ca2391d28b6290c561e3332/f1/d13fb7a00ef748458b03332cd6a3c8d6 2023-02-10 19:02:51,855 INFO [rs(jenkins-hbase4.apache.org,43623,1676055764936)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/data/default/testWithMapReduce/0b68bcec2ca2391d28b6290c561e3332/f1/d13fb7a00ef748458b03332cd6a3c8d6, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-10 19:02:51,856 DEBUG [rs(jenkins-hbase4.apache.org,43623,1676055764936)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/data/default/testWithMapReduce/0b68bcec2ca2391d28b6290c561e3332/.tmp/f2/62c542c2d8914d098b3c5d2ac43084a1 as hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/data/default/testWithMapReduce/0b68bcec2ca2391d28b6290c561e3332/f2/62c542c2d8914d098b3c5d2ac43084a1 2023-02-10 19:02:51,864 INFO [rs(jenkins-hbase4.apache.org,43623,1676055764936)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/data/default/testWithMapReduce/0b68bcec2ca2391d28b6290c561e3332/f2/62c542c2d8914d098b3c5d2ac43084a1, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-10 19:02:51,866 INFO [rs(jenkins-hbase4.apache.org,43623,1676055764936)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 0b68bcec2ca2391d28b6290c561e3332 in 561ms, sequenceid=5, compaction requested=false 2023-02-10 19:02:51,866 DEBUG [rs(jenkins-hbase4.apache.org,43623,1676055764936)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 0b68bcec2ca2391d28b6290c561e3332: 2023-02-10 19:02:51,866 DEBUG [rs(jenkins-hbase4.apache.org,43623,1676055764936)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,g\xA7\xA7,1676055767944.0b68bcec2ca2391d28b6290c561e3332.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-10 19:02:51,866 DEBUG [rs(jenkins-hbase4.apache.org,43623,1676055764936)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-10 19:02:51,866 DEBUG [rs(jenkins-hbase4.apache.org,43623,1676055764936)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/data/default/testWithMapReduce/0b68bcec2ca2391d28b6290c561e3332/f1/d13fb7a00ef748458b03332cd6a3c8d6] hfiles 2023-02-10 19:02:51,866 DEBUG [rs(jenkins-hbase4.apache.org,43623,1676055764936)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/data/default/testWithMapReduce/0b68bcec2ca2391d28b6290c561e3332/f1/d13fb7a00ef748458b03332cd6a3c8d6 for snapshot=testWithMapReduceMultiRegion 2023-02-10 19:02:51,866 DEBUG [rs(jenkins-hbase4.apache.org,43623,1676055764936)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/data/default/testWithMapReduce/0b68bcec2ca2391d28b6290c561e3332/f2/62c542c2d8914d098b3c5d2ac43084a1] hfiles 2023-02-10 19:02:51,866 DEBUG [rs(jenkins-hbase4.apache.org,43623,1676055764936)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/data/default/testWithMapReduce/0b68bcec2ca2391d28b6290c561e3332/f2/62c542c2d8914d098b3c5d2ac43084a1 for snapshot=testWithMapReduceMultiRegion 2023-02-10 19:02:51,875 DEBUG [rs(jenkins-hbase4.apache.org,43623,1676055764936)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,g\xA7\xA7,1676055767944.0b68bcec2ca2391d28b6290c561e3332. completed. 2023-02-10 19:02:51,875 DEBUG [rs(jenkins-hbase4.apache.org,43623,1676055764936)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,g\xA7\xA7,1676055767944.0b68bcec2ca2391d28b6290c561e3332. 2023-02-10 19:02:51,875 DEBUG [member: 'jenkins-hbase4.apache.org,43623,1676055764936' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 5/5 local region snapshots. 2023-02-10 19:02:51,875 DEBUG [member: 'jenkins-hbase4.apache.org,43623,1676055764936' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 5 local region snapshots. 2023-02-10 19:02:51,875 DEBUG [member: 'jenkins-hbase4.apache.org,43623,1676055764936' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,43623,1676055764936 2023-02-10 19:02:51,875 DEBUG [member: 'jenkins-hbase4.apache.org,43623,1676055764936' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduceMultiRegion' locally completed 2023-02-10 19:02:51,875 DEBUG [member: 'jenkins-hbase4.apache.org,43623,1676055764936' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduceMultiRegion' completed for member 'jenkins-hbase4.apache.org,43623,1676055764936' in zk 2023-02-10 19:02:51,880 DEBUG [Listener at localhost/32909-EventThread] zookeeper.ZKWatcher(600): master:41145-0x1003f9d40a30000, quorum=127.0.0.1:63334, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,43623,1676055764936 2023-02-10 19:02:51,880 DEBUG [member: 'jenkins-hbase4.apache.org,43623,1676055764936' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduceMultiRegion' has notified controller of completion 2023-02-10 19:02:51,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,43623,1676055764936 2023-02-10 19:02:51,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-10 19:02:51,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-10 19:02:51,880 DEBUG [member: 'jenkins-hbase4.apache.org,43623,1676055764936' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-10 19:02:51,880 DEBUG [member: 'jenkins-hbase4.apache.org,43623,1676055764936' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduceMultiRegion' completed. 2023-02-10 19:02:51,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-10 19:02:51,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-10 19:02:51,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-10 19:02:51,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43623,1676055764936 2023-02-10 19:02:51,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43337,1676055764986 2023-02-10 19:02:51,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-10 19:02:51,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-10 19:02:51,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43623,1676055764936 2023-02-10 19:02:51,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduceMultiRegion' member 'jenkins-hbase4.apache.org,43623,1676055764936': 2023-02-10 19:02:51,885 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43623,1676055764936' released barrier for procedure'testWithMapReduceMultiRegion', counting down latch. Waiting for 1 more 2023-02-10 19:02:51,930 DEBUG [rs(jenkins-hbase4.apache.org,43337,1676055764986)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,t43,1676055767944.52e916374c45f2d5119804d8db34ffe7. completed. 2023-02-10 19:02:51,931 DEBUG [rs(jenkins-hbase4.apache.org,43337,1676055764986)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,t43,1676055767944.52e916374c45f2d5119804d8db34ffe7. 2023-02-10 19:02:51,931 DEBUG [member: 'jenkins-hbase4.apache.org,43337,1676055764986' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 5/5 local region snapshots. 2023-02-10 19:02:51,931 DEBUG [member: 'jenkins-hbase4.apache.org,43337,1676055764986' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 5 local region snapshots. 2023-02-10 19:02:51,931 DEBUG [member: 'jenkins-hbase4.apache.org,43337,1676055764986' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,43337,1676055764986 2023-02-10 19:02:51,931 DEBUG [member: 'jenkins-hbase4.apache.org,43337,1676055764986' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduceMultiRegion' locally completed 2023-02-10 19:02:51,931 DEBUG [member: 'jenkins-hbase4.apache.org,43337,1676055764986' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduceMultiRegion' completed for member 'jenkins-hbase4.apache.org,43337,1676055764986' in zk 2023-02-10 19:02:51,933 DEBUG [member: 'jenkins-hbase4.apache.org,43337,1676055764986' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduceMultiRegion' has notified controller of completion 2023-02-10 19:02:51,933 DEBUG [Listener at localhost/32909-EventThread] zookeeper.ZKWatcher(600): master:41145-0x1003f9d40a30000, quorum=127.0.0.1:63334, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,43337,1676055764986 2023-02-10 19:02:51,933 DEBUG [member: 'jenkins-hbase4.apache.org,43337,1676055764986' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-10 19:02:51,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,43337,1676055764986 2023-02-10 19:02:51,934 DEBUG [member: 'jenkins-hbase4.apache.org,43337,1676055764986' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduceMultiRegion' completed. 2023-02-10 19:02:51,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-10 19:02:51,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-10 19:02:51,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-10 19:02:51,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-10 19:02:51,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-10 19:02:51,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43623,1676055764936 2023-02-10 19:02:51,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43337,1676055764986 2023-02-10 19:02:51,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-10 19:02:51,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-10 19:02:51,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43623,1676055764936 2023-02-10 19:02:51,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43337,1676055764986 2023-02-10 19:02:51,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduceMultiRegion' member 'jenkins-hbase4.apache.org,43337,1676055764986': 2023-02-10 19:02:51,939 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43337,1676055764986' released barrier for procedure'testWithMapReduceMultiRegion', counting down latch. Waiting for 0 more 2023-02-10 19:02:51,939 INFO [(jenkins-hbase4.apache.org,41145,1676055763642)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMapReduceMultiRegion' execution completed 2023-02-10 19:02:51,939 DEBUG [(jenkins-hbase4.apache.org,41145,1676055763642)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-10 19:02:51,939 DEBUG [(jenkins-hbase4.apache.org,41145,1676055763642)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-10 19:02:51,939 DEBUG [(jenkins-hbase4.apache.org,41145,1676055763642)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMapReduceMultiRegion 2023-02-10 19:02:51,939 INFO [(jenkins-hbase4.apache.org,41145,1676055763642)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMapReduceMultiRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-02-10 19:02:51,942 DEBUG [Listener at localhost/32909-EventThread] zookeeper.ZKWatcher(600): regionserver:43623-0x1003f9d40a30001, quorum=127.0.0.1:63334, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-10 19:02:51,942 DEBUG [Listener at localhost/32909-EventThread] zookeeper.ZKWatcher(600): regionserver:43337-0x1003f9d40a30002, quorum=127.0.0.1:63334, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-10 19:02:51,943 DEBUG [Listener at localhost/32909-EventThread] zookeeper.ZKWatcher(600): regionserver:43337-0x1003f9d40a30002, quorum=127.0.0.1:63334, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-10 19:02:51,943 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-10 19:02:51,943 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-10 19:02:51,943 DEBUG [Listener at localhost/32909-EventThread] zookeeper.ZKWatcher(600): regionserver:43623-0x1003f9d40a30001, quorum=127.0.0.1:63334, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-10 19:02:51,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-10 19:02:51,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-10 19:02:51,943 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-10 19:02:51,943 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-10 19:02:51,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-10 19:02:51,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-10 19:02:51,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-10 19:02:51,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-10 19:02:51,948 DEBUG [Listener at localhost/32909-EventThread] zookeeper.ZKWatcher(600): master:41145-0x1003f9d40a30000, quorum=127.0.0.1:63334, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-10 19:02:51,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-10 19:02:51,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-10 19:02:51,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-10 19:02:51,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-10 19:02:51,949 DEBUG [(jenkins-hbase4.apache.org,41145,1676055763642)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41145-0x1003f9d40a30000, quorum=127.0.0.1:63334, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,43623,1676055764936 2023-02-10 19:02:51,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-10 19:02:51,949 DEBUG [(jenkins-hbase4.apache.org,41145,1676055763642)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41145-0x1003f9d40a30000, quorum=127.0.0.1:63334, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,43337,1676055764986 2023-02-10 19:02:51,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-10 19:02:51,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-10 19:02:51,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43623,1676055764936 2023-02-10 19:02:51,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43337,1676055764986 2023-02-10 19:02:51,951 DEBUG [(jenkins-hbase4.apache.org,41145,1676055763642)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41145-0x1003f9d40a30000, quorum=127.0.0.1:63334, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,43623,1676055764936 2023-02-10 19:02:51,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-10 19:02:51,952 DEBUG [(jenkins-hbase4.apache.org,41145,1676055763642)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41145-0x1003f9d40a30000, quorum=127.0.0.1:63334, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,43337,1676055764986 2023-02-10 19:02:51,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-10 19:02:51,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43623,1676055764936 2023-02-10 19:02:51,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43337,1676055764986 2023-02-10 19:02:51,970 DEBUG [Listener at localhost/32909-EventThread] zookeeper.ZKWatcher(600): master:41145-0x1003f9d40a30000, quorum=127.0.0.1:63334, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,43337,1676055764986 2023-02-10 19:02:51,971 DEBUG [Listener at localhost/32909-EventThread] zookeeper.ZKWatcher(600): master:41145-0x1003f9d40a30000, quorum=127.0.0.1:63334, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion 2023-02-10 19:02:51,971 DEBUG [Listener at localhost/32909-EventThread] zookeeper.ZKWatcher(600): regionserver:43337-0x1003f9d40a30002, quorum=127.0.0.1:63334, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-10 19:02:51,971 DEBUG [Listener at localhost/32909-EventThread] zookeeper.ZKWatcher(600): master:41145-0x1003f9d40a30000, quorum=127.0.0.1:63334, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,43623,1676055764936 2023-02-10 19:02:51,971 DEBUG [Listener at localhost/32909-EventThread] zookeeper.ZKWatcher(600): regionserver:43623-0x1003f9d40a30001, quorum=127.0.0.1:63334, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-10 19:02:51,971 DEBUG [Listener at localhost/32909-EventThread] zookeeper.ZKWatcher(600): regionserver:43337-0x1003f9d40a30002, quorum=127.0.0.1:63334, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-10 19:02:51,971 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-10 19:02:51,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-10 19:02:51,971 DEBUG [Listener at localhost/32909-EventThread] zookeeper.ZKWatcher(600): regionserver:43623-0x1003f9d40a30001, quorum=127.0.0.1:63334, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-10 19:02:51,971 DEBUG [Listener at localhost/32909-EventThread] zookeeper.ZKWatcher(600): master:41145-0x1003f9d40a30000, quorum=127.0.0.1:63334, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion 2023-02-10 19:02:51,971 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-10 19:02:51,971 DEBUG [Listener at localhost/32909-EventThread] zookeeper.ZKWatcher(600): master:41145-0x1003f9d40a30000, quorum=127.0.0.1:63334, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,43337,1676055764986 2023-02-10 19:02:51,971 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for testWithMapReduceMultiRegion 2023-02-10 19:02:51,971 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-10 19:02:51,971 DEBUG [(jenkins-hbase4.apache.org,41145,1676055763642)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-10 19:02:51,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-10 19:02:51,971 DEBUG [Listener at localhost/32909-EventThread] zookeeper.ZKWatcher(600): master:41145-0x1003f9d40a30000, quorum=127.0.0.1:63334, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-10 19:02:51,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-10 19:02:51,972 DEBUG [Listener at localhost/32909-EventThread] zookeeper.ZKWatcher(600): master:41145-0x1003f9d40a30000, quorum=127.0.0.1:63334, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,43623,1676055764936 2023-02-10 19:02:51,972 DEBUG [Listener at localhost/32909-EventThread] zookeeper.ZKWatcher(600): master:41145-0x1003f9d40a30000, quorum=127.0.0.1:63334, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-10 19:02:51,972 DEBUG [Listener at localhost/32909-EventThread] zookeeper.ZKWatcher(600): master:41145-0x1003f9d40a30000, quorum=127.0.0.1:63334, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-10 19:02:51,972 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for testWithMapReduceMultiRegion 2023-02-10 19:02:51,975 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-10 19:02:51,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-10 19:02:51,976 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/.hbase-snapshot/.tmp/testWithMapReduceMultiRegion 2023-02-10 19:02:52,066 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/.hbase-snapshot/.tmp/testWithMapReduceMultiRegion to hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/.hbase-snapshot/testWithMapReduceMultiRegion 2023-02-10 19:02:52,104 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot testWithMapReduceMultiRegion of table testWithMapReduce completed 2023-02-10 19:02:52,105 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/.hbase-snapshot/.tmp/testWithMapReduceMultiRegion 2023-02-10 19:02:52,105 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/.hbase-snapshot/.tmp/testWithMapReduceMultiRegion 2023-02-10 19:02:52,105 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot testWithMapReduceMultiRegion C_M_SNAPSHOT_TABLE on table testWithMapReduce at 1676055770719Consolidate snapshot: testWithMapReduceMultiRegion at 1676055771972 (+1253 ms)Loading Region manifests for testWithMapReduceMultiRegion at 1676055771973 (+1 ms)Writing data manifest for testWithMapReduceMultiRegion at 1676055772003 (+30 ms)Verifying snapshot: testWithMapReduceMultiRegion at 1676055772027 (+24 ms)Snapshot testWithMapReduceMultiRegion of table testWithMapReduce completed at 1676055772104 (+77 ms) 2023-02-10 19:02:52,107 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=32, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-10 19:02:52,109 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=32, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED in 1.3860 sec 2023-02-10 19:02:52,314 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-02-10 19:02:52,378 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-02-10 19:02:52,379 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-02-10 19:02:52,841 DEBUG [Listener at localhost/32909] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-10 19:02:52,842 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41145] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-10 19:02:52,842 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41145] snapshot.SnapshotManager(401): Snapshot '{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' has completed, notifying client. 2023-02-10 19:02:52,843 INFO [Listener at localhost/32909] snapshot.SnapshotTestingUtils(399): Confirming snapshot exists. 2023-02-10 19:02:52,855 INFO [Listener at localhost/32909] snapshot.SnapshotTestingUtils(406): validating snapshot. 2023-02-10 19:02:52,867 INFO [Listener at localhost/32909] mapreduce.TableSnapshotInputFormatTestBase(218): load different values 2023-02-10 19:02:52,916 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43337] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 6084 Client: jenkins//172.31.14.131 first region in multi=testWithMapReduce,d\x84\x84,1676055767944.b5248077ace761a2c5d43c344f646651. 2023-02-10 19:02:52,929 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43623] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 11492 Client: jenkins//172.31.14.131 first region in multi=testWithMapReduce,aaa,1676055767944.ea671e7088d3fe84e68b3d345289fe97. 2023-02-10 19:02:53,070 INFO [Listener at localhost/32909] mapreduce.TableSnapshotInputFormatTestBase(222): cause flush to create new files in the region 2023-02-10 19:02:53,084 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41145] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-10 19:02:53,090 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41145] procedure.ProcedureCoordinator(165): Submitting procedure testWithMapReduce 2023-02-10 19:02:53,090 INFO [(jenkins-hbase4.apache.org,41145,1676055763642)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMapReduce' 2023-02-10 19:02:53,091 DEBUG [(jenkins-hbase4.apache.org,41145,1676055763642)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-10 19:02:53,091 DEBUG [(jenkins-hbase4.apache.org,41145,1676055763642)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMapReduce' starting 'acquire' 2023-02-10 19:02:53,091 DEBUG [(jenkins-hbase4.apache.org,41145,1676055763642)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMapReduce', kicking off acquire phase on members. 2023-02-10 19:02:53,092 DEBUG [(jenkins-hbase4.apache.org,41145,1676055763642)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41145-0x1003f9d40a30000, quorum=127.0.0.1:63334, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-10 19:02:53,092 DEBUG [(jenkins-hbase4.apache.org,41145,1676055763642)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-10 19:02:53,093 DEBUG [(jenkins-hbase4.apache.org,41145,1676055763642)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,43337,1676055764986 2023-02-10 19:02:53,093 DEBUG [Listener at localhost/32909-EventThread] zookeeper.ZKWatcher(600): regionserver:43337-0x1003f9d40a30002, quorum=127.0.0.1:63334, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-10 19:02:53,093 DEBUG [Listener at localhost/32909-EventThread] zookeeper.ZKWatcher(600): regionserver:43623-0x1003f9d40a30001, quorum=127.0.0.1:63334, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-10 19:02:53,094 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-10 19:02:53,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-10 19:02:53,094 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-10 19:02:53,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-10 19:02:53,094 DEBUG [(jenkins-hbase4.apache.org,41145,1676055763642)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41145-0x1003f9d40a30000, quorum=127.0.0.1:63334, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,43337,1676055764986 2023-02-10 19:02:53,094 DEBUG [(jenkins-hbase4.apache.org,41145,1676055763642)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,43623,1676055764936 2023-02-10 19:02:53,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-10 19:02:53,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-10 19:02:53,095 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43337-0x1003f9d40a30002, quorum=127.0.0.1:63334, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-10 19:02:53,095 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43623-0x1003f9d40a30001, quorum=127.0.0.1:63334, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-10 19:02:53,095 DEBUG [(jenkins-hbase4.apache.org,41145,1676055763642)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41145-0x1003f9d40a30000, quorum=127.0.0.1:63334, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,43623,1676055764936 2023-02-10 19:02:53,095 DEBUG [(jenkins-hbase4.apache.org,41145,1676055763642)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-10 19:02:53,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-10 19:02:53,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-10 19:02:53,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-10 19:02:53,096 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMapReduce 2023-02-10 19:02:53,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-10 19:02:53,096 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMapReduce 2023-02-10 19:02:53,097 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduce 2023-02-10 19:02:53,097 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduce 2023-02-10 19:02:53,100 DEBUG [member: 'jenkins-hbase4.apache.org,43337,1676055764986' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduce' with timeout 60000ms 2023-02-10 19:02:53,100 DEBUG [member: 'jenkins-hbase4.apache.org,43337,1676055764986' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-10 19:02:53,100 DEBUG [member: 'jenkins-hbase4.apache.org,43337,1676055764986' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduce' starting 'acquire' stage 2023-02-10 19:02:53,101 DEBUG [member: 'jenkins-hbase4.apache.org,43623,1676055764936' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduce' with timeout 60000ms 2023-02-10 19:02:53,101 DEBUG [member: 'jenkins-hbase4.apache.org,43623,1676055764936' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-10 19:02:53,101 DEBUG [member: 'jenkins-hbase4.apache.org,43623,1676055764936' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduce' starting 'acquire' stage 2023-02-10 19:02:53,102 DEBUG [rs(jenkins-hbase4.apache.org,43623,1676055764936)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,q\x11\x10,1676055767944.07dbe2f766a0b8b265d0439c26307ef7. 2023-02-10 19:02:53,102 DEBUG [rs(jenkins-hbase4.apache.org,43623,1676055764936)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,q\x11\x10,1676055767944.07dbe2f766a0b8b265d0439c26307ef7. started... 2023-02-10 19:02:53,103 INFO [rs(jenkins-hbase4.apache.org,43623,1676055764936)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 07dbe2f766a0b8b265d0439c26307ef7 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-10 19:02:53,104 DEBUG [rs(jenkins-hbase4.apache.org,43337,1676055764986)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,d\x84\x84,1676055767944.b5248077ace761a2c5d43c344f646651. 2023-02-10 19:02:53,104 DEBUG [rs(jenkins-hbase4.apache.org,43337,1676055764986)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,d\x84\x84,1676055767944.b5248077ace761a2c5d43c344f646651. started... 2023-02-10 19:02:53,104 DEBUG [rs(jenkins-hbase4.apache.org,43337,1676055764986)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,j\xCA\xCA,1676055767944.053dc7037d94e17f3f72f5ea563ab135. 2023-02-10 19:02:53,104 DEBUG [rs(jenkins-hbase4.apache.org,43623,1676055764936)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,wWV,1676055767944.cca73b62b14aebcd72ce9f0317bde286. 2023-02-10 19:02:53,104 INFO [rs(jenkins-hbase4.apache.org,43337,1676055764986)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing b5248077ace761a2c5d43c344f646651 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-10 19:02:53,104 DEBUG [rs(jenkins-hbase4.apache.org,43337,1676055764986)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,j\xCA\xCA,1676055767944.053dc7037d94e17f3f72f5ea563ab135. started... 2023-02-10 19:02:53,104 DEBUG [rs(jenkins-hbase4.apache.org,43623,1676055764936)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,wWV,1676055767944.cca73b62b14aebcd72ce9f0317bde286. started... 2023-02-10 19:02:53,104 INFO [rs(jenkins-hbase4.apache.org,43337,1676055764986)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 053dc7037d94e17f3f72f5ea563ab135 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-10 19:02:53,104 INFO [rs(jenkins-hbase4.apache.org,43623,1676055764936)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing cca73b62b14aebcd72ce9f0317bde286 2/2 column families, dataSize=248.22 KB heapSize=634.25 KB 2023-02-10 19:02:53,108 DEBUG [member: 'jenkins-hbase4.apache.org,43337,1676055764986' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 5 regions 2023-02-10 19:02:53,109 DEBUG [member: 'jenkins-hbase4.apache.org,43623,1676055764936' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 5 regions 2023-02-10 19:02:53,109 DEBUG [member: 'jenkins-hbase4.apache.org,43623,1676055764936' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-10 19:02:53,109 DEBUG [member: 'jenkins-hbase4.apache.org,43337,1676055764986' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-10 19:02:53,114 DEBUG [rs(jenkins-hbase4.apache.org,43337,1676055764986)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,,1676055767944.813b88c1d27659129f4a12d3c70b79c7. 2023-02-10 19:02:53,114 DEBUG [rs(jenkins-hbase4.apache.org,43337,1676055764986)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,,1676055767944.813b88c1d27659129f4a12d3c70b79c7. started... 2023-02-10 19:02:53,114 DEBUG [rs(jenkins-hbase4.apache.org,43623,1676055764936)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,m\xED\xED,1676055767944.2abc519a8c9fd6a76400a0e9294c9317. 2023-02-10 19:02:53,114 DEBUG [rs(jenkins-hbase4.apache.org,43623,1676055764936)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,m\xED\xED,1676055767944.2abc519a8c9fd6a76400a0e9294c9317. started... 2023-02-10 19:02:53,114 DEBUG [rs(jenkins-hbase4.apache.org,43337,1676055764986)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 813b88c1d27659129f4a12d3c70b79c7: 2023-02-10 19:02:53,115 DEBUG [rs(jenkins-hbase4.apache.org,43337,1676055764986)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,,1676055767944.813b88c1d27659129f4a12d3c70b79c7. 2023-02-10 19:02:53,115 DEBUG [rs(jenkins-hbase4.apache.org,43337,1676055764986)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,zz{,1676055767944.05d2a877c2d90362a1d4209daff5b54a. 2023-02-10 19:02:53,115 INFO [rs(jenkins-hbase4.apache.org,43623,1676055764936)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 2abc519a8c9fd6a76400a0e9294c9317 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-10 19:02:53,115 DEBUG [rs(jenkins-hbase4.apache.org,43337,1676055764986)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,zz{,1676055767944.05d2a877c2d90362a1d4209daff5b54a. started... 2023-02-10 19:02:53,115 DEBUG [member: 'jenkins-hbase4.apache.org,43337,1676055764986' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/5 local region flush tasks. 2023-02-10 19:02:53,115 DEBUG [rs(jenkins-hbase4.apache.org,43337,1676055764986)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 05d2a877c2d90362a1d4209daff5b54a: 2023-02-10 19:02:53,115 DEBUG [rs(jenkins-hbase4.apache.org,43337,1676055764986)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,zz{,1676055767944.05d2a877c2d90362a1d4209daff5b54a. 2023-02-10 19:02:53,115 DEBUG [rs(jenkins-hbase4.apache.org,43337,1676055764986)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,t43,1676055767944.52e916374c45f2d5119804d8db34ffe7. 2023-02-10 19:02:53,115 DEBUG [member: 'jenkins-hbase4.apache.org,43337,1676055764986' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/5 local region flush tasks. 2023-02-10 19:02:53,115 DEBUG [rs(jenkins-hbase4.apache.org,43337,1676055764986)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,t43,1676055767944.52e916374c45f2d5119804d8db34ffe7. started... 2023-02-10 19:02:53,115 INFO [rs(jenkins-hbase4.apache.org,43337,1676055764986)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 52e916374c45f2d5119804d8db34ffe7 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-10 19:02:53,200 INFO [rs(jenkins-hbase4.apache.org,43337,1676055764986)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/data/default/testWithMapReduce/053dc7037d94e17f3f72f5ea563ab135/.tmp/f1/f795d1efa9254132acf85b0ad72dd294 2023-02-10 19:02:53,201 INFO [rs(jenkins-hbase4.apache.org,43623,1676055764936)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/data/default/testWithMapReduce/07dbe2f766a0b8b265d0439c26307ef7/.tmp/f1/01bc21d694ca4861bce7970bc4592462 2023-02-10 19:02:53,201 INFO [rs(jenkins-hbase4.apache.org,43337,1676055764986)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/data/default/testWithMapReduce/b5248077ace761a2c5d43c344f646651/.tmp/f1/6c1788f5219e46cebb9f819da3c12bc9 2023-02-10 19:02:53,209 INFO [rs(jenkins-hbase4.apache.org,43623,1676055764936)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/data/default/testWithMapReduce/2abc519a8c9fd6a76400a0e9294c9317/.tmp/f1/1e73f571f2fb4538bf0058ab7be51d9f 2023-02-10 19:02:53,212 INFO [rs(jenkins-hbase4.apache.org,43337,1676055764986)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/data/default/testWithMapReduce/52e916374c45f2d5119804d8db34ffe7/.tmp/f1/3645d6a50d4e40c29a3e54e0b3ec7817 2023-02-10 19:02:53,213 INFO [rs(jenkins-hbase4.apache.org,43623,1676055764936)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/data/default/testWithMapReduce/cca73b62b14aebcd72ce9f0317bde286/.tmp/f1/523a73fd51c843b0a3e8a0db93bd953c 2023-02-10 19:02:53,273 INFO [rs(jenkins-hbase4.apache.org,43623,1676055764936)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/data/default/testWithMapReduce/2abc519a8c9fd6a76400a0e9294c9317/.tmp/f2/39bc8652d07c454dad3031cb6bda2dfb 2023-02-10 19:02:53,277 INFO [rs(jenkins-hbase4.apache.org,43337,1676055764986)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/data/default/testWithMapReduce/b5248077ace761a2c5d43c344f646651/.tmp/f2/96c8b0a7f07049989a5df57a6e3d7d91 2023-02-10 19:02:53,283 DEBUG [rs(jenkins-hbase4.apache.org,43623,1676055764936)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/data/default/testWithMapReduce/2abc519a8c9fd6a76400a0e9294c9317/.tmp/f1/1e73f571f2fb4538bf0058ab7be51d9f as hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/data/default/testWithMapReduce/2abc519a8c9fd6a76400a0e9294c9317/f1/1e73f571f2fb4538bf0058ab7be51d9f 2023-02-10 19:02:53,287 DEBUG [rs(jenkins-hbase4.apache.org,43337,1676055764986)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/data/default/testWithMapReduce/b5248077ace761a2c5d43c344f646651/.tmp/f1/6c1788f5219e46cebb9f819da3c12bc9 as hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/data/default/testWithMapReduce/b5248077ace761a2c5d43c344f646651/f1/6c1788f5219e46cebb9f819da3c12bc9 2023-02-10 19:02:53,291 INFO [rs(jenkins-hbase4.apache.org,43337,1676055764986)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/data/default/testWithMapReduce/053dc7037d94e17f3f72f5ea563ab135/.tmp/f2/27b372f4c63c4bd98cfe88becc9d062e 2023-02-10 19:02:53,292 INFO [rs(jenkins-hbase4.apache.org,43623,1676055764936)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/data/default/testWithMapReduce/2abc519a8c9fd6a76400a0e9294c9317/f1/1e73f571f2fb4538bf0058ab7be51d9f, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-10 19:02:53,294 DEBUG [rs(jenkins-hbase4.apache.org,43623,1676055764936)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/data/default/testWithMapReduce/2abc519a8c9fd6a76400a0e9294c9317/.tmp/f2/39bc8652d07c454dad3031cb6bda2dfb as hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/data/default/testWithMapReduce/2abc519a8c9fd6a76400a0e9294c9317/f2/39bc8652d07c454dad3031cb6bda2dfb 2023-02-10 19:02:53,295 INFO [rs(jenkins-hbase4.apache.org,43337,1676055764986)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/data/default/testWithMapReduce/52e916374c45f2d5119804d8db34ffe7/.tmp/f2/1488a087f4594f8ca23f1bbb12554feb 2023-02-10 19:02:53,298 INFO [rs(jenkins-hbase4.apache.org,43337,1676055764986)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/data/default/testWithMapReduce/b5248077ace761a2c5d43c344f646651/f1/6c1788f5219e46cebb9f819da3c12bc9, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-10 19:02:53,302 INFO [rs(jenkins-hbase4.apache.org,43623,1676055764936)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/data/default/testWithMapReduce/2abc519a8c9fd6a76400a0e9294c9317/f2/39bc8652d07c454dad3031cb6bda2dfb, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-10 19:02:53,303 DEBUG [rs(jenkins-hbase4.apache.org,43337,1676055764986)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/data/default/testWithMapReduce/b5248077ace761a2c5d43c344f646651/.tmp/f2/96c8b0a7f07049989a5df57a6e3d7d91 as hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/data/default/testWithMapReduce/b5248077ace761a2c5d43c344f646651/f2/96c8b0a7f07049989a5df57a6e3d7d91 2023-02-10 19:02:53,304 INFO [rs(jenkins-hbase4.apache.org,43623,1676055764936)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 2abc519a8c9fd6a76400a0e9294c9317 in 190ms, sequenceid=9, compaction requested=false 2023-02-10 19:02:53,304 DEBUG [rs(jenkins-hbase4.apache.org,43623,1676055764936)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 2abc519a8c9fd6a76400a0e9294c9317: 2023-02-10 19:02:53,304 DEBUG [rs(jenkins-hbase4.apache.org,43623,1676055764936)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,m\xED\xED,1676055767944.2abc519a8c9fd6a76400a0e9294c9317. 2023-02-10 19:02:53,305 DEBUG [member: 'jenkins-hbase4.apache.org,43623,1676055764936' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/5 local region flush tasks. 2023-02-10 19:02:53,305 DEBUG [rs(jenkins-hbase4.apache.org,43623,1676055764936)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,aaa,1676055767944.ea671e7088d3fe84e68b3d345289fe97. 2023-02-10 19:02:53,305 DEBUG [rs(jenkins-hbase4.apache.org,43623,1676055764936)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,aaa,1676055767944.ea671e7088d3fe84e68b3d345289fe97. started... 2023-02-10 19:02:53,305 DEBUG [rs(jenkins-hbase4.apache.org,43337,1676055764986)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/data/default/testWithMapReduce/053dc7037d94e17f3f72f5ea563ab135/.tmp/f1/f795d1efa9254132acf85b0ad72dd294 as hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/data/default/testWithMapReduce/053dc7037d94e17f3f72f5ea563ab135/f1/f795d1efa9254132acf85b0ad72dd294 2023-02-10 19:02:53,305 INFO [rs(jenkins-hbase4.apache.org,43623,1676055764936)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing ea671e7088d3fe84e68b3d345289fe97 2/2 column families, dataSize=248.22 KB heapSize=634.25 KB 2023-02-10 19:02:53,306 DEBUG [rs(jenkins-hbase4.apache.org,43337,1676055764986)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/data/default/testWithMapReduce/52e916374c45f2d5119804d8db34ffe7/.tmp/f1/3645d6a50d4e40c29a3e54e0b3ec7817 as hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/data/default/testWithMapReduce/52e916374c45f2d5119804d8db34ffe7/f1/3645d6a50d4e40c29a3e54e0b3ec7817 2023-02-10 19:02:53,317 INFO [rs(jenkins-hbase4.apache.org,43337,1676055764986)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/data/default/testWithMapReduce/b5248077ace761a2c5d43c344f646651/f2/96c8b0a7f07049989a5df57a6e3d7d91, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-10 19:02:53,318 INFO [rs(jenkins-hbase4.apache.org,43337,1676055764986)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/data/default/testWithMapReduce/053dc7037d94e17f3f72f5ea563ab135/f1/f795d1efa9254132acf85b0ad72dd294, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-10 19:02:53,319 INFO [rs(jenkins-hbase4.apache.org,43337,1676055764986)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for b5248077ace761a2c5d43c344f646651 in 214ms, sequenceid=9, compaction requested=false 2023-02-10 19:02:53,319 DEBUG [rs(jenkins-hbase4.apache.org,43337,1676055764986)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for b5248077ace761a2c5d43c344f646651: 2023-02-10 19:02:53,319 DEBUG [rs(jenkins-hbase4.apache.org,43337,1676055764986)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,d\x84\x84,1676055767944.b5248077ace761a2c5d43c344f646651. 2023-02-10 19:02:53,319 INFO [rs(jenkins-hbase4.apache.org,43337,1676055764986)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/data/default/testWithMapReduce/52e916374c45f2d5119804d8db34ffe7/f1/3645d6a50d4e40c29a3e54e0b3ec7817, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-10 19:02:53,319 DEBUG [member: 'jenkins-hbase4.apache.org,43337,1676055764986' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/5 local region flush tasks. 2023-02-10 19:02:53,320 DEBUG [rs(jenkins-hbase4.apache.org,43337,1676055764986)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/data/default/testWithMapReduce/053dc7037d94e17f3f72f5ea563ab135/.tmp/f2/27b372f4c63c4bd98cfe88becc9d062e as hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/data/default/testWithMapReduce/053dc7037d94e17f3f72f5ea563ab135/f2/27b372f4c63c4bd98cfe88becc9d062e 2023-02-10 19:02:53,321 DEBUG [rs(jenkins-hbase4.apache.org,43337,1676055764986)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/data/default/testWithMapReduce/52e916374c45f2d5119804d8db34ffe7/.tmp/f2/1488a087f4594f8ca23f1bbb12554feb as hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/data/default/testWithMapReduce/52e916374c45f2d5119804d8db34ffe7/f2/1488a087f4594f8ca23f1bbb12554feb 2023-02-10 19:02:53,330 INFO [rs(jenkins-hbase4.apache.org,43337,1676055764986)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/data/default/testWithMapReduce/053dc7037d94e17f3f72f5ea563ab135/f2/27b372f4c63c4bd98cfe88becc9d062e, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-10 19:02:53,332 INFO [rs(jenkins-hbase4.apache.org,43337,1676055764986)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 053dc7037d94e17f3f72f5ea563ab135 in 228ms, sequenceid=9, compaction requested=false 2023-02-10 19:02:53,332 DEBUG [rs(jenkins-hbase4.apache.org,43337,1676055764986)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 053dc7037d94e17f3f72f5ea563ab135: 2023-02-10 19:02:53,332 DEBUG [rs(jenkins-hbase4.apache.org,43337,1676055764986)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,j\xCA\xCA,1676055767944.053dc7037d94e17f3f72f5ea563ab135. 2023-02-10 19:02:53,332 DEBUG [member: 'jenkins-hbase4.apache.org,43337,1676055764986' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 4/5 local region flush tasks. 2023-02-10 19:02:53,336 INFO [rs(jenkins-hbase4.apache.org,43623,1676055764936)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/data/default/testWithMapReduce/ea671e7088d3fe84e68b3d345289fe97/.tmp/f1/2641d8bc11d64e8eb33c35377da94d3a 2023-02-10 19:02:53,337 INFO [rs(jenkins-hbase4.apache.org,43337,1676055764986)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/data/default/testWithMapReduce/52e916374c45f2d5119804d8db34ffe7/f2/1488a087f4594f8ca23f1bbb12554feb, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-10 19:02:53,338 INFO [rs(jenkins-hbase4.apache.org,43337,1676055764986)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 52e916374c45f2d5119804d8db34ffe7 in 223ms, sequenceid=9, compaction requested=false 2023-02-10 19:02:53,339 DEBUG [rs(jenkins-hbase4.apache.org,43337,1676055764986)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 52e916374c45f2d5119804d8db34ffe7: 2023-02-10 19:02:53,339 DEBUG [rs(jenkins-hbase4.apache.org,43337,1676055764986)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,t43,1676055767944.52e916374c45f2d5119804d8db34ffe7. 2023-02-10 19:02:53,339 DEBUG [member: 'jenkins-hbase4.apache.org,43337,1676055764986' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 5/5 local region flush tasks. 2023-02-10 19:02:53,339 DEBUG [member: 'jenkins-hbase4.apache.org,43337,1676055764986' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 5 local region flush tasks. 2023-02-10 19:02:53,339 DEBUG [member: 'jenkins-hbase4.apache.org,43337,1676055764986' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43337,1676055764986 2023-02-10 19:02:53,339 DEBUG [member: 'jenkins-hbase4.apache.org,43337,1676055764986' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduce' locally acquired 2023-02-10 19:02:53,339 DEBUG [member: 'jenkins-hbase4.apache.org,43337,1676055764986' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43337,1676055764986' joining acquired barrier for procedure (testWithMapReduce) in zk 2023-02-10 19:02:53,342 DEBUG [Listener at localhost/32909-EventThread] zookeeper.ZKWatcher(600): master:41145-0x1003f9d40a30000, quorum=127.0.0.1:63334, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,43337,1676055764986 2023-02-10 19:02:53,342 DEBUG [member: 'jenkins-hbase4.apache.org,43337,1676055764986' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-10 19:02:53,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,43337,1676055764986 2023-02-10 19:02:53,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-10 19:02:53,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-10 19:02:53,342 DEBUG [member: 'jenkins-hbase4.apache.org,43337,1676055764986' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43337-0x1003f9d40a30002, quorum=127.0.0.1:63334, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce 2023-02-10 19:02:53,342 DEBUG [member: 'jenkins-hbase4.apache.org,43337,1676055764986' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduce' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-10 19:02:53,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-10 19:02:53,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-10 19:02:53,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-10 19:02:53,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43337,1676055764986 2023-02-10 19:02:53,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-10 19:02:53,345 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43337,1676055764986' joining acquired barrier for procedure 'testWithMapReduce' on coordinator 2023-02-10 19:02:53,345 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@54283385[Count = 1] remaining members to acquire global barrier 2023-02-10 19:02:53,357 INFO [rs(jenkins-hbase4.apache.org,43623,1676055764936)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/data/default/testWithMapReduce/ea671e7088d3fe84e68b3d345289fe97/.tmp/f2/95a2d515eabf41419d3cb8d7251f6f0d 2023-02-10 19:02:53,365 DEBUG [rs(jenkins-hbase4.apache.org,43623,1676055764936)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/data/default/testWithMapReduce/ea671e7088d3fe84e68b3d345289fe97/.tmp/f1/2641d8bc11d64e8eb33c35377da94d3a as hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/data/default/testWithMapReduce/ea671e7088d3fe84e68b3d345289fe97/f1/2641d8bc11d64e8eb33c35377da94d3a 2023-02-10 19:02:53,372 INFO [rs(jenkins-hbase4.apache.org,43623,1676055764936)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/data/default/testWithMapReduce/ea671e7088d3fe84e68b3d345289fe97/f1/2641d8bc11d64e8eb33c35377da94d3a, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-10 19:02:53,373 DEBUG [rs(jenkins-hbase4.apache.org,43623,1676055764936)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/data/default/testWithMapReduce/ea671e7088d3fe84e68b3d345289fe97/.tmp/f2/95a2d515eabf41419d3cb8d7251f6f0d as hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/data/default/testWithMapReduce/ea671e7088d3fe84e68b3d345289fe97/f2/95a2d515eabf41419d3cb8d7251f6f0d 2023-02-10 19:02:53,379 INFO [rs(jenkins-hbase4.apache.org,43623,1676055764936)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/data/default/testWithMapReduce/ea671e7088d3fe84e68b3d345289fe97/f2/95a2d515eabf41419d3cb8d7251f6f0d, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-10 19:02:53,381 INFO [rs(jenkins-hbase4.apache.org,43623,1676055764936)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~248.22 KB/254176, heapSize ~634.22 KB/649440, currentSize=0 B/0 for ea671e7088d3fe84e68b3d345289fe97 in 76ms, sequenceid=9, compaction requested=false 2023-02-10 19:02:53,381 DEBUG [rs(jenkins-hbase4.apache.org,43623,1676055764936)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for ea671e7088d3fe84e68b3d345289fe97: 2023-02-10 19:02:53,381 DEBUG [rs(jenkins-hbase4.apache.org,43623,1676055764936)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,aaa,1676055767944.ea671e7088d3fe84e68b3d345289fe97. 2023-02-10 19:02:53,381 DEBUG [rs(jenkins-hbase4.apache.org,43623,1676055764936)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,g\xA7\xA7,1676055767944.0b68bcec2ca2391d28b6290c561e3332. 2023-02-10 19:02:53,381 DEBUG [member: 'jenkins-hbase4.apache.org,43623,1676055764936' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/5 local region flush tasks. 2023-02-10 19:02:53,381 DEBUG [rs(jenkins-hbase4.apache.org,43623,1676055764936)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,g\xA7\xA7,1676055767944.0b68bcec2ca2391d28b6290c561e3332. started... 2023-02-10 19:02:53,381 INFO [rs(jenkins-hbase4.apache.org,43623,1676055764936)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 0b68bcec2ca2391d28b6290c561e3332 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-10 19:02:53,400 INFO [rs(jenkins-hbase4.apache.org,43623,1676055764936)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/data/default/testWithMapReduce/0b68bcec2ca2391d28b6290c561e3332/.tmp/f1/9c33c4ef93f946039df2b785883b48ed 2023-02-10 19:02:53,418 INFO [rs(jenkins-hbase4.apache.org,43623,1676055764936)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/data/default/testWithMapReduce/0b68bcec2ca2391d28b6290c561e3332/.tmp/f2/eea04d059c44478ea2da475bc2fe8389 2023-02-10 19:02:53,424 DEBUG [rs(jenkins-hbase4.apache.org,43623,1676055764936)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/data/default/testWithMapReduce/0b68bcec2ca2391d28b6290c561e3332/.tmp/f1/9c33c4ef93f946039df2b785883b48ed as hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/data/default/testWithMapReduce/0b68bcec2ca2391d28b6290c561e3332/f1/9c33c4ef93f946039df2b785883b48ed 2023-02-10 19:02:53,431 INFO [rs(jenkins-hbase4.apache.org,43623,1676055764936)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/data/default/testWithMapReduce/0b68bcec2ca2391d28b6290c561e3332/f1/9c33c4ef93f946039df2b785883b48ed, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-10 19:02:53,432 DEBUG [rs(jenkins-hbase4.apache.org,43623,1676055764936)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/data/default/testWithMapReduce/0b68bcec2ca2391d28b6290c561e3332/.tmp/f2/eea04d059c44478ea2da475bc2fe8389 as hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/data/default/testWithMapReduce/0b68bcec2ca2391d28b6290c561e3332/f2/eea04d059c44478ea2da475bc2fe8389 2023-02-10 19:02:53,439 INFO [rs(jenkins-hbase4.apache.org,43623,1676055764936)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/data/default/testWithMapReduce/0b68bcec2ca2391d28b6290c561e3332/f2/eea04d059c44478ea2da475bc2fe8389, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-10 19:02:53,440 INFO [rs(jenkins-hbase4.apache.org,43623,1676055764936)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 0b68bcec2ca2391d28b6290c561e3332 in 59ms, sequenceid=9, compaction requested=false 2023-02-10 19:02:53,440 DEBUG [rs(jenkins-hbase4.apache.org,43623,1676055764936)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 0b68bcec2ca2391d28b6290c561e3332: 2023-02-10 19:02:53,440 DEBUG [rs(jenkins-hbase4.apache.org,43623,1676055764936)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,g\xA7\xA7,1676055767944.0b68bcec2ca2391d28b6290c561e3332. 2023-02-10 19:02:53,440 DEBUG [member: 'jenkins-hbase4.apache.org,43623,1676055764936' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/5 local region flush tasks. 2023-02-10 19:02:53,658 INFO [rs(jenkins-hbase4.apache.org,43623,1676055764936)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/data/default/testWithMapReduce/07dbe2f766a0b8b265d0439c26307ef7/.tmp/f2/fc868dc715a649c4a2271d87c3af326f 2023-02-10 19:02:53,665 DEBUG [rs(jenkins-hbase4.apache.org,43623,1676055764936)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/data/default/testWithMapReduce/07dbe2f766a0b8b265d0439c26307ef7/.tmp/f1/01bc21d694ca4861bce7970bc4592462 as hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/data/default/testWithMapReduce/07dbe2f766a0b8b265d0439c26307ef7/f1/01bc21d694ca4861bce7970bc4592462 2023-02-10 19:02:53,672 INFO [rs(jenkins-hbase4.apache.org,43623,1676055764936)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/data/default/testWithMapReduce/07dbe2f766a0b8b265d0439c26307ef7/f1/01bc21d694ca4861bce7970bc4592462, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-10 19:02:53,673 DEBUG [rs(jenkins-hbase4.apache.org,43623,1676055764936)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/data/default/testWithMapReduce/07dbe2f766a0b8b265d0439c26307ef7/.tmp/f2/fc868dc715a649c4a2271d87c3af326f as hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/data/default/testWithMapReduce/07dbe2f766a0b8b265d0439c26307ef7/f2/fc868dc715a649c4a2271d87c3af326f 2023-02-10 19:02:53,679 INFO [rs(jenkins-hbase4.apache.org,43623,1676055764936)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/data/default/testWithMapReduce/07dbe2f766a0b8b265d0439c26307ef7/f2/fc868dc715a649c4a2271d87c3af326f, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-10 19:02:53,680 INFO [rs(jenkins-hbase4.apache.org,43623,1676055764936)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 07dbe2f766a0b8b265d0439c26307ef7 in 578ms, sequenceid=9, compaction requested=false 2023-02-10 19:02:53,680 DEBUG [rs(jenkins-hbase4.apache.org,43623,1676055764936)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 07dbe2f766a0b8b265d0439c26307ef7: 2023-02-10 19:02:53,680 DEBUG [rs(jenkins-hbase4.apache.org,43623,1676055764936)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,q\x11\x10,1676055767944.07dbe2f766a0b8b265d0439c26307ef7. 2023-02-10 19:02:53,680 DEBUG [member: 'jenkins-hbase4.apache.org,43623,1676055764936' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 4/5 local region flush tasks. 2023-02-10 19:02:53,695 INFO [rs(jenkins-hbase4.apache.org,43623,1676055764936)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/data/default/testWithMapReduce/cca73b62b14aebcd72ce9f0317bde286/.tmp/f2/c1574399f6cf46ca92e81ba576db7b9e 2023-02-10 19:02:53,701 DEBUG [rs(jenkins-hbase4.apache.org,43623,1676055764936)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/data/default/testWithMapReduce/cca73b62b14aebcd72ce9f0317bde286/.tmp/f1/523a73fd51c843b0a3e8a0db93bd953c as hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/data/default/testWithMapReduce/cca73b62b14aebcd72ce9f0317bde286/f1/523a73fd51c843b0a3e8a0db93bd953c 2023-02-10 19:02:53,707 INFO [rs(jenkins-hbase4.apache.org,43623,1676055764936)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/data/default/testWithMapReduce/cca73b62b14aebcd72ce9f0317bde286/f1/523a73fd51c843b0a3e8a0db93bd953c, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-10 19:02:53,708 DEBUG [rs(jenkins-hbase4.apache.org,43623,1676055764936)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/data/default/testWithMapReduce/cca73b62b14aebcd72ce9f0317bde286/.tmp/f2/c1574399f6cf46ca92e81ba576db7b9e as hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/data/default/testWithMapReduce/cca73b62b14aebcd72ce9f0317bde286/f2/c1574399f6cf46ca92e81ba576db7b9e 2023-02-10 19:02:53,714 INFO [rs(jenkins-hbase4.apache.org,43623,1676055764936)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/data/default/testWithMapReduce/cca73b62b14aebcd72ce9f0317bde286/f2/c1574399f6cf46ca92e81ba576db7b9e, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-10 19:02:53,716 INFO [rs(jenkins-hbase4.apache.org,43623,1676055764936)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~248.22 KB/254176, heapSize ~634.22 KB/649440, currentSize=0 B/0 for cca73b62b14aebcd72ce9f0317bde286 in 612ms, sequenceid=9, compaction requested=false 2023-02-10 19:02:53,716 DEBUG [rs(jenkins-hbase4.apache.org,43623,1676055764936)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for cca73b62b14aebcd72ce9f0317bde286: 2023-02-10 19:02:53,716 DEBUG [rs(jenkins-hbase4.apache.org,43623,1676055764936)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,wWV,1676055767944.cca73b62b14aebcd72ce9f0317bde286. 2023-02-10 19:02:53,716 DEBUG [member: 'jenkins-hbase4.apache.org,43623,1676055764936' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 5/5 local region flush tasks. 2023-02-10 19:02:53,716 DEBUG [member: 'jenkins-hbase4.apache.org,43623,1676055764936' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 5 local region flush tasks. 2023-02-10 19:02:53,716 DEBUG [member: 'jenkins-hbase4.apache.org,43623,1676055764936' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43623,1676055764936 2023-02-10 19:02:53,716 DEBUG [member: 'jenkins-hbase4.apache.org,43623,1676055764936' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduce' locally acquired 2023-02-10 19:02:53,716 DEBUG [member: 'jenkins-hbase4.apache.org,43623,1676055764936' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43623,1676055764936' joining acquired barrier for procedure (testWithMapReduce) in zk 2023-02-10 19:02:53,718 DEBUG [Listener at localhost/32909-EventThread] zookeeper.ZKWatcher(600): master:41145-0x1003f9d40a30000, quorum=127.0.0.1:63334, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,43623,1676055764936 2023-02-10 19:02:53,718 DEBUG [member: 'jenkins-hbase4.apache.org,43623,1676055764936' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-10 19:02:53,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,43623,1676055764936 2023-02-10 19:02:53,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-10 19:02:53,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-10 19:02:53,718 DEBUG [member: 'jenkins-hbase4.apache.org,43623,1676055764936' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43623-0x1003f9d40a30001, quorum=127.0.0.1:63334, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce 2023-02-10 19:02:53,719 DEBUG [member: 'jenkins-hbase4.apache.org,43623,1676055764936' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduce' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-10 19:02:53,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-10 19:02:53,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-10 19:02:53,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-10 19:02:53,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43623,1676055764936 2023-02-10 19:02:53,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43337,1676055764986 2023-02-10 19:02:53,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-10 19:02:53,721 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43623,1676055764936' joining acquired barrier for procedure 'testWithMapReduce' on coordinator 2023-02-10 19:02:53,721 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@54283385[Count = 0] remaining members to acquire global barrier 2023-02-10 19:02:53,721 DEBUG [(jenkins-hbase4.apache.org,41145,1676055763642)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMapReduce' starting 'in-barrier' execution. 2023-02-10 19:02:53,721 DEBUG [(jenkins-hbase4.apache.org,41145,1676055763642)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-10 19:02:53,727 DEBUG [Listener at localhost/32909-EventThread] zookeeper.ZKWatcher(600): regionserver:43623-0x1003f9d40a30001, quorum=127.0.0.1:63334, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-10 19:02:53,727 DEBUG [Listener at localhost/32909-EventThread] zookeeper.ZKWatcher(600): regionserver:43337-0x1003f9d40a30002, quorum=127.0.0.1:63334, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-10 19:02:53,727 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-10 19:02:53,727 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-10 19:02:53,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-10 19:02:53,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-10 19:02:53,727 DEBUG [(jenkins-hbase4.apache.org,41145,1676055763642)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41145-0x1003f9d40a30000, quorum=127.0.0.1:63334, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,43337,1676055764986 2023-02-10 19:02:53,727 DEBUG [member: 'jenkins-hbase4.apache.org,43337,1676055764986' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduce' received 'reached' from coordinator. 2023-02-10 19:02:53,727 DEBUG [member: 'jenkins-hbase4.apache.org,43623,1676055764936' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduce' received 'reached' from coordinator. 2023-02-10 19:02:53,727 DEBUG [member: 'jenkins-hbase4.apache.org,43337,1676055764986' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduce' locally completed 2023-02-10 19:02:53,727 DEBUG [member: 'jenkins-hbase4.apache.org,43337,1676055764986' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduce' completed for member 'jenkins-hbase4.apache.org,43337,1676055764986' in zk 2023-02-10 19:02:53,727 DEBUG [member: 'jenkins-hbase4.apache.org,43623,1676055764936' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduce' locally completed 2023-02-10 19:02:53,728 DEBUG [member: 'jenkins-hbase4.apache.org,43623,1676055764936' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduce' completed for member 'jenkins-hbase4.apache.org,43623,1676055764936' in zk 2023-02-10 19:02:53,728 DEBUG [(jenkins-hbase4.apache.org,41145,1676055763642)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41145-0x1003f9d40a30000, quorum=127.0.0.1:63334, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,43623,1676055764936 2023-02-10 19:02:53,728 DEBUG [(jenkins-hbase4.apache.org,41145,1676055763642)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-10 19:02:53,730 DEBUG [member: 'jenkins-hbase4.apache.org,43337,1676055764986' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduce' has notified controller of completion 2023-02-10 19:02:53,730 DEBUG [member: 'jenkins-hbase4.apache.org,43623,1676055764936' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduce' has notified controller of completion 2023-02-10 19:02:53,730 DEBUG [member: 'jenkins-hbase4.apache.org,43337,1676055764986' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-10 19:02:53,730 DEBUG [Listener at localhost/32909-EventThread] zookeeper.ZKWatcher(600): master:41145-0x1003f9d40a30000, quorum=127.0.0.1:63334, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,43337,1676055764986 2023-02-10 19:02:53,731 DEBUG [Listener at localhost/32909-EventThread] zookeeper.ZKWatcher(600): master:41145-0x1003f9d40a30000, quorum=127.0.0.1:63334, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,43623,1676055764936 2023-02-10 19:02:53,730 DEBUG [member: 'jenkins-hbase4.apache.org,43337,1676055764986' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduce' completed. 2023-02-10 19:02:53,730 DEBUG [member: 'jenkins-hbase4.apache.org,43623,1676055764936' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-10 19:02:53,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,43337,1676055764986 2023-02-10 19:02:53,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-10 19:02:53,731 DEBUG [member: 'jenkins-hbase4.apache.org,43623,1676055764936' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduce' completed. 2023-02-10 19:02:53,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-10 19:02:53,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-10 19:02:53,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-10 19:02:53,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-10 19:02:53,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43623,1676055764936 2023-02-10 19:02:53,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43337,1676055764986 2023-02-10 19:02:53,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-10 19:02:53,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-10 19:02:53,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43623,1676055764936 2023-02-10 19:02:53,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43337,1676055764986 2023-02-10 19:02:53,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduce' member 'jenkins-hbase4.apache.org,43337,1676055764986': 2023-02-10 19:02:53,736 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43337,1676055764986' released barrier for procedure'testWithMapReduce', counting down latch. Waiting for 1 more 2023-02-10 19:02:53,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,43623,1676055764936 2023-02-10 19:02:53,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-10 19:02:53,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-10 19:02:53,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-10 19:02:53,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-10 19:02:53,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-10 19:02:53,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43623,1676055764936 2023-02-10 19:02:53,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43337,1676055764986 2023-02-10 19:02:53,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-10 19:02:53,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-10 19:02:53,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43623,1676055764936 2023-02-10 19:02:53,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43337,1676055764986 2023-02-10 19:02:53,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduce' member 'jenkins-hbase4.apache.org,43623,1676055764936': 2023-02-10 19:02:53,740 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43623,1676055764936' released barrier for procedure'testWithMapReduce', counting down latch. Waiting for 0 more 2023-02-10 19:02:53,740 INFO [(jenkins-hbase4.apache.org,41145,1676055763642)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMapReduce' execution completed 2023-02-10 19:02:53,740 DEBUG [(jenkins-hbase4.apache.org,41145,1676055763642)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-10 19:02:53,740 DEBUG [(jenkins-hbase4.apache.org,41145,1676055763642)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-10 19:02:53,740 DEBUG [(jenkins-hbase4.apache.org,41145,1676055763642)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMapReduce 2023-02-10 19:02:53,741 INFO [(jenkins-hbase4.apache.org,41145,1676055763642)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMapReduceincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-10 19:02:53,743 DEBUG [Listener at localhost/32909-EventThread] zookeeper.ZKWatcher(600): master:41145-0x1003f9d40a30000, quorum=127.0.0.1:63334, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-10 19:02:53,743 DEBUG [Listener at localhost/32909-EventThread] zookeeper.ZKWatcher(600): regionserver:43623-0x1003f9d40a30001, quorum=127.0.0.1:63334, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-10 19:02:53,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-10 19:02:53,743 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-10 19:02:53,743 DEBUG [Listener at localhost/32909-EventThread] zookeeper.ZKWatcher(600): regionserver:43337-0x1003f9d40a30002, quorum=127.0.0.1:63334, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-10 19:02:53,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-10 19:02:53,743 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-10 19:02:53,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-10 19:02:53,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-10 19:02:53,743 DEBUG [Listener at localhost/32909-EventThread] zookeeper.ZKWatcher(600): regionserver:43623-0x1003f9d40a30001, quorum=127.0.0.1:63334, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-10 19:02:53,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-10 19:02:53,743 DEBUG [Listener at localhost/32909-EventThread] zookeeper.ZKWatcher(600): regionserver:43337-0x1003f9d40a30002, quorum=127.0.0.1:63334, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-10 19:02:53,744 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-10 19:02:53,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-10 19:02:53,744 DEBUG [(jenkins-hbase4.apache.org,41145,1676055763642)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41145-0x1003f9d40a30000, quorum=127.0.0.1:63334, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,43623,1676055764936 2023-02-10 19:02:53,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-10 19:02:53,744 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-10 19:02:53,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-10 19:02:53,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-10 19:02:53,744 DEBUG [(jenkins-hbase4.apache.org,41145,1676055763642)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41145-0x1003f9d40a30000, quorum=127.0.0.1:63334, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,43337,1676055764986 2023-02-10 19:02:53,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-10 19:02:53,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-10 19:02:53,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-10 19:02:53,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-10 19:02:53,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43623,1676055764936 2023-02-10 19:02:53,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43337,1676055764986 2023-02-10 19:02:53,747 DEBUG [(jenkins-hbase4.apache.org,41145,1676055763642)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41145-0x1003f9d40a30000, quorum=127.0.0.1:63334, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,43623,1676055764936 2023-02-10 19:02:53,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-10 19:02:53,747 DEBUG [(jenkins-hbase4.apache.org,41145,1676055763642)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41145-0x1003f9d40a30000, quorum=127.0.0.1:63334, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,43337,1676055764986 2023-02-10 19:02:53,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-10 19:02:53,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43623,1676055764936 2023-02-10 19:02:53,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43337,1676055764986 2023-02-10 19:02:53,753 DEBUG [Listener at localhost/32909-EventThread] zookeeper.ZKWatcher(600): regionserver:43623-0x1003f9d40a30001, quorum=127.0.0.1:63334, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-10 19:02:53,754 DEBUG [Listener at localhost/32909-EventThread] zookeeper.ZKWatcher(600): regionserver:43623-0x1003f9d40a30001, quorum=127.0.0.1:63334, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-10 19:02:53,754 DEBUG [Listener at localhost/32909-EventThread] zookeeper.ZKWatcher(600): master:41145-0x1003f9d40a30000, quorum=127.0.0.1:63334, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,43337,1676055764986 2023-02-10 19:02:53,753 DEBUG [Listener at localhost/32909-EventThread] zookeeper.ZKWatcher(600): regionserver:43337-0x1003f9d40a30002, quorum=127.0.0.1:63334, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-10 19:02:53,754 DEBUG [Listener at localhost/32909-EventThread] zookeeper.ZKWatcher(600): master:41145-0x1003f9d40a30000, quorum=127.0.0.1:63334, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-10 19:02:53,754 DEBUG [(jenkins-hbase4.apache.org,41145,1676055763642)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-10 19:02:53,754 DEBUG [Listener at localhost/32909-EventThread] zookeeper.ZKWatcher(600): master:41145-0x1003f9d40a30000, quorum=127.0.0.1:63334, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,43623,1676055764936 2023-02-10 19:02:53,754 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-10 19:02:53,754 DEBUG [Listener at localhost/32909-EventThread] zookeeper.ZKWatcher(600): master:41145-0x1003f9d40a30000, quorum=127.0.0.1:63334, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-10 19:02:53,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-10 19:02:53,754 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41145] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testWithMapReduce' 2023-02-10 19:02:53,755 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41145] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-10 19:02:53,754 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-10 19:02:53,754 DEBUG [Listener at localhost/32909-EventThread] zookeeper.ZKWatcher(600): regionserver:43337-0x1003f9d40a30002, quorum=127.0.0.1:63334, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-10 19:02:53,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-10 19:02:53,755 DEBUG [Listener at localhost/32909-EventThread] zookeeper.ZKWatcher(600): master:41145-0x1003f9d40a30000, quorum=127.0.0.1:63334, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,43337,1676055764986 2023-02-10 19:02:53,755 DEBUG [Listener at localhost/32909-EventThread] zookeeper.ZKWatcher(600): master:41145-0x1003f9d40a30000, quorum=127.0.0.1:63334, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-10 19:02:53,755 DEBUG [Listener at localhost/32909-EventThread] zookeeper.ZKWatcher(600): master:41145-0x1003f9d40a30000, quorum=127.0.0.1:63334, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,43623,1676055764936 2023-02-10 19:02:53,755 DEBUG [Listener at localhost/32909-EventThread] zookeeper.ZKWatcher(600): master:41145-0x1003f9d40a30000, quorum=127.0.0.1:63334, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-10 19:02:53,755 DEBUG [Listener at localhost/32909-EventThread] zookeeper.ZKWatcher(600): master:41145-0x1003f9d40a30000, quorum=127.0.0.1:63334, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-10 19:02:53,757 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-10 19:02:53,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-10 19:02:53,757 DEBUG [Listener at localhost/32909] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testWithMapReduce'' to complete. (max 20000 ms per retry) 2023-02-10 19:02:53,757 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-10 19:02:53,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-10 19:02:53,757 DEBUG [Listener at localhost/32909] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-10 19:02:53,819 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-10 19:02:53,820 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2023-02-10 19:02:53,858 DEBUG [Listener at localhost/32909] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-10 19:02:53,863 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41145] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-10 19:02:53,964 DEBUG [Listener at localhost/32909] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapred.TestTableSnapshotInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/df59ff2b-dcbe-75a4-cab6-314b30c9ac42/hadoop-1642393864613181318.jar 2023-02-10 19:02:53,981 INFO [Listener at localhost/32909] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "testWithMapReduceMultiRegion" table: "testWithMapReduce" creation_time: 1676055770656 type: FLUSH version: 2 ttl: 0 2023-02-10 19:02:53,982 DEBUG [Listener at localhost/32909] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost:46001/user/jenkins/test-data/e38f8928-0bc5-63bf-a015-81024004f54e/testWithMapReduceMultiRegion/29491060-6c8b-409e-ae71-b2d2144454c4/data/default/testWithMapReduce 2023-02-10 19:02:53,983 INFO [Listener at localhost/32909] snapshot.RestoreSnapshotHelper(239): region to add: b5248077ace761a2c5d43c344f646651 2023-02-10 19:02:53,983 INFO [Listener at localhost/32909] snapshot.RestoreSnapshotHelper(239): region to add: 07dbe2f766a0b8b265d0439c26307ef7 2023-02-10 19:02:53,984 INFO [Listener at localhost/32909] snapshot.RestoreSnapshotHelper(239): region to add: cca73b62b14aebcd72ce9f0317bde286 2023-02-10 19:02:53,984 INFO [Listener at localhost/32909] snapshot.RestoreSnapshotHelper(239): region to add: 053dc7037d94e17f3f72f5ea563ab135 2023-02-10 19:02:53,984 INFO [Listener at localhost/32909] snapshot.RestoreSnapshotHelper(239): region to add: 813b88c1d27659129f4a12d3c70b79c7 2023-02-10 19:02:53,984 INFO [Listener at localhost/32909] snapshot.RestoreSnapshotHelper(239): region to add: 2abc519a8c9fd6a76400a0e9294c9317 2023-02-10 19:02:53,984 INFO [Listener at localhost/32909] snapshot.RestoreSnapshotHelper(239): region to add: 05d2a877c2d90362a1d4209daff5b54a 2023-02-10 19:02:53,984 INFO [Listener at localhost/32909] snapshot.RestoreSnapshotHelper(239): region to add: ea671e7088d3fe84e68b3d345289fe97 2023-02-10 19:02:53,984 INFO [Listener at localhost/32909] snapshot.RestoreSnapshotHelper(239): region to add: 52e916374c45f2d5119804d8db34ffe7 2023-02-10 19:02:53,984 INFO [Listener at localhost/32909] snapshot.RestoreSnapshotHelper(239): region to add: 0b68bcec2ca2391d28b6290c561e3332 2023-02-10 19:02:53,984 INFO [Listener at localhost/32909] snapshot.RestoreSnapshotHelper(585): clone region=b5248077ace761a2c5d43c344f646651 as b5248077ace761a2c5d43c344f646651 in snapshot testWithMapReduceMultiRegion 2023-02-10 19:02:53,984 INFO [Listener at localhost/32909] snapshot.RestoreSnapshotHelper(585): clone region=07dbe2f766a0b8b265d0439c26307ef7 as 07dbe2f766a0b8b265d0439c26307ef7 in snapshot testWithMapReduceMultiRegion 2023-02-10 19:02:53,984 INFO [Listener at localhost/32909] snapshot.RestoreSnapshotHelper(585): clone region=cca73b62b14aebcd72ce9f0317bde286 as cca73b62b14aebcd72ce9f0317bde286 in snapshot testWithMapReduceMultiRegion 2023-02-10 19:02:53,985 INFO [Listener at localhost/32909] snapshot.RestoreSnapshotHelper(585): clone region=053dc7037d94e17f3f72f5ea563ab135 as 053dc7037d94e17f3f72f5ea563ab135 in snapshot testWithMapReduceMultiRegion 2023-02-10 19:02:53,985 INFO [Listener at localhost/32909] snapshot.RestoreSnapshotHelper(585): clone region=813b88c1d27659129f4a12d3c70b79c7 as 813b88c1d27659129f4a12d3c70b79c7 in snapshot testWithMapReduceMultiRegion 2023-02-10 19:02:53,985 INFO [Listener at localhost/32909] snapshot.RestoreSnapshotHelper(585): clone region=2abc519a8c9fd6a76400a0e9294c9317 as 2abc519a8c9fd6a76400a0e9294c9317 in snapshot testWithMapReduceMultiRegion 2023-02-10 19:02:53,985 INFO [Listener at localhost/32909] snapshot.RestoreSnapshotHelper(585): clone region=05d2a877c2d90362a1d4209daff5b54a as 05d2a877c2d90362a1d4209daff5b54a in snapshot testWithMapReduceMultiRegion 2023-02-10 19:02:53,985 INFO [Listener at localhost/32909] snapshot.RestoreSnapshotHelper(585): clone region=ea671e7088d3fe84e68b3d345289fe97 as ea671e7088d3fe84e68b3d345289fe97 in snapshot testWithMapReduceMultiRegion 2023-02-10 19:02:53,985 INFO [Listener at localhost/32909] snapshot.RestoreSnapshotHelper(585): clone region=52e916374c45f2d5119804d8db34ffe7 as 52e916374c45f2d5119804d8db34ffe7 in snapshot testWithMapReduceMultiRegion 2023-02-10 19:02:53,985 INFO [Listener at localhost/32909] snapshot.RestoreSnapshotHelper(585): clone region=0b68bcec2ca2391d28b6290c561e3332 as 0b68bcec2ca2391d28b6290c561e3332 in snapshot testWithMapReduceMultiRegion 2023-02-10 19:02:53,998 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(7671): creating {ENCODED => 07dbe2f766a0b8b265d0439c26307ef7, NAME => 'testWithMapReduce,q\x11\x10,1676055767944.07dbe2f766a0b8b265d0439c26307ef7.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:46001/user/jenkins/test-data/e38f8928-0bc5-63bf-a015-81024004f54e/testWithMapReduceMultiRegion/29491060-6c8b-409e-ae71-b2d2144454c4 2023-02-10 19:02:53,998 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(7671): creating {ENCODED => cca73b62b14aebcd72ce9f0317bde286, NAME => 'testWithMapReduce,wWV,1676055767944.cca73b62b14aebcd72ce9f0317bde286.', STARTKEY => 'wWV', ENDKEY => 'zz{'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:46001/user/jenkins/test-data/e38f8928-0bc5-63bf-a015-81024004f54e/testWithMapReduceMultiRegion/29491060-6c8b-409e-ae71-b2d2144454c4 2023-02-10 19:02:53,999 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(7671): creating {ENCODED => 2abc519a8c9fd6a76400a0e9294c9317, NAME => 'testWithMapReduce,m\xED\xED,1676055767944.2abc519a8c9fd6a76400a0e9294c9317.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:46001/user/jenkins/test-data/e38f8928-0bc5-63bf-a015-81024004f54e/testWithMapReduceMultiRegion/29491060-6c8b-409e-ae71-b2d2144454c4 2023-02-10 19:02:53,999 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(7671): creating {ENCODED => b5248077ace761a2c5d43c344f646651, NAME => 'testWithMapReduce,d\x84\x84,1676055767944.b5248077ace761a2c5d43c344f646651.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:46001/user/jenkins/test-data/e38f8928-0bc5-63bf-a015-81024004f54e/testWithMapReduceMultiRegion/29491060-6c8b-409e-ae71-b2d2144454c4 2023-02-10 19:02:53,999 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(7671): creating {ENCODED => 813b88c1d27659129f4a12d3c70b79c7, NAME => 'testWithMapReduce,,1676055767944.813b88c1d27659129f4a12d3c70b79c7.', STARTKEY => '', ENDKEY => 'aaa'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:46001/user/jenkins/test-data/e38f8928-0bc5-63bf-a015-81024004f54e/testWithMapReduceMultiRegion/29491060-6c8b-409e-ae71-b2d2144454c4 2023-02-10 19:02:53,999 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(7671): creating {ENCODED => 053dc7037d94e17f3f72f5ea563ab135, NAME => 'testWithMapReduce,j\xCA\xCA,1676055767944.053dc7037d94e17f3f72f5ea563ab135.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:46001/user/jenkins/test-data/e38f8928-0bc5-63bf-a015-81024004f54e/testWithMapReduceMultiRegion/29491060-6c8b-409e-ae71-b2d2144454c4 2023-02-10 19:02:54,000 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(7671): creating {ENCODED => ea671e7088d3fe84e68b3d345289fe97, NAME => 'testWithMapReduce,aaa,1676055767944.ea671e7088d3fe84e68b3d345289fe97.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:46001/user/jenkins/test-data/e38f8928-0bc5-63bf-a015-81024004f54e/testWithMapReduceMultiRegion/29491060-6c8b-409e-ae71-b2d2144454c4 2023-02-10 19:02:54,000 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(7671): creating {ENCODED => 05d2a877c2d90362a1d4209daff5b54a, NAME => 'testWithMapReduce,zz{,1676055767944.05d2a877c2d90362a1d4209daff5b54a.', STARTKEY => 'zz{', ENDKEY => ''}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:46001/user/jenkins/test-data/e38f8928-0bc5-63bf-a015-81024004f54e/testWithMapReduceMultiRegion/29491060-6c8b-409e-ae71-b2d2144454c4 2023-02-10 19:02:54,041 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676055767944.813b88c1d27659129f4a12d3c70b79c7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-10 19:02:54,041 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1603): Closing 813b88c1d27659129f4a12d3c70b79c7, disabling compactions & flushes 2023-02-10 19:02:54,041 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676055767944.813b88c1d27659129f4a12d3c70b79c7. 2023-02-10 19:02:54,041 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676055767944.813b88c1d27659129f4a12d3c70b79c7. 2023-02-10 19:02:54,041 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676055767944.813b88c1d27659129f4a12d3c70b79c7. after waiting 0 ms 2023-02-10 19:02:54,041 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676055767944.813b88c1d27659129f4a12d3c70b79c7. 2023-02-10 19:02:54,042 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(1837): Closed testWithMapReduce,,1676055767944.813b88c1d27659129f4a12d3c70b79c7. 2023-02-10 19:02:54,042 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1557): Region close journal for 813b88c1d27659129f4a12d3c70b79c7: Waiting for close lock at 1676055774041Disabling compacts and flushes for region at 1676055774041Disabling writes for close at 1676055774041Writing region close event to WAL at 1676055774042 (+1 ms)Closed at 1676055774042 2023-02-10 19:02:54,042 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(7671): creating {ENCODED => 52e916374c45f2d5119804d8db34ffe7, NAME => 'testWithMapReduce,t43,1676055767944.52e916374c45f2d5119804d8db34ffe7.', STARTKEY => 't43', ENDKEY => 'wWV'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:46001/user/jenkins/test-data/e38f8928-0bc5-63bf-a015-81024004f54e/testWithMapReduceMultiRegion/29491060-6c8b-409e-ae71-b2d2144454c4 2023-02-10 19:02:54,045 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,q\x11\x10,1676055767944.07dbe2f766a0b8b265d0439c26307ef7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-10 19:02:54,045 INFO [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 7f2eeb0ade74437c8e98b1f9c6e4998f from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-10 19:02:54,057 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(865): Instantiated testWithMapReduce,m\xED\xED,1676055767944.2abc519a8c9fd6a76400a0e9294c9317.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-10 19:02:54,057 INFO [RestoreSnapshot-pool-5] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 253de5c7eb7e4d3d9eb98c4c28bf4117 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-10 19:02:54,068 INFO [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(628): Adding HFileLink ce63b0110ef64f13adedf84c456454a1 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-10 19:02:54,069 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(865): Instantiated testWithMapReduce,j\xCA\xCA,1676055767944.053dc7037d94e17f3f72f5ea563ab135.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-10 19:02:54,069 INFO [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 504d267354704aa1887fe95c8317e485 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-10 19:02:54,083 INFO [RestoreSnapshot-pool-5] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 6e0c81a35f164756ba1801d4b22b31e8 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-10 19:02:54,087 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1603): Closing 2abc519a8c9fd6a76400a0e9294c9317, disabling compactions & flushes 2023-02-10 19:02:54,087 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(1625): Closing region testWithMapReduce,m\xED\xED,1676055767944.2abc519a8c9fd6a76400a0e9294c9317. 2023-02-10 19:02:54,087 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,m\xED\xED,1676055767944.2abc519a8c9fd6a76400a0e9294c9317. 2023-02-10 19:02:54,087 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,m\xED\xED,1676055767944.2abc519a8c9fd6a76400a0e9294c9317. after waiting 0 ms 2023-02-10 19:02:54,088 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,m\xED\xED,1676055767944.2abc519a8c9fd6a76400a0e9294c9317. 2023-02-10 19:02:54,088 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(1837): Closed testWithMapReduce,m\xED\xED,1676055767944.2abc519a8c9fd6a76400a0e9294c9317. 2023-02-10 19:02:54,088 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(865): Instantiated testWithMapReduce,aaa,1676055767944.ea671e7088d3fe84e68b3d345289fe97.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-10 19:02:54,088 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1557): Region close journal for 2abc519a8c9fd6a76400a0e9294c9317: Waiting for close lock at 1676055774087Disabling compacts and flushes for region at 1676055774087Disabling writes for close at 1676055774088 (+1 ms)Writing region close event to WAL at 1676055774088Closed at 1676055774088 2023-02-10 19:02:54,088 INFO [RestoreSnapshot-pool-7] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 1cb1c69f1d034168966cde09a17b098e from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-10 19:02:54,089 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(7671): creating {ENCODED => 0b68bcec2ca2391d28b6290c561e3332, NAME => 'testWithMapReduce,g\xA7\xA7,1676055767944.0b68bcec2ca2391d28b6290c561e3332.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:46001/user/jenkins/test-data/e38f8928-0bc5-63bf-a015-81024004f54e/testWithMapReduceMultiRegion/29491060-6c8b-409e-ae71-b2d2144454c4 2023-02-10 19:02:54,102 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,wWV,1676055767944.cca73b62b14aebcd72ce9f0317bde286.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-10 19:02:54,102 INFO [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 4cfcead0fcb24e6598b31b611cdd39bf from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-10 19:02:54,102 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,d\x84\x84,1676055767944.b5248077ace761a2c5d43c344f646651.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-10 19:02:54,102 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink fb0ff4da36be4e70b3c8085cf63149b8 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-10 19:02:54,104 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(865): Instantiated testWithMapReduce,zz{,1676055767944.05d2a877c2d90362a1d4209daff5b54a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-10 19:02:54,104 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1603): Closing 05d2a877c2d90362a1d4209daff5b54a, disabling compactions & flushes 2023-02-10 19:02:54,104 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(1625): Closing region testWithMapReduce,zz{,1676055767944.05d2a877c2d90362a1d4209daff5b54a. 2023-02-10 19:02:54,104 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,zz{,1676055767944.05d2a877c2d90362a1d4209daff5b54a. 2023-02-10 19:02:54,104 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,zz{,1676055767944.05d2a877c2d90362a1d4209daff5b54a. after waiting 0 ms 2023-02-10 19:02:54,104 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,zz{,1676055767944.05d2a877c2d90362a1d4209daff5b54a. 2023-02-10 19:02:54,104 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(1837): Closed testWithMapReduce,zz{,1676055767944.05d2a877c2d90362a1d4209daff5b54a. 2023-02-10 19:02:54,104 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1557): Region close journal for 05d2a877c2d90362a1d4209daff5b54a: Waiting for close lock at 1676055774104Disabling compacts and flushes for region at 1676055774104Disabling writes for close at 1676055774104Writing region close event to WAL at 1676055774104Closed at 1676055774104 2023-02-10 19:02:54,105 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1603): Closing 07dbe2f766a0b8b265d0439c26307ef7, disabling compactions & flushes 2023-02-10 19:02:54,105 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,q\x11\x10,1676055767944.07dbe2f766a0b8b265d0439c26307ef7. 2023-02-10 19:02:54,105 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,q\x11\x10,1676055767944.07dbe2f766a0b8b265d0439c26307ef7. 2023-02-10 19:02:54,105 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,q\x11\x10,1676055767944.07dbe2f766a0b8b265d0439c26307ef7. after waiting 0 ms 2023-02-10 19:02:54,105 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,q\x11\x10,1676055767944.07dbe2f766a0b8b265d0439c26307ef7. 2023-02-10 19:02:54,105 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,q\x11\x10,1676055767944.07dbe2f766a0b8b265d0439c26307ef7. 2023-02-10 19:02:54,106 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1557): Region close journal for 07dbe2f766a0b8b265d0439c26307ef7: Waiting for close lock at 1676055774105Disabling compacts and flushes for region at 1676055774105Disabling writes for close at 1676055774105Writing region close event to WAL at 1676055774105Closed at 1676055774105 2023-02-10 19:02:54,108 INFO [RestoreSnapshot-pool-7] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 905d6e0f39194973bc5d4ae34b4d908f from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-10 19:02:54,116 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1603): Closing ea671e7088d3fe84e68b3d345289fe97, disabling compactions & flushes 2023-02-10 19:02:54,117 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(1625): Closing region testWithMapReduce,aaa,1676055767944.ea671e7088d3fe84e68b3d345289fe97. 2023-02-10 19:02:54,117 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,aaa,1676055767944.ea671e7088d3fe84e68b3d345289fe97. 2023-02-10 19:02:54,117 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,aaa,1676055767944.ea671e7088d3fe84e68b3d345289fe97. after waiting 0 ms 2023-02-10 19:02:54,117 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,aaa,1676055767944.ea671e7088d3fe84e68b3d345289fe97. 2023-02-10 19:02:54,117 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(1837): Closed testWithMapReduce,aaa,1676055767944.ea671e7088d3fe84e68b3d345289fe97. 2023-02-10 19:02:54,117 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1557): Region close journal for ea671e7088d3fe84e68b3d345289fe97: Waiting for close lock at 1676055774116Disabling compacts and flushes for region at 1676055774116Disabling writes for close at 1676055774117 (+1 ms)Writing region close event to WAL at 1676055774117Closed at 1676055774117 2023-02-10 19:02:54,120 INFO [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 94a02f29869d405ab4270bd8fffe2c6d from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-10 19:02:54,120 INFO [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 871880a6275949d4800f26e30c4edeb8 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-10 19:02:54,121 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(865): Instantiated testWithMapReduce,t43,1676055767944.52e916374c45f2d5119804d8db34ffe7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-10 19:02:54,121 INFO [RestoreSnapshot-pool-4] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 7046e04cad38425f93b18e9cdf97792a from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-10 19:02:54,122 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink a897301323734c9b82ef09fe533f9dc0 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-10 19:02:54,129 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(865): Instantiated testWithMapReduce,g\xA7\xA7,1676055767944.0b68bcec2ca2391d28b6290c561e3332.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-10 19:02:54,129 INFO [RestoreSnapshot-pool-5] snapshot.RestoreSnapshotHelper(628): Adding HFileLink d13fb7a00ef748458b03332cd6a3c8d6 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-10 19:02:54,129 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1603): Closing 053dc7037d94e17f3f72f5ea563ab135, disabling compactions & flushes 2023-02-10 19:02:54,129 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(1625): Closing region testWithMapReduce,j\xCA\xCA,1676055767944.053dc7037d94e17f3f72f5ea563ab135. 2023-02-10 19:02:54,129 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,j\xCA\xCA,1676055767944.053dc7037d94e17f3f72f5ea563ab135. 2023-02-10 19:02:54,129 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,j\xCA\xCA,1676055767944.053dc7037d94e17f3f72f5ea563ab135. after waiting 0 ms 2023-02-10 19:02:54,129 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,j\xCA\xCA,1676055767944.053dc7037d94e17f3f72f5ea563ab135. 2023-02-10 19:02:54,129 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(1837): Closed testWithMapReduce,j\xCA\xCA,1676055767944.053dc7037d94e17f3f72f5ea563ab135. 2023-02-10 19:02:54,130 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1557): Region close journal for 053dc7037d94e17f3f72f5ea563ab135: Waiting for close lock at 1676055774129Disabling compacts and flushes for region at 1676055774129Disabling writes for close at 1676055774129Writing region close event to WAL at 1676055774129Closed at 1676055774129 2023-02-10 19:02:54,132 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1603): Closing cca73b62b14aebcd72ce9f0317bde286, disabling compactions & flushes 2023-02-10 19:02:54,132 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,wWV,1676055767944.cca73b62b14aebcd72ce9f0317bde286. 2023-02-10 19:02:54,132 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,wWV,1676055767944.cca73b62b14aebcd72ce9f0317bde286. 2023-02-10 19:02:54,132 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,wWV,1676055767944.cca73b62b14aebcd72ce9f0317bde286. after waiting 0 ms 2023-02-10 19:02:54,132 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,wWV,1676055767944.cca73b62b14aebcd72ce9f0317bde286. 2023-02-10 19:02:54,132 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,wWV,1676055767944.cca73b62b14aebcd72ce9f0317bde286. 2023-02-10 19:02:54,132 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1557): Region close journal for cca73b62b14aebcd72ce9f0317bde286: Waiting for close lock at 1676055774132Disabling compacts and flushes for region at 1676055774132Disabling writes for close at 1676055774132Writing region close event to WAL at 1676055774132Closed at 1676055774132 2023-02-10 19:02:54,132 INFO [RestoreSnapshot-pool-4] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 9cd807e0a98e4c4091980728d6f09bfa from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-10 19:02:54,133 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1603): Closing b5248077ace761a2c5d43c344f646651, disabling compactions & flushes 2023-02-10 19:02:54,133 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,d\x84\x84,1676055767944.b5248077ace761a2c5d43c344f646651. 2023-02-10 19:02:54,133 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,d\x84\x84,1676055767944.b5248077ace761a2c5d43c344f646651. 2023-02-10 19:02:54,133 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,d\x84\x84,1676055767944.b5248077ace761a2c5d43c344f646651. after waiting 0 ms 2023-02-10 19:02:54,133 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,d\x84\x84,1676055767944.b5248077ace761a2c5d43c344f646651. 2023-02-10 19:02:54,133 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,d\x84\x84,1676055767944.b5248077ace761a2c5d43c344f646651. 2023-02-10 19:02:54,133 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1557): Region close journal for b5248077ace761a2c5d43c344f646651: Waiting for close lock at 1676055774133Disabling compacts and flushes for region at 1676055774133Disabling writes for close at 1676055774133Writing region close event to WAL at 1676055774133Closed at 1676055774133 2023-02-10 19:02:54,133 INFO [RestoreSnapshot-pool-5] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 62c542c2d8914d098b3c5d2ac43084a1 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-10 19:02:54,136 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1603): Closing 52e916374c45f2d5119804d8db34ffe7, disabling compactions & flushes 2023-02-10 19:02:54,136 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1603): Closing 0b68bcec2ca2391d28b6290c561e3332, disabling compactions & flushes 2023-02-10 19:02:54,136 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(1625): Closing region testWithMapReduce,t43,1676055767944.52e916374c45f2d5119804d8db34ffe7. 2023-02-10 19:02:54,136 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(1625): Closing region testWithMapReduce,g\xA7\xA7,1676055767944.0b68bcec2ca2391d28b6290c561e3332. 2023-02-10 19:02:54,136 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,t43,1676055767944.52e916374c45f2d5119804d8db34ffe7. 2023-02-10 19:02:54,136 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,g\xA7\xA7,1676055767944.0b68bcec2ca2391d28b6290c561e3332. 2023-02-10 19:02:54,136 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,t43,1676055767944.52e916374c45f2d5119804d8db34ffe7. after waiting 0 ms 2023-02-10 19:02:54,136 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,g\xA7\xA7,1676055767944.0b68bcec2ca2391d28b6290c561e3332. after waiting 0 ms 2023-02-10 19:02:54,136 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,g\xA7\xA7,1676055767944.0b68bcec2ca2391d28b6290c561e3332. 2023-02-10 19:02:54,136 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,t43,1676055767944.52e916374c45f2d5119804d8db34ffe7. 2023-02-10 19:02:54,137 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(1837): Closed testWithMapReduce,g\xA7\xA7,1676055767944.0b68bcec2ca2391d28b6290c561e3332. 2023-02-10 19:02:54,137 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(1837): Closed testWithMapReduce,t43,1676055767944.52e916374c45f2d5119804d8db34ffe7. 2023-02-10 19:02:54,137 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1557): Region close journal for 0b68bcec2ca2391d28b6290c561e3332: Waiting for close lock at 1676055774136Disabling compacts and flushes for region at 1676055774136Disabling writes for close at 1676055774136Writing region close event to WAL at 1676055774137 (+1 ms)Closed at 1676055774137 2023-02-10 19:02:54,137 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1557): Region close journal for 52e916374c45f2d5119804d8db34ffe7: Waiting for close lock at 1676055774136Disabling compacts and flushes for region at 1676055774136Disabling writes for close at 1676055774136Writing region close event to WAL at 1676055774137 (+1 ms)Closed at 1676055774137 2023-02-10 19:02:54,137 INFO [Listener at localhost/32909] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "testWithMapReduceMultiRegion" table: "testWithMapReduce" creation_time: 1676055770656 type: FLUSH version: 2 ttl: 0 2023-02-10 19:02:54,137 DEBUG [Listener at localhost/32909] snapshot.RestoreSnapshotHelper(832): Restored table dir:hdfs://localhost:46001/user/jenkins/test-data/e38f8928-0bc5-63bf-a015-81024004f54e/testWithMapReduceMultiRegion/29491060-6c8b-409e-ae71-b2d2144454c4 2023-02-10 19:02:54,137 DEBUG [Listener at localhost/32909] util.CommonFSUtils(682): File system contents for path hdfs://localhost:46001/user/jenkins/test-data/e38f8928-0bc5-63bf-a015-81024004f54e/testWithMapReduceMultiRegion/29491060-6c8b-409e-ae71-b2d2144454c4 2023-02-10 19:02:54,138 DEBUG [Listener at localhost/32909] util.CommonFSUtils(699): |-data/ 2023-02-10 19:02:54,139 DEBUG [Listener at localhost/32909] util.CommonFSUtils(699): |----default/ 2023-02-10 19:02:54,139 DEBUG [Listener at localhost/32909] util.CommonFSUtils(699): |-------testWithMapReduce/ 2023-02-10 19:02:54,140 DEBUG [Listener at localhost/32909] util.CommonFSUtils(699): |----------053dc7037d94e17f3f72f5ea563ab135/ 2023-02-10 19:02:54,140 DEBUG [Listener at localhost/32909] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-10 19:02:54,140 DEBUG [Listener at localhost/32909] util.CommonFSUtils(699): |-------------f1/ 2023-02-10 19:02:54,141 DEBUG [Listener at localhost/32909] util.CommonFSUtils(702): |----------------testWithMapReduce=053dc7037d94e17f3f72f5ea563ab135-504d267354704aa1887fe95c8317e485 2023-02-10 19:02:54,141 DEBUG [Listener at localhost/32909] util.CommonFSUtils(699): |-------------f2/ 2023-02-10 19:02:54,141 DEBUG [Listener at localhost/32909] util.CommonFSUtils(702): |----------------testWithMapReduce=053dc7037d94e17f3f72f5ea563ab135-871880a6275949d4800f26e30c4edeb8 2023-02-10 19:02:54,142 DEBUG [Listener at localhost/32909] util.CommonFSUtils(699): |----------05d2a877c2d90362a1d4209daff5b54a/ 2023-02-10 19:02:54,142 DEBUG [Listener at localhost/32909] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-10 19:02:54,142 DEBUG [Listener at localhost/32909] util.CommonFSUtils(699): |----------07dbe2f766a0b8b265d0439c26307ef7/ 2023-02-10 19:02:54,143 DEBUG [Listener at localhost/32909] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-10 19:02:54,143 DEBUG [Listener at localhost/32909] util.CommonFSUtils(699): |-------------f1/ 2023-02-10 19:02:54,143 DEBUG [Listener at localhost/32909] util.CommonFSUtils(702): |----------------testWithMapReduce=07dbe2f766a0b8b265d0439c26307ef7-7f2eeb0ade74437c8e98b1f9c6e4998f 2023-02-10 19:02:54,143 DEBUG [Listener at localhost/32909] util.CommonFSUtils(699): |-------------f2/ 2023-02-10 19:02:54,144 DEBUG [Listener at localhost/32909] util.CommonFSUtils(702): |----------------testWithMapReduce=07dbe2f766a0b8b265d0439c26307ef7-ce63b0110ef64f13adedf84c456454a1 2023-02-10 19:02:54,144 DEBUG [Listener at localhost/32909] util.CommonFSUtils(699): |----------0b68bcec2ca2391d28b6290c561e3332/ 2023-02-10 19:02:54,144 DEBUG [Listener at localhost/32909] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-10 19:02:54,144 DEBUG [Listener at localhost/32909] util.CommonFSUtils(699): |-------------f1/ 2023-02-10 19:02:54,145 DEBUG [Listener at localhost/32909] util.CommonFSUtils(702): |----------------testWithMapReduce=0b68bcec2ca2391d28b6290c561e3332-d13fb7a00ef748458b03332cd6a3c8d6 2023-02-10 19:02:54,145 DEBUG [Listener at localhost/32909] util.CommonFSUtils(699): |-------------f2/ 2023-02-10 19:02:54,145 DEBUG [Listener at localhost/32909] util.CommonFSUtils(702): |----------------testWithMapReduce=0b68bcec2ca2391d28b6290c561e3332-62c542c2d8914d098b3c5d2ac43084a1 2023-02-10 19:02:54,145 DEBUG [Listener at localhost/32909] util.CommonFSUtils(699): |----------2abc519a8c9fd6a76400a0e9294c9317/ 2023-02-10 19:02:54,146 DEBUG [Listener at localhost/32909] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-10 19:02:54,146 DEBUG [Listener at localhost/32909] util.CommonFSUtils(699): |-------------f1/ 2023-02-10 19:02:54,146 DEBUG [Listener at localhost/32909] util.CommonFSUtils(702): |----------------testWithMapReduce=2abc519a8c9fd6a76400a0e9294c9317-253de5c7eb7e4d3d9eb98c4c28bf4117 2023-02-10 19:02:54,147 DEBUG [Listener at localhost/32909] util.CommonFSUtils(699): |-------------f2/ 2023-02-10 19:02:54,147 DEBUG [Listener at localhost/32909] util.CommonFSUtils(702): |----------------testWithMapReduce=2abc519a8c9fd6a76400a0e9294c9317-6e0c81a35f164756ba1801d4b22b31e8 2023-02-10 19:02:54,147 DEBUG [Listener at localhost/32909] util.CommonFSUtils(699): |----------52e916374c45f2d5119804d8db34ffe7/ 2023-02-10 19:02:54,148 DEBUG [Listener at localhost/32909] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-10 19:02:54,148 DEBUG [Listener at localhost/32909] util.CommonFSUtils(699): |-------------f1/ 2023-02-10 19:02:54,148 DEBUG [Listener at localhost/32909] util.CommonFSUtils(702): |----------------testWithMapReduce=52e916374c45f2d5119804d8db34ffe7-7046e04cad38425f93b18e9cdf97792a 2023-02-10 19:02:54,148 DEBUG [Listener at localhost/32909] util.CommonFSUtils(699): |-------------f2/ 2023-02-10 19:02:54,149 DEBUG [Listener at localhost/32909] util.CommonFSUtils(702): |----------------testWithMapReduce=52e916374c45f2d5119804d8db34ffe7-9cd807e0a98e4c4091980728d6f09bfa 2023-02-10 19:02:54,149 DEBUG [Listener at localhost/32909] util.CommonFSUtils(699): |----------813b88c1d27659129f4a12d3c70b79c7/ 2023-02-10 19:02:54,149 DEBUG [Listener at localhost/32909] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-10 19:02:54,149 DEBUG [Listener at localhost/32909] util.CommonFSUtils(699): |----------b5248077ace761a2c5d43c344f646651/ 2023-02-10 19:02:54,150 DEBUG [Listener at localhost/32909] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-10 19:02:54,150 DEBUG [Listener at localhost/32909] util.CommonFSUtils(699): |-------------f1/ 2023-02-10 19:02:54,150 DEBUG [Listener at localhost/32909] util.CommonFSUtils(702): |----------------testWithMapReduce=b5248077ace761a2c5d43c344f646651-fb0ff4da36be4e70b3c8085cf63149b8 2023-02-10 19:02:54,151 DEBUG [Listener at localhost/32909] util.CommonFSUtils(699): |-------------f2/ 2023-02-10 19:02:54,151 DEBUG [Listener at localhost/32909] util.CommonFSUtils(702): |----------------testWithMapReduce=b5248077ace761a2c5d43c344f646651-a897301323734c9b82ef09fe533f9dc0 2023-02-10 19:02:54,151 DEBUG [Listener at localhost/32909] util.CommonFSUtils(699): |----------cca73b62b14aebcd72ce9f0317bde286/ 2023-02-10 19:02:54,152 DEBUG [Listener at localhost/32909] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-10 19:02:54,152 DEBUG [Listener at localhost/32909] util.CommonFSUtils(699): |-------------f1/ 2023-02-10 19:02:54,152 DEBUG [Listener at localhost/32909] util.CommonFSUtils(702): |----------------testWithMapReduce=cca73b62b14aebcd72ce9f0317bde286-4cfcead0fcb24e6598b31b611cdd39bf 2023-02-10 19:02:54,152 DEBUG [Listener at localhost/32909] util.CommonFSUtils(699): |-------------f2/ 2023-02-10 19:02:54,153 DEBUG [Listener at localhost/32909] util.CommonFSUtils(702): |----------------testWithMapReduce=cca73b62b14aebcd72ce9f0317bde286-94a02f29869d405ab4270bd8fffe2c6d 2023-02-10 19:02:54,153 DEBUG [Listener at localhost/32909] util.CommonFSUtils(699): |----------ea671e7088d3fe84e68b3d345289fe97/ 2023-02-10 19:02:54,153 DEBUG [Listener at localhost/32909] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-10 19:02:54,154 DEBUG [Listener at localhost/32909] util.CommonFSUtils(699): |-------------f1/ 2023-02-10 19:02:54,154 DEBUG [Listener at localhost/32909] util.CommonFSUtils(702): |----------------testWithMapReduce=ea671e7088d3fe84e68b3d345289fe97-1cb1c69f1d034168966cde09a17b098e 2023-02-10 19:02:54,154 DEBUG [Listener at localhost/32909] util.CommonFSUtils(699): |-------------f2/ 2023-02-10 19:02:54,155 DEBUG [Listener at localhost/32909] util.CommonFSUtils(702): |----------------testWithMapReduce=ea671e7088d3fe84e68b3d345289fe97-905d6e0f39194973bc5d4ae34b4d908f 2023-02-10 19:02:54,163 DEBUG [Listener at localhost/32909] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.17-SNAPSHOT.jar 2023-02-10 19:02:54,163 DEBUG [Listener at localhost/32909] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.17-SNAPSHOT.jar 2023-02-10 19:02:54,164 DEBUG [Listener at localhost/32909] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.17-SNAPSHOT.jar 2023-02-10 19:02:54,164 DEBUG [Listener at localhost/32909] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.17-SNAPSHOT.jar 2023-02-10 19:02:54,165 DEBUG [Listener at localhost/32909] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.17-SNAPSHOT.jar 2023-02-10 19:02:54,165 DEBUG [Listener at localhost/32909] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.17-SNAPSHOT.jar 2023-02-10 19:02:54,165 DEBUG [Listener at localhost/32909] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.17-SNAPSHOT.jar 2023-02-10 19:02:54,235 DEBUG [Listener at localhost/32909] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/df59ff2b-dcbe-75a4-cab6-314b30c9ac42/hadoop-2119221229401900807.jar 2023-02-10 19:02:54,236 DEBUG [Listener at localhost/32909] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.17-SNAPSHOT.jar 2023-02-10 19:02:54,237 DEBUG [Listener at localhost/32909] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.17-SNAPSHOT.jar 2023-02-10 19:02:54,237 DEBUG [Listener at localhost/32909] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.17-SNAPSHOT.jar 2023-02-10 19:02:54,237 DEBUG [Listener at localhost/32909] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.17-SNAPSHOT.jar 2023-02-10 19:02:54,238 DEBUG [Listener at localhost/32909] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.17-SNAPSHOT.jar 2023-02-10 19:02:54,238 DEBUG [Listener at localhost/32909] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.17-SNAPSHOT.jar 2023-02-10 19:02:54,239 DEBUG [Listener at localhost/32909] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-02-10 19:02:54,239 DEBUG [Listener at localhost/32909] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-02-10 19:02:54,240 DEBUG [Listener at localhost/32909] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-02-10 19:02:54,240 DEBUG [Listener at localhost/32909] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-02-10 19:02:54,241 DEBUG [Listener at localhost/32909] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-02-10 19:02:54,241 DEBUG [Listener at localhost/32909] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-02-10 19:02:54,242 DEBUG [Listener at localhost/32909] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-02-10 19:02:54,242 DEBUG [Listener at localhost/32909] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-02-10 19:02:54,243 DEBUG [Listener at localhost/32909] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-02-10 19:02:54,243 DEBUG [Listener at localhost/32909] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-02-10 19:02:54,249 DEBUG [Listener at localhost/32909] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.io.ImmutableBytesWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.17-SNAPSHOT.jar 2023-02-10 19:02:54,249 DEBUG [Listener at localhost/32909] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.NullWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-10 19:02:54,249 DEBUG [Listener at localhost/32909] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-10 19:02:54,250 DEBUG [Listener at localhost/32909] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-10 19:02:54,250 DEBUG [Listener at localhost/32909] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapred.lib.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-02-10 19:02:54,319 DEBUG [Listener at localhost/32909] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapred.TableSnapshotInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/df59ff2b-dcbe-75a4-cab6-314b30c9ac42/hadoop-5430689242774219656.jar 2023-02-10 19:02:54,319 DEBUG [Listener at localhost/32909] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapred.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-02-10 19:02:54,368 WARN [Listener at localhost/32909] mapreduce.JobResourceUploader(142): Hadoop command-line option parsing not performed. Implement the Tool interface and execute your application with ToolRunner to remedy this. 2023-02-10 19:02:54,421 INFO [Listener at localhost/32909] mapreduce.TableSnapshotInputFormatImpl(392): Provided Scan has DEFAULT ReadType, updating STREAM for Snapshot-based InputFormat 2023-02-10 19:02:54,860 WARN [Listener at localhost/32909] fs.FileUtil(850): Command 'ln -s /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/df59ff2b-dcbe-75a4-cab6-314b30c9ac42/mapreduce.cluster.local.dir/1676055774700/libjars /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/*' failed 1 with: ln: failed to create symbolic link '/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/*': No such file or directory 2023-02-10 19:02:54,860 WARN [Listener at localhost/32909] mapred.LocalDistributedCacheManager(202): Failed to create symlink: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/df59ff2b-dcbe-75a4-cab6-314b30c9ac42/mapreduce.cluster.local.dir/1676055774700/libjars <- /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/* 2023-02-10 19:02:55,037 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,q\x11\x10,1676055767944.07dbe2f766a0b8b265d0439c26307ef7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-10 19:02:55,037 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-10 19:02:55,045 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-10 19:02:55,047 INFO [StoreOpener-07dbe2f766a0b8b265d0439c26307ef7-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 07dbe2f766a0b8b265d0439c26307ef7 2023-02-10 19:02:55,048 DEBUG [StoreOpener-07dbe2f766a0b8b265d0439c26307ef7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46001/user/jenkins/test-data/e38f8928-0bc5-63bf-a015-81024004f54e/testWithMapReduceMultiRegion/29491060-6c8b-409e-ae71-b2d2144454c4/data/default/testWithMapReduce/07dbe2f766a0b8b265d0439c26307ef7/f1 2023-02-10 19:02:55,049 INFO [StoreOpener-07dbe2f766a0b8b265d0439c26307ef7-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 07dbe2f766a0b8b265d0439c26307ef7 columnFamilyName f1 2023-02-10 19:02:55,058 DEBUG [StoreOpener-07dbe2f766a0b8b265d0439c26307ef7-1] regionserver.HStore(539): loaded hdfs://localhost:46001/user/jenkins/test-data/e38f8928-0bc5-63bf-a015-81024004f54e/testWithMapReduceMultiRegion/29491060-6c8b-409e-ae71-b2d2144454c4/data/default/testWithMapReduce/07dbe2f766a0b8b265d0439c26307ef7/f1/testWithMapReduce=07dbe2f766a0b8b265d0439c26307ef7-7f2eeb0ade74437c8e98b1f9c6e4998f 2023-02-10 19:02:55,059 INFO [StoreOpener-07dbe2f766a0b8b265d0439c26307ef7-1] regionserver.HStore(310): Store=07dbe2f766a0b8b265d0439c26307ef7/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-10 19:02:55,059 INFO [StoreOpener-07dbe2f766a0b8b265d0439c26307ef7-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 07dbe2f766a0b8b265d0439c26307ef7 2023-02-10 19:02:55,060 DEBUG [StoreOpener-07dbe2f766a0b8b265d0439c26307ef7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46001/user/jenkins/test-data/e38f8928-0bc5-63bf-a015-81024004f54e/testWithMapReduceMultiRegion/29491060-6c8b-409e-ae71-b2d2144454c4/data/default/testWithMapReduce/07dbe2f766a0b8b265d0439c26307ef7/f2 2023-02-10 19:02:55,061 INFO [StoreOpener-07dbe2f766a0b8b265d0439c26307ef7-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 07dbe2f766a0b8b265d0439c26307ef7 columnFamilyName f2 2023-02-10 19:02:55,067 DEBUG [StoreOpener-07dbe2f766a0b8b265d0439c26307ef7-1] regionserver.HStore(539): loaded hdfs://localhost:46001/user/jenkins/test-data/e38f8928-0bc5-63bf-a015-81024004f54e/testWithMapReduceMultiRegion/29491060-6c8b-409e-ae71-b2d2144454c4/data/default/testWithMapReduce/07dbe2f766a0b8b265d0439c26307ef7/f2/testWithMapReduce=07dbe2f766a0b8b265d0439c26307ef7-ce63b0110ef64f13adedf84c456454a1 2023-02-10 19:02:55,067 INFO [StoreOpener-07dbe2f766a0b8b265d0439c26307ef7-1] regionserver.HStore(310): Store=07dbe2f766a0b8b265d0439c26307ef7/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-10 19:02:55,067 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-10 19:02:55,067 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 07dbe2f766a0b8b265d0439c26307ef7; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74581084, jitterRate=0.11134475469589233}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-10 19:02:55,067 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 07dbe2f766a0b8b265d0439c26307ef7: Writing region info on filesystem at 1676055775045Initializing all the Stores at 1676055775046 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676055775046Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676055775046Region opened successfully at 1676055775067 (+21 ms) 2023-02-10 19:02:55,234 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 07dbe2f766a0b8b265d0439c26307ef7, disabling compactions & flushes 2023-02-10 19:02:55,234 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,q\x11\x10,1676055767944.07dbe2f766a0b8b265d0439c26307ef7. 2023-02-10 19:02:55,235 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,q\x11\x10,1676055767944.07dbe2f766a0b8b265d0439c26307ef7. 2023-02-10 19:02:55,235 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,q\x11\x10,1676055767944.07dbe2f766a0b8b265d0439c26307ef7. after waiting 0 ms 2023-02-10 19:02:55,235 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,q\x11\x10,1676055767944.07dbe2f766a0b8b265d0439c26307ef7. 2023-02-10 19:02:55,241 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,q\x11\x10,1676055767944.07dbe2f766a0b8b265d0439c26307ef7. 2023-02-10 19:02:55,241 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 07dbe2f766a0b8b265d0439c26307ef7: Waiting for close lock at 1676055775234Disabling compacts and flushes for region at 1676055775234Disabling writes for close at 1676055775235 (+1 ms)Writing region close event to WAL at 1676055775241 (+6 ms)Closed at 1676055775241 2023-02-10 19:02:55,254 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,zz{,1676055767944.05d2a877c2d90362a1d4209daff5b54a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-10 19:02:55,254 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-10 19:02:55,260 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-10 19:02:55,262 INFO [StoreOpener-05d2a877c2d90362a1d4209daff5b54a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 05d2a877c2d90362a1d4209daff5b54a 2023-02-10 19:02:55,265 DEBUG [StoreOpener-05d2a877c2d90362a1d4209daff5b54a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46001/user/jenkins/test-data/e38f8928-0bc5-63bf-a015-81024004f54e/testWithMapReduceMultiRegion/29491060-6c8b-409e-ae71-b2d2144454c4/data/default/testWithMapReduce/05d2a877c2d90362a1d4209daff5b54a/f1 2023-02-10 19:02:55,265 INFO [StoreOpener-05d2a877c2d90362a1d4209daff5b54a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 05d2a877c2d90362a1d4209daff5b54a columnFamilyName f1 2023-02-10 19:02:55,266 INFO [StoreOpener-05d2a877c2d90362a1d4209daff5b54a-1] regionserver.HStore(310): Store=05d2a877c2d90362a1d4209daff5b54a/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-10 19:02:55,266 INFO [StoreOpener-05d2a877c2d90362a1d4209daff5b54a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 05d2a877c2d90362a1d4209daff5b54a 2023-02-10 19:02:55,267 DEBUG [StoreOpener-05d2a877c2d90362a1d4209daff5b54a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46001/user/jenkins/test-data/e38f8928-0bc5-63bf-a015-81024004f54e/testWithMapReduceMultiRegion/29491060-6c8b-409e-ae71-b2d2144454c4/data/default/testWithMapReduce/05d2a877c2d90362a1d4209daff5b54a/f2 2023-02-10 19:02:55,268 INFO [StoreOpener-05d2a877c2d90362a1d4209daff5b54a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 05d2a877c2d90362a1d4209daff5b54a columnFamilyName f2 2023-02-10 19:02:55,269 INFO [StoreOpener-05d2a877c2d90362a1d4209daff5b54a-1] regionserver.HStore(310): Store=05d2a877c2d90362a1d4209daff5b54a/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-10 19:02:55,269 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-10 19:02:55,269 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 05d2a877c2d90362a1d4209daff5b54a; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67759391, jitterRate=0.009693607687950134}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-10 19:02:55,270 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 05d2a877c2d90362a1d4209daff5b54a: Writing region info on filesystem at 1676055775260Initializing all the Stores at 1676055775261 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676055775261Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676055775261Region opened successfully at 1676055775270 (+9 ms) 2023-02-10 19:02:55,289 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 05d2a877c2d90362a1d4209daff5b54a, disabling compactions & flushes 2023-02-10 19:02:55,289 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,zz{,1676055767944.05d2a877c2d90362a1d4209daff5b54a. 2023-02-10 19:02:55,289 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,zz{,1676055767944.05d2a877c2d90362a1d4209daff5b54a. 2023-02-10 19:02:55,289 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,zz{,1676055767944.05d2a877c2d90362a1d4209daff5b54a. after waiting 0 ms 2023-02-10 19:02:55,289 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,zz{,1676055767944.05d2a877c2d90362a1d4209daff5b54a. 2023-02-10 19:02:55,296 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,zz{,1676055767944.05d2a877c2d90362a1d4209daff5b54a. 2023-02-10 19:02:55,296 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 05d2a877c2d90362a1d4209daff5b54a: Waiting for close lock at 1676055775289Disabling compacts and flushes for region at 1676055775289Disabling writes for close at 1676055775289Writing region close event to WAL at 1676055775296 (+7 ms)Closed at 1676055775296 2023-02-10 19:02:55,303 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,j\xCA\xCA,1676055767944.053dc7037d94e17f3f72f5ea563ab135.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-10 19:02:55,303 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-10 19:02:55,313 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-10 19:02:55,316 INFO [StoreOpener-053dc7037d94e17f3f72f5ea563ab135-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 053dc7037d94e17f3f72f5ea563ab135 2023-02-10 19:02:55,318 DEBUG [StoreOpener-053dc7037d94e17f3f72f5ea563ab135-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46001/user/jenkins/test-data/e38f8928-0bc5-63bf-a015-81024004f54e/testWithMapReduceMultiRegion/29491060-6c8b-409e-ae71-b2d2144454c4/data/default/testWithMapReduce/053dc7037d94e17f3f72f5ea563ab135/f1 2023-02-10 19:02:55,318 INFO [StoreOpener-053dc7037d94e17f3f72f5ea563ab135-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 053dc7037d94e17f3f72f5ea563ab135 columnFamilyName f1 2023-02-10 19:02:55,332 DEBUG [StoreOpener-053dc7037d94e17f3f72f5ea563ab135-1] regionserver.HStore(539): loaded hdfs://localhost:46001/user/jenkins/test-data/e38f8928-0bc5-63bf-a015-81024004f54e/testWithMapReduceMultiRegion/29491060-6c8b-409e-ae71-b2d2144454c4/data/default/testWithMapReduce/053dc7037d94e17f3f72f5ea563ab135/f1/testWithMapReduce=053dc7037d94e17f3f72f5ea563ab135-504d267354704aa1887fe95c8317e485 2023-02-10 19:02:55,332 INFO [StoreOpener-053dc7037d94e17f3f72f5ea563ab135-1] regionserver.HStore(310): Store=053dc7037d94e17f3f72f5ea563ab135/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-10 19:02:55,333 INFO [StoreOpener-053dc7037d94e17f3f72f5ea563ab135-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 053dc7037d94e17f3f72f5ea563ab135 2023-02-10 19:02:55,336 DEBUG [StoreOpener-053dc7037d94e17f3f72f5ea563ab135-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46001/user/jenkins/test-data/e38f8928-0bc5-63bf-a015-81024004f54e/testWithMapReduceMultiRegion/29491060-6c8b-409e-ae71-b2d2144454c4/data/default/testWithMapReduce/053dc7037d94e17f3f72f5ea563ab135/f2 2023-02-10 19:02:55,336 INFO [StoreOpener-053dc7037d94e17f3f72f5ea563ab135-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 053dc7037d94e17f3f72f5ea563ab135 columnFamilyName f2 2023-02-10 19:02:55,350 DEBUG [StoreOpener-053dc7037d94e17f3f72f5ea563ab135-1] regionserver.HStore(539): loaded hdfs://localhost:46001/user/jenkins/test-data/e38f8928-0bc5-63bf-a015-81024004f54e/testWithMapReduceMultiRegion/29491060-6c8b-409e-ae71-b2d2144454c4/data/default/testWithMapReduce/053dc7037d94e17f3f72f5ea563ab135/f2/testWithMapReduce=053dc7037d94e17f3f72f5ea563ab135-871880a6275949d4800f26e30c4edeb8 2023-02-10 19:02:55,350 INFO [StoreOpener-053dc7037d94e17f3f72f5ea563ab135-1] regionserver.HStore(310): Store=053dc7037d94e17f3f72f5ea563ab135/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-10 19:02:55,351 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-10 19:02:55,351 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 053dc7037d94e17f3f72f5ea563ab135; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72504359, jitterRate=0.08039914071559906}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-10 19:02:55,351 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 053dc7037d94e17f3f72f5ea563ab135: Writing region info on filesystem at 1676055775313Initializing all the Stores at 1676055775314 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676055775314Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676055775315 (+1 ms)Region opened successfully at 1676055775351 (+36 ms) 2023-02-10 19:02:55,430 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 053dc7037d94e17f3f72f5ea563ab135, disabling compactions & flushes 2023-02-10 19:02:55,430 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,j\xCA\xCA,1676055767944.053dc7037d94e17f3f72f5ea563ab135. 2023-02-10 19:02:55,430 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,j\xCA\xCA,1676055767944.053dc7037d94e17f3f72f5ea563ab135. 2023-02-10 19:02:55,430 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,j\xCA\xCA,1676055767944.053dc7037d94e17f3f72f5ea563ab135. after waiting 0 ms 2023-02-10 19:02:55,430 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,j\xCA\xCA,1676055767944.053dc7037d94e17f3f72f5ea563ab135. 2023-02-10 19:02:55,440 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,j\xCA\xCA,1676055767944.053dc7037d94e17f3f72f5ea563ab135. 2023-02-10 19:02:55,440 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 053dc7037d94e17f3f72f5ea563ab135: Waiting for close lock at 1676055775430Disabling compacts and flushes for region at 1676055775430Disabling writes for close at 1676055775430Writing region close event to WAL at 1676055775440 (+10 ms)Closed at 1676055775440 2023-02-10 19:02:55,446 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,g\xA7\xA7,1676055767944.0b68bcec2ca2391d28b6290c561e3332.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-10 19:02:55,447 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-10 19:02:55,460 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-10 19:02:55,469 INFO [StoreOpener-0b68bcec2ca2391d28b6290c561e3332-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 0b68bcec2ca2391d28b6290c561e3332 2023-02-10 19:02:55,470 DEBUG [StoreOpener-0b68bcec2ca2391d28b6290c561e3332-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46001/user/jenkins/test-data/e38f8928-0bc5-63bf-a015-81024004f54e/testWithMapReduceMultiRegion/29491060-6c8b-409e-ae71-b2d2144454c4/data/default/testWithMapReduce/0b68bcec2ca2391d28b6290c561e3332/f1 2023-02-10 19:02:55,471 INFO [StoreOpener-0b68bcec2ca2391d28b6290c561e3332-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0b68bcec2ca2391d28b6290c561e3332 columnFamilyName f1 2023-02-10 19:02:55,486 DEBUG [StoreOpener-0b68bcec2ca2391d28b6290c561e3332-1] regionserver.HStore(539): loaded hdfs://localhost:46001/user/jenkins/test-data/e38f8928-0bc5-63bf-a015-81024004f54e/testWithMapReduceMultiRegion/29491060-6c8b-409e-ae71-b2d2144454c4/data/default/testWithMapReduce/0b68bcec2ca2391d28b6290c561e3332/f1/testWithMapReduce=0b68bcec2ca2391d28b6290c561e3332-d13fb7a00ef748458b03332cd6a3c8d6 2023-02-10 19:02:55,486 INFO [StoreOpener-0b68bcec2ca2391d28b6290c561e3332-1] regionserver.HStore(310): Store=0b68bcec2ca2391d28b6290c561e3332/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-10 19:02:55,487 INFO [StoreOpener-0b68bcec2ca2391d28b6290c561e3332-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 0b68bcec2ca2391d28b6290c561e3332 2023-02-10 19:02:55,488 DEBUG [StoreOpener-0b68bcec2ca2391d28b6290c561e3332-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46001/user/jenkins/test-data/e38f8928-0bc5-63bf-a015-81024004f54e/testWithMapReduceMultiRegion/29491060-6c8b-409e-ae71-b2d2144454c4/data/default/testWithMapReduce/0b68bcec2ca2391d28b6290c561e3332/f2 2023-02-10 19:02:55,489 INFO [StoreOpener-0b68bcec2ca2391d28b6290c561e3332-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0b68bcec2ca2391d28b6290c561e3332 columnFamilyName f2 2023-02-10 19:02:55,508 DEBUG [StoreOpener-0b68bcec2ca2391d28b6290c561e3332-1] regionserver.HStore(539): loaded hdfs://localhost:46001/user/jenkins/test-data/e38f8928-0bc5-63bf-a015-81024004f54e/testWithMapReduceMultiRegion/29491060-6c8b-409e-ae71-b2d2144454c4/data/default/testWithMapReduce/0b68bcec2ca2391d28b6290c561e3332/f2/testWithMapReduce=0b68bcec2ca2391d28b6290c561e3332-62c542c2d8914d098b3c5d2ac43084a1 2023-02-10 19:02:55,508 INFO [StoreOpener-0b68bcec2ca2391d28b6290c561e3332-1] regionserver.HStore(310): Store=0b68bcec2ca2391d28b6290c561e3332/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-10 19:02:55,508 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-10 19:02:55,509 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 0b68bcec2ca2391d28b6290c561e3332; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64868526, jitterRate=-0.03338363766670227}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-10 19:02:55,509 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 0b68bcec2ca2391d28b6290c561e3332: Writing region info on filesystem at 1676055775460Initializing all the Stores at 1676055775461 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676055775462 (+1 ms)Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676055775462Region opened successfully at 1676055775509 (+47 ms) 2023-02-10 19:02:55,622 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 0b68bcec2ca2391d28b6290c561e3332, disabling compactions & flushes 2023-02-10 19:02:55,622 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,g\xA7\xA7,1676055767944.0b68bcec2ca2391d28b6290c561e3332. 2023-02-10 19:02:55,622 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,g\xA7\xA7,1676055767944.0b68bcec2ca2391d28b6290c561e3332. 2023-02-10 19:02:55,622 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,g\xA7\xA7,1676055767944.0b68bcec2ca2391d28b6290c561e3332. after waiting 0 ms 2023-02-10 19:02:55,622 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,g\xA7\xA7,1676055767944.0b68bcec2ca2391d28b6290c561e3332. 2023-02-10 19:02:55,629 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,g\xA7\xA7,1676055767944.0b68bcec2ca2391d28b6290c561e3332. 2023-02-10 19:02:55,629 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 0b68bcec2ca2391d28b6290c561e3332: Waiting for close lock at 1676055775622Disabling compacts and flushes for region at 1676055775622Disabling writes for close at 1676055775622Writing region close event to WAL at 1676055775629 (+7 ms)Closed at 1676055775629 2023-02-10 19:02:55,638 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,wWV,1676055767944.cca73b62b14aebcd72ce9f0317bde286.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-10 19:02:55,638 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-10 19:02:55,643 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-10 19:02:55,649 INFO [StoreOpener-cca73b62b14aebcd72ce9f0317bde286-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region cca73b62b14aebcd72ce9f0317bde286 2023-02-10 19:02:55,650 DEBUG [StoreOpener-cca73b62b14aebcd72ce9f0317bde286-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46001/user/jenkins/test-data/e38f8928-0bc5-63bf-a015-81024004f54e/testWithMapReduceMultiRegion/29491060-6c8b-409e-ae71-b2d2144454c4/data/default/testWithMapReduce/cca73b62b14aebcd72ce9f0317bde286/f1 2023-02-10 19:02:55,651 INFO [StoreOpener-cca73b62b14aebcd72ce9f0317bde286-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region cca73b62b14aebcd72ce9f0317bde286 columnFamilyName f1 2023-02-10 19:02:55,662 DEBUG [StoreOpener-cca73b62b14aebcd72ce9f0317bde286-1] regionserver.HStore(539): loaded hdfs://localhost:46001/user/jenkins/test-data/e38f8928-0bc5-63bf-a015-81024004f54e/testWithMapReduceMultiRegion/29491060-6c8b-409e-ae71-b2d2144454c4/data/default/testWithMapReduce/cca73b62b14aebcd72ce9f0317bde286/f1/testWithMapReduce=cca73b62b14aebcd72ce9f0317bde286-4cfcead0fcb24e6598b31b611cdd39bf 2023-02-10 19:02:55,662 INFO [StoreOpener-cca73b62b14aebcd72ce9f0317bde286-1] regionserver.HStore(310): Store=cca73b62b14aebcd72ce9f0317bde286/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-10 19:02:55,662 INFO [StoreOpener-cca73b62b14aebcd72ce9f0317bde286-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region cca73b62b14aebcd72ce9f0317bde286 2023-02-10 19:02:55,664 DEBUG [StoreOpener-cca73b62b14aebcd72ce9f0317bde286-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46001/user/jenkins/test-data/e38f8928-0bc5-63bf-a015-81024004f54e/testWithMapReduceMultiRegion/29491060-6c8b-409e-ae71-b2d2144454c4/data/default/testWithMapReduce/cca73b62b14aebcd72ce9f0317bde286/f2 2023-02-10 19:02:55,665 INFO [StoreOpener-cca73b62b14aebcd72ce9f0317bde286-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region cca73b62b14aebcd72ce9f0317bde286 columnFamilyName f2 2023-02-10 19:02:55,672 DEBUG [StoreOpener-cca73b62b14aebcd72ce9f0317bde286-1] regionserver.HStore(539): loaded hdfs://localhost:46001/user/jenkins/test-data/e38f8928-0bc5-63bf-a015-81024004f54e/testWithMapReduceMultiRegion/29491060-6c8b-409e-ae71-b2d2144454c4/data/default/testWithMapReduce/cca73b62b14aebcd72ce9f0317bde286/f2/testWithMapReduce=cca73b62b14aebcd72ce9f0317bde286-94a02f29869d405ab4270bd8fffe2c6d 2023-02-10 19:02:55,673 INFO [StoreOpener-cca73b62b14aebcd72ce9f0317bde286-1] regionserver.HStore(310): Store=cca73b62b14aebcd72ce9f0317bde286/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-10 19:02:55,673 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-10 19:02:55,673 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened cca73b62b14aebcd72ce9f0317bde286; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65421823, jitterRate=-0.025138869881629944}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-10 19:02:55,673 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for cca73b62b14aebcd72ce9f0317bde286: Writing region info on filesystem at 1676055775643Initializing all the Stores at 1676055775644 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676055775644Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676055775648 (+4 ms)Region opened successfully at 1676055775673 (+25 ms) 2023-02-10 19:02:55,722 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing cca73b62b14aebcd72ce9f0317bde286, disabling compactions & flushes 2023-02-10 19:02:55,722 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,wWV,1676055767944.cca73b62b14aebcd72ce9f0317bde286. 2023-02-10 19:02:55,722 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,wWV,1676055767944.cca73b62b14aebcd72ce9f0317bde286. 2023-02-10 19:02:55,722 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,wWV,1676055767944.cca73b62b14aebcd72ce9f0317bde286. after waiting 0 ms 2023-02-10 19:02:55,722 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,wWV,1676055767944.cca73b62b14aebcd72ce9f0317bde286. 2023-02-10 19:02:55,733 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,wWV,1676055767944.cca73b62b14aebcd72ce9f0317bde286. 2023-02-10 19:02:55,734 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for cca73b62b14aebcd72ce9f0317bde286: Waiting for close lock at 1676055775722Disabling compacts and flushes for region at 1676055775722Disabling writes for close at 1676055775722Writing region close event to WAL at 1676055775733 (+11 ms)Closed at 1676055775733 2023-02-10 19:02:55,740 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,aaa,1676055767944.ea671e7088d3fe84e68b3d345289fe97.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-10 19:02:55,740 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-10 19:02:55,745 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-10 19:02:55,747 INFO [StoreOpener-ea671e7088d3fe84e68b3d345289fe97-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region ea671e7088d3fe84e68b3d345289fe97 2023-02-10 19:02:55,749 DEBUG [StoreOpener-ea671e7088d3fe84e68b3d345289fe97-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46001/user/jenkins/test-data/e38f8928-0bc5-63bf-a015-81024004f54e/testWithMapReduceMultiRegion/29491060-6c8b-409e-ae71-b2d2144454c4/data/default/testWithMapReduce/ea671e7088d3fe84e68b3d345289fe97/f1 2023-02-10 19:02:55,749 INFO [StoreOpener-ea671e7088d3fe84e68b3d345289fe97-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ea671e7088d3fe84e68b3d345289fe97 columnFamilyName f1 2023-02-10 19:02:55,757 DEBUG [StoreOpener-ea671e7088d3fe84e68b3d345289fe97-1] regionserver.HStore(539): loaded hdfs://localhost:46001/user/jenkins/test-data/e38f8928-0bc5-63bf-a015-81024004f54e/testWithMapReduceMultiRegion/29491060-6c8b-409e-ae71-b2d2144454c4/data/default/testWithMapReduce/ea671e7088d3fe84e68b3d345289fe97/f1/testWithMapReduce=ea671e7088d3fe84e68b3d345289fe97-1cb1c69f1d034168966cde09a17b098e 2023-02-10 19:02:55,757 INFO [StoreOpener-ea671e7088d3fe84e68b3d345289fe97-1] regionserver.HStore(310): Store=ea671e7088d3fe84e68b3d345289fe97/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-10 19:02:55,757 INFO [StoreOpener-ea671e7088d3fe84e68b3d345289fe97-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region ea671e7088d3fe84e68b3d345289fe97 2023-02-10 19:02:55,758 DEBUG [StoreOpener-ea671e7088d3fe84e68b3d345289fe97-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46001/user/jenkins/test-data/e38f8928-0bc5-63bf-a015-81024004f54e/testWithMapReduceMultiRegion/29491060-6c8b-409e-ae71-b2d2144454c4/data/default/testWithMapReduce/ea671e7088d3fe84e68b3d345289fe97/f2 2023-02-10 19:02:55,759 INFO [StoreOpener-ea671e7088d3fe84e68b3d345289fe97-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ea671e7088d3fe84e68b3d345289fe97 columnFamilyName f2 2023-02-10 19:02:55,766 DEBUG [StoreOpener-ea671e7088d3fe84e68b3d345289fe97-1] regionserver.HStore(539): loaded hdfs://localhost:46001/user/jenkins/test-data/e38f8928-0bc5-63bf-a015-81024004f54e/testWithMapReduceMultiRegion/29491060-6c8b-409e-ae71-b2d2144454c4/data/default/testWithMapReduce/ea671e7088d3fe84e68b3d345289fe97/f2/testWithMapReduce=ea671e7088d3fe84e68b3d345289fe97-905d6e0f39194973bc5d4ae34b4d908f 2023-02-10 19:02:55,766 INFO [StoreOpener-ea671e7088d3fe84e68b3d345289fe97-1] regionserver.HStore(310): Store=ea671e7088d3fe84e68b3d345289fe97/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-10 19:02:55,766 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-10 19:02:55,767 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened ea671e7088d3fe84e68b3d345289fe97; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=75190258, jitterRate=0.12042215466499329}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-10 19:02:55,767 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for ea671e7088d3fe84e68b3d345289fe97: Writing region info on filesystem at 1676055775745Initializing all the Stores at 1676055775746 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676055775746Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676055775746Region opened successfully at 1676055775767 (+21 ms) 2023-02-10 19:02:55,819 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing ea671e7088d3fe84e68b3d345289fe97, disabling compactions & flushes 2023-02-10 19:02:55,819 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,aaa,1676055767944.ea671e7088d3fe84e68b3d345289fe97. 2023-02-10 19:02:55,819 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,aaa,1676055767944.ea671e7088d3fe84e68b3d345289fe97. 2023-02-10 19:02:55,819 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,aaa,1676055767944.ea671e7088d3fe84e68b3d345289fe97. after waiting 0 ms 2023-02-10 19:02:55,819 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,aaa,1676055767944.ea671e7088d3fe84e68b3d345289fe97. 2023-02-10 19:02:55,831 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,aaa,1676055767944.ea671e7088d3fe84e68b3d345289fe97. 2023-02-10 19:02:55,831 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for ea671e7088d3fe84e68b3d345289fe97: Waiting for close lock at 1676055775819Disabling compacts and flushes for region at 1676055775819Disabling writes for close at 1676055775819Writing region close event to WAL at 1676055775831 (+12 ms)Closed at 1676055775831 2023-02-10 19:02:55,835 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,d\x84\x84,1676055767944.b5248077ace761a2c5d43c344f646651.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-10 19:02:55,835 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-10 19:02:55,845 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-10 19:02:55,853 INFO [StoreOpener-b5248077ace761a2c5d43c344f646651-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region b5248077ace761a2c5d43c344f646651 2023-02-10 19:02:55,854 DEBUG [StoreOpener-b5248077ace761a2c5d43c344f646651-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46001/user/jenkins/test-data/e38f8928-0bc5-63bf-a015-81024004f54e/testWithMapReduceMultiRegion/29491060-6c8b-409e-ae71-b2d2144454c4/data/default/testWithMapReduce/b5248077ace761a2c5d43c344f646651/f1 2023-02-10 19:02:55,855 INFO [StoreOpener-b5248077ace761a2c5d43c344f646651-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b5248077ace761a2c5d43c344f646651 columnFamilyName f1 2023-02-10 19:02:55,867 DEBUG [StoreOpener-b5248077ace761a2c5d43c344f646651-1] regionserver.HStore(539): loaded hdfs://localhost:46001/user/jenkins/test-data/e38f8928-0bc5-63bf-a015-81024004f54e/testWithMapReduceMultiRegion/29491060-6c8b-409e-ae71-b2d2144454c4/data/default/testWithMapReduce/b5248077ace761a2c5d43c344f646651/f1/testWithMapReduce=b5248077ace761a2c5d43c344f646651-fb0ff4da36be4e70b3c8085cf63149b8 2023-02-10 19:02:55,867 INFO [StoreOpener-b5248077ace761a2c5d43c344f646651-1] regionserver.HStore(310): Store=b5248077ace761a2c5d43c344f646651/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-10 19:02:55,867 INFO [StoreOpener-b5248077ace761a2c5d43c344f646651-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region b5248077ace761a2c5d43c344f646651 2023-02-10 19:02:55,869 DEBUG [StoreOpener-b5248077ace761a2c5d43c344f646651-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46001/user/jenkins/test-data/e38f8928-0bc5-63bf-a015-81024004f54e/testWithMapReduceMultiRegion/29491060-6c8b-409e-ae71-b2d2144454c4/data/default/testWithMapReduce/b5248077ace761a2c5d43c344f646651/f2 2023-02-10 19:02:55,869 INFO [StoreOpener-b5248077ace761a2c5d43c344f646651-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b5248077ace761a2c5d43c344f646651 columnFamilyName f2 2023-02-10 19:02:55,885 DEBUG [StoreOpener-b5248077ace761a2c5d43c344f646651-1] regionserver.HStore(539): loaded hdfs://localhost:46001/user/jenkins/test-data/e38f8928-0bc5-63bf-a015-81024004f54e/testWithMapReduceMultiRegion/29491060-6c8b-409e-ae71-b2d2144454c4/data/default/testWithMapReduce/b5248077ace761a2c5d43c344f646651/f2/testWithMapReduce=b5248077ace761a2c5d43c344f646651-a897301323734c9b82ef09fe533f9dc0 2023-02-10 19:02:55,886 INFO [StoreOpener-b5248077ace761a2c5d43c344f646651-1] regionserver.HStore(310): Store=b5248077ace761a2c5d43c344f646651/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-10 19:02:55,886 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-10 19:02:55,886 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened b5248077ace761a2c5d43c344f646651; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59615631, jitterRate=-0.11165787279605865}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-10 19:02:55,886 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for b5248077ace761a2c5d43c344f646651: Writing region info on filesystem at 1676055775845Initializing all the Stores at 1676055775846 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676055775846Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676055775852 (+6 ms)Region opened successfully at 1676055775886 (+34 ms) 2023-02-10 19:02:55,929 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing b5248077ace761a2c5d43c344f646651, disabling compactions & flushes 2023-02-10 19:02:55,930 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,d\x84\x84,1676055767944.b5248077ace761a2c5d43c344f646651. 2023-02-10 19:02:55,930 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,d\x84\x84,1676055767944.b5248077ace761a2c5d43c344f646651. 2023-02-10 19:02:55,930 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,d\x84\x84,1676055767944.b5248077ace761a2c5d43c344f646651. after waiting 0 ms 2023-02-10 19:02:55,930 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,d\x84\x84,1676055767944.b5248077ace761a2c5d43c344f646651. 2023-02-10 19:02:55,958 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,d\x84\x84,1676055767944.b5248077ace761a2c5d43c344f646651. 2023-02-10 19:02:55,958 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for b5248077ace761a2c5d43c344f646651: Waiting for close lock at 1676055775929Disabling compacts and flushes for region at 1676055775929Disabling writes for close at 1676055775930 (+1 ms)Writing region close event to WAL at 1676055775958 (+28 ms)Closed at 1676055775958 2023-02-10 19:02:55,966 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676055767944.813b88c1d27659129f4a12d3c70b79c7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-10 19:02:55,966 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-10 19:02:55,985 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-10 19:02:55,989 INFO [StoreOpener-813b88c1d27659129f4a12d3c70b79c7-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 813b88c1d27659129f4a12d3c70b79c7 2023-02-10 19:02:55,991 DEBUG [StoreOpener-813b88c1d27659129f4a12d3c70b79c7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46001/user/jenkins/test-data/e38f8928-0bc5-63bf-a015-81024004f54e/testWithMapReduceMultiRegion/29491060-6c8b-409e-ae71-b2d2144454c4/data/default/testWithMapReduce/813b88c1d27659129f4a12d3c70b79c7/f1 2023-02-10 19:02:55,992 INFO [StoreOpener-813b88c1d27659129f4a12d3c70b79c7-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 813b88c1d27659129f4a12d3c70b79c7 columnFamilyName f1 2023-02-10 19:02:55,992 INFO [StoreOpener-813b88c1d27659129f4a12d3c70b79c7-1] regionserver.HStore(310): Store=813b88c1d27659129f4a12d3c70b79c7/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-10 19:02:55,993 INFO [StoreOpener-813b88c1d27659129f4a12d3c70b79c7-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 813b88c1d27659129f4a12d3c70b79c7 2023-02-10 19:02:55,995 DEBUG [StoreOpener-813b88c1d27659129f4a12d3c70b79c7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46001/user/jenkins/test-data/e38f8928-0bc5-63bf-a015-81024004f54e/testWithMapReduceMultiRegion/29491060-6c8b-409e-ae71-b2d2144454c4/data/default/testWithMapReduce/813b88c1d27659129f4a12d3c70b79c7/f2 2023-02-10 19:02:55,995 INFO [StoreOpener-813b88c1d27659129f4a12d3c70b79c7-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 813b88c1d27659129f4a12d3c70b79c7 columnFamilyName f2 2023-02-10 19:02:55,996 INFO [StoreOpener-813b88c1d27659129f4a12d3c70b79c7-1] regionserver.HStore(310): Store=813b88c1d27659129f4a12d3c70b79c7/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-10 19:02:55,997 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-10 19:02:55,997 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 813b88c1d27659129f4a12d3c70b79c7; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73531535, jitterRate=0.09570525586605072}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-10 19:02:55,997 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 813b88c1d27659129f4a12d3c70b79c7: Writing region info on filesystem at 1676055775985Initializing all the Stores at 1676055775986 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676055775986Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676055775987 (+1 ms)Region opened successfully at 1676055775997 (+10 ms) 2023-02-10 19:02:56,031 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 813b88c1d27659129f4a12d3c70b79c7, disabling compactions & flushes 2023-02-10 19:02:56,031 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676055767944.813b88c1d27659129f4a12d3c70b79c7. 2023-02-10 19:02:56,031 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676055767944.813b88c1d27659129f4a12d3c70b79c7. 2023-02-10 19:02:56,031 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676055767944.813b88c1d27659129f4a12d3c70b79c7. after waiting 0 ms 2023-02-10 19:02:56,031 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676055767944.813b88c1d27659129f4a12d3c70b79c7. 2023-02-10 19:02:56,032 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,,1676055767944.813b88c1d27659129f4a12d3c70b79c7. 2023-02-10 19:02:56,032 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 813b88c1d27659129f4a12d3c70b79c7: Waiting for close lock at 1676055776031Disabling compacts and flushes for region at 1676055776031Disabling writes for close at 1676055776031Writing region close event to WAL at 1676055776032 (+1 ms)Closed at 1676055776032 2023-02-10 19:02:56,041 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,m\xED\xED,1676055767944.2abc519a8c9fd6a76400a0e9294c9317.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-10 19:02:56,041 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-10 19:02:56,043 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-10 19:02:56,045 INFO [StoreOpener-2abc519a8c9fd6a76400a0e9294c9317-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 2abc519a8c9fd6a76400a0e9294c9317 2023-02-10 19:02:56,046 DEBUG [StoreOpener-2abc519a8c9fd6a76400a0e9294c9317-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46001/user/jenkins/test-data/e38f8928-0bc5-63bf-a015-81024004f54e/testWithMapReduceMultiRegion/29491060-6c8b-409e-ae71-b2d2144454c4/data/default/testWithMapReduce/2abc519a8c9fd6a76400a0e9294c9317/f1 2023-02-10 19:02:56,046 INFO [StoreOpener-2abc519a8c9fd6a76400a0e9294c9317-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2abc519a8c9fd6a76400a0e9294c9317 columnFamilyName f1 2023-02-10 19:02:56,053 DEBUG [StoreOpener-2abc519a8c9fd6a76400a0e9294c9317-1] regionserver.HStore(539): loaded hdfs://localhost:46001/user/jenkins/test-data/e38f8928-0bc5-63bf-a015-81024004f54e/testWithMapReduceMultiRegion/29491060-6c8b-409e-ae71-b2d2144454c4/data/default/testWithMapReduce/2abc519a8c9fd6a76400a0e9294c9317/f1/testWithMapReduce=2abc519a8c9fd6a76400a0e9294c9317-253de5c7eb7e4d3d9eb98c4c28bf4117 2023-02-10 19:02:56,053 INFO [StoreOpener-2abc519a8c9fd6a76400a0e9294c9317-1] regionserver.HStore(310): Store=2abc519a8c9fd6a76400a0e9294c9317/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-10 19:02:56,053 INFO [StoreOpener-2abc519a8c9fd6a76400a0e9294c9317-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 2abc519a8c9fd6a76400a0e9294c9317 2023-02-10 19:02:56,054 DEBUG [StoreOpener-2abc519a8c9fd6a76400a0e9294c9317-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46001/user/jenkins/test-data/e38f8928-0bc5-63bf-a015-81024004f54e/testWithMapReduceMultiRegion/29491060-6c8b-409e-ae71-b2d2144454c4/data/default/testWithMapReduce/2abc519a8c9fd6a76400a0e9294c9317/f2 2023-02-10 19:02:56,055 INFO [StoreOpener-2abc519a8c9fd6a76400a0e9294c9317-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2abc519a8c9fd6a76400a0e9294c9317 columnFamilyName f2 2023-02-10 19:02:56,065 DEBUG [StoreOpener-2abc519a8c9fd6a76400a0e9294c9317-1] regionserver.HStore(539): loaded hdfs://localhost:46001/user/jenkins/test-data/e38f8928-0bc5-63bf-a015-81024004f54e/testWithMapReduceMultiRegion/29491060-6c8b-409e-ae71-b2d2144454c4/data/default/testWithMapReduce/2abc519a8c9fd6a76400a0e9294c9317/f2/testWithMapReduce=2abc519a8c9fd6a76400a0e9294c9317-6e0c81a35f164756ba1801d4b22b31e8 2023-02-10 19:02:56,065 INFO [StoreOpener-2abc519a8c9fd6a76400a0e9294c9317-1] regionserver.HStore(310): Store=2abc519a8c9fd6a76400a0e9294c9317/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-10 19:02:56,066 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-10 19:02:56,066 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 2abc519a8c9fd6a76400a0e9294c9317; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62670857, jitterRate=-0.06613145768642426}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-10 19:02:56,066 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 2abc519a8c9fd6a76400a0e9294c9317: Writing region info on filesystem at 1676055776043Initializing all the Stores at 1676055776044 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676055776044Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676055776044Region opened successfully at 1676055776066 (+22 ms) 2023-02-10 19:02:56,101 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 2abc519a8c9fd6a76400a0e9294c9317, disabling compactions & flushes 2023-02-10 19:02:56,101 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,m\xED\xED,1676055767944.2abc519a8c9fd6a76400a0e9294c9317. 2023-02-10 19:02:56,102 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,m\xED\xED,1676055767944.2abc519a8c9fd6a76400a0e9294c9317. 2023-02-10 19:02:56,102 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,m\xED\xED,1676055767944.2abc519a8c9fd6a76400a0e9294c9317. after waiting 0 ms 2023-02-10 19:02:56,102 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,m\xED\xED,1676055767944.2abc519a8c9fd6a76400a0e9294c9317. 2023-02-10 19:02:56,105 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,m\xED\xED,1676055767944.2abc519a8c9fd6a76400a0e9294c9317. 2023-02-10 19:02:56,105 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 2abc519a8c9fd6a76400a0e9294c9317: Waiting for close lock at 1676055776101Disabling compacts and flushes for region at 1676055776101Disabling writes for close at 1676055776102 (+1 ms)Writing region close event to WAL at 1676055776105 (+3 ms)Closed at 1676055776105 2023-02-10 19:02:56,109 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,t43,1676055767944.52e916374c45f2d5119804d8db34ffe7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-10 19:02:56,109 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-10 19:02:56,110 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-10 19:02:56,113 INFO [StoreOpener-52e916374c45f2d5119804d8db34ffe7-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 52e916374c45f2d5119804d8db34ffe7 2023-02-10 19:02:56,114 DEBUG [StoreOpener-52e916374c45f2d5119804d8db34ffe7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46001/user/jenkins/test-data/e38f8928-0bc5-63bf-a015-81024004f54e/testWithMapReduceMultiRegion/29491060-6c8b-409e-ae71-b2d2144454c4/data/default/testWithMapReduce/52e916374c45f2d5119804d8db34ffe7/f1 2023-02-10 19:02:56,114 INFO [StoreOpener-52e916374c45f2d5119804d8db34ffe7-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 52e916374c45f2d5119804d8db34ffe7 columnFamilyName f1 2023-02-10 19:02:56,129 DEBUG [StoreOpener-52e916374c45f2d5119804d8db34ffe7-1] regionserver.HStore(539): loaded hdfs://localhost:46001/user/jenkins/test-data/e38f8928-0bc5-63bf-a015-81024004f54e/testWithMapReduceMultiRegion/29491060-6c8b-409e-ae71-b2d2144454c4/data/default/testWithMapReduce/52e916374c45f2d5119804d8db34ffe7/f1/testWithMapReduce=52e916374c45f2d5119804d8db34ffe7-7046e04cad38425f93b18e9cdf97792a 2023-02-10 19:02:56,129 INFO [StoreOpener-52e916374c45f2d5119804d8db34ffe7-1] regionserver.HStore(310): Store=52e916374c45f2d5119804d8db34ffe7/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-10 19:02:56,129 INFO [StoreOpener-52e916374c45f2d5119804d8db34ffe7-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 52e916374c45f2d5119804d8db34ffe7 2023-02-10 19:02:56,131 DEBUG [StoreOpener-52e916374c45f2d5119804d8db34ffe7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46001/user/jenkins/test-data/e38f8928-0bc5-63bf-a015-81024004f54e/testWithMapReduceMultiRegion/29491060-6c8b-409e-ae71-b2d2144454c4/data/default/testWithMapReduce/52e916374c45f2d5119804d8db34ffe7/f2 2023-02-10 19:02:56,131 INFO [StoreOpener-52e916374c45f2d5119804d8db34ffe7-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 52e916374c45f2d5119804d8db34ffe7 columnFamilyName f2 2023-02-10 19:02:56,138 DEBUG [StoreOpener-52e916374c45f2d5119804d8db34ffe7-1] regionserver.HStore(539): loaded hdfs://localhost:46001/user/jenkins/test-data/e38f8928-0bc5-63bf-a015-81024004f54e/testWithMapReduceMultiRegion/29491060-6c8b-409e-ae71-b2d2144454c4/data/default/testWithMapReduce/52e916374c45f2d5119804d8db34ffe7/f2/testWithMapReduce=52e916374c45f2d5119804d8db34ffe7-9cd807e0a98e4c4091980728d6f09bfa 2023-02-10 19:02:56,139 INFO [StoreOpener-52e916374c45f2d5119804d8db34ffe7-1] regionserver.HStore(310): Store=52e916374c45f2d5119804d8db34ffe7/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-10 19:02:56,139 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-10 19:02:56,139 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 52e916374c45f2d5119804d8db34ffe7; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63340877, jitterRate=-0.05614738166332245}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-10 19:02:56,139 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 52e916374c45f2d5119804d8db34ffe7: Writing region info on filesystem at 1676055776110Initializing all the Stores at 1676055776112 (+2 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676055776112Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676055776112Region opened successfully at 1676055776139 (+27 ms) 2023-02-10 19:02:56,169 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 52e916374c45f2d5119804d8db34ffe7, disabling compactions & flushes 2023-02-10 19:02:56,169 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,t43,1676055767944.52e916374c45f2d5119804d8db34ffe7. 2023-02-10 19:02:56,169 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,t43,1676055767944.52e916374c45f2d5119804d8db34ffe7. 2023-02-10 19:02:56,169 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,t43,1676055767944.52e916374c45f2d5119804d8db34ffe7. after waiting 0 ms 2023-02-10 19:02:56,169 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,t43,1676055767944.52e916374c45f2d5119804d8db34ffe7. 2023-02-10 19:02:56,175 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,t43,1676055767944.52e916374c45f2d5119804d8db34ffe7. 2023-02-10 19:02:56,175 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 52e916374c45f2d5119804d8db34ffe7: Waiting for close lock at 1676055776169Disabling compacts and flushes for region at 1676055776169Disabling writes for close at 1676055776169Writing region close event to WAL at 1676055776175 (+6 ms)Closed at 1676055776175 2023-02-10 19:02:56,963 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41145] master.MasterRpcServices(748): Client=jenkins//172.31.14.131 delete name: "testWithMapReduceMultiRegion" 2023-02-10 19:02:56,966 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41145] snapshot.SnapshotManager(333): Deleting snapshot: testWithMapReduceMultiRegion 2023-02-10 19:02:56,970 INFO [Listener at localhost/32909] client.HBaseAdmin$15(890): Started disable of testWithMapReduce 2023-02-10 19:02:56,970 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41145] master.HMaster$11(2405): Client=jenkins//172.31.14.131 disable testWithMapReduce 2023-02-10 19:02:56,977 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41145] procedure2.ProcedureExecutor(1029): Stored pid=33, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testWithMapReduce 2023-02-10 19:02:56,981 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676055776981"}]},"ts":"1676055776981"} 2023-02-10 19:02:56,982 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41145] master.MasterRpcServices(1227): Checking to see if procedure is done pid=33 2023-02-10 19:02:56,983 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=DISABLING in hbase:meta 2023-02-10 19:02:56,985 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testWithMapReduce to state=DISABLING 2023-02-10 19:02:56,989 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=34, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=813b88c1d27659129f4a12d3c70b79c7, UNASSIGN}, {pid=35, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=ea671e7088d3fe84e68b3d345289fe97, UNASSIGN}, {pid=36, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=b5248077ace761a2c5d43c344f646651, UNASSIGN}, {pid=37, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=0b68bcec2ca2391d28b6290c561e3332, UNASSIGN}, {pid=38, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=053dc7037d94e17f3f72f5ea563ab135, UNASSIGN}, {pid=39, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=2abc519a8c9fd6a76400a0e9294c9317, UNASSIGN}, {pid=40, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=07dbe2f766a0b8b265d0439c26307ef7, UNASSIGN}, {pid=41, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=52e916374c45f2d5119804d8db34ffe7, UNASSIGN}, {pid=42, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=cca73b62b14aebcd72ce9f0317bde286, UNASSIGN}, {pid=43, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=05d2a877c2d90362a1d4209daff5b54a, UNASSIGN}] 2023-02-10 19:02:56,992 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=43, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=05d2a877c2d90362a1d4209daff5b54a, UNASSIGN 2023-02-10 19:02:56,992 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=41, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=52e916374c45f2d5119804d8db34ffe7, UNASSIGN 2023-02-10 19:02:56,992 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=40, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=07dbe2f766a0b8b265d0439c26307ef7, UNASSIGN 2023-02-10 19:02:56,992 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=42, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=cca73b62b14aebcd72ce9f0317bde286, UNASSIGN 2023-02-10 19:02:56,993 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=39, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=2abc519a8c9fd6a76400a0e9294c9317, UNASSIGN 2023-02-10 19:02:56,994 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=40 updating hbase:meta row=07dbe2f766a0b8b265d0439c26307ef7, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,43623,1676055764936 2023-02-10 19:02:56,994 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=39 updating hbase:meta row=2abc519a8c9fd6a76400a0e9294c9317, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,43623,1676055764936 2023-02-10 19:02:56,994 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=41 updating hbase:meta row=52e916374c45f2d5119804d8db34ffe7, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,43337,1676055764986 2023-02-10 19:02:56,994 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=05d2a877c2d90362a1d4209daff5b54a, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,43337,1676055764986 2023-02-10 19:02:56,994 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,q\\x11\\x10,1676055767944.07dbe2f766a0b8b265d0439c26307ef7.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676055776994"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676055776994"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676055776994"}]},"ts":"1676055776994"} 2023-02-10 19:02:56,994 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=42 updating hbase:meta row=cca73b62b14aebcd72ce9f0317bde286, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,43623,1676055764936 2023-02-10 19:02:56,994 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,m\\xED\\xED,1676055767944.2abc519a8c9fd6a76400a0e9294c9317.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676055776994"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676055776994"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676055776994"}]},"ts":"1676055776994"} 2023-02-10 19:02:56,994 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,t43,1676055767944.52e916374c45f2d5119804d8db34ffe7.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676055776994"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676055776994"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676055776994"}]},"ts":"1676055776994"} 2023-02-10 19:02:56,995 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,zz{,1676055767944.05d2a877c2d90362a1d4209daff5b54a.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676055776994"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676055776994"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676055776994"}]},"ts":"1676055776994"} 2023-02-10 19:02:56,995 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,wWV,1676055767944.cca73b62b14aebcd72ce9f0317bde286.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676055776994"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676055776994"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676055776994"}]},"ts":"1676055776994"} 2023-02-10 19:02:56,997 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=44, ppid=40, state=RUNNABLE; CloseRegionProcedure 07dbe2f766a0b8b265d0439c26307ef7, server=jenkins-hbase4.apache.org,43623,1676055764936}] 2023-02-10 19:02:56,997 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=45, ppid=43, state=RUNNABLE; CloseRegionProcedure 05d2a877c2d90362a1d4209daff5b54a, server=jenkins-hbase4.apache.org,43337,1676055764986}] 2023-02-10 19:02:56,998 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=46, ppid=41, state=RUNNABLE; CloseRegionProcedure 52e916374c45f2d5119804d8db34ffe7, server=jenkins-hbase4.apache.org,43337,1676055764986}] 2023-02-10 19:02:56,999 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=47, ppid=42, state=RUNNABLE; CloseRegionProcedure cca73b62b14aebcd72ce9f0317bde286, server=jenkins-hbase4.apache.org,43623,1676055764936}] 2023-02-10 19:02:57,000 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=48, ppid=39, state=RUNNABLE; CloseRegionProcedure 2abc519a8c9fd6a76400a0e9294c9317, server=jenkins-hbase4.apache.org,43623,1676055764936}] 2023-02-10 19:02:57,008 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=38, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=053dc7037d94e17f3f72f5ea563ab135, UNASSIGN 2023-02-10 19:02:57,008 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=37, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=0b68bcec2ca2391d28b6290c561e3332, UNASSIGN 2023-02-10 19:02:57,008 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=36, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=b5248077ace761a2c5d43c344f646651, UNASSIGN 2023-02-10 19:02:57,009 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=35, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=ea671e7088d3fe84e68b3d345289fe97, UNASSIGN 2023-02-10 19:02:57,010 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=053dc7037d94e17f3f72f5ea563ab135, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,43337,1676055764986 2023-02-10 19:02:57,010 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=0b68bcec2ca2391d28b6290c561e3332, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,43623,1676055764936 2023-02-10 19:02:57,010 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=36 updating hbase:meta row=b5248077ace761a2c5d43c344f646651, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,43337,1676055764986 2023-02-10 19:02:57,010 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,g\\xA7\\xA7,1676055767944.0b68bcec2ca2391d28b6290c561e3332.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676055777010"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676055777010"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676055777010"}]},"ts":"1676055777010"} 2023-02-10 19:02:57,010 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,d\\x84\\x84,1676055767944.b5248077ace761a2c5d43c344f646651.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676055777010"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676055777010"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676055777010"}]},"ts":"1676055777010"} 2023-02-10 19:02:57,010 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,j\\xCA\\xCA,1676055767944.053dc7037d94e17f3f72f5ea563ab135.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676055777010"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676055777010"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676055777010"}]},"ts":"1676055777010"} 2023-02-10 19:02:57,011 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=34, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=813b88c1d27659129f4a12d3c70b79c7, UNASSIGN 2023-02-10 19:02:57,011 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=35 updating hbase:meta row=ea671e7088d3fe84e68b3d345289fe97, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,43623,1676055764936 2023-02-10 19:02:57,011 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,aaa,1676055767944.ea671e7088d3fe84e68b3d345289fe97.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676055777011"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676055777011"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676055777011"}]},"ts":"1676055777011"} 2023-02-10 19:02:57,012 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=34 updating hbase:meta row=813b88c1d27659129f4a12d3c70b79c7, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,43337,1676055764986 2023-02-10 19:02:57,012 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,,1676055767944.813b88c1d27659129f4a12d3c70b79c7.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676055777012"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676055777012"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676055777012"}]},"ts":"1676055777012"} 2023-02-10 19:02:57,013 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=49, ppid=37, state=RUNNABLE; CloseRegionProcedure 0b68bcec2ca2391d28b6290c561e3332, server=jenkins-hbase4.apache.org,43623,1676055764936}] 2023-02-10 19:02:57,014 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=50, ppid=36, state=RUNNABLE; CloseRegionProcedure b5248077ace761a2c5d43c344f646651, server=jenkins-hbase4.apache.org,43337,1676055764986}] 2023-02-10 19:02:57,015 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=51, ppid=38, state=RUNNABLE; CloseRegionProcedure 053dc7037d94e17f3f72f5ea563ab135, server=jenkins-hbase4.apache.org,43337,1676055764986}] 2023-02-10 19:02:57,017 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=52, ppid=35, state=RUNNABLE; CloseRegionProcedure ea671e7088d3fe84e68b3d345289fe97, server=jenkins-hbase4.apache.org,43623,1676055764936}] 2023-02-10 19:02:57,018 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=53, ppid=34, state=RUNNABLE; CloseRegionProcedure 813b88c1d27659129f4a12d3c70b79c7, server=jenkins-hbase4.apache.org,43337,1676055764986}] 2023-02-10 19:02:57,084 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41145] master.MasterRpcServices(1227): Checking to see if procedure is done pid=33 2023-02-10 19:02:57,159 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close cca73b62b14aebcd72ce9f0317bde286 2023-02-10 19:02:57,159 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 813b88c1d27659129f4a12d3c70b79c7 2023-02-10 19:02:57,159 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing cca73b62b14aebcd72ce9f0317bde286, disabling compactions & flushes 2023-02-10 19:02:57,159 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 813b88c1d27659129f4a12d3c70b79c7, disabling compactions & flushes 2023-02-10 19:02:57,159 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,wWV,1676055767944.cca73b62b14aebcd72ce9f0317bde286. 2023-02-10 19:02:57,159 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676055767944.813b88c1d27659129f4a12d3c70b79c7. 2023-02-10 19:02:57,159 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,wWV,1676055767944.cca73b62b14aebcd72ce9f0317bde286. 2023-02-10 19:02:57,159 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676055767944.813b88c1d27659129f4a12d3c70b79c7. 2023-02-10 19:02:57,159 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,wWV,1676055767944.cca73b62b14aebcd72ce9f0317bde286. after waiting 0 ms 2023-02-10 19:02:57,160 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676055767944.813b88c1d27659129f4a12d3c70b79c7. after waiting 0 ms 2023-02-10 19:02:57,160 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,wWV,1676055767944.cca73b62b14aebcd72ce9f0317bde286. 2023-02-10 19:02:57,160 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676055767944.813b88c1d27659129f4a12d3c70b79c7. 2023-02-10 19:02:57,170 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/data/default/testWithMapReduce/813b88c1d27659129f4a12d3c70b79c7/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-02-10 19:02:57,171 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/data/default/testWithMapReduce/cca73b62b14aebcd72ce9f0317bde286/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-10 19:02:57,173 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,,1676055767944.813b88c1d27659129f4a12d3c70b79c7. 2023-02-10 19:02:57,173 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,wWV,1676055767944.cca73b62b14aebcd72ce9f0317bde286. 2023-02-10 19:02:57,173 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 813b88c1d27659129f4a12d3c70b79c7: Waiting for close lock at 1676055777159Running coprocessor pre-close hooks at 1676055777159Disabling compacts and flushes for region at 1676055777159Disabling writes for close at 1676055777160 (+1 ms)Writing region close event to WAL at 1676055777160Running coprocessor post-close hooks at 1676055777171 (+11 ms)Closed at 1676055777173 (+2 ms) 2023-02-10 19:02:57,173 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for cca73b62b14aebcd72ce9f0317bde286: Waiting for close lock at 1676055777159Running coprocessor pre-close hooks at 1676055777159Disabling compacts and flushes for region at 1676055777159Disabling writes for close at 1676055777160 (+1 ms)Writing region close event to WAL at 1676055777167 (+7 ms)Running coprocessor post-close hooks at 1676055777172 (+5 ms)Closed at 1676055777173 (+1 ms) 2023-02-10 19:02:57,175 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 813b88c1d27659129f4a12d3c70b79c7 2023-02-10 19:02:57,175 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 05d2a877c2d90362a1d4209daff5b54a 2023-02-10 19:02:57,175 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 05d2a877c2d90362a1d4209daff5b54a, disabling compactions & flushes 2023-02-10 19:02:57,175 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,zz{,1676055767944.05d2a877c2d90362a1d4209daff5b54a. 2023-02-10 19:02:57,175 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,zz{,1676055767944.05d2a877c2d90362a1d4209daff5b54a. 2023-02-10 19:02:57,176 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,zz{,1676055767944.05d2a877c2d90362a1d4209daff5b54a. after waiting 0 ms 2023-02-10 19:02:57,176 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,zz{,1676055767944.05d2a877c2d90362a1d4209daff5b54a. 2023-02-10 19:02:57,177 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=34 updating hbase:meta row=813b88c1d27659129f4a12d3c70b79c7, regionState=CLOSED 2023-02-10 19:02:57,177 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,,1676055767944.813b88c1d27659129f4a12d3c70b79c7.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676055777177"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676055777177"}]},"ts":"1676055777177"} 2023-02-10 19:02:57,183 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed cca73b62b14aebcd72ce9f0317bde286 2023-02-10 19:02:57,183 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 2abc519a8c9fd6a76400a0e9294c9317 2023-02-10 19:02:57,183 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 2abc519a8c9fd6a76400a0e9294c9317, disabling compactions & flushes 2023-02-10 19:02:57,183 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,m\xED\xED,1676055767944.2abc519a8c9fd6a76400a0e9294c9317. 2023-02-10 19:02:57,183 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,m\xED\xED,1676055767944.2abc519a8c9fd6a76400a0e9294c9317. 2023-02-10 19:02:57,183 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,m\xED\xED,1676055767944.2abc519a8c9fd6a76400a0e9294c9317. after waiting 0 ms 2023-02-10 19:02:57,183 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,m\xED\xED,1676055767944.2abc519a8c9fd6a76400a0e9294c9317. 2023-02-10 19:02:57,184 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=42 updating hbase:meta row=cca73b62b14aebcd72ce9f0317bde286, regionState=CLOSED 2023-02-10 19:02:57,184 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,wWV,1676055767944.cca73b62b14aebcd72ce9f0317bde286.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676055777183"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676055777183"}]},"ts":"1676055777183"} 2023-02-10 19:02:57,187 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=53, resume processing ppid=34 2023-02-10 19:02:57,187 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=53, ppid=34, state=SUCCESS; CloseRegionProcedure 813b88c1d27659129f4a12d3c70b79c7, server=jenkins-hbase4.apache.org,43337,1676055764986 in 164 msec 2023-02-10 19:02:57,189 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=47, resume processing ppid=42 2023-02-10 19:02:57,190 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=34, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=813b88c1d27659129f4a12d3c70b79c7, UNASSIGN in 200 msec 2023-02-10 19:02:57,190 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=47, ppid=42, state=SUCCESS; CloseRegionProcedure cca73b62b14aebcd72ce9f0317bde286, server=jenkins-hbase4.apache.org,43623,1676055764936 in 188 msec 2023-02-10 19:02:57,192 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=42, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=cca73b62b14aebcd72ce9f0317bde286, UNASSIGN in 201 msec 2023-02-10 19:02:57,199 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/data/default/testWithMapReduce/05d2a877c2d90362a1d4209daff5b54a/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-02-10 19:02:57,200 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,zz{,1676055767944.05d2a877c2d90362a1d4209daff5b54a. 2023-02-10 19:02:57,200 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 05d2a877c2d90362a1d4209daff5b54a: Waiting for close lock at 1676055777175Running coprocessor pre-close hooks at 1676055777175Disabling compacts and flushes for region at 1676055777175Disabling writes for close at 1676055777176 (+1 ms)Writing region close event to WAL at 1676055777178 (+2 ms)Running coprocessor post-close hooks at 1676055777199 (+21 ms)Closed at 1676055777200 (+1 ms) 2023-02-10 19:02:57,202 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 05d2a877c2d90362a1d4209daff5b54a 2023-02-10 19:02:57,202 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close b5248077ace761a2c5d43c344f646651 2023-02-10 19:02:57,203 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing b5248077ace761a2c5d43c344f646651, disabling compactions & flushes 2023-02-10 19:02:57,203 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,d\x84\x84,1676055767944.b5248077ace761a2c5d43c344f646651. 2023-02-10 19:02:57,203 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,d\x84\x84,1676055767944.b5248077ace761a2c5d43c344f646651. 2023-02-10 19:02:57,203 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,d\x84\x84,1676055767944.b5248077ace761a2c5d43c344f646651. after waiting 0 ms 2023-02-10 19:02:57,203 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,d\x84\x84,1676055767944.b5248077ace761a2c5d43c344f646651. 2023-02-10 19:02:57,205 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=05d2a877c2d90362a1d4209daff5b54a, regionState=CLOSED 2023-02-10 19:02:57,205 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,zz{,1676055767944.05d2a877c2d90362a1d4209daff5b54a.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676055777205"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676055777205"}]},"ts":"1676055777205"} 2023-02-10 19:02:57,205 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/data/default/testWithMapReduce/2abc519a8c9fd6a76400a0e9294c9317/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-10 19:02:57,208 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,m\xED\xED,1676055767944.2abc519a8c9fd6a76400a0e9294c9317. 2023-02-10 19:02:57,208 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 2abc519a8c9fd6a76400a0e9294c9317: Waiting for close lock at 1676055777183Running coprocessor pre-close hooks at 1676055777183Disabling compacts and flushes for region at 1676055777183Disabling writes for close at 1676055777183Writing region close event to WAL at 1676055777198 (+15 ms)Running coprocessor post-close hooks at 1676055777206 (+8 ms)Closed at 1676055777208 (+2 ms) 2023-02-10 19:02:57,214 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/data/default/testWithMapReduce/b5248077ace761a2c5d43c344f646651/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-10 19:02:57,215 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,d\x84\x84,1676055767944.b5248077ace761a2c5d43c344f646651. 2023-02-10 19:02:57,215 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for b5248077ace761a2c5d43c344f646651: Waiting for close lock at 1676055777203Running coprocessor pre-close hooks at 1676055777203Disabling compacts and flushes for region at 1676055777203Disabling writes for close at 1676055777203Writing region close event to WAL at 1676055777209 (+6 ms)Running coprocessor post-close hooks at 1676055777214 (+5 ms)Closed at 1676055777215 (+1 ms) 2023-02-10 19:02:57,216 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=45, resume processing ppid=43 2023-02-10 19:02:57,216 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=45, ppid=43, state=SUCCESS; CloseRegionProcedure 05d2a877c2d90362a1d4209daff5b54a, server=jenkins-hbase4.apache.org,43337,1676055764986 in 210 msec 2023-02-10 19:02:57,217 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 2abc519a8c9fd6a76400a0e9294c9317 2023-02-10 19:02:57,217 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 07dbe2f766a0b8b265d0439c26307ef7 2023-02-10 19:02:57,217 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 07dbe2f766a0b8b265d0439c26307ef7, disabling compactions & flushes 2023-02-10 19:02:57,217 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,q\x11\x10,1676055767944.07dbe2f766a0b8b265d0439c26307ef7. 2023-02-10 19:02:57,217 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,q\x11\x10,1676055767944.07dbe2f766a0b8b265d0439c26307ef7. 2023-02-10 19:02:57,217 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,q\x11\x10,1676055767944.07dbe2f766a0b8b265d0439c26307ef7. after waiting 0 ms 2023-02-10 19:02:57,217 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,q\x11\x10,1676055767944.07dbe2f766a0b8b265d0439c26307ef7. 2023-02-10 19:02:57,220 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=39 updating hbase:meta row=2abc519a8c9fd6a76400a0e9294c9317, regionState=CLOSED 2023-02-10 19:02:57,221 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,m\\xED\\xED,1676055767944.2abc519a8c9fd6a76400a0e9294c9317.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676055777220"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676055777220"}]},"ts":"1676055777220"} 2023-02-10 19:02:57,221 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=36 updating hbase:meta row=b5248077ace761a2c5d43c344f646651, regionState=CLOSED 2023-02-10 19:02:57,221 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=43, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=05d2a877c2d90362a1d4209daff5b54a, UNASSIGN in 227 msec 2023-02-10 19:02:57,222 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,d\\x84\\x84,1676055767944.b5248077ace761a2c5d43c344f646651.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676055777221"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676055777221"}]},"ts":"1676055777221"} 2023-02-10 19:02:57,222 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed b5248077ace761a2c5d43c344f646651 2023-02-10 19:02:57,222 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 52e916374c45f2d5119804d8db34ffe7 2023-02-10 19:02:57,222 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 52e916374c45f2d5119804d8db34ffe7, disabling compactions & flushes 2023-02-10 19:02:57,222 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,t43,1676055767944.52e916374c45f2d5119804d8db34ffe7. 2023-02-10 19:02:57,222 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,t43,1676055767944.52e916374c45f2d5119804d8db34ffe7. 2023-02-10 19:02:57,222 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,t43,1676055767944.52e916374c45f2d5119804d8db34ffe7. after waiting 0 ms 2023-02-10 19:02:57,222 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,t43,1676055767944.52e916374c45f2d5119804d8db34ffe7. 2023-02-10 19:02:57,226 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=48, resume processing ppid=39 2023-02-10 19:02:57,226 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=48, ppid=39, state=SUCCESS; CloseRegionProcedure 2abc519a8c9fd6a76400a0e9294c9317, server=jenkins-hbase4.apache.org,43623,1676055764936 in 223 msec 2023-02-10 19:02:57,227 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=50, resume processing ppid=36 2023-02-10 19:02:57,227 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=50, ppid=36, state=SUCCESS; CloseRegionProcedure b5248077ace761a2c5d43c344f646651, server=jenkins-hbase4.apache.org,43337,1676055764986 in 210 msec 2023-02-10 19:02:57,228 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=39, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=2abc519a8c9fd6a76400a0e9294c9317, UNASSIGN in 239 msec 2023-02-10 19:02:57,229 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=36, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=b5248077ace761a2c5d43c344f646651, UNASSIGN in 240 msec 2023-02-10 19:02:57,268 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/data/default/testWithMapReduce/52e916374c45f2d5119804d8db34ffe7/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-10 19:02:57,270 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,t43,1676055767944.52e916374c45f2d5119804d8db34ffe7. 2023-02-10 19:02:57,270 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/data/default/testWithMapReduce/07dbe2f766a0b8b265d0439c26307ef7/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-10 19:02:57,270 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 52e916374c45f2d5119804d8db34ffe7: Waiting for close lock at 1676055777222Running coprocessor pre-close hooks at 1676055777222Disabling compacts and flushes for region at 1676055777222Disabling writes for close at 1676055777222Writing region close event to WAL at 1676055777261 (+39 ms)Running coprocessor post-close hooks at 1676055777269 (+8 ms)Closed at 1676055777269 2023-02-10 19:02:57,271 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,q\x11\x10,1676055767944.07dbe2f766a0b8b265d0439c26307ef7. 2023-02-10 19:02:57,271 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 07dbe2f766a0b8b265d0439c26307ef7: Waiting for close lock at 1676055777217Running coprocessor pre-close hooks at 1676055777217Disabling compacts and flushes for region at 1676055777217Disabling writes for close at 1676055777217Writing region close event to WAL at 1676055777257 (+40 ms)Running coprocessor post-close hooks at 1676055777270 (+13 ms)Closed at 1676055777271 (+1 ms) 2023-02-10 19:02:57,273 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 52e916374c45f2d5119804d8db34ffe7 2023-02-10 19:02:57,273 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 053dc7037d94e17f3f72f5ea563ab135 2023-02-10 19:02:57,273 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 053dc7037d94e17f3f72f5ea563ab135, disabling compactions & flushes 2023-02-10 19:02:57,273 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,j\xCA\xCA,1676055767944.053dc7037d94e17f3f72f5ea563ab135. 2023-02-10 19:02:57,273 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,j\xCA\xCA,1676055767944.053dc7037d94e17f3f72f5ea563ab135. 2023-02-10 19:02:57,273 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,j\xCA\xCA,1676055767944.053dc7037d94e17f3f72f5ea563ab135. after waiting 0 ms 2023-02-10 19:02:57,273 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,j\xCA\xCA,1676055767944.053dc7037d94e17f3f72f5ea563ab135. 2023-02-10 19:02:57,273 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=41 updating hbase:meta row=52e916374c45f2d5119804d8db34ffe7, regionState=CLOSED 2023-02-10 19:02:57,274 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,t43,1676055767944.52e916374c45f2d5119804d8db34ffe7.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676055777273"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676055777273"}]},"ts":"1676055777273"} 2023-02-10 19:02:57,274 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 07dbe2f766a0b8b265d0439c26307ef7 2023-02-10 19:02:57,274 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 0b68bcec2ca2391d28b6290c561e3332 2023-02-10 19:02:57,274 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 0b68bcec2ca2391d28b6290c561e3332, disabling compactions & flushes 2023-02-10 19:02:57,274 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,g\xA7\xA7,1676055767944.0b68bcec2ca2391d28b6290c561e3332. 2023-02-10 19:02:57,274 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,g\xA7\xA7,1676055767944.0b68bcec2ca2391d28b6290c561e3332. 2023-02-10 19:02:57,274 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,g\xA7\xA7,1676055767944.0b68bcec2ca2391d28b6290c561e3332. after waiting 0 ms 2023-02-10 19:02:57,274 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,g\xA7\xA7,1676055767944.0b68bcec2ca2391d28b6290c561e3332. 2023-02-10 19:02:57,275 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=40 updating hbase:meta row=07dbe2f766a0b8b265d0439c26307ef7, regionState=CLOSED 2023-02-10 19:02:57,275 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,q\\x11\\x10,1676055767944.07dbe2f766a0b8b265d0439c26307ef7.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676055777275"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676055777275"}]},"ts":"1676055777275"} 2023-02-10 19:02:57,283 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=46, resume processing ppid=41 2023-02-10 19:02:57,283 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=46, ppid=41, state=SUCCESS; CloseRegionProcedure 52e916374c45f2d5119804d8db34ffe7, server=jenkins-hbase4.apache.org,43337,1676055764986 in 280 msec 2023-02-10 19:02:57,286 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=44, resume processing ppid=40 2023-02-10 19:02:57,286 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=44, ppid=40, state=SUCCESS; CloseRegionProcedure 07dbe2f766a0b8b265d0439c26307ef7, server=jenkins-hbase4.apache.org,43623,1676055764936 in 284 msec 2023-02-10 19:02:57,286 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41145] master.MasterRpcServices(1227): Checking to see if procedure is done pid=33 2023-02-10 19:02:57,287 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=41, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=52e916374c45f2d5119804d8db34ffe7, UNASSIGN in 296 msec 2023-02-10 19:02:57,288 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=40, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=07dbe2f766a0b8b265d0439c26307ef7, UNASSIGN in 299 msec 2023-02-10 19:02:57,299 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/data/default/testWithMapReduce/0b68bcec2ca2391d28b6290c561e3332/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-10 19:02:57,299 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/data/default/testWithMapReduce/053dc7037d94e17f3f72f5ea563ab135/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-10 19:02:57,302 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,g\xA7\xA7,1676055767944.0b68bcec2ca2391d28b6290c561e3332. 2023-02-10 19:02:57,302 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,j\xCA\xCA,1676055767944.053dc7037d94e17f3f72f5ea563ab135. 2023-02-10 19:02:57,303 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 0b68bcec2ca2391d28b6290c561e3332: Waiting for close lock at 1676055777274Running coprocessor pre-close hooks at 1676055777274Disabling compacts and flushes for region at 1676055777274Disabling writes for close at 1676055777274Writing region close event to WAL at 1676055777284 (+10 ms)Running coprocessor post-close hooks at 1676055777301 (+17 ms)Closed at 1676055777302 (+1 ms) 2023-02-10 19:02:57,303 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 053dc7037d94e17f3f72f5ea563ab135: Waiting for close lock at 1676055777273Running coprocessor pre-close hooks at 1676055777273Disabling compacts and flushes for region at 1676055777273Disabling writes for close at 1676055777273Writing region close event to WAL at 1676055777284 (+11 ms)Running coprocessor post-close hooks at 1676055777301 (+17 ms)Closed at 1676055777302 (+1 ms) 2023-02-10 19:02:57,310 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 053dc7037d94e17f3f72f5ea563ab135 2023-02-10 19:02:57,311 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=053dc7037d94e17f3f72f5ea563ab135, regionState=CLOSED 2023-02-10 19:02:57,311 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,j\\xCA\\xCA,1676055767944.053dc7037d94e17f3f72f5ea563ab135.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676055777311"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676055777311"}]},"ts":"1676055777311"} 2023-02-10 19:02:57,312 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 0b68bcec2ca2391d28b6290c561e3332 2023-02-10 19:02:57,313 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close ea671e7088d3fe84e68b3d345289fe97 2023-02-10 19:02:57,313 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing ea671e7088d3fe84e68b3d345289fe97, disabling compactions & flushes 2023-02-10 19:02:57,313 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,aaa,1676055767944.ea671e7088d3fe84e68b3d345289fe97. 2023-02-10 19:02:57,313 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,aaa,1676055767944.ea671e7088d3fe84e68b3d345289fe97. 2023-02-10 19:02:57,313 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,aaa,1676055767944.ea671e7088d3fe84e68b3d345289fe97. after waiting 0 ms 2023-02-10 19:02:57,313 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,aaa,1676055767944.ea671e7088d3fe84e68b3d345289fe97. 2023-02-10 19:02:57,313 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=0b68bcec2ca2391d28b6290c561e3332, regionState=CLOSED 2023-02-10 19:02:57,313 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,g\\xA7\\xA7,1676055767944.0b68bcec2ca2391d28b6290c561e3332.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676055777313"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676055777313"}]},"ts":"1676055777313"} 2023-02-10 19:02:57,318 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=51, resume processing ppid=38 2023-02-10 19:02:57,319 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=51, ppid=38, state=SUCCESS; CloseRegionProcedure 053dc7037d94e17f3f72f5ea563ab135, server=jenkins-hbase4.apache.org,43337,1676055764986 in 300 msec 2023-02-10 19:02:57,319 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=49, resume processing ppid=37 2023-02-10 19:02:57,320 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=49, ppid=37, state=SUCCESS; CloseRegionProcedure 0b68bcec2ca2391d28b6290c561e3332, server=jenkins-hbase4.apache.org,43623,1676055764936 in 303 msec 2023-02-10 19:02:57,321 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=38, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=053dc7037d94e17f3f72f5ea563ab135, UNASSIGN in 332 msec 2023-02-10 19:02:57,322 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=37, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=0b68bcec2ca2391d28b6290c561e3332, UNASSIGN in 333 msec 2023-02-10 19:02:57,334 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/data/default/testWithMapReduce/ea671e7088d3fe84e68b3d345289fe97/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-10 19:02:57,335 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,aaa,1676055767944.ea671e7088d3fe84e68b3d345289fe97. 2023-02-10 19:02:57,335 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for ea671e7088d3fe84e68b3d345289fe97: Waiting for close lock at 1676055777313Running coprocessor pre-close hooks at 1676055777313Disabling compacts and flushes for region at 1676055777313Disabling writes for close at 1676055777313Writing region close event to WAL at 1676055777329 (+16 ms)Running coprocessor post-close hooks at 1676055777334 (+5 ms)Closed at 1676055777335 (+1 ms) 2023-02-10 19:02:57,338 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed ea671e7088d3fe84e68b3d345289fe97 2023-02-10 19:02:57,338 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=35 updating hbase:meta row=ea671e7088d3fe84e68b3d345289fe97, regionState=CLOSED 2023-02-10 19:02:57,338 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,aaa,1676055767944.ea671e7088d3fe84e68b3d345289fe97.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676055777338"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676055777338"}]},"ts":"1676055777338"} 2023-02-10 19:02:57,343 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=52, resume processing ppid=35 2023-02-10 19:02:57,343 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=52, ppid=35, state=SUCCESS; CloseRegionProcedure ea671e7088d3fe84e68b3d345289fe97, server=jenkins-hbase4.apache.org,43623,1676055764936 in 323 msec 2023-02-10 19:02:57,345 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=35, resume processing ppid=33 2023-02-10 19:02:57,345 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=35, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=ea671e7088d3fe84e68b3d345289fe97, UNASSIGN in 356 msec 2023-02-10 19:02:57,346 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676055777346"}]},"ts":"1676055777346"} 2023-02-10 19:02:57,349 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=DISABLED in hbase:meta 2023-02-10 19:02:57,351 INFO [PEWorker-2] procedure.DisableTableProcedure(305): Set testWithMapReduce to state=DISABLED 2023-02-10 19:02:57,353 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=33, state=SUCCESS; DisableTableProcedure table=testWithMapReduce in 379 msec 2023-02-10 19:02:57,589 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41145] master.MasterRpcServices(1227): Checking to see if procedure is done pid=33 2023-02-10 19:02:57,589 INFO [Listener at localhost/32909] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testWithMapReduce, procId: 33 completed 2023-02-10 19:02:57,594 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41145] master.HMaster$5(2215): Client=jenkins//172.31.14.131 delete testWithMapReduce 2023-02-10 19:02:57,600 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41145] procedure2.ProcedureExecutor(1029): Stored pid=54, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testWithMapReduce 2023-02-10 19:02:57,602 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=54, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-10 19:02:57,605 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=54, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-10 19:02:57,605 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41145] master.MasterRpcServices(1227): Checking to see if procedure is done pid=54 2023-02-10 19:02:57,620 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/.tmp/data/default/testWithMapReduce/813b88c1d27659129f4a12d3c70b79c7 2023-02-10 19:02:57,620 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/.tmp/data/default/testWithMapReduce/b5248077ace761a2c5d43c344f646651 2023-02-10 19:02:57,620 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/.tmp/data/default/testWithMapReduce/053dc7037d94e17f3f72f5ea563ab135 2023-02-10 19:02:57,620 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/.tmp/data/default/testWithMapReduce/2abc519a8c9fd6a76400a0e9294c9317 2023-02-10 19:02:57,620 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/.tmp/data/default/testWithMapReduce/52e916374c45f2d5119804d8db34ffe7 2023-02-10 19:02:57,620 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/.tmp/data/default/testWithMapReduce/07dbe2f766a0b8b265d0439c26307ef7 2023-02-10 19:02:57,620 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/.tmp/data/default/testWithMapReduce/0b68bcec2ca2391d28b6290c561e3332 2023-02-10 19:02:57,620 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/.tmp/data/default/testWithMapReduce/ea671e7088d3fe84e68b3d345289fe97 2023-02-10 19:02:57,627 DEBUG [HFileArchiver-3] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/.tmp/data/default/testWithMapReduce/0b68bcec2ca2391d28b6290c561e3332/f1, FileablePath, hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/.tmp/data/default/testWithMapReduce/0b68bcec2ca2391d28b6290c561e3332/f2, FileablePath, hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/.tmp/data/default/testWithMapReduce/0b68bcec2ca2391d28b6290c561e3332/recovered.edits] 2023-02-10 19:02:57,627 DEBUG [HFileArchiver-1] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/.tmp/data/default/testWithMapReduce/053dc7037d94e17f3f72f5ea563ab135/f1, FileablePath, hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/.tmp/data/default/testWithMapReduce/053dc7037d94e17f3f72f5ea563ab135/f2, FileablePath, hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/.tmp/data/default/testWithMapReduce/053dc7037d94e17f3f72f5ea563ab135/recovered.edits] 2023-02-10 19:02:57,627 DEBUG [HFileArchiver-2] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/.tmp/data/default/testWithMapReduce/813b88c1d27659129f4a12d3c70b79c7/f1, FileablePath, hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/.tmp/data/default/testWithMapReduce/813b88c1d27659129f4a12d3c70b79c7/f2, FileablePath, hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/.tmp/data/default/testWithMapReduce/813b88c1d27659129f4a12d3c70b79c7/recovered.edits] 2023-02-10 19:02:57,627 DEBUG [HFileArchiver-7] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/.tmp/data/default/testWithMapReduce/2abc519a8c9fd6a76400a0e9294c9317/f1, FileablePath, hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/.tmp/data/default/testWithMapReduce/2abc519a8c9fd6a76400a0e9294c9317/f2, FileablePath, hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/.tmp/data/default/testWithMapReduce/2abc519a8c9fd6a76400a0e9294c9317/recovered.edits] 2023-02-10 19:02:57,628 DEBUG [HFileArchiver-6] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/.tmp/data/default/testWithMapReduce/07dbe2f766a0b8b265d0439c26307ef7/f1, FileablePath, hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/.tmp/data/default/testWithMapReduce/07dbe2f766a0b8b265d0439c26307ef7/f2, FileablePath, hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/.tmp/data/default/testWithMapReduce/07dbe2f766a0b8b265d0439c26307ef7/recovered.edits] 2023-02-10 19:02:57,629 DEBUG [HFileArchiver-8] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/.tmp/data/default/testWithMapReduce/52e916374c45f2d5119804d8db34ffe7/f1, FileablePath, hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/.tmp/data/default/testWithMapReduce/52e916374c45f2d5119804d8db34ffe7/f2, FileablePath, hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/.tmp/data/default/testWithMapReduce/52e916374c45f2d5119804d8db34ffe7/recovered.edits] 2023-02-10 19:02:57,629 DEBUG [HFileArchiver-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/.tmp/data/default/testWithMapReduce/b5248077ace761a2c5d43c344f646651/f1, FileablePath, hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/.tmp/data/default/testWithMapReduce/b5248077ace761a2c5d43c344f646651/f2, FileablePath, hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/.tmp/data/default/testWithMapReduce/b5248077ace761a2c5d43c344f646651/recovered.edits] 2023-02-10 19:02:57,631 DEBUG [HFileArchiver-4] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/.tmp/data/default/testWithMapReduce/ea671e7088d3fe84e68b3d345289fe97/f1, FileablePath, hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/.tmp/data/default/testWithMapReduce/ea671e7088d3fe84e68b3d345289fe97/f2, FileablePath, hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/.tmp/data/default/testWithMapReduce/ea671e7088d3fe84e68b3d345289fe97/recovered.edits] 2023-02-10 19:02:57,642 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/.tmp/data/default/testWithMapReduce/2abc519a8c9fd6a76400a0e9294c9317/f1/1e73f571f2fb4538bf0058ab7be51d9f to hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/archive/data/default/testWithMapReduce/2abc519a8c9fd6a76400a0e9294c9317/f1/1e73f571f2fb4538bf0058ab7be51d9f 2023-02-10 19:02:57,644 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/.tmp/data/default/testWithMapReduce/0b68bcec2ca2391d28b6290c561e3332/f1/9c33c4ef93f946039df2b785883b48ed to hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/archive/data/default/testWithMapReduce/0b68bcec2ca2391d28b6290c561e3332/f1/9c33c4ef93f946039df2b785883b48ed 2023-02-10 19:02:57,645 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/.tmp/data/default/testWithMapReduce/52e916374c45f2d5119804d8db34ffe7/f1/3645d6a50d4e40c29a3e54e0b3ec7817 to hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/archive/data/default/testWithMapReduce/52e916374c45f2d5119804d8db34ffe7/f1/3645d6a50d4e40c29a3e54e0b3ec7817 2023-02-10 19:02:57,645 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/.tmp/data/default/testWithMapReduce/053dc7037d94e17f3f72f5ea563ab135/f1/504d267354704aa1887fe95c8317e485 to hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/archive/data/default/testWithMapReduce/053dc7037d94e17f3f72f5ea563ab135/f1/504d267354704aa1887fe95c8317e485 2023-02-10 19:02:57,646 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/.tmp/data/default/testWithMapReduce/07dbe2f766a0b8b265d0439c26307ef7/f1/01bc21d694ca4861bce7970bc4592462 to hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/archive/data/default/testWithMapReduce/07dbe2f766a0b8b265d0439c26307ef7/f1/01bc21d694ca4861bce7970bc4592462 2023-02-10 19:02:57,646 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/.tmp/data/default/testWithMapReduce/b5248077ace761a2c5d43c344f646651/f1/6c1788f5219e46cebb9f819da3c12bc9 to hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/archive/data/default/testWithMapReduce/b5248077ace761a2c5d43c344f646651/f1/6c1788f5219e46cebb9f819da3c12bc9 2023-02-10 19:02:57,647 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/.tmp/data/default/testWithMapReduce/2abc519a8c9fd6a76400a0e9294c9317/f1/253de5c7eb7e4d3d9eb98c4c28bf4117 to hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/archive/data/default/testWithMapReduce/2abc519a8c9fd6a76400a0e9294c9317/f1/253de5c7eb7e4d3d9eb98c4c28bf4117 2023-02-10 19:02:57,648 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/.tmp/data/default/testWithMapReduce/0b68bcec2ca2391d28b6290c561e3332/f1/d13fb7a00ef748458b03332cd6a3c8d6 to hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/archive/data/default/testWithMapReduce/0b68bcec2ca2391d28b6290c561e3332/f1/d13fb7a00ef748458b03332cd6a3c8d6 2023-02-10 19:02:57,649 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/.tmp/data/default/testWithMapReduce/813b88c1d27659129f4a12d3c70b79c7/recovered.edits/6.seqid to hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/archive/data/default/testWithMapReduce/813b88c1d27659129f4a12d3c70b79c7/recovered.edits/6.seqid 2023-02-10 19:02:57,649 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/.tmp/data/default/testWithMapReduce/b5248077ace761a2c5d43c344f646651/f1/fb0ff4da36be4e70b3c8085cf63149b8 to hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/archive/data/default/testWithMapReduce/b5248077ace761a2c5d43c344f646651/f1/fb0ff4da36be4e70b3c8085cf63149b8 2023-02-10 19:02:57,650 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/.tmp/data/default/testWithMapReduce/ea671e7088d3fe84e68b3d345289fe97/f1/1cb1c69f1d034168966cde09a17b098e to hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/archive/data/default/testWithMapReduce/ea671e7088d3fe84e68b3d345289fe97/f1/1cb1c69f1d034168966cde09a17b098e 2023-02-10 19:02:57,650 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/.tmp/data/default/testWithMapReduce/52e916374c45f2d5119804d8db34ffe7/f1/7046e04cad38425f93b18e9cdf97792a to hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/archive/data/default/testWithMapReduce/52e916374c45f2d5119804d8db34ffe7/f1/7046e04cad38425f93b18e9cdf97792a 2023-02-10 19:02:57,650 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/.tmp/data/default/testWithMapReduce/053dc7037d94e17f3f72f5ea563ab135/f1/f795d1efa9254132acf85b0ad72dd294 to hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/archive/data/default/testWithMapReduce/053dc7037d94e17f3f72f5ea563ab135/f1/f795d1efa9254132acf85b0ad72dd294 2023-02-10 19:02:57,651 DEBUG [HFileArchiver-2] backup.HFileArchiver(596): Deleted hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/.tmp/data/default/testWithMapReduce/813b88c1d27659129f4a12d3c70b79c7 2023-02-10 19:02:57,651 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/.tmp/data/default/testWithMapReduce/cca73b62b14aebcd72ce9f0317bde286 2023-02-10 19:02:57,652 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/.tmp/data/default/testWithMapReduce/07dbe2f766a0b8b265d0439c26307ef7/f1/7f2eeb0ade74437c8e98b1f9c6e4998f to hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/archive/data/default/testWithMapReduce/07dbe2f766a0b8b265d0439c26307ef7/f1/7f2eeb0ade74437c8e98b1f9c6e4998f 2023-02-10 19:02:57,656 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/.tmp/data/default/testWithMapReduce/ea671e7088d3fe84e68b3d345289fe97/f1/2641d8bc11d64e8eb33c35377da94d3a to hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/archive/data/default/testWithMapReduce/ea671e7088d3fe84e68b3d345289fe97/f1/2641d8bc11d64e8eb33c35377da94d3a 2023-02-10 19:02:57,657 DEBUG [HFileArchiver-2] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/.tmp/data/default/testWithMapReduce/cca73b62b14aebcd72ce9f0317bde286/f1, FileablePath, hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/.tmp/data/default/testWithMapReduce/cca73b62b14aebcd72ce9f0317bde286/f2, FileablePath, hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/.tmp/data/default/testWithMapReduce/cca73b62b14aebcd72ce9f0317bde286/recovered.edits] 2023-02-10 19:02:57,658 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/.tmp/data/default/testWithMapReduce/2abc519a8c9fd6a76400a0e9294c9317/f2/39bc8652d07c454dad3031cb6bda2dfb to hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/archive/data/default/testWithMapReduce/2abc519a8c9fd6a76400a0e9294c9317/f2/39bc8652d07c454dad3031cb6bda2dfb 2023-02-10 19:02:57,661 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/.tmp/data/default/testWithMapReduce/0b68bcec2ca2391d28b6290c561e3332/f2/62c542c2d8914d098b3c5d2ac43084a1 to hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/archive/data/default/testWithMapReduce/0b68bcec2ca2391d28b6290c561e3332/f2/62c542c2d8914d098b3c5d2ac43084a1 2023-02-10 19:02:57,662 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/.tmp/data/default/testWithMapReduce/07dbe2f766a0b8b265d0439c26307ef7/f2/ce63b0110ef64f13adedf84c456454a1 to hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/archive/data/default/testWithMapReduce/07dbe2f766a0b8b265d0439c26307ef7/f2/ce63b0110ef64f13adedf84c456454a1 2023-02-10 19:02:57,662 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/.tmp/data/default/testWithMapReduce/52e916374c45f2d5119804d8db34ffe7/f2/1488a087f4594f8ca23f1bbb12554feb to hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/archive/data/default/testWithMapReduce/52e916374c45f2d5119804d8db34ffe7/f2/1488a087f4594f8ca23f1bbb12554feb 2023-02-10 19:02:57,662 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/.tmp/data/default/testWithMapReduce/053dc7037d94e17f3f72f5ea563ab135/f2/27b372f4c63c4bd98cfe88becc9d062e to hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/archive/data/default/testWithMapReduce/053dc7037d94e17f3f72f5ea563ab135/f2/27b372f4c63c4bd98cfe88becc9d062e 2023-02-10 19:02:57,662 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/.tmp/data/default/testWithMapReduce/b5248077ace761a2c5d43c344f646651/f2/96c8b0a7f07049989a5df57a6e3d7d91 to hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/archive/data/default/testWithMapReduce/b5248077ace761a2c5d43c344f646651/f2/96c8b0a7f07049989a5df57a6e3d7d91 2023-02-10 19:02:57,665 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/.tmp/data/default/testWithMapReduce/2abc519a8c9fd6a76400a0e9294c9317/f2/6e0c81a35f164756ba1801d4b22b31e8 to hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/archive/data/default/testWithMapReduce/2abc519a8c9fd6a76400a0e9294c9317/f2/6e0c81a35f164756ba1801d4b22b31e8 2023-02-10 19:02:57,666 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/.tmp/data/default/testWithMapReduce/b5248077ace761a2c5d43c344f646651/f2/a897301323734c9b82ef09fe533f9dc0 to hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/archive/data/default/testWithMapReduce/b5248077ace761a2c5d43c344f646651/f2/a897301323734c9b82ef09fe533f9dc0 2023-02-10 19:02:57,667 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/.tmp/data/default/testWithMapReduce/0b68bcec2ca2391d28b6290c561e3332/f2/eea04d059c44478ea2da475bc2fe8389 to hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/archive/data/default/testWithMapReduce/0b68bcec2ca2391d28b6290c561e3332/f2/eea04d059c44478ea2da475bc2fe8389 2023-02-10 19:02:57,667 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/.tmp/data/default/testWithMapReduce/52e916374c45f2d5119804d8db34ffe7/f2/9cd807e0a98e4c4091980728d6f09bfa to hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/archive/data/default/testWithMapReduce/52e916374c45f2d5119804d8db34ffe7/f2/9cd807e0a98e4c4091980728d6f09bfa 2023-02-10 19:02:57,667 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/.tmp/data/default/testWithMapReduce/07dbe2f766a0b8b265d0439c26307ef7/f2/fc868dc715a649c4a2271d87c3af326f to hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/archive/data/default/testWithMapReduce/07dbe2f766a0b8b265d0439c26307ef7/f2/fc868dc715a649c4a2271d87c3af326f 2023-02-10 19:02:57,668 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/.tmp/data/default/testWithMapReduce/053dc7037d94e17f3f72f5ea563ab135/f2/871880a6275949d4800f26e30c4edeb8 to hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/archive/data/default/testWithMapReduce/053dc7037d94e17f3f72f5ea563ab135/f2/871880a6275949d4800f26e30c4edeb8 2023-02-10 19:02:57,668 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/.tmp/data/default/testWithMapReduce/ea671e7088d3fe84e68b3d345289fe97/f2/905d6e0f39194973bc5d4ae34b4d908f to hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/archive/data/default/testWithMapReduce/ea671e7088d3fe84e68b3d345289fe97/f2/905d6e0f39194973bc5d4ae34b4d908f 2023-02-10 19:02:57,672 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/.tmp/data/default/testWithMapReduce/cca73b62b14aebcd72ce9f0317bde286/f1/4cfcead0fcb24e6598b31b611cdd39bf to hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/archive/data/default/testWithMapReduce/cca73b62b14aebcd72ce9f0317bde286/f1/4cfcead0fcb24e6598b31b611cdd39bf 2023-02-10 19:02:57,675 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/.tmp/data/default/testWithMapReduce/ea671e7088d3fe84e68b3d345289fe97/f2/95a2d515eabf41419d3cb8d7251f6f0d to hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/archive/data/default/testWithMapReduce/ea671e7088d3fe84e68b3d345289fe97/f2/95a2d515eabf41419d3cb8d7251f6f0d 2023-02-10 19:02:57,675 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/.tmp/data/default/testWithMapReduce/2abc519a8c9fd6a76400a0e9294c9317/recovered.edits/12.seqid to hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/archive/data/default/testWithMapReduce/2abc519a8c9fd6a76400a0e9294c9317/recovered.edits/12.seqid 2023-02-10 19:02:57,676 DEBUG [HFileArchiver-7] backup.HFileArchiver(596): Deleted hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/.tmp/data/default/testWithMapReduce/2abc519a8c9fd6a76400a0e9294c9317 2023-02-10 19:02:57,676 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/.tmp/data/default/testWithMapReduce/05d2a877c2d90362a1d4209daff5b54a 2023-02-10 19:02:57,677 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/.tmp/data/default/testWithMapReduce/cca73b62b14aebcd72ce9f0317bde286/f1/523a73fd51c843b0a3e8a0db93bd953c to hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/archive/data/default/testWithMapReduce/cca73b62b14aebcd72ce9f0317bde286/f1/523a73fd51c843b0a3e8a0db93bd953c 2023-02-10 19:02:57,677 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/.tmp/data/default/testWithMapReduce/0b68bcec2ca2391d28b6290c561e3332/recovered.edits/12.seqid to hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/archive/data/default/testWithMapReduce/0b68bcec2ca2391d28b6290c561e3332/recovered.edits/12.seqid 2023-02-10 19:02:57,677 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/.tmp/data/default/testWithMapReduce/b5248077ace761a2c5d43c344f646651/recovered.edits/12.seqid to hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/archive/data/default/testWithMapReduce/b5248077ace761a2c5d43c344f646651/recovered.edits/12.seqid 2023-02-10 19:02:57,677 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/.tmp/data/default/testWithMapReduce/07dbe2f766a0b8b265d0439c26307ef7/recovered.edits/12.seqid to hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/archive/data/default/testWithMapReduce/07dbe2f766a0b8b265d0439c26307ef7/recovered.edits/12.seqid 2023-02-10 19:02:57,678 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/.tmp/data/default/testWithMapReduce/053dc7037d94e17f3f72f5ea563ab135/recovered.edits/12.seqid to hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/archive/data/default/testWithMapReduce/053dc7037d94e17f3f72f5ea563ab135/recovered.edits/12.seqid 2023-02-10 19:02:57,678 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/.tmp/data/default/testWithMapReduce/52e916374c45f2d5119804d8db34ffe7/recovered.edits/12.seqid to hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/archive/data/default/testWithMapReduce/52e916374c45f2d5119804d8db34ffe7/recovered.edits/12.seqid 2023-02-10 19:02:57,678 DEBUG [HFileArchiver-5] backup.HFileArchiver(596): Deleted hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/.tmp/data/default/testWithMapReduce/b5248077ace761a2c5d43c344f646651 2023-02-10 19:02:57,678 DEBUG [HFileArchiver-3] backup.HFileArchiver(596): Deleted hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/.tmp/data/default/testWithMapReduce/0b68bcec2ca2391d28b6290c561e3332 2023-02-10 19:02:57,679 DEBUG [HFileArchiver-6] backup.HFileArchiver(596): Deleted hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/.tmp/data/default/testWithMapReduce/07dbe2f766a0b8b265d0439c26307ef7 2023-02-10 19:02:57,680 DEBUG [HFileArchiver-8] backup.HFileArchiver(596): Deleted hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/.tmp/data/default/testWithMapReduce/52e916374c45f2d5119804d8db34ffe7 2023-02-10 19:02:57,680 DEBUG [HFileArchiver-1] backup.HFileArchiver(596): Deleted hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/.tmp/data/default/testWithMapReduce/053dc7037d94e17f3f72f5ea563ab135 2023-02-10 19:02:57,682 DEBUG [HFileArchiver-7] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/.tmp/data/default/testWithMapReduce/05d2a877c2d90362a1d4209daff5b54a/f1, FileablePath, hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/.tmp/data/default/testWithMapReduce/05d2a877c2d90362a1d4209daff5b54a/f2, FileablePath, hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/.tmp/data/default/testWithMapReduce/05d2a877c2d90362a1d4209daff5b54a/recovered.edits] 2023-02-10 19:02:57,683 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/.tmp/data/default/testWithMapReduce/ea671e7088d3fe84e68b3d345289fe97/recovered.edits/12.seqid to hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/archive/data/default/testWithMapReduce/ea671e7088d3fe84e68b3d345289fe97/recovered.edits/12.seqid 2023-02-10 19:02:57,684 DEBUG [HFileArchiver-4] backup.HFileArchiver(596): Deleted hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/.tmp/data/default/testWithMapReduce/ea671e7088d3fe84e68b3d345289fe97 2023-02-10 19:02:57,685 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/.tmp/data/default/testWithMapReduce/cca73b62b14aebcd72ce9f0317bde286/f2/94a02f29869d405ab4270bd8fffe2c6d to hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/archive/data/default/testWithMapReduce/cca73b62b14aebcd72ce9f0317bde286/f2/94a02f29869d405ab4270bd8fffe2c6d 2023-02-10 19:02:57,687 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/.tmp/data/default/testWithMapReduce/cca73b62b14aebcd72ce9f0317bde286/f2/c1574399f6cf46ca92e81ba576db7b9e to hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/archive/data/default/testWithMapReduce/cca73b62b14aebcd72ce9f0317bde286/f2/c1574399f6cf46ca92e81ba576db7b9e 2023-02-10 19:02:57,690 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/.tmp/data/default/testWithMapReduce/05d2a877c2d90362a1d4209daff5b54a/recovered.edits/6.seqid to hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/archive/data/default/testWithMapReduce/05d2a877c2d90362a1d4209daff5b54a/recovered.edits/6.seqid 2023-02-10 19:02:57,691 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/.tmp/data/default/testWithMapReduce/cca73b62b14aebcd72ce9f0317bde286/recovered.edits/12.seqid to hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/archive/data/default/testWithMapReduce/cca73b62b14aebcd72ce9f0317bde286/recovered.edits/12.seqid 2023-02-10 19:02:57,691 DEBUG [HFileArchiver-7] backup.HFileArchiver(596): Deleted hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/.tmp/data/default/testWithMapReduce/05d2a877c2d90362a1d4209daff5b54a 2023-02-10 19:02:57,691 DEBUG [HFileArchiver-2] backup.HFileArchiver(596): Deleted hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/.tmp/data/default/testWithMapReduce/cca73b62b14aebcd72ce9f0317bde286 2023-02-10 19:02:57,691 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testWithMapReduce regions 2023-02-10 19:02:57,694 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=54, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-10 19:02:57,707 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41145] master.MasterRpcServices(1227): Checking to see if procedure is done pid=54 2023-02-10 19:02:57,726 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 10 rows of testWithMapReduce from hbase:meta 2023-02-10 19:02:57,730 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'testWithMapReduce' descriptor. 2023-02-10 19:02:57,732 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=54, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-10 19:02:57,732 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'testWithMapReduce' from region states. 2023-02-10 19:02:57,732 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,,1676055767944.813b88c1d27659129f4a12d3c70b79c7.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676055777732"}]},"ts":"9223372036854775807"} 2023-02-10 19:02:57,732 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,aaa,1676055767944.ea671e7088d3fe84e68b3d345289fe97.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676055777732"}]},"ts":"9223372036854775807"} 2023-02-10 19:02:57,732 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,d\\x84\\x84,1676055767944.b5248077ace761a2c5d43c344f646651.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676055777732"}]},"ts":"9223372036854775807"} 2023-02-10 19:02:57,732 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,g\\xA7\\xA7,1676055767944.0b68bcec2ca2391d28b6290c561e3332.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676055777732"}]},"ts":"9223372036854775807"} 2023-02-10 19:02:57,732 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,j\\xCA\\xCA,1676055767944.053dc7037d94e17f3f72f5ea563ab135.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676055777732"}]},"ts":"9223372036854775807"} 2023-02-10 19:02:57,732 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,m\\xED\\xED,1676055767944.2abc519a8c9fd6a76400a0e9294c9317.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676055777732"}]},"ts":"9223372036854775807"} 2023-02-10 19:02:57,732 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,q\\x11\\x10,1676055767944.07dbe2f766a0b8b265d0439c26307ef7.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676055777732"}]},"ts":"9223372036854775807"} 2023-02-10 19:02:57,733 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,t43,1676055767944.52e916374c45f2d5119804d8db34ffe7.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676055777732"}]},"ts":"9223372036854775807"} 2023-02-10 19:02:57,733 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,wWV,1676055767944.cca73b62b14aebcd72ce9f0317bde286.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676055777732"}]},"ts":"9223372036854775807"} 2023-02-10 19:02:57,733 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,zz{,1676055767944.05d2a877c2d90362a1d4209daff5b54a.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676055777732"}]},"ts":"9223372036854775807"} 2023-02-10 19:02:57,736 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 10 regions from META 2023-02-10 19:02:57,736 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 813b88c1d27659129f4a12d3c70b79c7, NAME => 'testWithMapReduce,,1676055767944.813b88c1d27659129f4a12d3c70b79c7.', STARTKEY => '', ENDKEY => 'aaa'}, {ENCODED => ea671e7088d3fe84e68b3d345289fe97, NAME => 'testWithMapReduce,aaa,1676055767944.ea671e7088d3fe84e68b3d345289fe97.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'}, {ENCODED => b5248077ace761a2c5d43c344f646651, NAME => 'testWithMapReduce,d\x84\x84,1676055767944.b5248077ace761a2c5d43c344f646651.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'}, {ENCODED => 0b68bcec2ca2391d28b6290c561e3332, NAME => 'testWithMapReduce,g\xA7\xA7,1676055767944.0b68bcec2ca2391d28b6290c561e3332.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'}, {ENCODED => 053dc7037d94e17f3f72f5ea563ab135, NAME => 'testWithMapReduce,j\xCA\xCA,1676055767944.053dc7037d94e17f3f72f5ea563ab135.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'}, {ENCODED => 2abc519a8c9fd6a76400a0e9294c9317, NAME => 'testWithMapReduce,m\xED\xED,1676055767944.2abc519a8c9fd6a76400a0e9294c9317.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'}, {ENCODED => 07dbe2f766a0b8b265d0439c26307ef7, NAME => 'testWithMapReduce,q\x11\x10,1676055767944.07dbe2f766a0b8b265d0439c26307ef7.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'}, {ENCODED => 52e916374c45f2d5119804d8db34ffe7, NAME => 'testWithMapReduce,t43,1676055767944.52e916374c45f2d5119804d8db34ffe7.', STARTKEY => 't43', ENDKEY => 'wWV'}, {ENCODED => cca73b62b14aebcd72ce9f0317bde286, NAME => 'testWithMapReduce,wWV,1676055767944.cca73b62b14aebcd72ce9f0317bde286.', STARTKEY => 'wWV', ENDKEY => 'zz{'}, {ENCODED => 05d2a877c2d90362a1d4209daff5b54a, NAME => 'testWithMapReduce,zz{,1676055767944.05d2a877c2d90362a1d4209daff5b54a.', STARTKEY => 'zz{', ENDKEY => ''}] 2023-02-10 19:02:57,736 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'testWithMapReduce' as deleted. 2023-02-10 19:02:57,736 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1676055777736"}]},"ts":"9223372036854775807"} 2023-02-10 19:02:57,738 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table testWithMapReduce state from META 2023-02-10 19:02:57,741 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=54, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-10 19:02:57,742 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=54, state=SUCCESS; DeleteTableProcedure table=testWithMapReduce in 146 msec 2023-02-10 19:02:57,909 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41145] master.MasterRpcServices(1227): Checking to see if procedure is done pid=54 2023-02-10 19:02:57,910 INFO [Listener at localhost/32909] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testWithMapReduce, procId: 54 completed 2023-02-10 19:02:57,910 INFO [Listener at localhost/32909] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-02-10 19:02:57,910 INFO [Listener at localhost/32909] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-10 19:02:57,910 DEBUG [Listener at localhost/32909] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2e05c909 to 127.0.0.1:63334 2023-02-10 19:02:57,910 DEBUG [Listener at localhost/32909] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-10 19:02:57,910 DEBUG [Listener at localhost/32909] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-02-10 19:02:57,911 DEBUG [Listener at localhost/32909] util.JVMClusterUtil(257): Found active master hash=1483463506, stopped=false 2023-02-10 19:02:57,911 INFO [Listener at localhost/32909] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,41145,1676055763642 2023-02-10 19:02:57,914 DEBUG [Listener at localhost/32909-EventThread] zookeeper.ZKWatcher(600): regionserver:43337-0x1003f9d40a30002, quorum=127.0.0.1:63334, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-10 19:02:57,914 DEBUG [Listener at localhost/32909-EventThread] zookeeper.ZKWatcher(600): master:41145-0x1003f9d40a30000, quorum=127.0.0.1:63334, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-10 19:02:57,914 INFO [Listener at localhost/32909] procedure2.ProcedureExecutor(629): Stopping 2023-02-10 19:02:57,914 DEBUG [Listener at localhost/32909-EventThread] zookeeper.ZKWatcher(600): regionserver:43623-0x1003f9d40a30001, quorum=127.0.0.1:63334, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-10 19:02:57,914 DEBUG [Listener at localhost/32909-EventThread] zookeeper.ZKWatcher(600): master:41145-0x1003f9d40a30000, quorum=127.0.0.1:63334, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-10 19:02:57,916 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:41145-0x1003f9d40a30000, quorum=127.0.0.1:63334, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-10 19:02:57,916 DEBUG [Listener at localhost/32909] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6cf7b80a to 127.0.0.1:63334 2023-02-10 19:02:57,916 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43337-0x1003f9d40a30002, quorum=127.0.0.1:63334, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-10 19:02:57,916 DEBUG [Listener at localhost/32909] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-10 19:02:57,916 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43623-0x1003f9d40a30001, quorum=127.0.0.1:63334, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-10 19:02:57,916 INFO [Listener at localhost/32909] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,43623,1676055764936' ***** 2023-02-10 19:02:57,916 INFO [Listener at localhost/32909] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-10 19:02:57,917 INFO [Listener at localhost/32909] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,43337,1676055764986' ***** 2023-02-10 19:02:57,917 INFO [Listener at localhost/32909] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-10 19:02:57,917 INFO [RS:0;jenkins-hbase4:43623] regionserver.HeapMemoryManager(220): Stopping 2023-02-10 19:02:57,917 INFO [RS:1;jenkins-hbase4:43337] regionserver.HeapMemoryManager(220): Stopping 2023-02-10 19:02:57,917 INFO [RS:0;jenkins-hbase4:43623] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-10 19:02:57,917 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-10 19:02:57,917 INFO [RS:0;jenkins-hbase4:43623] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-10 19:02:57,917 INFO [RS:1;jenkins-hbase4:43337] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-10 19:02:57,917 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-10 19:02:57,918 INFO [RS:1;jenkins-hbase4:43337] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-10 19:02:57,919 INFO [RS:0;jenkins-hbase4:43623] regionserver.HRegionServer(3304): Received CLOSE for 286c590596b53e18c86a9d4f2113eb8c 2023-02-10 19:02:57,919 INFO [RS:1;jenkins-hbase4:43337] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,43337,1676055764986 2023-02-10 19:02:57,919 DEBUG [RS:1;jenkins-hbase4:43337] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x327befac to 127.0.0.1:63334 2023-02-10 19:02:57,919 DEBUG [RS:1;jenkins-hbase4:43337] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-10 19:02:57,919 INFO [RS:0;jenkins-hbase4:43623] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,43623,1676055764936 2023-02-10 19:02:57,919 INFO [RS:1;jenkins-hbase4:43337] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,43337,1676055764986; all regions closed. 2023-02-10 19:02:57,919 DEBUG [RS:0;jenkins-hbase4:43623] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x40450016 to 127.0.0.1:63334 2023-02-10 19:02:57,920 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 286c590596b53e18c86a9d4f2113eb8c, disabling compactions & flushes 2023-02-10 19:02:57,920 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676055767055.286c590596b53e18c86a9d4f2113eb8c. 2023-02-10 19:02:57,920 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676055767055.286c590596b53e18c86a9d4f2113eb8c. 2023-02-10 19:02:57,920 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676055767055.286c590596b53e18c86a9d4f2113eb8c. after waiting 0 ms 2023-02-10 19:02:57,920 DEBUG [RS:0;jenkins-hbase4:43623] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-10 19:02:57,920 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676055767055.286c590596b53e18c86a9d4f2113eb8c. 2023-02-10 19:02:57,920 INFO [RS:0;jenkins-hbase4:43623] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-10 19:02:57,920 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 286c590596b53e18c86a9d4f2113eb8c 1/1 column families, dataSize=78 B heapSize=488 B 2023-02-10 19:02:57,920 INFO [RS:0;jenkins-hbase4:43623] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-10 19:02:57,920 INFO [RS:0;jenkins-hbase4:43623] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-10 19:02:57,920 INFO [RS:0;jenkins-hbase4:43623] regionserver.HRegionServer(3304): Received CLOSE for 1588230740 2023-02-10 19:02:57,920 INFO [RS:0;jenkins-hbase4:43623] regionserver.HRegionServer(1475): Waiting on 2 regions to close 2023-02-10 19:02:57,920 DEBUG [RS:0;jenkins-hbase4:43623] regionserver.HRegionServer(1479): Online Regions={1588230740=hbase:meta,,1.1588230740, 286c590596b53e18c86a9d4f2113eb8c=hbase:namespace,,1676055767055.286c590596b53e18c86a9d4f2113eb8c.} 2023-02-10 19:02:57,921 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-10 19:02:57,921 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-10 19:02:57,921 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-10 19:02:57,921 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-10 19:02:57,921 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-10 19:02:57,922 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 1588230740 3/3 column families, dataSize=24.29 KB heapSize=40.20 KB 2023-02-10 19:02:57,922 DEBUG [RS:0;jenkins-hbase4:43623] regionserver.HRegionServer(1505): Waiting on 1588230740, 286c590596b53e18c86a9d4f2113eb8c 2023-02-10 19:02:57,928 DEBUG [RS:1;jenkins-hbase4:43337] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/oldWALs 2023-02-10 19:02:57,928 INFO [RS:1;jenkins-hbase4:43337] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C43337%2C1676055764986:(num 1676055767358) 2023-02-10 19:02:57,928 DEBUG [RS:1;jenkins-hbase4:43337] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-10 19:02:57,929 INFO [RS:1;jenkins-hbase4:43337] regionserver.LeaseManager(133): Closed leases 2023-02-10 19:02:57,929 INFO [RS:1;jenkins-hbase4:43337] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-02-10 19:02:57,929 INFO [RS:1;jenkins-hbase4:43337] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-10 19:02:57,929 INFO [RS:1;jenkins-hbase4:43337] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-10 19:02:57,929 INFO [RS:1;jenkins-hbase4:43337] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-10 19:02:57,929 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-10 19:02:57,930 INFO [RS:1;jenkins-hbase4:43337] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:43337 2023-02-10 19:02:57,943 DEBUG [Listener at localhost/32909-EventThread] zookeeper.ZKWatcher(600): master:41145-0x1003f9d40a30000, quorum=127.0.0.1:63334, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-10 19:02:57,943 DEBUG [Listener at localhost/32909-EventThread] zookeeper.ZKWatcher(600): regionserver:43623-0x1003f9d40a30001, quorum=127.0.0.1:63334, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,43337,1676055764986 2023-02-10 19:02:57,943 DEBUG [Listener at localhost/32909-EventThread] zookeeper.ZKWatcher(600): regionserver:43623-0x1003f9d40a30001, quorum=127.0.0.1:63334, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-10 19:02:57,943 DEBUG [Listener at localhost/32909-EventThread] zookeeper.ZKWatcher(600): regionserver:43337-0x1003f9d40a30002, quorum=127.0.0.1:63334, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,43337,1676055764986 2023-02-10 19:02:57,943 ERROR [Listener at localhost/32909-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@43ee90bc rejected from java.util.concurrent.ThreadPoolExecutor@47d10c19[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-10 19:02:57,943 DEBUG [Listener at localhost/32909-EventThread] zookeeper.ZKWatcher(600): regionserver:43337-0x1003f9d40a30002, quorum=127.0.0.1:63334, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-10 19:02:57,943 ERROR [Listener at localhost/32909-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@4c7b79b rejected from java.util.concurrent.ThreadPoolExecutor@47d10c19[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-10 19:02:57,945 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,43337,1676055764986] 2023-02-10 19:02:57,945 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,43337,1676055764986; numProcessing=1 2023-02-10 19:02:57,959 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=22.08 KB at sequenceid=57 (bloomFilter=false), to=hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/data/hbase/meta/1588230740/.tmp/info/fcb7b32cce2f40e787c807cc0ab14eed 2023-02-10 19:02:57,966 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-10 19:02:57,968 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-10 19:02:57,969 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for fcb7b32cce2f40e787c807cc0ab14eed 2023-02-10 19:02:57,983 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=997 B at sequenceid=57 (bloomFilter=false), to=hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/data/hbase/meta/1588230740/.tmp/rep_barrier/c9c7e5f27e714dafa6a3ceffc3748e37 2023-02-10 19:02:57,989 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c9c7e5f27e714dafa6a3ceffc3748e37 2023-02-10 19:02:58,003 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.24 KB at sequenceid=57 (bloomFilter=false), to=hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/data/hbase/meta/1588230740/.tmp/table/8612edf71b334b7cbc75e3db7abee53e 2023-02-10 19:02:58,009 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 8612edf71b334b7cbc75e3db7abee53e 2023-02-10 19:02:58,010 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/data/hbase/meta/1588230740/.tmp/info/fcb7b32cce2f40e787c807cc0ab14eed as hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/data/hbase/meta/1588230740/info/fcb7b32cce2f40e787c807cc0ab14eed 2023-02-10 19:02:58,023 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for fcb7b32cce2f40e787c807cc0ab14eed 2023-02-10 19:02:58,023 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/data/hbase/meta/1588230740/info/fcb7b32cce2f40e787c807cc0ab14eed, entries=30, sequenceid=57, filesize=7.9 K 2023-02-10 19:02:58,024 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/data/hbase/meta/1588230740/.tmp/rep_barrier/c9c7e5f27e714dafa6a3ceffc3748e37 as hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/data/hbase/meta/1588230740/rep_barrier/c9c7e5f27e714dafa6a3ceffc3748e37 2023-02-10 19:02:58,030 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c9c7e5f27e714dafa6a3ceffc3748e37 2023-02-10 19:02:58,030 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/data/hbase/meta/1588230740/rep_barrier/c9c7e5f27e714dafa6a3ceffc3748e37, entries=10, sequenceid=57, filesize=5.9 K 2023-02-10 19:02:58,031 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/data/hbase/meta/1588230740/.tmp/table/8612edf71b334b7cbc75e3db7abee53e as hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/data/hbase/meta/1588230740/table/8612edf71b334b7cbc75e3db7abee53e 2023-02-10 19:02:58,036 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 8612edf71b334b7cbc75e3db7abee53e 2023-02-10 19:02:58,036 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/data/hbase/meta/1588230740/table/8612edf71b334b7cbc75e3db7abee53e, entries=13, sequenceid=57, filesize=5.9 K 2023-02-10 19:02:58,037 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~24.29 KB/24876, heapSize ~40.16 KB/41120, currentSize=0 B/0 for 1588230740 in 116ms, sequenceid=57, compaction requested=false 2023-02-10 19:02:58,046 DEBUG [Listener at localhost/32909-EventThread] zookeeper.ZKWatcher(600): regionserver:43337-0x1003f9d40a30002, quorum=127.0.0.1:63334, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-10 19:02:58,046 INFO [RS:1;jenkins-hbase4:43337] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,43337,1676055764986; zookeeper connection closed. 2023-02-10 19:02:58,046 ERROR [Listener at localhost/32909-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@7ce5cf71 rejected from java.util.concurrent.ThreadPoolExecutor@47d10c19[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-10 19:02:58,046 DEBUG [Listener at localhost/32909-EventThread] zookeeper.ZKWatcher(600): regionserver:43337-0x1003f9d40a30002, quorum=127.0.0.1:63334, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-10 19:02:58,046 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@15c9c425] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@15c9c425 2023-02-10 19:02:58,046 ERROR [Listener at localhost/32909-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@5b3e7d63 rejected from java.util.concurrent.ThreadPoolExecutor@47d10c19[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-10 19:02:58,048 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,43337,1676055764986 already deleted, retry=false 2023-02-10 19:02:58,048 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,43337,1676055764986 expired; onlineServers=1 2023-02-10 19:02:58,050 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/data/hbase/meta/1588230740/recovered.edits/60.seqid, newMaxSeqId=60, maxSeqId=1 2023-02-10 19:02:58,050 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-10 19:02:58,051 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-10 19:02:58,052 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1676055777920Running coprocessor pre-close hooks at 1676055777920Disabling compacts and flushes for region at 1676055777921 (+1 ms)Disabling writes for close at 1676055777921Obtaining lock to block concurrent updates at 1676055777922 (+1 ms)Preparing flush snapshotting stores in 1588230740 at 1676055777922Finished memstore snapshotting hbase:meta,,1.1588230740, syncing WAL and waiting on mvcc, flushsize=dataSize=24876, getHeapSize=41120, getOffHeapSize=0, getCellsCount=207 at 1676055777922Flushing stores of hbase:meta,,1.1588230740 at 1676055777924 (+2 ms)Flushing 1588230740/info: creating writer at 1676055777924Flushing 1588230740/info: appending metadata at 1676055777931 (+7 ms)Flushing 1588230740/info: closing flushed file at 1676055777931Flushing 1588230740/rep_barrier: creating writer at 1676055777969 (+38 ms)Flushing 1588230740/rep_barrier: appending metadata at 1676055777972 (+3 ms)Flushing 1588230740/rep_barrier: closing flushed file at 1676055777972Flushing 1588230740/table: creating writer at 1676055777989 (+17 ms)Flushing 1588230740/table: appending metadata at 1676055777992 (+3 ms)Flushing 1588230740/table: closing flushed file at 1676055777992Flushing 1588230740/info: reopening flushed file at 1676055778014 (+22 ms)Flushing 1588230740/rep_barrier: reopening flushed file at 1676055778025 (+11 ms)Flushing 1588230740/table: reopening flushed file at 1676055778032 (+7 ms)Finished flush of dataSize ~24.29 KB/24876, heapSize ~40.16 KB/41120, currentSize=0 B/0 for 1588230740 in 116ms, sequenceid=57, compaction requested=false at 1676055778037 (+5 ms)Writing region close event to WAL at 1676055778044 (+7 ms)Running coprocessor post-close hooks at 1676055778050 (+6 ms)Closed at 1676055778051 (+1 ms) 2023-02-10 19:02:58,052 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-02-10 19:02:58,124 DEBUG [RS:0;jenkins-hbase4:43623] regionserver.HRegionServer(1505): Waiting on 286c590596b53e18c86a9d4f2113eb8c 2023-02-10 19:02:58,324 DEBUG [RS:0;jenkins-hbase4:43623] regionserver.HRegionServer(1505): Waiting on 286c590596b53e18c86a9d4f2113eb8c 2023-02-10 19:02:58,347 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/data/hbase/namespace/286c590596b53e18c86a9d4f2113eb8c/.tmp/info/ae80b8bb2f1e4ed2a145b2b8a9c355a1 2023-02-10 19:02:58,353 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/data/hbase/namespace/286c590596b53e18c86a9d4f2113eb8c/.tmp/info/ae80b8bb2f1e4ed2a145b2b8a9c355a1 as hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/data/hbase/namespace/286c590596b53e18c86a9d4f2113eb8c/info/ae80b8bb2f1e4ed2a145b2b8a9c355a1 2023-02-10 19:02:58,359 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/data/hbase/namespace/286c590596b53e18c86a9d4f2113eb8c/info/ae80b8bb2f1e4ed2a145b2b8a9c355a1, entries=2, sequenceid=6, filesize=4.8 K 2023-02-10 19:02:58,360 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 286c590596b53e18c86a9d4f2113eb8c in 440ms, sequenceid=6, compaction requested=false 2023-02-10 19:02:58,364 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-02-10 19:02:58,364 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-02-10 19:02:58,366 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/data/hbase/namespace/286c590596b53e18c86a9d4f2113eb8c/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-02-10 19:02:58,367 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676055767055.286c590596b53e18c86a9d4f2113eb8c. 2023-02-10 19:02:58,367 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 286c590596b53e18c86a9d4f2113eb8c: Waiting for close lock at 1676055777919Running coprocessor pre-close hooks at 1676055777919Disabling compacts and flushes for region at 1676055777919Disabling writes for close at 1676055777920 (+1 ms)Obtaining lock to block concurrent updates at 1676055777920Preparing flush snapshotting stores in 286c590596b53e18c86a9d4f2113eb8c at 1676055777920Finished memstore snapshotting hbase:namespace,,1676055767055.286c590596b53e18c86a9d4f2113eb8c., syncing WAL and waiting on mvcc, flushsize=dataSize=78, getHeapSize=472, getOffHeapSize=0, getCellsCount=2 at 1676055777920Flushing stores of hbase:namespace,,1676055767055.286c590596b53e18c86a9d4f2113eb8c. at 1676055777921 (+1 ms)Flushing 286c590596b53e18c86a9d4f2113eb8c/info: creating writer at 1676055777922 (+1 ms)Flushing 286c590596b53e18c86a9d4f2113eb8c/info: appending metadata at 1676055777927 (+5 ms)Flushing 286c590596b53e18c86a9d4f2113eb8c/info: closing flushed file at 1676055777927Flushing 286c590596b53e18c86a9d4f2113eb8c/info: reopening flushed file at 1676055778354 (+427 ms)Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 286c590596b53e18c86a9d4f2113eb8c in 440ms, sequenceid=6, compaction requested=false at 1676055778360 (+6 ms)Writing region close event to WAL at 1676055778362 (+2 ms)Running coprocessor post-close hooks at 1676055778367 (+5 ms)Closed at 1676055778367 2023-02-10 19:02:58,367 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1676055767055.286c590596b53e18c86a9d4f2113eb8c. 2023-02-10 19:02:58,524 INFO [RS:0;jenkins-hbase4:43623] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,43623,1676055764936; all regions closed. 2023-02-10 19:02:58,529 DEBUG [RS:0;jenkins-hbase4:43623] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/oldWALs 2023-02-10 19:02:58,530 INFO [RS:0;jenkins-hbase4:43623] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C43623%2C1676055764936.meta:.meta(num 1676055766678) 2023-02-10 19:02:58,533 WARN [Close-WAL-Writer-0] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(641): complete file /user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/WALs/jenkins-hbase4.apache.org,43623,1676055764936/jenkins-hbase4.apache.org%2C43623%2C1676055764936.1676055767358 not finished, retry = 0 2023-02-10 19:02:58,636 DEBUG [RS:0;jenkins-hbase4:43623] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/oldWALs 2023-02-10 19:02:58,637 INFO [RS:0;jenkins-hbase4:43623] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C43623%2C1676055764936:(num 1676055767358) 2023-02-10 19:02:58,637 DEBUG [RS:0;jenkins-hbase4:43623] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-10 19:02:58,637 INFO [RS:0;jenkins-hbase4:43623] regionserver.LeaseManager(133): Closed leases 2023-02-10 19:02:58,637 INFO [RS:0;jenkins-hbase4:43623] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-02-10 19:02:58,638 INFO [RS:0;jenkins-hbase4:43623] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:43623 2023-02-10 19:02:58,640 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-10 19:02:58,646 DEBUG [Listener at localhost/32909-EventThread] zookeeper.ZKWatcher(600): regionserver:43623-0x1003f9d40a30001, quorum=127.0.0.1:63334, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,43623,1676055764936 2023-02-10 19:02:58,646 DEBUG [Listener at localhost/32909-EventThread] zookeeper.ZKWatcher(600): master:41145-0x1003f9d40a30000, quorum=127.0.0.1:63334, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-10 19:02:58,647 ERROR [Listener at localhost/32909-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@43dc4ac2 rejected from java.util.concurrent.ThreadPoolExecutor@47e3c661[Shutting down, pool size = 1, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1374) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-10 19:02:58,648 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,43623,1676055764936] 2023-02-10 19:02:58,648 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,43623,1676055764936; numProcessing=2 2023-02-10 19:02:58,649 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,43623,1676055764936 already deleted, retry=false 2023-02-10 19:02:58,649 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,43623,1676055764936 expired; onlineServers=0 2023-02-10 19:02:58,649 INFO [RegionServerTracker-0] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,41145,1676055763642' ***** 2023-02-10 19:02:58,649 INFO [RegionServerTracker-0] regionserver.HRegionServer(2310): STOPPED: Cluster shutdown set; onlineServer=0 2023-02-10 19:02:58,649 DEBUG [M:0;jenkins-hbase4:41145] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1956d169, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-10 19:02:58,650 INFO [M:0;jenkins-hbase4:41145] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,41145,1676055763642 2023-02-10 19:02:58,650 INFO [M:0;jenkins-hbase4:41145] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,41145,1676055763642; all regions closed. 2023-02-10 19:02:58,650 DEBUG [M:0;jenkins-hbase4:41145] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-10 19:02:58,650 DEBUG [M:0;jenkins-hbase4:41145] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-02-10 19:02:58,650 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-02-10 19:02:58,650 DEBUG [M:0;jenkins-hbase4:41145] cleaner.HFileCleaner(317): Stopping file delete threads 2023-02-10 19:02:58,650 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676055766157] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676055766157,5,FailOnTimeoutGroup] 2023-02-10 19:02:58,651 INFO [M:0;jenkins-hbase4:41145] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-02-10 19:02:58,650 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676055766157] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676055766157,5,FailOnTimeoutGroup] 2023-02-10 19:02:58,652 INFO [M:0;jenkins-hbase4:41145] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-02-10 19:02:58,652 INFO [M:0;jenkins-hbase4:41145] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-02-10 19:02:58,652 DEBUG [M:0;jenkins-hbase4:41145] master.HMaster(1502): Stopping service threads 2023-02-10 19:02:58,652 INFO [M:0;jenkins-hbase4:41145] procedure2.RemoteProcedureDispatcher(118): Stopping procedure remote dispatcher 2023-02-10 19:02:58,653 DEBUG [Listener at localhost/32909-EventThread] zookeeper.ZKWatcher(600): master:41145-0x1003f9d40a30000, quorum=127.0.0.1:63334, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-02-10 19:02:58,653 ERROR [M:0;jenkins-hbase4:41145] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT 2023-02-10 19:02:58,653 DEBUG [Listener at localhost/32909-EventThread] zookeeper.ZKWatcher(600): master:41145-0x1003f9d40a30000, quorum=127.0.0.1:63334, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] Thread[HFileArchiver-1,5,PEWorkerGroup] Thread[HFileArchiver-2,5,PEWorkerGroup] Thread[HFileArchiver-3,5,PEWorkerGroup] Thread[HFileArchiver-4,5,PEWorkerGroup] Thread[HFileArchiver-5,5,PEWorkerGroup] Thread[HFileArchiver-6,5,PEWorkerGroup] Thread[HFileArchiver-7,5,PEWorkerGroup] Thread[HFileArchiver-8,5,PEWorkerGroup] 2023-02-10 19:02:58,653 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:41145-0x1003f9d40a30000, quorum=127.0.0.1:63334, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-10 19:02:58,654 INFO [M:0;jenkins-hbase4:41145] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-02-10 19:02:58,654 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-02-10 19:02:58,654 DEBUG [M:0;jenkins-hbase4:41145] zookeeper.ZKUtil(398): master:41145-0x1003f9d40a30000, quorum=127.0.0.1:63334, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-02-10 19:02:58,654 WARN [M:0;jenkins-hbase4:41145] master.ActiveMasterManager(323): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-02-10 19:02:58,654 INFO [M:0;jenkins-hbase4:41145] assignment.AssignmentManager(315): Stopping assignment manager 2023-02-10 19:02:58,654 INFO [M:0;jenkins-hbase4:41145] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-02-10 19:02:58,655 DEBUG [M:0;jenkins-hbase4:41145] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-10 19:02:58,655 INFO [M:0;jenkins-hbase4:41145] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-10 19:02:58,655 DEBUG [M:0;jenkins-hbase4:41145] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-10 19:02:58,655 DEBUG [M:0;jenkins-hbase4:41145] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-10 19:02:58,655 DEBUG [M:0;jenkins-hbase4:41145] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-10 19:02:58,655 INFO [M:0;jenkins-hbase4:41145] regionserver.HRegion(2744): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=159.25 KB heapSize=192.17 KB 2023-02-10 19:02:58,673 INFO [M:0;jenkins-hbase4:41145] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=159.25 KB at sequenceid=357 (bloomFilter=true), to=hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/9ccab0725dde43e2b985d6072e938262 2023-02-10 19:02:58,679 DEBUG [M:0;jenkins-hbase4:41145] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/9ccab0725dde43e2b985d6072e938262 as hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/9ccab0725dde43e2b985d6072e938262 2023-02-10 19:02:58,684 INFO [M:0;jenkins-hbase4:41145] regionserver.HStore(1080): Added hdfs://localhost:46001/user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/9ccab0725dde43e2b985d6072e938262, entries=53, sequenceid=357, filesize=10.4 K 2023-02-10 19:02:58,685 INFO [M:0;jenkins-hbase4:41145] regionserver.HRegion(2947): Finished flush of dataSize ~159.25 KB/163067, heapSize ~192.16 KB/196768, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 30ms, sequenceid=357, compaction requested=false 2023-02-10 19:02:58,689 INFO [M:0;jenkins-hbase4:41145] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-10 19:02:58,689 DEBUG [M:0;jenkins-hbase4:41145] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1676055778655Disabling compacts and flushes for region at 1676055778655Disabling writes for close at 1676055778655Obtaining lock to block concurrent updates at 1676055778655Preparing flush snapshotting stores in 1595e783b53d99cd5eef43b6debb2682 at 1676055778655Finished memstore snapshotting master:store,,1.1595e783b53d99cd5eef43b6debb2682., syncing WAL and waiting on mvcc, flushsize=dataSize=163067, getHeapSize=196768, getOffHeapSize=0, getCellsCount=442 at 1676055778655Flushing stores of master:store,,1.1595e783b53d99cd5eef43b6debb2682. at 1676055778656 (+1 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: creating writer at 1676055778657 (+1 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: appending metadata at 1676055778660 (+3 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: closing flushed file at 1676055778660Flushing 1595e783b53d99cd5eef43b6debb2682/proc: reopening flushed file at 1676055778680 (+20 ms)Finished flush of dataSize ~159.25 KB/163067, heapSize ~192.16 KB/196768, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 30ms, sequenceid=357, compaction requested=false at 1676055778685 (+5 ms)Writing region close event to WAL at 1676055778689 (+4 ms)Closed at 1676055778689 2023-02-10 19:02:58,694 WARN [Close-WAL-Writer-0] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(641): complete file /user/jenkins/test-data/ec846b9a-28fb-c992-92a4-e9c604eeef75/MasterData/WALs/jenkins-hbase4.apache.org,41145,1676055763642/jenkins-hbase4.apache.org%2C41145%2C1676055763642.1676055765441 not finished, retry = 0 2023-02-10 19:02:58,748 DEBUG [Listener at localhost/32909-EventThread] zookeeper.ZKWatcher(600): regionserver:43623-0x1003f9d40a30001, quorum=127.0.0.1:63334, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-10 19:02:58,748 INFO [RS:0;jenkins-hbase4:43623] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,43623,1676055764936; zookeeper connection closed. 2023-02-10 19:02:58,748 ERROR [Listener at localhost/32909-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@12821691 rejected from java.util.concurrent.ThreadPoolExecutor@47e3c661[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-10 19:02:58,748 DEBUG [Listener at localhost/32909-EventThread] zookeeper.ZKWatcher(600): regionserver:43623-0x1003f9d40a30001, quorum=127.0.0.1:63334, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-10 19:02:58,748 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@d5f26f] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@d5f26f 2023-02-10 19:02:58,748 ERROR [Listener at localhost/32909-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@6a20cc83 rejected from java.util.concurrent.ThreadPoolExecutor@47e3c661[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-10 19:02:58,749 INFO [Listener at localhost/32909] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 2 regionserver(s) complete 2023-02-10 19:02:58,796 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-10 19:02:58,796 INFO [M:0;jenkins-hbase4:41145] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-02-10 19:02:58,797 INFO [M:0;jenkins-hbase4:41145] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:41145 2023-02-10 19:02:58,803 DEBUG [M:0;jenkins-hbase4:41145] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,41145,1676055763642 already deleted, retry=false 2023-02-10 19:02:58,904 DEBUG [Listener at localhost/32909-EventThread] zookeeper.ZKWatcher(600): master:41145-0x1003f9d40a30000, quorum=127.0.0.1:63334, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-10 19:02:58,904 INFO [M:0;jenkins-hbase4:41145] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,41145,1676055763642; zookeeper connection closed. 2023-02-10 19:02:58,905 ERROR [Listener at localhost/32909-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@383f0276 rejected from java.util.concurrent.ThreadPoolExecutor@861387[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 55] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-10 19:02:58,905 DEBUG [Listener at localhost/32909-EventThread] zookeeper.ZKWatcher(600): master:41145-0x1003f9d40a30000, quorum=127.0.0.1:63334, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-10 19:02:58,905 ERROR [Listener at localhost/32909-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@6bc478a0 rejected from java.util.concurrent.ThreadPoolExecutor@861387[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 55] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-10 19:02:58,907 WARN [Listener at localhost/32909] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-10 19:02:58,910 INFO [Listener at localhost/32909] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-10 19:02:59,014 WARN [BP-1304201802-172.31.14.131-1676055760209 heartbeating to localhost/127.0.0.1:46001] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-10 19:02:59,014 WARN [BP-1304201802-172.31.14.131-1676055760209 heartbeating to localhost/127.0.0.1:46001] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1304201802-172.31.14.131-1676055760209 (Datanode Uuid 6fe54ac5-2638-422d-8594-9057a6fea5c0) service to localhost/127.0.0.1:46001 2023-02-10 19:02:59,015 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/df59ff2b-dcbe-75a4-cab6-314b30c9ac42/cluster_62645702-7f4c-8040-e3dd-93ad81c2f524/dfs/data/data3/current/BP-1304201802-172.31.14.131-1676055760209] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-10 19:02:59,016 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/df59ff2b-dcbe-75a4-cab6-314b30c9ac42/cluster_62645702-7f4c-8040-e3dd-93ad81c2f524/dfs/data/data4/current/BP-1304201802-172.31.14.131-1676055760209] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-10 19:02:59,017 WARN [Listener at localhost/32909] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-10 19:02:59,023 INFO [Listener at localhost/32909] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-10 19:02:59,127 WARN [BP-1304201802-172.31.14.131-1676055760209 heartbeating to localhost/127.0.0.1:46001] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-10 19:02:59,127 WARN [BP-1304201802-172.31.14.131-1676055760209 heartbeating to localhost/127.0.0.1:46001] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1304201802-172.31.14.131-1676055760209 (Datanode Uuid e1db60ba-1d64-4a4b-bddf-16e85b09a2bc) service to localhost/127.0.0.1:46001 2023-02-10 19:02:59,128 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/df59ff2b-dcbe-75a4-cab6-314b30c9ac42/cluster_62645702-7f4c-8040-e3dd-93ad81c2f524/dfs/data/data1/current/BP-1304201802-172.31.14.131-1676055760209] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-10 19:02:59,128 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/df59ff2b-dcbe-75a4-cab6-314b30c9ac42/cluster_62645702-7f4c-8040-e3dd-93ad81c2f524/dfs/data/data2/current/BP-1304201802-172.31.14.131-1676055760209] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-10 19:02:59,167 INFO [Listener at localhost/32909] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-10 19:02:59,293 INFO [Listener at localhost/32909] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-02-10 19:02:59,361 INFO [Listener at localhost/32909] hbase.HBaseTestingUtility(1293): Minicluster is down 2023-02-10 19:02:59,377 INFO [Listener at localhost/32909] hbase.ResourceChecker(175): after: mapred.TestTableSnapshotInputFormat#testWithMapReduceMultiRegion Thread=101 (was 7) Potentially hanging thread: HFileArchiver-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-6 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: process reaper sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: master/jenkins-hbase4:0:becomeActiveMaster-MemStoreChunkPool Statistics sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-2 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-3 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: SessionTracker java.lang.Thread.sleep(Native Method) org.apache.zookeeper.server.SessionTrackerImpl.run(SessionTrackerImpl.java:151) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-5-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-3-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1688088802) connection to localhost/127.0.0.1:46001 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: IPC Parameter Sending Thread #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ForkJoinPool-2-worker-4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.ForkJoinPool.awaitWork(ForkJoinPool.java:1824) java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1693) java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: nioEventLoopGroup-3-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ForkJoinPool-2-worker-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.ForkJoinPool.awaitWork(ForkJoinPool.java:1824) java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1693) java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175) Potentially hanging thread: RS-EventLoopGroup-4-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/32909 java.lang.Thread.dumpThreads(Native Method) java.lang.Thread.getAllStackTraces(Thread.java:1615) org.apache.hadoop.hbase.ResourceCheckerJUnitListener$ThreadResourceAnalyzer.getVal(ResourceCheckerJUnitListener.java:49) org.apache.hadoop.hbase.ResourceChecker.fill(ResourceChecker.java:110) org.apache.hadoop.hbase.ResourceChecker.fillEndings(ResourceChecker.java:104) org.apache.hadoop.hbase.ResourceChecker.end(ResourceChecker.java:206) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.end(ResourceCheckerJUnitListener.java:165) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.testFinished(ResourceCheckerJUnitListener.java:185) org.junit.runner.notification.SynchronizedRunListener.testFinished(SynchronizedRunListener.java:87) org.junit.runner.notification.RunNotifier$9.notifyListener(RunNotifier.java:225) org.junit.runner.notification.RunNotifier$SafeNotifier.run(RunNotifier.java:72) org.junit.runner.notification.RunNotifier.fireTestFinished(RunNotifier.java:222) org.junit.internal.runners.model.EachTestNotifier.fireTestFinished(EachTestNotifier.java:38) org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:372) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) org.apache.hadoop.hbase.SystemExitRule$1.evaluate(SystemExitRule.java:39) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-4-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-3-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Parameter Sending Thread #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-5-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.1@localhost:46001 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins@localhost:46001 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-4-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1688088802) connection to localhost/127.0.0.1:46001 from jenkins.hfs.1 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Timer for 'HBase' metrics system java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: (jenkins-hbase4.apache.org,41145,1676055763642)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: process reaper sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-3-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: region-location-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-3-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: region-location-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RpcClient-timer-pool-0 java.lang.Thread.sleep(Native Method) org.apache.hbase.thirdparty.io.netty.util.HashedWheelTimer$Worker.waitForNextTick(HashedWheelTimer.java:600) org.apache.hbase.thirdparty.io.netty.util.HashedWheelTimer$Worker.run(HashedWheelTimer.java:496) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-2-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: SnapshotHandlerChoreCleaner sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-3-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-1-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: ForkJoinPool-2-worker-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.ForkJoinPool.awaitWork(ForkJoinPool.java:1824) java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1693) java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175) Potentially hanging thread: RS-EventLoopGroup-4-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-2-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: master/jenkins-hbase4:0:becomeActiveMaster-MemStoreChunkPool Statistics sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1688088802) connection to localhost/127.0.0.1:46001 from jenkins.hfs.0 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: Idle-Rpc-Conn-Sweeper-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: regionserver/jenkins-hbase4:0.procedureResultReporter sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.hadoop.hbase.regionserver.RemoteProcedureResultReporter.run(RemoteProcedureResultReporter.java:77) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-1 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1688088802) connection to localhost/127.0.0.1:46001 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: ForkJoinPool-2-worker-5 sun.misc.Unsafe.park(Native Method) java.util.concurrent.ForkJoinPool.awaitWork(ForkJoinPool.java:1824) java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1693) java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175) Potentially hanging thread: HBase-Metrics2-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: org.apache.hadoop.fs.FileSystem$Statistics$StatisticsDataReferenceCleaner java.lang.Object.wait(Native Method) java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:144) java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:165) org.apache.hadoop.fs.FileSystem$Statistics$StatisticsDataReferenceCleaner.run(FileSystem.java:3693) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: IPC Parameter Sending Thread #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-4-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-1-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: RS-EventLoopGroup-4-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-5 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.0@localhost:46001 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Monitor thread for TaskMonitor java.lang.Thread.sleep(Native Method) org.apache.hadoop.hbase.monitoring.TaskMonitor$MonitorRunnable.run(TaskMonitor.java:300) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: org.apache.hadoop.hdfs.PeerCache@6efd3492 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.PeerCache.run(PeerCache.java:253) org.apache.hadoop.hdfs.PeerCache.access$000(PeerCache.java:46) org.apache.hadoop.hdfs.PeerCache$1.run(PeerCache.java:124) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: regionserver/jenkins-hbase4:0.procedureResultReporter sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.hadoop.hbase.regionserver.RemoteProcedureResultReporter.run(RemoteProcedureResultReporter.java:77) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: RS-EventLoopGroup-1-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-5-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-2-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=532 (was 242) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=353 (was 180) - SystemLoadAverage LEAK? -, ProcessCount=167 (was 169), AvailableMemoryMB=3754 (was 4759) 2023-02-10 19:02:59,388 INFO [Listener at localhost/32909] hbase.ResourceChecker(147): before: mapred.TestTableSnapshotInputFormat#testWithMapReduceAndOfflineHBaseMultiRegion Thread=101, OpenFileDescriptor=532, MaxFileDescriptor=60000, SystemLoadAverage=353, ProcessCount=167, AvailableMemoryMB=3753 2023-02-10 19:02:59,403 INFO [Listener at localhost/32909] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.log.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/df59ff2b-dcbe-75a4-cab6-314b30c9ac42/hadoop.log.dir so I do NOT create it in target/test-data/3335ac0e-fb88-6eb8-b993-c028993dd2d7 2023-02-10 19:02:59,403 WARN [Listener at localhost/32909] hbase.HBaseTestingUtility(449): hadoop.log.dir property value differs in configuration and system: Configuration=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/../logs while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/df59ff2b-dcbe-75a4-cab6-314b30c9ac42/hadoop.log.dir Erasing configuration value by system value. 2023-02-10 19:02:59,403 INFO [Listener at localhost/32909] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.tmp.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/df59ff2b-dcbe-75a4-cab6-314b30c9ac42/hadoop.tmp.dir so I do NOT create it in target/test-data/3335ac0e-fb88-6eb8-b993-c028993dd2d7 2023-02-10 19:02:59,403 WARN [Listener at localhost/32909] hbase.HBaseTestingUtility(449): hadoop.tmp.dir property value differs in configuration and system: Configuration=/tmp/hadoop-jenkins while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/df59ff2b-dcbe-75a4-cab6-314b30c9ac42/hadoop.tmp.dir Erasing configuration value by system value. 2023-02-10 19:02:59,403 DEBUG [Listener at localhost/32909] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3335ac0e-fb88-6eb8-b993-c028993dd2d7 2023-02-10 19:02:59,404 INFO [Listener at localhost/32909] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=2, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=true, createWALDir=false} 2023-02-10 19:02:59,404 INFO [Listener at localhost/32909] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3335ac0e-fb88-6eb8-b993-c028993dd2d7/cluster_c25d0905-9b0f-64e8-fbc0-da8b20564564, deleteOnExit=true 2023-02-10 19:02:59,404 INFO [Listener at localhost/32909] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-02-10 19:02:59,404 INFO [Listener at localhost/32909] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3335ac0e-fb88-6eb8-b993-c028993dd2d7/test.cache.data in system properties and HBase conf 2023-02-10 19:02:59,404 INFO [Listener at localhost/32909] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3335ac0e-fb88-6eb8-b993-c028993dd2d7/hadoop.tmp.dir in system properties and HBase conf 2023-02-10 19:02:59,405 INFO [Listener at localhost/32909] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3335ac0e-fb88-6eb8-b993-c028993dd2d7/hadoop.log.dir in system properties and HBase conf 2023-02-10 19:02:59,405 INFO [Listener at localhost/32909] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3335ac0e-fb88-6eb8-b993-c028993dd2d7/mapreduce.cluster.local.dir in system properties and HBase conf 2023-02-10 19:02:59,405 INFO [Listener at localhost/32909] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3335ac0e-fb88-6eb8-b993-c028993dd2d7/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-02-10 19:02:59,405 INFO [Listener at localhost/32909] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-02-10 19:02:59,405 DEBUG [Listener at localhost/32909] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-02-10 19:02:59,406 INFO [Listener at localhost/32909] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3335ac0e-fb88-6eb8-b993-c028993dd2d7/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-02-10 19:02:59,406 INFO [Listener at localhost/32909] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3335ac0e-fb88-6eb8-b993-c028993dd2d7/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-02-10 19:02:59,406 INFO [Listener at localhost/32909] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3335ac0e-fb88-6eb8-b993-c028993dd2d7/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-02-10 19:02:59,406 INFO [Listener at localhost/32909] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3335ac0e-fb88-6eb8-b993-c028993dd2d7/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-10 19:02:59,406 INFO [Listener at localhost/32909] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3335ac0e-fb88-6eb8-b993-c028993dd2d7/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-02-10 19:02:59,406 INFO [Listener at localhost/32909] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3335ac0e-fb88-6eb8-b993-c028993dd2d7/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-02-10 19:02:59,407 INFO [Listener at localhost/32909] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3335ac0e-fb88-6eb8-b993-c028993dd2d7/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-10 19:02:59,407 INFO [Listener at localhost/32909] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3335ac0e-fb88-6eb8-b993-c028993dd2d7/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-10 19:02:59,407 INFO [Listener at localhost/32909] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3335ac0e-fb88-6eb8-b993-c028993dd2d7/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-02-10 19:02:59,407 INFO [Listener at localhost/32909] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3335ac0e-fb88-6eb8-b993-c028993dd2d7/nfs.dump.dir in system properties and HBase conf 2023-02-10 19:02:59,407 INFO [Listener at localhost/32909] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3335ac0e-fb88-6eb8-b993-c028993dd2d7/java.io.tmpdir in system properties and HBase conf 2023-02-10 19:02:59,407 INFO [Listener at localhost/32909] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3335ac0e-fb88-6eb8-b993-c028993dd2d7/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-10 19:02:59,407 INFO [Listener at localhost/32909] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3335ac0e-fb88-6eb8-b993-c028993dd2d7/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-02-10 19:02:59,408 INFO [Listener at localhost/32909] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3335ac0e-fb88-6eb8-b993-c028993dd2d7/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-02-10 19:02:59,413 WARN [Listener at localhost/32909] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-10 19:02:59,413 WARN [Listener at localhost/32909] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-10 19:02:59,455 WARN [Listener at localhost/32909] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-10 19:02:59,458 INFO [Listener at localhost/32909] log.Slf4jLog(67): jetty-6.1.26 2023-02-10 19:02:59,465 INFO [Listener at localhost/32909] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3335ac0e-fb88-6eb8-b993-c028993dd2d7/java.io.tmpdir/Jetty_localhost_32769_hdfs____.gozizf/webapp 2023-02-10 19:02:59,615 INFO [Listener at localhost/32909] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:32769 2023-02-10 19:02:59,620 WARN [Listener at localhost/32909] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-10 19:02:59,620 WARN [Listener at localhost/32909] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-10 19:02:59,684 WARN [Listener at localhost/34605] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-10 19:02:59,699 WARN [Listener at localhost/34605] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-10 19:02:59,702 WARN [Listener at localhost/34605] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-10 19:02:59,704 INFO [Listener at localhost/34605] log.Slf4jLog(67): jetty-6.1.26 2023-02-10 19:02:59,711 INFO [Listener at localhost/34605] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3335ac0e-fb88-6eb8-b993-c028993dd2d7/java.io.tmpdir/Jetty_localhost_42691_datanode____.5ab9ft/webapp 2023-02-10 19:02:59,822 INFO [Listener at localhost/34605] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:42691 2023-02-10 19:02:59,832 WARN [Listener at localhost/39253] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-10 19:02:59,854 WARN [Listener at localhost/39253] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-10 19:02:59,857 WARN [Listener at localhost/39253] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-10 19:02:59,858 INFO [Listener at localhost/39253] log.Slf4jLog(67): jetty-6.1.26 2023-02-10 19:02:59,863 INFO [Listener at localhost/39253] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3335ac0e-fb88-6eb8-b993-c028993dd2d7/java.io.tmpdir/Jetty_localhost_32995_datanode____rpw8jh/webapp 2023-02-10 19:02:59,960 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x710ef4eb4a804565: Processing first storage report for DS-eed40a6d-0d20-4883-936f-2082985e6383 from datanode cb616b07-e100-41ac-a67a-7d33ff65a0b4 2023-02-10 19:02:59,960 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x710ef4eb4a804565: from storage DS-eed40a6d-0d20-4883-936f-2082985e6383 node DatanodeRegistration(127.0.0.1:46609, datanodeUuid=cb616b07-e100-41ac-a67a-7d33ff65a0b4, infoPort=36053, infoSecurePort=0, ipcPort=39253, storageInfo=lv=-57;cid=testClusterID;nsid=784088281;c=1676055779416), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-10 19:02:59,960 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x710ef4eb4a804565: Processing first storage report for DS-5502827c-d053-4308-9712-69ce7dc68af0 from datanode cb616b07-e100-41ac-a67a-7d33ff65a0b4 2023-02-10 19:02:59,960 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x710ef4eb4a804565: from storage DS-5502827c-d053-4308-9712-69ce7dc68af0 node DatanodeRegistration(127.0.0.1:46609, datanodeUuid=cb616b07-e100-41ac-a67a-7d33ff65a0b4, infoPort=36053, infoSecurePort=0, ipcPort=39253, storageInfo=lv=-57;cid=testClusterID;nsid=784088281;c=1676055779416), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-10 19:02:59,987 INFO [Listener at localhost/39253] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:32995 2023-02-10 19:03:00,003 WARN [Listener at localhost/35877] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-10 19:03:00,117 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xc497cc272a503d: Processing first storage report for DS-bd89f331-16cf-42ed-9769-6b8e5d3726db from datanode 6440fdca-19c5-4754-beea-92350679d0e7 2023-02-10 19:03:00,117 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xc497cc272a503d: from storage DS-bd89f331-16cf-42ed-9769-6b8e5d3726db node DatanodeRegistration(127.0.0.1:37361, datanodeUuid=6440fdca-19c5-4754-beea-92350679d0e7, infoPort=42709, infoSecurePort=0, ipcPort=35877, storageInfo=lv=-57;cid=testClusterID;nsid=784088281;c=1676055779416), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-10 19:03:00,117 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xc497cc272a503d: Processing first storage report for DS-86f9114f-8c61-4a61-bd9f-09d7e54e50d1 from datanode 6440fdca-19c5-4754-beea-92350679d0e7 2023-02-10 19:03:00,117 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xc497cc272a503d: from storage DS-86f9114f-8c61-4a61-bd9f-09d7e54e50d1 node DatanodeRegistration(127.0.0.1:37361, datanodeUuid=6440fdca-19c5-4754-beea-92350679d0e7, infoPort=42709, infoSecurePort=0, ipcPort=35877, storageInfo=lv=-57;cid=testClusterID;nsid=784088281;c=1676055779416), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-10 19:03:00,124 DEBUG [Listener at localhost/35877] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3335ac0e-fb88-6eb8-b993-c028993dd2d7 2023-02-10 19:03:00,126 INFO [Listener at localhost/35877] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3335ac0e-fb88-6eb8-b993-c028993dd2d7/cluster_c25d0905-9b0f-64e8-fbc0-da8b20564564/zookeeper_0, clientPort=55517, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3335ac0e-fb88-6eb8-b993-c028993dd2d7/cluster_c25d0905-9b0f-64e8-fbc0-da8b20564564/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3335ac0e-fb88-6eb8-b993-c028993dd2d7/cluster_c25d0905-9b0f-64e8-fbc0-da8b20564564/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-02-10 19:03:00,128 INFO [Listener at localhost/35877] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=55517 2023-02-10 19:03:00,128 INFO [Listener at localhost/35877] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-10 19:03:00,129 INFO [Listener at localhost/35877] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-10 19:03:00,151 INFO [Listener at localhost/35877] util.FSUtils(479): Created version file at hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91 with version=8 2023-02-10 19:03:00,151 INFO [Listener at localhost/35877] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-10 19:03:00,152 INFO [Listener at localhost/35877] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-10 19:03:00,154 INFO [Listener at localhost/35877] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:34605/user/jenkins/test-data/cdb8cff8-4bcc-a25f-b430-f9a2ac74b842/hbase-staging 2023-02-10 19:03:00,155 INFO [Listener at localhost/35877] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-02-10 19:03:00,156 INFO [Listener at localhost/35877] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-10 19:03:00,156 INFO [Listener at localhost/35877] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-10 19:03:00,156 INFO [Listener at localhost/35877] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-10 19:03:00,156 INFO [Listener at localhost/35877] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-10 19:03:00,156 INFO [Listener at localhost/35877] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-10 19:03:00,156 INFO [Listener at localhost/35877] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-02-10 19:03:00,158 INFO [Listener at localhost/35877] ipc.NettyRpcServer(120): Bind to /172.31.14.131:40103 2023-02-10 19:03:00,159 INFO [Listener at localhost/35877] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-10 19:03:00,160 INFO [Listener at localhost/35877] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-10 19:03:00,173 INFO [Listener at localhost/35877] zookeeper.RecoverableZooKeeper(93): Process identifier=master:40103 connecting to ZooKeeper ensemble=127.0.0.1:55517 2023-02-10 19:03:00,187 DEBUG [Listener at localhost/35877-EventThread] zookeeper.ZKWatcher(600): master:401030x0, quorum=127.0.0.1:55517, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-10 19:03:00,187 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): master:40103-0x1003f9d84e20000 connected 2023-02-10 19:03:00,214 DEBUG [Listener at localhost/35877] zookeeper.ZKUtil(164): master:40103-0x1003f9d84e20000, quorum=127.0.0.1:55517, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-10 19:03:00,215 DEBUG [Listener at localhost/35877] zookeeper.ZKUtil(164): master:40103-0x1003f9d84e20000, quorum=127.0.0.1:55517, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-10 19:03:00,215 DEBUG [Listener at localhost/35877] zookeeper.ZKUtil(164): master:40103-0x1003f9d84e20000, quorum=127.0.0.1:55517, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-10 19:03:00,220 DEBUG [Listener at localhost/35877] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=40103 2023-02-10 19:03:00,220 DEBUG [Listener at localhost/35877] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=40103 2023-02-10 19:03:00,221 DEBUG [Listener at localhost/35877] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=40103 2023-02-10 19:03:00,221 DEBUG [Listener at localhost/35877] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=40103 2023-02-10 19:03:00,221 DEBUG [Listener at localhost/35877] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=40103 2023-02-10 19:03:00,222 INFO [Listener at localhost/35877] master.HMaster(439): hbase.rootdir=hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91, hbase.cluster.distributed=false 2023-02-10 19:03:00,236 INFO [Listener at localhost/35877] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-10 19:03:00,236 INFO [Listener at localhost/35877] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-10 19:03:00,236 INFO [Listener at localhost/35877] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-10 19:03:00,236 INFO [Listener at localhost/35877] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-10 19:03:00,237 INFO [Listener at localhost/35877] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-10 19:03:00,237 INFO [Listener at localhost/35877] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-10 19:03:00,237 INFO [Listener at localhost/35877] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-10 19:03:00,241 INFO [Listener at localhost/35877] ipc.NettyRpcServer(120): Bind to /172.31.14.131:38097 2023-02-10 19:03:00,241 INFO [Listener at localhost/35877] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-10 19:03:00,245 DEBUG [Listener at localhost/35877] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-10 19:03:00,245 INFO [Listener at localhost/35877] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-10 19:03:00,246 INFO [Listener at localhost/35877] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-10 19:03:00,247 INFO [Listener at localhost/35877] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:38097 connecting to ZooKeeper ensemble=127.0.0.1:55517 2023-02-10 19:03:00,256 DEBUG [Listener at localhost/35877-EventThread] zookeeper.ZKWatcher(600): regionserver:380970x0, quorum=127.0.0.1:55517, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-10 19:03:00,257 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:38097-0x1003f9d84e20001 connected 2023-02-10 19:03:00,257 DEBUG [Listener at localhost/35877] zookeeper.ZKUtil(164): regionserver:38097-0x1003f9d84e20001, quorum=127.0.0.1:55517, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-10 19:03:00,257 DEBUG [Listener at localhost/35877] zookeeper.ZKUtil(164): regionserver:38097-0x1003f9d84e20001, quorum=127.0.0.1:55517, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-10 19:03:00,258 DEBUG [Listener at localhost/35877] zookeeper.ZKUtil(164): regionserver:38097-0x1003f9d84e20001, quorum=127.0.0.1:55517, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-10 19:03:00,259 DEBUG [Listener at localhost/35877] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=38097 2023-02-10 19:03:00,260 DEBUG [Listener at localhost/35877] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=38097 2023-02-10 19:03:00,262 DEBUG [Listener at localhost/35877] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=38097 2023-02-10 19:03:00,264 DEBUG [Listener at localhost/35877] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=38097 2023-02-10 19:03:00,268 DEBUG [Listener at localhost/35877] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=38097 2023-02-10 19:03:00,283 INFO [Listener at localhost/35877] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-10 19:03:00,283 INFO [Listener at localhost/35877] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-10 19:03:00,284 INFO [Listener at localhost/35877] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-10 19:03:00,284 INFO [Listener at localhost/35877] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-10 19:03:00,284 INFO [Listener at localhost/35877] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-10 19:03:00,284 INFO [Listener at localhost/35877] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-10 19:03:00,284 INFO [Listener at localhost/35877] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-10 19:03:00,287 INFO [Listener at localhost/35877] ipc.NettyRpcServer(120): Bind to /172.31.14.131:35609 2023-02-10 19:03:00,287 INFO [Listener at localhost/35877] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-10 19:03:00,289 DEBUG [Listener at localhost/35877] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-10 19:03:00,290 INFO [Listener at localhost/35877] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-10 19:03:00,291 INFO [Listener at localhost/35877] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-10 19:03:00,292 INFO [Listener at localhost/35877] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:35609 connecting to ZooKeeper ensemble=127.0.0.1:55517 2023-02-10 19:03:00,298 DEBUG [Listener at localhost/35877-EventThread] zookeeper.ZKWatcher(600): regionserver:356090x0, quorum=127.0.0.1:55517, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-10 19:03:00,300 DEBUG [Listener at localhost/35877] zookeeper.ZKUtil(164): regionserver:356090x0, quorum=127.0.0.1:55517, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-10 19:03:00,300 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:35609-0x1003f9d84e20002 connected 2023-02-10 19:03:00,300 DEBUG [Listener at localhost/35877] zookeeper.ZKUtil(164): regionserver:35609-0x1003f9d84e20002, quorum=127.0.0.1:55517, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-10 19:03:00,301 DEBUG [Listener at localhost/35877] zookeeper.ZKUtil(164): regionserver:35609-0x1003f9d84e20002, quorum=127.0.0.1:55517, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-10 19:03:00,306 DEBUG [Listener at localhost/35877] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=35609 2023-02-10 19:03:00,307 DEBUG [Listener at localhost/35877] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=35609 2023-02-10 19:03:00,307 DEBUG [Listener at localhost/35877] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=35609 2023-02-10 19:03:00,312 DEBUG [Listener at localhost/35877] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=35609 2023-02-10 19:03:00,312 DEBUG [Listener at localhost/35877] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=35609 2023-02-10 19:03:00,316 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2158): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,40103,1676055780155 2023-02-10 19:03:00,318 DEBUG [Listener at localhost/35877-EventThread] zookeeper.ZKWatcher(600): master:40103-0x1003f9d84e20000, quorum=127.0.0.1:55517, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-10 19:03:00,320 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:40103-0x1003f9d84e20000, quorum=127.0.0.1:55517, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,40103,1676055780155 2023-02-10 19:03:00,322 DEBUG [Listener at localhost/35877-EventThread] zookeeper.ZKWatcher(600): master:40103-0x1003f9d84e20000, quorum=127.0.0.1:55517, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-10 19:03:00,322 DEBUG [Listener at localhost/35877-EventThread] zookeeper.ZKWatcher(600): regionserver:35609-0x1003f9d84e20002, quorum=127.0.0.1:55517, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-10 19:03:00,322 DEBUG [Listener at localhost/35877-EventThread] zookeeper.ZKWatcher(600): master:40103-0x1003f9d84e20000, quorum=127.0.0.1:55517, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-10 19:03:00,322 DEBUG [Listener at localhost/35877-EventThread] zookeeper.ZKWatcher(600): regionserver:38097-0x1003f9d84e20001, quorum=127.0.0.1:55517, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-10 19:03:00,323 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:40103-0x1003f9d84e20000, quorum=127.0.0.1:55517, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-10 19:03:00,325 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(224): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,40103,1676055780155 from backup master directory 2023-02-10 19:03:00,325 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:40103-0x1003f9d84e20000, quorum=127.0.0.1:55517, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-10 19:03:00,327 DEBUG [Listener at localhost/35877-EventThread] zookeeper.ZKWatcher(600): master:40103-0x1003f9d84e20000, quorum=127.0.0.1:55517, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,40103,1676055780155 2023-02-10 19:03:00,328 DEBUG [Listener at localhost/35877-EventThread] zookeeper.ZKWatcher(600): master:40103-0x1003f9d84e20000, quorum=127.0.0.1:55517, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-10 19:03:00,328 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-10 19:03:00,328 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(234): Registered as active master=jenkins-hbase4.apache.org,40103,1676055780155 2023-02-10 19:03:00,348 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(628): Created cluster ID file at hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/hbase.id with ID: 2b1d2b9e-51ee-432f-8616-3e0c21f41c22 2023-02-10 19:03:00,359 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-10 19:03:00,362 DEBUG [Listener at localhost/35877-EventThread] zookeeper.ZKWatcher(600): master:40103-0x1003f9d84e20000, quorum=127.0.0.1:55517, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-10 19:03:00,775 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x7bba4cf6 to 127.0.0.1:55517 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-10 19:03:00,779 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@618be565, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-10 19:03:00,780 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-10 19:03:00,780 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-02-10 19:03:00,780 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-10 19:03:00,782 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7689): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/MasterData/data/master/store-tmp 2023-02-10 19:03:00,791 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-10 19:03:00,791 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-10 19:03:00,791 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-10 19:03:00,791 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-10 19:03:00,791 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-10 19:03:00,791 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-10 19:03:00,791 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-10 19:03:00,791 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1676055780791Disabling compacts and flushes for region at 1676055780791Disabling writes for close at 1676055780791Writing region close event to WAL at 1676055780791Closed at 1676055780791 2023-02-10 19:03:00,792 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/MasterData/WALs/jenkins-hbase4.apache.org,40103,1676055780155 2023-02-10 19:03:00,795 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C40103%2C1676055780155, suffix=, logDir=hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/MasterData/WALs/jenkins-hbase4.apache.org,40103,1676055780155, archiveDir=hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/MasterData/oldWALs, maxLogs=10 2023-02-10 19:03:00,812 DEBUG [RS-EventLoopGroup-8-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46609,DS-eed40a6d-0d20-4883-936f-2082985e6383,DISK] 2023-02-10 19:03:00,812 DEBUG [RS-EventLoopGroup-8-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37361,DS-bd89f331-16cf-42ed-9769-6b8e5d3726db,DISK] 2023-02-10 19:03:00,814 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/MasterData/WALs/jenkins-hbase4.apache.org,40103,1676055780155/jenkins-hbase4.apache.org%2C40103%2C1676055780155.1676055780795 2023-02-10 19:03:00,815 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:46609,DS-eed40a6d-0d20-4883-936f-2082985e6383,DISK], DatanodeInfoWithStorage[127.0.0.1:37361,DS-bd89f331-16cf-42ed-9769-6b8e5d3726db,DISK]] 2023-02-10 19:03:00,815 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7850): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-02-10 19:03:00,815 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-10 19:03:00,815 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7890): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-02-10 19:03:00,815 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7893): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-02-10 19:03:00,816 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-02-10 19:03:00,818 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-02-10 19:03:00,818 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-02-10 19:03:00,819 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-10 19:03:00,820 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-10 19:03:00,820 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-10 19:03:00,823 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1054): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-02-10 19:03:00,825 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-10 19:03:00,826 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1071): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73900754, jitterRate=0.10120704770088196}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-10 19:03:00,826 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(964): Region open journal for 1595e783b53d99cd5eef43b6debb2682: Writing region info on filesystem at 1676055780815Initializing all the Stores at 1676055780816 (+1 ms)Instantiating store for column family {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676055780816Cleaning up temporary data from old regions at 1676055780821 (+5 ms)Cleaning up detritus from prior splits at 1676055780821Region opened successfully at 1676055780826 (+5 ms) 2023-02-10 19:03:00,826 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-02-10 19:03:00,827 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-02-10 19:03:00,827 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-02-10 19:03:00,827 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-02-10 19:03:00,828 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 0 msec 2023-02-10 19:03:00,828 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 0 msec 2023-02-10 19:03:00,828 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(95): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-02-10 19:03:00,831 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-02-10 19:03:00,832 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-02-10 19:03:00,848 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-02-10 19:03:00,848 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-02-10 19:03:00,849 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:40103-0x1003f9d84e20000, quorum=127.0.0.1:55517, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-02-10 19:03:00,849 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-02-10 19:03:00,850 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:40103-0x1003f9d84e20000, quorum=127.0.0.1:55517, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-02-10 19:03:00,851 DEBUG [Listener at localhost/35877-EventThread] zookeeper.ZKWatcher(600): master:40103-0x1003f9d84e20000, quorum=127.0.0.1:55517, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-10 19:03:00,852 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:40103-0x1003f9d84e20000, quorum=127.0.0.1:55517, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-02-10 19:03:00,852 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:40103-0x1003f9d84e20000, quorum=127.0.0.1:55517, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-02-10 19:03:00,853 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:40103-0x1003f9d84e20000, quorum=127.0.0.1:55517, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-02-10 19:03:00,855 DEBUG [Listener at localhost/35877-EventThread] zookeeper.ZKWatcher(600): regionserver:38097-0x1003f9d84e20001, quorum=127.0.0.1:55517, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-10 19:03:00,855 DEBUG [Listener at localhost/35877-EventThread] zookeeper.ZKWatcher(600): master:40103-0x1003f9d84e20000, quorum=127.0.0.1:55517, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-10 19:03:00,855 DEBUG [Listener at localhost/35877-EventThread] zookeeper.ZKWatcher(600): regionserver:35609-0x1003f9d84e20002, quorum=127.0.0.1:55517, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-10 19:03:00,855 DEBUG [Listener at localhost/35877-EventThread] zookeeper.ZKWatcher(600): master:40103-0x1003f9d84e20000, quorum=127.0.0.1:55517, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-10 19:03:00,856 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(739): Active/primary master=jenkins-hbase4.apache.org,40103,1676055780155, sessionid=0x1003f9d84e20000, setting cluster-up flag (Was=false) 2023-02-10 19:03:00,861 DEBUG [Listener at localhost/35877-EventThread] zookeeper.ZKWatcher(600): master:40103-0x1003f9d84e20000, quorum=127.0.0.1:55517, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-10 19:03:00,870 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-02-10 19:03:00,871 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,40103,1676055780155 2023-02-10 19:03:00,874 DEBUG [Listener at localhost/35877-EventThread] zookeeper.ZKWatcher(600): master:40103-0x1003f9d84e20000, quorum=127.0.0.1:55517, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-10 19:03:00,878 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-02-10 19:03:00,879 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,40103,1676055780155 2023-02-10 19:03:00,880 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/.hbase-snapshot/.tmp 2023-02-10 19:03:00,881 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-02-10 19:03:00,882 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-10 19:03:00,882 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-10 19:03:00,882 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-10 19:03:00,882 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-10 19:03:00,882 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-02-10 19:03:00,882 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-10 19:03:00,882 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-10 19:03:00,882 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-10 19:03:00,883 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1676055810883 2023-02-10 19:03:00,884 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-02-10 19:03:00,884 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-02-10 19:03:00,884 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-02-10 19:03:00,884 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-02-10 19:03:00,884 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-02-10 19:03:00,884 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-02-10 19:03:00,884 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-10 19:03:00,885 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-02-10 19:03:00,885 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-02-10 19:03:00,885 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-02-10 19:03:00,885 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-02-10 19:03:00,885 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-02-10 19:03:00,885 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-02-10 19:03:00,886 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-02-10 19:03:00,886 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676055780886,5,FailOnTimeoutGroup] 2023-02-10 19:03:00,886 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676055780886,5,FailOnTimeoutGroup] 2023-02-10 19:03:00,886 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-10 19:03:00,886 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1451): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-02-10 19:03:00,886 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-02-10 19:03:00,886 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-02-10 19:03:00,886 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-10 19:03:00,898 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-10 19:03:00,899 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-10 19:03:00,899 INFO [PEWorker-1] regionserver.HRegion(7671): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91 2023-02-10 19:03:00,911 DEBUG [PEWorker-1] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-10 19:03:00,913 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-10 19:03:00,915 INFO [RS:0;jenkins-hbase4:38097] regionserver.HRegionServer(952): ClusterId : 2b1d2b9e-51ee-432f-8616-3e0c21f41c22 2023-02-10 19:03:00,915 INFO [RS:1;jenkins-hbase4:35609] regionserver.HRegionServer(952): ClusterId : 2b1d2b9e-51ee-432f-8616-3e0c21f41c22 2023-02-10 19:03:00,915 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/data/hbase/meta/1588230740/info 2023-02-10 19:03:00,916 DEBUG [RS:1;jenkins-hbase4:35609] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-10 19:03:00,916 DEBUG [RS:0;jenkins-hbase4:38097] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-10 19:03:00,916 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-10 19:03:00,917 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-10 19:03:00,917 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-10 19:03:00,918 DEBUG [RS:1;jenkins-hbase4:35609] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-10 19:03:00,918 DEBUG [RS:1;jenkins-hbase4:35609] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-10 19:03:00,918 DEBUG [RS:0;jenkins-hbase4:38097] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-10 19:03:00,918 DEBUG [RS:0;jenkins-hbase4:38097] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-10 19:03:00,918 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/data/hbase/meta/1588230740/rep_barrier 2023-02-10 19:03:00,919 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-10 19:03:00,920 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-10 19:03:00,920 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-10 19:03:00,921 DEBUG [RS:0;jenkins-hbase4:38097] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-10 19:03:00,921 DEBUG [RS:1;jenkins-hbase4:35609] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-10 19:03:00,923 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/data/hbase/meta/1588230740/table 2023-02-10 19:03:00,924 DEBUG [RS:0;jenkins-hbase4:38097] zookeeper.ReadOnlyZKClient(139): Connect 0x71a33668 to 127.0.0.1:55517 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-10 19:03:00,924 DEBUG [RS:1;jenkins-hbase4:35609] zookeeper.ReadOnlyZKClient(139): Connect 0x6748b647 to 127.0.0.1:55517 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-10 19:03:00,924 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-10 19:03:00,925 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-10 19:03:00,928 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/data/hbase/meta/1588230740 2023-02-10 19:03:00,929 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/data/hbase/meta/1588230740 2023-02-10 19:03:00,932 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-10 19:03:00,934 DEBUG [PEWorker-1] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-10 19:03:00,936 DEBUG [RS:1;jenkins-hbase4:35609] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@698f54de, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-10 19:03:00,936 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-10 19:03:00,936 DEBUG [RS:1;jenkins-hbase4:35609] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6db0dd37, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-10 19:03:00,937 INFO [PEWorker-1] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59620567, jitterRate=-0.11158432066440582}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-10 19:03:00,937 DEBUG [PEWorker-1] regionserver.HRegion(964): Region open journal for 1588230740: Writing region info on filesystem at 1676055780911Initializing all the Stores at 1676055780912 (+1 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676055780912Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676055780912Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676055780912Cleaning up temporary data from old regions at 1676055780930 (+18 ms)Cleaning up detritus from prior splits at 1676055780931 (+1 ms)Region opened successfully at 1676055780937 (+6 ms) 2023-02-10 19:03:00,937 DEBUG [PEWorker-1] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-10 19:03:00,937 INFO [PEWorker-1] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-10 19:03:00,937 DEBUG [PEWorker-1] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-10 19:03:00,937 DEBUG [PEWorker-1] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-10 19:03:00,937 DEBUG [PEWorker-1] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-10 19:03:00,938 INFO [PEWorker-1] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-10 19:03:00,938 DEBUG [PEWorker-1] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1676055780937Disabling compacts and flushes for region at 1676055780937Disabling writes for close at 1676055780937Writing region close event to WAL at 1676055780938 (+1 ms)Closed at 1676055780938 2023-02-10 19:03:00,939 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-02-10 19:03:00,939 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-02-10 19:03:00,939 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-02-10 19:03:00,941 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-02-10 19:03:00,941 DEBUG [RS:0;jenkins-hbase4:38097] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7f64c62c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-10 19:03:00,942 DEBUG [RS:0;jenkins-hbase4:38097] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7b5b5d18, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-10 19:03:00,948 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-02-10 19:03:00,951 DEBUG [RS:1;jenkins-hbase4:35609] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:35609 2023-02-10 19:03:00,951 INFO [RS:1;jenkins-hbase4:35609] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-10 19:03:00,951 INFO [RS:1;jenkins-hbase4:35609] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-10 19:03:00,951 DEBUG [RS:1;jenkins-hbase4:35609] regionserver.HRegionServer(1023): About to register with Master. 2023-02-10 19:03:00,952 INFO [RS:1;jenkins-hbase4:35609] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,40103,1676055780155 with isa=jenkins-hbase4.apache.org/172.31.14.131:35609, startcode=1676055780283 2023-02-10 19:03:00,952 DEBUG [RS:1;jenkins-hbase4:35609] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-10 19:03:00,952 DEBUG [RS:0;jenkins-hbase4:38097] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:38097 2023-02-10 19:03:00,952 INFO [RS:0;jenkins-hbase4:38097] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-10 19:03:00,952 INFO [RS:0;jenkins-hbase4:38097] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-10 19:03:00,952 DEBUG [RS:0;jenkins-hbase4:38097] regionserver.HRegionServer(1023): About to register with Master. 2023-02-10 19:03:00,953 INFO [RS:0;jenkins-hbase4:38097] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,40103,1676055780155 with isa=jenkins-hbase4.apache.org/172.31.14.131:38097, startcode=1676055780236 2023-02-10 19:03:00,953 DEBUG [RS:0;jenkins-hbase4:38097] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-10 19:03:00,956 INFO [RS-EventLoopGroup-6-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56815, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.3 (auth:SIMPLE), service=RegionServerStatusService 2023-02-10 19:03:00,957 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40103] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,35609,1676055780283 2023-02-10 19:03:00,958 DEBUG [RS:1;jenkins-hbase4:35609] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91 2023-02-10 19:03:00,958 DEBUG [RS:1;jenkins-hbase4:35609] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:34605 2023-02-10 19:03:00,958 DEBUG [RS:1;jenkins-hbase4:35609] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-10 19:03:00,959 DEBUG [Listener at localhost/35877-EventThread] zookeeper.ZKWatcher(600): master:40103-0x1003f9d84e20000, quorum=127.0.0.1:55517, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-10 19:03:00,960 DEBUG [RS:1;jenkins-hbase4:35609] zookeeper.ZKUtil(162): regionserver:35609-0x1003f9d84e20002, quorum=127.0.0.1:55517, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,35609,1676055780283 2023-02-10 19:03:00,960 WARN [RS:1;jenkins-hbase4:35609] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-10 19:03:00,961 INFO [RS:1;jenkins-hbase4:35609] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-10 19:03:00,961 DEBUG [RS:1;jenkins-hbase4:35609] regionserver.HRegionServer(1947): logDir=hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/WALs/jenkins-hbase4.apache.org,35609,1676055780283 2023-02-10 19:03:00,962 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,35609,1676055780283] 2023-02-10 19:03:00,962 INFO [RS-EventLoopGroup-6-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54257, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.2 (auth:SIMPLE), service=RegionServerStatusService 2023-02-10 19:03:00,963 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40103] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,38097,1676055780236 2023-02-10 19:03:00,964 DEBUG [RS:0;jenkins-hbase4:38097] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91 2023-02-10 19:03:00,964 DEBUG [RS:0;jenkins-hbase4:38097] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:34605 2023-02-10 19:03:00,965 DEBUG [RS:0;jenkins-hbase4:38097] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-10 19:03:00,973 DEBUG [Listener at localhost/35877-EventThread] zookeeper.ZKWatcher(600): master:40103-0x1003f9d84e20000, quorum=127.0.0.1:55517, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-10 19:03:00,973 DEBUG [RS:0;jenkins-hbase4:38097] zookeeper.ZKUtil(162): regionserver:38097-0x1003f9d84e20001, quorum=127.0.0.1:55517, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,38097,1676055780236 2023-02-10 19:03:00,973 WARN [RS:0;jenkins-hbase4:38097] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-10 19:03:00,973 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,38097,1676055780236] 2023-02-10 19:03:00,973 INFO [RS:0;jenkins-hbase4:38097] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-10 19:03:00,974 DEBUG [RS:1;jenkins-hbase4:35609] zookeeper.ZKUtil(162): regionserver:35609-0x1003f9d84e20002, quorum=127.0.0.1:55517, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,35609,1676055780283 2023-02-10 19:03:00,974 DEBUG [RS:0;jenkins-hbase4:38097] regionserver.HRegionServer(1947): logDir=hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/WALs/jenkins-hbase4.apache.org,38097,1676055780236 2023-02-10 19:03:00,974 DEBUG [RS:1;jenkins-hbase4:35609] zookeeper.ZKUtil(162): regionserver:35609-0x1003f9d84e20002, quorum=127.0.0.1:55517, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,38097,1676055780236 2023-02-10 19:03:00,977 DEBUG [RS:1;jenkins-hbase4:35609] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-10 19:03:00,977 INFO [RS:1;jenkins-hbase4:35609] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-10 19:03:00,979 DEBUG [RS:0;jenkins-hbase4:38097] zookeeper.ZKUtil(162): regionserver:38097-0x1003f9d84e20001, quorum=127.0.0.1:55517, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,35609,1676055780283 2023-02-10 19:03:00,980 DEBUG [RS:0;jenkins-hbase4:38097] zookeeper.ZKUtil(162): regionserver:38097-0x1003f9d84e20001, quorum=127.0.0.1:55517, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,38097,1676055780236 2023-02-10 19:03:00,981 DEBUG [RS:0;jenkins-hbase4:38097] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-10 19:03:00,981 INFO [RS:0;jenkins-hbase4:38097] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-10 19:03:00,984 INFO [RS:1;jenkins-hbase4:35609] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-10 19:03:00,984 INFO [RS:0;jenkins-hbase4:38097] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-10 19:03:00,984 INFO [RS:1;jenkins-hbase4:35609] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-10 19:03:00,984 INFO [RS:1;jenkins-hbase4:35609] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-10 19:03:00,984 INFO [RS:0;jenkins-hbase4:38097] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-10 19:03:00,985 INFO [RS:0;jenkins-hbase4:38097] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-10 19:03:00,985 INFO [RS:1;jenkins-hbase4:35609] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-10 19:03:00,985 INFO [RS:0;jenkins-hbase4:38097] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-10 19:03:00,987 INFO [RS:0;jenkins-hbase4:38097] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-10 19:03:00,987 INFO [RS:1;jenkins-hbase4:35609] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-10 19:03:00,987 DEBUG [RS:0;jenkins-hbase4:38097] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-10 19:03:00,988 DEBUG [RS:1;jenkins-hbase4:35609] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-10 19:03:00,988 DEBUG [RS:0;jenkins-hbase4:38097] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-10 19:03:00,988 DEBUG [RS:1;jenkins-hbase4:35609] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-10 19:03:00,988 DEBUG [RS:0;jenkins-hbase4:38097] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-10 19:03:00,988 DEBUG [RS:1;jenkins-hbase4:35609] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-10 19:03:00,988 DEBUG [RS:0;jenkins-hbase4:38097] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-10 19:03:00,988 DEBUG [RS:1;jenkins-hbase4:35609] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-10 19:03:00,988 DEBUG [RS:0;jenkins-hbase4:38097] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-10 19:03:00,988 DEBUG [RS:1;jenkins-hbase4:35609] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-10 19:03:00,988 DEBUG [RS:0;jenkins-hbase4:38097] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-10 19:03:00,988 DEBUG [RS:1;jenkins-hbase4:35609] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-10 19:03:00,988 DEBUG [RS:0;jenkins-hbase4:38097] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-10 19:03:00,988 DEBUG [RS:1;jenkins-hbase4:35609] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-10 19:03:00,988 DEBUG [RS:0;jenkins-hbase4:38097] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-10 19:03:00,988 DEBUG [RS:1;jenkins-hbase4:35609] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-10 19:03:00,988 DEBUG [RS:0;jenkins-hbase4:38097] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-10 19:03:00,988 DEBUG [RS:1;jenkins-hbase4:35609] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-10 19:03:00,989 DEBUG [RS:0;jenkins-hbase4:38097] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-10 19:03:00,989 DEBUG [RS:1;jenkins-hbase4:35609] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-10 19:03:01,000 INFO [RS:1;jenkins-hbase4:35609] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-10 19:03:01,000 INFO [RS:0;jenkins-hbase4:38097] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-10 19:03:01,000 INFO [RS:1;jenkins-hbase4:35609] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-10 19:03:01,000 INFO [RS:0;jenkins-hbase4:38097] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-10 19:03:01,000 INFO [RS:1;jenkins-hbase4:35609] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-10 19:03:01,000 INFO [RS:0;jenkins-hbase4:38097] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-10 19:03:01,015 INFO [RS:1;jenkins-hbase4:35609] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-10 19:03:01,015 INFO [RS:1;jenkins-hbase4:35609] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,35609,1676055780283-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-10 19:03:01,018 INFO [RS:0;jenkins-hbase4:38097] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-10 19:03:01,018 INFO [RS:0;jenkins-hbase4:38097] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,38097,1676055780236-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-10 19:03:01,031 INFO [RS:1;jenkins-hbase4:35609] regionserver.Replication(203): jenkins-hbase4.apache.org,35609,1676055780283 started 2023-02-10 19:03:01,031 INFO [RS:1;jenkins-hbase4:35609] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,35609,1676055780283, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:35609, sessionid=0x1003f9d84e20002 2023-02-10 19:03:01,032 DEBUG [RS:1;jenkins-hbase4:35609] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-10 19:03:01,032 DEBUG [RS:1;jenkins-hbase4:35609] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,35609,1676055780283 2023-02-10 19:03:01,032 DEBUG [RS:1;jenkins-hbase4:35609] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,35609,1676055780283' 2023-02-10 19:03:01,032 DEBUG [RS:1;jenkins-hbase4:35609] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-10 19:03:01,032 DEBUG [RS:1;jenkins-hbase4:35609] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-10 19:03:01,033 DEBUG [RS:1;jenkins-hbase4:35609] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-10 19:03:01,033 DEBUG [RS:1;jenkins-hbase4:35609] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-10 19:03:01,033 DEBUG [RS:1;jenkins-hbase4:35609] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,35609,1676055780283 2023-02-10 19:03:01,033 DEBUG [RS:1;jenkins-hbase4:35609] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,35609,1676055780283' 2023-02-10 19:03:01,033 DEBUG [RS:1;jenkins-hbase4:35609] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-10 19:03:01,033 DEBUG [RS:1;jenkins-hbase4:35609] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-10 19:03:01,034 DEBUG [RS:1;jenkins-hbase4:35609] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-10 19:03:01,034 INFO [RS:1;jenkins-hbase4:35609] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-10 19:03:01,034 INFO [RS:1;jenkins-hbase4:35609] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-10 19:03:01,035 INFO [RS:0;jenkins-hbase4:38097] regionserver.Replication(203): jenkins-hbase4.apache.org,38097,1676055780236 started 2023-02-10 19:03:01,035 INFO [RS:0;jenkins-hbase4:38097] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,38097,1676055780236, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:38097, sessionid=0x1003f9d84e20001 2023-02-10 19:03:01,035 DEBUG [RS:0;jenkins-hbase4:38097] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-10 19:03:01,035 DEBUG [RS:0;jenkins-hbase4:38097] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,38097,1676055780236 2023-02-10 19:03:01,035 DEBUG [RS:0;jenkins-hbase4:38097] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,38097,1676055780236' 2023-02-10 19:03:01,035 DEBUG [RS:0;jenkins-hbase4:38097] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-10 19:03:01,036 DEBUG [RS:0;jenkins-hbase4:38097] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-10 19:03:01,038 DEBUG [RS:0;jenkins-hbase4:38097] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-10 19:03:01,038 DEBUG [RS:0;jenkins-hbase4:38097] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-10 19:03:01,038 DEBUG [RS:0;jenkins-hbase4:38097] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,38097,1676055780236 2023-02-10 19:03:01,038 DEBUG [RS:0;jenkins-hbase4:38097] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,38097,1676055780236' 2023-02-10 19:03:01,038 DEBUG [RS:0;jenkins-hbase4:38097] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-10 19:03:01,038 DEBUG [RS:0;jenkins-hbase4:38097] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-10 19:03:01,039 DEBUG [RS:0;jenkins-hbase4:38097] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-10 19:03:01,039 INFO [RS:0;jenkins-hbase4:38097] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-10 19:03:01,039 INFO [RS:0;jenkins-hbase4:38097] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-10 19:03:01,098 DEBUG [jenkins-hbase4:40103] assignment.AssignmentManager(2178): Processing assignQueue; systemServersCount=2, allServersCount=2 2023-02-10 19:03:01,098 DEBUG [jenkins-hbase4:40103] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-10 19:03:01,101 DEBUG [jenkins-hbase4:40103] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-10 19:03:01,101 DEBUG [jenkins-hbase4:40103] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-10 19:03:01,101 DEBUG [jenkins-hbase4:40103] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-10 19:03:01,102 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,35609,1676055780283, state=OPENING 2023-02-10 19:03:01,103 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-02-10 19:03:01,104 DEBUG [Listener at localhost/35877-EventThread] zookeeper.ZKWatcher(600): master:40103-0x1003f9d84e20000, quorum=127.0.0.1:55517, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-10 19:03:01,105 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,35609,1676055780283}] 2023-02-10 19:03:01,106 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-10 19:03:01,260 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,35609,1676055780283 2023-02-10 19:03:01,260 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-10 19:03:01,263 INFO [RS-EventLoopGroup-8-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34878, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-10 19:03:01,268 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:meta,,1.1588230740 2023-02-10 19:03:01,268 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-10 19:03:01,270 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C35609%2C1676055780283.meta, suffix=.meta, logDir=hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/WALs/jenkins-hbase4.apache.org,35609,1676055780283, archiveDir=hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/oldWALs, maxLogs=32 2023-02-10 19:03:01,289 DEBUG [RS-EventLoopGroup-8-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46609,DS-eed40a6d-0d20-4883-936f-2082985e6383,DISK] 2023-02-10 19:03:01,290 DEBUG [RS-EventLoopGroup-8-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37361,DS-bd89f331-16cf-42ed-9769-6b8e5d3726db,DISK] 2023-02-10 19:03:01,292 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/WALs/jenkins-hbase4.apache.org,35609,1676055780283/jenkins-hbase4.apache.org%2C35609%2C1676055780283.meta.1676055781271.meta 2023-02-10 19:03:01,292 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:46609,DS-eed40a6d-0d20-4883-936f-2082985e6383,DISK], DatanodeInfoWithStorage[127.0.0.1:37361,DS-bd89f331-16cf-42ed-9769-6b8e5d3726db,DISK]] 2023-02-10 19:03:01,292 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-02-10 19:03:01,293 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-02-10 19:03:01,293 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8546): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-02-10 19:03:01,294 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-02-10 19:03:01,294 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-02-10 19:03:01,294 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-10 19:03:01,294 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 1588230740 2023-02-10 19:03:01,294 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 1588230740 2023-02-10 19:03:01,295 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-10 19:03:01,297 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/data/hbase/meta/1588230740/info 2023-02-10 19:03:01,297 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/data/hbase/meta/1588230740/info 2023-02-10 19:03:01,297 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-10 19:03:01,298 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-10 19:03:01,298 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-10 19:03:01,299 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/data/hbase/meta/1588230740/rep_barrier 2023-02-10 19:03:01,299 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/data/hbase/meta/1588230740/rep_barrier 2023-02-10 19:03:01,300 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-10 19:03:01,305 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-10 19:03:01,305 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-10 19:03:01,306 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/data/hbase/meta/1588230740/table 2023-02-10 19:03:01,306 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/data/hbase/meta/1588230740/table 2023-02-10 19:03:01,307 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-10 19:03:01,307 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-10 19:03:01,308 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/data/hbase/meta/1588230740 2023-02-10 19:03:01,309 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/data/hbase/meta/1588230740 2023-02-10 19:03:01,312 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-10 19:03:01,313 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-10 19:03:01,314 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62323003, jitterRate=-0.07131488621234894}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-10 19:03:01,314 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 1588230740: Running coprocessor pre-open hook at 1676055781294Writing region info on filesystem at 1676055781294Initializing all the Stores at 1676055781295 (+1 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676055781295Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676055781295Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676055781295Cleaning up temporary data from old regions at 1676055781311 (+16 ms)Cleaning up detritus from prior splits at 1676055781311Running coprocessor post-open hooks at 1676055781314 (+3 ms)Region opened successfully at 1676055781314 2023-02-10 19:03:01,315 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1676055781260 2023-02-10 19:03:01,319 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:meta,,1.1588230740 2023-02-10 19:03:01,320 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:meta,,1.1588230740 2023-02-10 19:03:01,320 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,35609,1676055780283, state=OPEN 2023-02-10 19:03:01,322 DEBUG [Listener at localhost/35877-EventThread] zookeeper.ZKWatcher(600): master:40103-0x1003f9d84e20000, quorum=127.0.0.1:55517, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-02-10 19:03:01,322 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-10 19:03:01,324 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-02-10 19:03:01,324 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,35609,1676055780283 in 217 msec 2023-02-10 19:03:01,326 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-02-10 19:03:01,326 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 385 msec 2023-02-10 19:03:01,327 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 446 msec 2023-02-10 19:03:01,328 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(946): Master startup: status=Wait for region servers to report in, state=RUNNING, startTime=1676055780320, completionTime=-1 2023-02-10 19:03:01,328 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=2; waited=0ms, expected min=2 server(s), max=2 server(s), master is running 2023-02-10 19:03:01,328 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1519): Joining cluster... 2023-02-10 19:03:01,331 DEBUG [hconnection-0x3210f010-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-10 19:03:01,333 INFO [RS-EventLoopGroup-8-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34894, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-10 19:03:01,335 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1531): Number of RegionServers=2 2023-02-10 19:03:01,335 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1676055841335 2023-02-10 19:03:01,335 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1676055901335 2023-02-10 19:03:01,335 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1538): Joined the cluster in 7 msec 2023-02-10 19:03:01,342 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,40103,1676055780155-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-10 19:03:01,343 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,40103,1676055780155-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-10 19:03:01,343 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,40103,1676055780155-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-10 19:03:01,343 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:40103, period=300000, unit=MILLISECONDS is enabled. 2023-02-10 19:03:01,343 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-02-10 19:03:01,343 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-02-10 19:03:01,343 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2138): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-10 19:03:01,344 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-02-10 19:03:01,345 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-02-10 19:03:01,347 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-02-10 19:03:01,348 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-10 19:03:01,349 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/.tmp/data/hbase/namespace/4301231127f63d0413cb613f701e56a2 2023-02-10 19:03:01,350 DEBUG [HFileArchiver-5] backup.HFileArchiver(153): Directory hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/.tmp/data/hbase/namespace/4301231127f63d0413cb613f701e56a2 empty. 2023-02-10 19:03:01,350 DEBUG [HFileArchiver-5] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/.tmp/data/hbase/namespace/4301231127f63d0413cb613f701e56a2 2023-02-10 19:03:01,351 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-02-10 19:03:01,366 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-02-10 19:03:01,368 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7671): creating {ENCODED => 4301231127f63d0413cb613f701e56a2, NAME => 'hbase:namespace,,1676055781343.4301231127f63d0413cb613f701e56a2.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/.tmp 2023-02-10 19:03:01,377 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676055781343.4301231127f63d0413cb613f701e56a2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-10 19:03:01,377 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1603): Closing 4301231127f63d0413cb613f701e56a2, disabling compactions & flushes 2023-02-10 19:03:01,377 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676055781343.4301231127f63d0413cb613f701e56a2. 2023-02-10 19:03:01,377 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676055781343.4301231127f63d0413cb613f701e56a2. 2023-02-10 19:03:01,377 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676055781343.4301231127f63d0413cb613f701e56a2. after waiting 0 ms 2023-02-10 19:03:01,377 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676055781343.4301231127f63d0413cb613f701e56a2. 2023-02-10 19:03:01,377 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676055781343.4301231127f63d0413cb613f701e56a2. 2023-02-10 19:03:01,377 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1557): Region close journal for 4301231127f63d0413cb613f701e56a2: Waiting for close lock at 1676055781377Disabling compacts and flushes for region at 1676055781377Disabling writes for close at 1676055781377Writing region close event to WAL at 1676055781377Closed at 1676055781377 2023-02-10 19:03:01,380 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-02-10 19:03:01,381 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1676055781343.4301231127f63d0413cb613f701e56a2.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676055781381"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676055781381"}]},"ts":"1676055781381"} 2023-02-10 19:03:01,385 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-10 19:03:01,386 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-10 19:03:01,386 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676055781386"}]},"ts":"1676055781386"} 2023-02-10 19:03:01,387 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-02-10 19:03:01,391 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-10 19:03:01,391 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-10 19:03:01,391 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-10 19:03:01,391 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-10 19:03:01,392 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=4301231127f63d0413cb613f701e56a2, ASSIGN}] 2023-02-10 19:03:01,394 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=4301231127f63d0413cb613f701e56a2, ASSIGN 2023-02-10 19:03:01,395 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=4301231127f63d0413cb613f701e56a2, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,38097,1676055780236; forceNewPlan=false, retain=false 2023-02-10 19:03:01,546 INFO [jenkins-hbase4:40103] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-10 19:03:01,547 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=4301231127f63d0413cb613f701e56a2, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,38097,1676055780236 2023-02-10 19:03:01,547 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1676055781343.4301231127f63d0413cb613f701e56a2.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676055781547"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676055781547"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676055781547"}]},"ts":"1676055781547"} 2023-02-10 19:03:01,550 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 4301231127f63d0413cb613f701e56a2, server=jenkins-hbase4.apache.org,38097,1676055780236}] 2023-02-10 19:03:01,703 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,38097,1676055780236 2023-02-10 19:03:01,703 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-10 19:03:01,706 INFO [RS-EventLoopGroup-7-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60616, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-10 19:03:01,710 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:namespace,,1676055781343.4301231127f63d0413cb613f701e56a2. 2023-02-10 19:03:01,712 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C38097%2C1676055780236, suffix=, logDir=hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/WALs/jenkins-hbase4.apache.org,38097,1676055780236, archiveDir=hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/oldWALs, maxLogs=32 2023-02-10 19:03:01,738 DEBUG [RS-EventLoopGroup-8-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46609,DS-eed40a6d-0d20-4883-936f-2082985e6383,DISK] 2023-02-10 19:03:01,738 DEBUG [RS-EventLoopGroup-8-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37361,DS-bd89f331-16cf-42ed-9769-6b8e5d3726db,DISK] 2023-02-10 19:03:01,740 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/WALs/jenkins-hbase4.apache.org,38097,1676055780236/jenkins-hbase4.apache.org%2C38097%2C1676055780236.1676055781714 2023-02-10 19:03:01,740 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:46609,DS-eed40a6d-0d20-4883-936f-2082985e6383,DISK], DatanodeInfoWithStorage[127.0.0.1:37361,DS-bd89f331-16cf-42ed-9769-6b8e5d3726db,DISK]] 2023-02-10 19:03:01,741 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 4301231127f63d0413cb613f701e56a2, NAME => 'hbase:namespace,,1676055781343.4301231127f63d0413cb613f701e56a2.', STARTKEY => '', ENDKEY => ''} 2023-02-10 19:03:01,741 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 4301231127f63d0413cb613f701e56a2 2023-02-10 19:03:01,741 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676055781343.4301231127f63d0413cb613f701e56a2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-10 19:03:01,741 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 4301231127f63d0413cb613f701e56a2 2023-02-10 19:03:01,741 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 4301231127f63d0413cb613f701e56a2 2023-02-10 19:03:01,743 INFO [StoreOpener-4301231127f63d0413cb613f701e56a2-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 4301231127f63d0413cb613f701e56a2 2023-02-10 19:03:01,744 DEBUG [StoreOpener-4301231127f63d0413cb613f701e56a2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/data/hbase/namespace/4301231127f63d0413cb613f701e56a2/info 2023-02-10 19:03:01,744 DEBUG [StoreOpener-4301231127f63d0413cb613f701e56a2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/data/hbase/namespace/4301231127f63d0413cb613f701e56a2/info 2023-02-10 19:03:01,745 INFO [StoreOpener-4301231127f63d0413cb613f701e56a2-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4301231127f63d0413cb613f701e56a2 columnFamilyName info 2023-02-10 19:03:01,746 INFO [StoreOpener-4301231127f63d0413cb613f701e56a2-1] regionserver.HStore(310): Store=4301231127f63d0413cb613f701e56a2/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-10 19:03:01,746 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/data/hbase/namespace/4301231127f63d0413cb613f701e56a2 2023-02-10 19:03:01,747 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/data/hbase/namespace/4301231127f63d0413cb613f701e56a2 2023-02-10 19:03:01,750 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 4301231127f63d0413cb613f701e56a2 2023-02-10 19:03:01,755 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/data/hbase/namespace/4301231127f63d0413cb613f701e56a2/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-10 19:03:01,756 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 4301231127f63d0413cb613f701e56a2; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61820548, jitterRate=-0.07880204916000366}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-10 19:03:01,756 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 4301231127f63d0413cb613f701e56a2: Running coprocessor pre-open hook at 1676055781741Writing region info on filesystem at 1676055781741Initializing all the Stores at 1676055781742 (+1 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676055781742Cleaning up temporary data from old regions at 1676055781747 (+5 ms)Cleaning up detritus from prior splits at 1676055781748 (+1 ms)Running coprocessor post-open hooks at 1676055781756 (+8 ms)Region opened successfully at 1676055781756 2023-02-10 19:03:01,757 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:namespace,,1676055781343.4301231127f63d0413cb613f701e56a2., pid=6, masterSystemTime=1676055781703 2023-02-10 19:03:01,762 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:namespace,,1676055781343.4301231127f63d0413cb613f701e56a2. 2023-02-10 19:03:01,763 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:namespace,,1676055781343.4301231127f63d0413cb613f701e56a2. 2023-02-10 19:03:01,763 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=4301231127f63d0413cb613f701e56a2, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,38097,1676055780236 2023-02-10 19:03:01,763 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1676055781343.4301231127f63d0413cb613f701e56a2.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676055781763"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676055781763"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676055781763"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676055781763"}]},"ts":"1676055781763"} 2023-02-10 19:03:01,767 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-02-10 19:03:01,768 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 4301231127f63d0413cb613f701e56a2, server=jenkins-hbase4.apache.org,38097,1676055780236 in 215 msec 2023-02-10 19:03:01,770 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-02-10 19:03:01,770 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=4301231127f63d0413cb613f701e56a2, ASSIGN in 376 msec 2023-02-10 19:03:01,771 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-10 19:03:01,771 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676055781771"}]},"ts":"1676055781771"} 2023-02-10 19:03:01,773 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-02-10 19:03:01,776 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-02-10 19:03:01,777 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 433 msec 2023-02-10 19:03:01,846 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:40103-0x1003f9d84e20000, quorum=127.0.0.1:55517, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-02-10 19:03:01,847 DEBUG [Listener at localhost/35877-EventThread] zookeeper.ZKWatcher(600): master:40103-0x1003f9d84e20000, quorum=127.0.0.1:55517, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-02-10 19:03:01,847 DEBUG [Listener at localhost/35877-EventThread] zookeeper.ZKWatcher(600): master:40103-0x1003f9d84e20000, quorum=127.0.0.1:55517, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-10 19:03:01,851 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-10 19:03:01,854 INFO [RS-EventLoopGroup-7-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60632, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-10 19:03:01,861 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-02-10 19:03:01,870 DEBUG [Listener at localhost/35877-EventThread] zookeeper.ZKWatcher(600): master:40103-0x1003f9d84e20000, quorum=127.0.0.1:55517, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-10 19:03:01,873 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 12 msec 2023-02-10 19:03:01,883 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-02-10 19:03:01,897 DEBUG [Listener at localhost/35877-EventThread] zookeeper.ZKWatcher(600): master:40103-0x1003f9d84e20000, quorum=127.0.0.1:55517, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-10 19:03:01,900 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 17 msec 2023-02-10 19:03:01,907 DEBUG [Listener at localhost/35877-EventThread] zookeeper.ZKWatcher(600): master:40103-0x1003f9d84e20000, quorum=127.0.0.1:55517, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-02-10 19:03:01,910 DEBUG [Listener at localhost/35877-EventThread] zookeeper.ZKWatcher(600): master:40103-0x1003f9d84e20000, quorum=127.0.0.1:55517, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-02-10 19:03:01,910 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1077): Master has completed initialization 1.582sec 2023-02-10 19:03:01,910 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-02-10 19:03:01,910 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-02-10 19:03:01,910 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-02-10 19:03:01,910 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,40103,1676055780155-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-02-10 19:03:01,911 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,40103,1676055780155-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-02-10 19:03:01,912 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1166): Balancer post startup initialization complete, took 0 seconds 2023-02-10 19:03:01,915 DEBUG [Listener at localhost/35877] zookeeper.ReadOnlyZKClient(139): Connect 0x5516db8d to 127.0.0.1:55517 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-10 19:03:01,920 DEBUG [Listener at localhost/35877] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@59b8dd25, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-10 19:03:01,921 DEBUG [hconnection-0x64951b6-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-10 19:03:01,925 INFO [RS-EventLoopGroup-8-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34900, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-10 19:03:01,927 INFO [Listener at localhost/35877] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,40103,1676055780155 2023-02-10 19:03:01,927 DEBUG [Listener at localhost/35877] mapreduce.TableSnapshotInputFormatTestBase(193): Ensuring table doesn't exist. 2023-02-10 19:03:01,929 DEBUG [Listener at localhost/35877] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-10 19:03:01,931 INFO [RS-EventLoopGroup-6-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50728, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-10 19:03:01,932 INFO [Listener at localhost/35877] client.HBaseAdmin$15(890): Started disable of testWithMapReduce 2023-02-10 19:03:01,933 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40103] master.HMaster$11(2405): Client=jenkins//172.31.14.131 disable testWithMapReduce 2023-02-10 19:03:01,933 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40103] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.TableNotFoundException: testWithMapReduce at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.checkTableModifiable(AbstractStateMachineTableProcedure.java:125) at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.preflightChecks(AbstractStateMachineTableProcedure.java:157) at org.apache.hadoop.hbase.master.procedure.DisableTableProcedure.(DisableTableProcedure.java:78) at org.apache.hadoop.hbase.master.HMaster$11.run(HMaster.java:2416) at org.apache.hadoop.hbase.master.procedure.MasterProcedureUtil.submitProcedure(MasterProcedureUtil.java:132) at org.apache.hadoop.hbase.master.HMaster.disableTable(HMaster.java:2400) at org.apache.hadoop.hbase.master.MasterRpcServices.disableTable(MasterRpcServices.java:784) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-02-10 19:03:01,933 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40103] ipc.CallRunner(144): callId: 2 service: MasterService methodName: DisableTable size: 76 connection: 172.31.14.131:50728 deadline: 1676055841933, exception=org.apache.hadoop.hbase.TableNotFoundException: testWithMapReduce 2023-02-10 19:03:01,934 INFO [Listener at localhost/35877] mapreduce.TableSnapshotInputFormatTestBase(199): creating table 'testWithMapReduce' 2023-02-10 19:03:01,937 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40103] master.HMaster$4(2102): Client=jenkins//172.31.14.131 create 'testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-10 19:03:01,939 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40103] procedure2.ProcedureExecutor(1029): Stored pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testWithMapReduce 2023-02-10 19:03:01,941 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_PRE_OPERATION 2023-02-10 19:03:01,941 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40103] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testWithMapReduce" procId is: 10 2023-02-10 19:03:01,942 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-10 19:03:01,942 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40103] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-10 19:03:01,952 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/.tmp/data/default/testWithMapReduce/fe00f1c4e3fbcd6d7560c2506ad6ca19 2023-02-10 19:03:01,952 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/.tmp/data/default/testWithMapReduce/f3c4392d756ce5e5e061ef2cb63d0fce 2023-02-10 19:03:01,952 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/.tmp/data/default/testWithMapReduce/ab9c3c4ad85b22b109e239684647572c 2023-02-10 19:03:01,952 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/.tmp/data/default/testWithMapReduce/e06f6220742d6bd40a5b138f872afaa0 2023-02-10 19:03:01,952 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/.tmp/data/default/testWithMapReduce/d1ba49f10de14d81a2fad0498c59a9b7 2023-02-10 19:03:01,952 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/.tmp/data/default/testWithMapReduce/c47924fd805c4df26e6e9e860c542007 2023-02-10 19:03:01,952 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/.tmp/data/default/testWithMapReduce/ceccc0adc99b7adc17715506edd714a5 2023-02-10 19:03:01,952 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/.tmp/data/default/testWithMapReduce/3c13d5e817a81b6f4b36ab3d9762b76f 2023-02-10 19:03:01,953 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/.tmp/data/default/testWithMapReduce/fe00f1c4e3fbcd6d7560c2506ad6ca19 empty. 2023-02-10 19:03:01,953 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/.tmp/data/default/testWithMapReduce/f3c4392d756ce5e5e061ef2cb63d0fce empty. 2023-02-10 19:03:01,954 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/.tmp/data/default/testWithMapReduce/e06f6220742d6bd40a5b138f872afaa0 empty. 2023-02-10 19:03:01,954 DEBUG [HFileArchiver-5] backup.HFileArchiver(153): Directory hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/.tmp/data/default/testWithMapReduce/ab9c3c4ad85b22b109e239684647572c empty. 2023-02-10 19:03:01,954 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/.tmp/data/default/testWithMapReduce/3c13d5e817a81b6f4b36ab3d9762b76f empty. 2023-02-10 19:03:01,954 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/.tmp/data/default/testWithMapReduce/f3c4392d756ce5e5e061ef2cb63d0fce 2023-02-10 19:03:01,954 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/.tmp/data/default/testWithMapReduce/4dfcfb14720b0f66e0e9179835dbe61d 2023-02-10 19:03:01,954 DEBUG [HFileArchiver-6] backup.HFileArchiver(153): Directory hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/.tmp/data/default/testWithMapReduce/d1ba49f10de14d81a2fad0498c59a9b7 empty. 2023-02-10 19:03:01,954 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/.tmp/data/default/testWithMapReduce/3c13d5e817a81b6f4b36ab3d9762b76f 2023-02-10 19:03:01,955 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/.tmp/data/default/testWithMapReduce/aff2d18d26e1916478e05b25bb5c9a89 2023-02-10 19:03:01,955 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/.tmp/data/default/testWithMapReduce/c47924fd805c4df26e6e9e860c542007 empty. 2023-02-10 19:03:01,955 DEBUG [HFileArchiver-5] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/.tmp/data/default/testWithMapReduce/ab9c3c4ad85b22b109e239684647572c 2023-02-10 19:03:01,955 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/.tmp/data/default/testWithMapReduce/e06f6220742d6bd40a5b138f872afaa0 2023-02-10 19:03:01,955 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/.tmp/data/default/testWithMapReduce/fe00f1c4e3fbcd6d7560c2506ad6ca19 2023-02-10 19:03:01,955 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/.tmp/data/default/testWithMapReduce/ceccc0adc99b7adc17715506edd714a5 empty. 2023-02-10 19:03:01,955 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/.tmp/data/default/testWithMapReduce/aff2d18d26e1916478e05b25bb5c9a89 empty. 2023-02-10 19:03:01,955 DEBUG [HFileArchiver-6] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/.tmp/data/default/testWithMapReduce/d1ba49f10de14d81a2fad0498c59a9b7 2023-02-10 19:03:01,956 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/.tmp/data/default/testWithMapReduce/ceccc0adc99b7adc17715506edd714a5 2023-02-10 19:03:01,956 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/.tmp/data/default/testWithMapReduce/4dfcfb14720b0f66e0e9179835dbe61d empty. 2023-02-10 19:03:01,956 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/.tmp/data/default/testWithMapReduce/aff2d18d26e1916478e05b25bb5c9a89 2023-02-10 19:03:01,956 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/.tmp/data/default/testWithMapReduce/c47924fd805c4df26e6e9e860c542007 2023-02-10 19:03:01,956 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/.tmp/data/default/testWithMapReduce/4dfcfb14720b0f66e0e9179835dbe61d 2023-02-10 19:03:01,956 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testWithMapReduce regions 2023-02-10 19:03:01,970 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/.tmp/data/default/testWithMapReduce/.tabledesc/.tableinfo.0000000001 2023-02-10 19:03:01,971 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(7671): creating {ENCODED => fe00f1c4e3fbcd6d7560c2506ad6ca19, NAME => 'testWithMapReduce,,1676055781936.fe00f1c4e3fbcd6d7560c2506ad6ca19.', STARTKEY => '', ENDKEY => 'aaa'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/.tmp 2023-02-10 19:03:01,980 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(7671): creating {ENCODED => d1ba49f10de14d81a2fad0498c59a9b7, NAME => 'testWithMapReduce,aaa,1676055781936.d1ba49f10de14d81a2fad0498c59a9b7.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/.tmp 2023-02-10 19:03:01,981 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(7671): creating {ENCODED => e06f6220742d6bd40a5b138f872afaa0, NAME => 'testWithMapReduce,d\x84\x84,1676055781936.e06f6220742d6bd40a5b138f872afaa0.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/.tmp 2023-02-10 19:03:02,000 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676055781936.fe00f1c4e3fbcd6d7560c2506ad6ca19.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-10 19:03:02,001 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1603): Closing fe00f1c4e3fbcd6d7560c2506ad6ca19, disabling compactions & flushes 2023-02-10 19:03:02,001 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676055781936.fe00f1c4e3fbcd6d7560c2506ad6ca19. 2023-02-10 19:03:02,001 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676055781936.fe00f1c4e3fbcd6d7560c2506ad6ca19. 2023-02-10 19:03:02,001 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676055781936.fe00f1c4e3fbcd6d7560c2506ad6ca19. after waiting 0 ms 2023-02-10 19:03:02,001 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676055781936.fe00f1c4e3fbcd6d7560c2506ad6ca19. 2023-02-10 19:03:02,001 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,,1676055781936.fe00f1c4e3fbcd6d7560c2506ad6ca19. 2023-02-10 19:03:02,001 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1557): Region close journal for fe00f1c4e3fbcd6d7560c2506ad6ca19: Waiting for close lock at 1676055782000Disabling compacts and flushes for region at 1676055782000Disabling writes for close at 1676055782001 (+1 ms)Writing region close event to WAL at 1676055782001Closed at 1676055782001 2023-02-10 19:03:02,001 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(7671): creating {ENCODED => f3c4392d756ce5e5e061ef2cb63d0fce, NAME => 'testWithMapReduce,g\xA7\xA7,1676055781936.f3c4392d756ce5e5e061ef2cb63d0fce.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/.tmp 2023-02-10 19:03:02,013 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,d\x84\x84,1676055781936.e06f6220742d6bd40a5b138f872afaa0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-10 19:03:02,014 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1603): Closing e06f6220742d6bd40a5b138f872afaa0, disabling compactions & flushes 2023-02-10 19:03:02,014 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,d\x84\x84,1676055781936.e06f6220742d6bd40a5b138f872afaa0. 2023-02-10 19:03:02,014 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,d\x84\x84,1676055781936.e06f6220742d6bd40a5b138f872afaa0. 2023-02-10 19:03:02,014 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,d\x84\x84,1676055781936.e06f6220742d6bd40a5b138f872afaa0. after waiting 0 ms 2023-02-10 19:03:02,014 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,d\x84\x84,1676055781936.e06f6220742d6bd40a5b138f872afaa0. 2023-02-10 19:03:02,014 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,d\x84\x84,1676055781936.e06f6220742d6bd40a5b138f872afaa0. 2023-02-10 19:03:02,014 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1557): Region close journal for e06f6220742d6bd40a5b138f872afaa0: Waiting for close lock at 1676055782014Disabling compacts and flushes for region at 1676055782014Disabling writes for close at 1676055782014Writing region close event to WAL at 1676055782014Closed at 1676055782014 2023-02-10 19:03:02,014 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(7671): creating {ENCODED => 3c13d5e817a81b6f4b36ab3d9762b76f, NAME => 'testWithMapReduce,j\xCA\xCA,1676055781936.3c13d5e817a81b6f4b36ab3d9762b76f.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/.tmp 2023-02-10 19:03:02,015 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,g\xA7\xA7,1676055781936.f3c4392d756ce5e5e061ef2cb63d0fce.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-10 19:03:02,015 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1603): Closing f3c4392d756ce5e5e061ef2cb63d0fce, disabling compactions & flushes 2023-02-10 19:03:02,015 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,g\xA7\xA7,1676055781936.f3c4392d756ce5e5e061ef2cb63d0fce. 2023-02-10 19:03:02,015 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,g\xA7\xA7,1676055781936.f3c4392d756ce5e5e061ef2cb63d0fce. 2023-02-10 19:03:02,015 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,g\xA7\xA7,1676055781936.f3c4392d756ce5e5e061ef2cb63d0fce. after waiting 0 ms 2023-02-10 19:03:02,015 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,g\xA7\xA7,1676055781936.f3c4392d756ce5e5e061ef2cb63d0fce. 2023-02-10 19:03:02,015 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,g\xA7\xA7,1676055781936.f3c4392d756ce5e5e061ef2cb63d0fce. 2023-02-10 19:03:02,015 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1557): Region close journal for f3c4392d756ce5e5e061ef2cb63d0fce: Waiting for close lock at 1676055782015Disabling compacts and flushes for region at 1676055782015Disabling writes for close at 1676055782015Writing region close event to WAL at 1676055782015Closed at 1676055782015 2023-02-10 19:03:02,016 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(7671): creating {ENCODED => ceccc0adc99b7adc17715506edd714a5, NAME => 'testWithMapReduce,m\xED\xED,1676055781936.ceccc0adc99b7adc17715506edd714a5.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/.tmp 2023-02-10 19:03:02,032 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,j\xCA\xCA,1676055781936.3c13d5e817a81b6f4b36ab3d9762b76f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-10 19:03:02,032 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1603): Closing 3c13d5e817a81b6f4b36ab3d9762b76f, disabling compactions & flushes 2023-02-10 19:03:02,032 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,j\xCA\xCA,1676055781936.3c13d5e817a81b6f4b36ab3d9762b76f. 2023-02-10 19:03:02,032 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,j\xCA\xCA,1676055781936.3c13d5e817a81b6f4b36ab3d9762b76f. 2023-02-10 19:03:02,032 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,j\xCA\xCA,1676055781936.3c13d5e817a81b6f4b36ab3d9762b76f. after waiting 0 ms 2023-02-10 19:03:02,032 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,j\xCA\xCA,1676055781936.3c13d5e817a81b6f4b36ab3d9762b76f. 2023-02-10 19:03:02,032 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,j\xCA\xCA,1676055781936.3c13d5e817a81b6f4b36ab3d9762b76f. 2023-02-10 19:03:02,032 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1557): Region close journal for 3c13d5e817a81b6f4b36ab3d9762b76f: Waiting for close lock at 1676055782032Disabling compacts and flushes for region at 1676055782032Disabling writes for close at 1676055782032Writing region close event to WAL at 1676055782032Closed at 1676055782032 2023-02-10 19:03:02,033 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(7671): creating {ENCODED => c47924fd805c4df26e6e9e860c542007, NAME => 'testWithMapReduce,q\x11\x10,1676055781936.c47924fd805c4df26e6e9e860c542007.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/.tmp 2023-02-10 19:03:02,037 INFO [RS:1;jenkins-hbase4:35609] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C35609%2C1676055780283, suffix=, logDir=hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/WALs/jenkins-hbase4.apache.org,35609,1676055780283, archiveDir=hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/oldWALs, maxLogs=32 2023-02-10 19:03:02,042 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,m\xED\xED,1676055781936.ceccc0adc99b7adc17715506edd714a5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-10 19:03:02,042 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1603): Closing ceccc0adc99b7adc17715506edd714a5, disabling compactions & flushes 2023-02-10 19:03:02,042 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,m\xED\xED,1676055781936.ceccc0adc99b7adc17715506edd714a5. 2023-02-10 19:03:02,042 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,m\xED\xED,1676055781936.ceccc0adc99b7adc17715506edd714a5. 2023-02-10 19:03:02,042 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,m\xED\xED,1676055781936.ceccc0adc99b7adc17715506edd714a5. after waiting 0 ms 2023-02-10 19:03:02,042 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,m\xED\xED,1676055781936.ceccc0adc99b7adc17715506edd714a5. 2023-02-10 19:03:02,042 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,m\xED\xED,1676055781936.ceccc0adc99b7adc17715506edd714a5. 2023-02-10 19:03:02,043 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1557): Region close journal for ceccc0adc99b7adc17715506edd714a5: Waiting for close lock at 1676055782042Disabling compacts and flushes for region at 1676055782042Disabling writes for close at 1676055782042Writing region close event to WAL at 1676055782042Closed at 1676055782042 2023-02-10 19:03:02,043 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(7671): creating {ENCODED => ab9c3c4ad85b22b109e239684647572c, NAME => 'testWithMapReduce,t43,1676055781936.ab9c3c4ad85b22b109e239684647572c.', STARTKEY => 't43', ENDKEY => 'wWV'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/.tmp 2023-02-10 19:03:02,044 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40103] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-10 19:03:02,055 DEBUG [RS-EventLoopGroup-8-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37361,DS-bd89f331-16cf-42ed-9769-6b8e5d3726db,DISK] 2023-02-10 19:03:02,057 DEBUG [RS-EventLoopGroup-8-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46609,DS-eed40a6d-0d20-4883-936f-2082985e6383,DISK] 2023-02-10 19:03:02,061 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,q\x11\x10,1676055781936.c47924fd805c4df26e6e9e860c542007.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-10 19:03:02,061 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1603): Closing c47924fd805c4df26e6e9e860c542007, disabling compactions & flushes 2023-02-10 19:03:02,061 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,q\x11\x10,1676055781936.c47924fd805c4df26e6e9e860c542007. 2023-02-10 19:03:02,061 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,q\x11\x10,1676055781936.c47924fd805c4df26e6e9e860c542007. 2023-02-10 19:03:02,061 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,q\x11\x10,1676055781936.c47924fd805c4df26e6e9e860c542007. after waiting 0 ms 2023-02-10 19:03:02,061 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,q\x11\x10,1676055781936.c47924fd805c4df26e6e9e860c542007. 2023-02-10 19:03:02,061 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,q\x11\x10,1676055781936.c47924fd805c4df26e6e9e860c542007. 2023-02-10 19:03:02,061 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1557): Region close journal for c47924fd805c4df26e6e9e860c542007: Waiting for close lock at 1676055782061Disabling compacts and flushes for region at 1676055782061Disabling writes for close at 1676055782061Writing region close event to WAL at 1676055782061Closed at 1676055782061 2023-02-10 19:03:02,062 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(7671): creating {ENCODED => 4dfcfb14720b0f66e0e9179835dbe61d, NAME => 'testWithMapReduce,wWV,1676055781936.4dfcfb14720b0f66e0e9179835dbe61d.', STARTKEY => 'wWV', ENDKEY => 'zz{'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/.tmp 2023-02-10 19:03:02,062 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,t43,1676055781936.ab9c3c4ad85b22b109e239684647572c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-10 19:03:02,062 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1603): Closing ab9c3c4ad85b22b109e239684647572c, disabling compactions & flushes 2023-02-10 19:03:02,062 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,t43,1676055781936.ab9c3c4ad85b22b109e239684647572c. 2023-02-10 19:03:02,062 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,t43,1676055781936.ab9c3c4ad85b22b109e239684647572c. 2023-02-10 19:03:02,062 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,t43,1676055781936.ab9c3c4ad85b22b109e239684647572c. after waiting 0 ms 2023-02-10 19:03:02,062 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,t43,1676055781936.ab9c3c4ad85b22b109e239684647572c. 2023-02-10 19:03:02,062 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,t43,1676055781936.ab9c3c4ad85b22b109e239684647572c. 2023-02-10 19:03:02,063 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1557): Region close journal for ab9c3c4ad85b22b109e239684647572c: Waiting for close lock at 1676055782062Disabling compacts and flushes for region at 1676055782062Disabling writes for close at 1676055782062Writing region close event to WAL at 1676055782062Closed at 1676055782062 2023-02-10 19:03:02,063 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(7671): creating {ENCODED => aff2d18d26e1916478e05b25bb5c9a89, NAME => 'testWithMapReduce,zz{,1676055781936.aff2d18d26e1916478e05b25bb5c9a89.', STARTKEY => 'zz{', ENDKEY => ''}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/.tmp 2023-02-10 19:03:02,064 INFO [RS:1;jenkins-hbase4:35609] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/WALs/jenkins-hbase4.apache.org,35609,1676055780283/jenkins-hbase4.apache.org%2C35609%2C1676055780283.1676055782038 2023-02-10 19:03:02,064 DEBUG [RS:1;jenkins-hbase4:35609] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:37361,DS-bd89f331-16cf-42ed-9769-6b8e5d3726db,DISK], DatanodeInfoWithStorage[127.0.0.1:46609,DS-eed40a6d-0d20-4883-936f-2082985e6383,DISK]] 2023-02-10 19:03:02,076 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,zz{,1676055781936.aff2d18d26e1916478e05b25bb5c9a89.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-10 19:03:02,077 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1603): Closing aff2d18d26e1916478e05b25bb5c9a89, disabling compactions & flushes 2023-02-10 19:03:02,077 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,zz{,1676055781936.aff2d18d26e1916478e05b25bb5c9a89. 2023-02-10 19:03:02,077 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,zz{,1676055781936.aff2d18d26e1916478e05b25bb5c9a89. 2023-02-10 19:03:02,077 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,zz{,1676055781936.aff2d18d26e1916478e05b25bb5c9a89. after waiting 0 ms 2023-02-10 19:03:02,077 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,zz{,1676055781936.aff2d18d26e1916478e05b25bb5c9a89. 2023-02-10 19:03:02,077 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,zz{,1676055781936.aff2d18d26e1916478e05b25bb5c9a89. 2023-02-10 19:03:02,077 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1557): Region close journal for aff2d18d26e1916478e05b25bb5c9a89: Waiting for close lock at 1676055782077Disabling compacts and flushes for region at 1676055782077Disabling writes for close at 1676055782077Writing region close event to WAL at 1676055782077Closed at 1676055782077 2023-02-10 19:03:02,077 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,wWV,1676055781936.4dfcfb14720b0f66e0e9179835dbe61d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-10 19:03:02,077 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1603): Closing 4dfcfb14720b0f66e0e9179835dbe61d, disabling compactions & flushes 2023-02-10 19:03:02,077 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,wWV,1676055781936.4dfcfb14720b0f66e0e9179835dbe61d. 2023-02-10 19:03:02,078 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,wWV,1676055781936.4dfcfb14720b0f66e0e9179835dbe61d. 2023-02-10 19:03:02,078 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,wWV,1676055781936.4dfcfb14720b0f66e0e9179835dbe61d. after waiting 0 ms 2023-02-10 19:03:02,078 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,wWV,1676055781936.4dfcfb14720b0f66e0e9179835dbe61d. 2023-02-10 19:03:02,078 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,wWV,1676055781936.4dfcfb14720b0f66e0e9179835dbe61d. 2023-02-10 19:03:02,078 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1557): Region close journal for 4dfcfb14720b0f66e0e9179835dbe61d: Waiting for close lock at 1676055782077Disabling compacts and flushes for region at 1676055782077Disabling writes for close at 1676055782078 (+1 ms)Writing region close event to WAL at 1676055782078Closed at 1676055782078 2023-02-10 19:03:02,246 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40103] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-10 19:03:02,410 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,aaa,1676055781936.d1ba49f10de14d81a2fad0498c59a9b7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-10 19:03:02,410 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1603): Closing d1ba49f10de14d81a2fad0498c59a9b7, disabling compactions & flushes 2023-02-10 19:03:02,411 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,aaa,1676055781936.d1ba49f10de14d81a2fad0498c59a9b7. 2023-02-10 19:03:02,411 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,aaa,1676055781936.d1ba49f10de14d81a2fad0498c59a9b7. 2023-02-10 19:03:02,411 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,aaa,1676055781936.d1ba49f10de14d81a2fad0498c59a9b7. after waiting 0 ms 2023-02-10 19:03:02,411 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,aaa,1676055781936.d1ba49f10de14d81a2fad0498c59a9b7. 2023-02-10 19:03:02,411 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,aaa,1676055781936.d1ba49f10de14d81a2fad0498c59a9b7. 2023-02-10 19:03:02,411 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1557): Region close journal for d1ba49f10de14d81a2fad0498c59a9b7: Waiting for close lock at 1676055782410Disabling compacts and flushes for region at 1676055782410Disabling writes for close at 1676055782411 (+1 ms)Writing region close event to WAL at 1676055782411Closed at 1676055782411 2023-02-10 19:03:02,414 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_ADD_TO_META 2023-02-10 19:03:02,415 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,,1676055781936.fe00f1c4e3fbcd6d7560c2506ad6ca19.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676055782415"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676055782415"}]},"ts":"1676055782415"} 2023-02-10 19:03:02,415 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,d\\x84\\x84,1676055781936.e06f6220742d6bd40a5b138f872afaa0.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676055782415"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676055782415"}]},"ts":"1676055782415"} 2023-02-10 19:03:02,416 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,g\\xA7\\xA7,1676055781936.f3c4392d756ce5e5e061ef2cb63d0fce.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676055782415"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676055782415"}]},"ts":"1676055782415"} 2023-02-10 19:03:02,416 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,j\\xCA\\xCA,1676055781936.3c13d5e817a81b6f4b36ab3d9762b76f.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676055782415"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676055782415"}]},"ts":"1676055782415"} 2023-02-10 19:03:02,416 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,m\\xED\\xED,1676055781936.ceccc0adc99b7adc17715506edd714a5.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676055782415"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676055782415"}]},"ts":"1676055782415"} 2023-02-10 19:03:02,416 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,q\\x11\\x10,1676055781936.c47924fd805c4df26e6e9e860c542007.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676055782415"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676055782415"}]},"ts":"1676055782415"} 2023-02-10 19:03:02,416 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,t43,1676055781936.ab9c3c4ad85b22b109e239684647572c.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676055782415"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676055782415"}]},"ts":"1676055782415"} 2023-02-10 19:03:02,416 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,zz{,1676055781936.aff2d18d26e1916478e05b25bb5c9a89.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676055782415"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676055782415"}]},"ts":"1676055782415"} 2023-02-10 19:03:02,416 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,wWV,1676055781936.4dfcfb14720b0f66e0e9179835dbe61d.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676055782415"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676055782415"}]},"ts":"1676055782415"} 2023-02-10 19:03:02,416 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,aaa,1676055781936.d1ba49f10de14d81a2fad0498c59a9b7.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676055782415"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676055782415"}]},"ts":"1676055782415"} 2023-02-10 19:03:02,421 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 10 regions to meta. 2023-02-10 19:03:02,422 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-10 19:03:02,422 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676055782422"}]},"ts":"1676055782422"} 2023-02-10 19:03:02,424 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=ENABLING in hbase:meta 2023-02-10 19:03:02,429 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-10 19:03:02,437 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-10 19:03:02,437 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-10 19:03:02,437 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-10 19:03:02,437 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=fe00f1c4e3fbcd6d7560c2506ad6ca19, ASSIGN}, {pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=d1ba49f10de14d81a2fad0498c59a9b7, ASSIGN}, {pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=e06f6220742d6bd40a5b138f872afaa0, ASSIGN}, {pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=f3c4392d756ce5e5e061ef2cb63d0fce, ASSIGN}, {pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=3c13d5e817a81b6f4b36ab3d9762b76f, ASSIGN}, {pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=ceccc0adc99b7adc17715506edd714a5, ASSIGN}, {pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=c47924fd805c4df26e6e9e860c542007, ASSIGN}, {pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=ab9c3c4ad85b22b109e239684647572c, ASSIGN}, {pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=4dfcfb14720b0f66e0e9179835dbe61d, ASSIGN}, {pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=aff2d18d26e1916478e05b25bb5c9a89, ASSIGN}] 2023-02-10 19:03:02,440 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=d1ba49f10de14d81a2fad0498c59a9b7, ASSIGN 2023-02-10 19:03:02,440 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=fe00f1c4e3fbcd6d7560c2506ad6ca19, ASSIGN 2023-02-10 19:03:02,440 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=e06f6220742d6bd40a5b138f872afaa0, ASSIGN 2023-02-10 19:03:02,440 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=f3c4392d756ce5e5e061ef2cb63d0fce, ASSIGN 2023-02-10 19:03:02,441 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=d1ba49f10de14d81a2fad0498c59a9b7, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,38097,1676055780236; forceNewPlan=false, retain=false 2023-02-10 19:03:02,441 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=e06f6220742d6bd40a5b138f872afaa0, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,38097,1676055780236; forceNewPlan=false, retain=false 2023-02-10 19:03:02,441 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=fe00f1c4e3fbcd6d7560c2506ad6ca19, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,35609,1676055780283; forceNewPlan=false, retain=false 2023-02-10 19:03:02,441 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=aff2d18d26e1916478e05b25bb5c9a89, ASSIGN 2023-02-10 19:03:02,441 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=f3c4392d756ce5e5e061ef2cb63d0fce, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,35609,1676055780283; forceNewPlan=false, retain=false 2023-02-10 19:03:02,442 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=4dfcfb14720b0f66e0e9179835dbe61d, ASSIGN 2023-02-10 19:03:02,442 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=ab9c3c4ad85b22b109e239684647572c, ASSIGN 2023-02-10 19:03:02,442 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=c47924fd805c4df26e6e9e860c542007, ASSIGN 2023-02-10 19:03:02,442 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=aff2d18d26e1916478e05b25bb5c9a89, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,38097,1676055780236; forceNewPlan=false, retain=false 2023-02-10 19:03:02,442 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=ceccc0adc99b7adc17715506edd714a5, ASSIGN 2023-02-10 19:03:02,443 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=4dfcfb14720b0f66e0e9179835dbe61d, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,35609,1676055780283; forceNewPlan=false, retain=false 2023-02-10 19:03:02,443 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=ab9c3c4ad85b22b109e239684647572c, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,35609,1676055780283; forceNewPlan=false, retain=false 2023-02-10 19:03:02,443 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=c47924fd805c4df26e6e9e860c542007, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,38097,1676055780236; forceNewPlan=false, retain=false 2023-02-10 19:03:02,444 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=3c13d5e817a81b6f4b36ab3d9762b76f, ASSIGN 2023-02-10 19:03:02,444 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=ceccc0adc99b7adc17715506edd714a5, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,35609,1676055780283; forceNewPlan=false, retain=false 2023-02-10 19:03:02,444 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=3c13d5e817a81b6f4b36ab3d9762b76f, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,38097,1676055780236; forceNewPlan=false, retain=false 2023-02-10 19:03:02,548 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40103] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-10 19:03:02,591 INFO [jenkins-hbase4:40103] balancer.BaseLoadBalancer(1545): Reassigned 10 regions. 10 retained the pre-restart assignment. 2023-02-10 19:03:02,604 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=e06f6220742d6bd40a5b138f872afaa0, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,38097,1676055780236 2023-02-10 19:03:02,604 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,d\\x84\\x84,1676055781936.e06f6220742d6bd40a5b138f872afaa0.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676055782604"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676055782604"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676055782604"}]},"ts":"1676055782604"} 2023-02-10 19:03:02,605 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=3c13d5e817a81b6f4b36ab3d9762b76f, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,38097,1676055780236 2023-02-10 19:03:02,605 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,j\\xCA\\xCA,1676055781936.3c13d5e817a81b6f4b36ab3d9762b76f.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676055782605"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676055782605"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676055782605"}]},"ts":"1676055782605"} 2023-02-10 19:03:02,606 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=12 updating hbase:meta row=d1ba49f10de14d81a2fad0498c59a9b7, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,38097,1676055780236 2023-02-10 19:03:02,606 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,aaa,1676055781936.d1ba49f10de14d81a2fad0498c59a9b7.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676055782606"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676055782606"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676055782606"}]},"ts":"1676055782606"} 2023-02-10 19:03:02,606 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=aff2d18d26e1916478e05b25bb5c9a89, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,38097,1676055780236 2023-02-10 19:03:02,606 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=17 updating hbase:meta row=c47924fd805c4df26e6e9e860c542007, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,38097,1676055780236 2023-02-10 19:03:02,606 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,zz{,1676055781936.aff2d18d26e1916478e05b25bb5c9a89.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676055782606"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676055782606"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676055782606"}]},"ts":"1676055782606"} 2023-02-10 19:03:02,606 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,q\\x11\\x10,1676055781936.c47924fd805c4df26e6e9e860c542007.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676055782606"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676055782606"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676055782606"}]},"ts":"1676055782606"} 2023-02-10 19:03:02,609 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=21, ppid=13, state=RUNNABLE; OpenRegionProcedure e06f6220742d6bd40a5b138f872afaa0, server=jenkins-hbase4.apache.org,38097,1676055780236}] 2023-02-10 19:03:02,610 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=22, ppid=15, state=RUNNABLE; OpenRegionProcedure 3c13d5e817a81b6f4b36ab3d9762b76f, server=jenkins-hbase4.apache.org,38097,1676055780236}] 2023-02-10 19:03:02,611 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=23, ppid=12, state=RUNNABLE; OpenRegionProcedure d1ba49f10de14d81a2fad0498c59a9b7, server=jenkins-hbase4.apache.org,38097,1676055780236}] 2023-02-10 19:03:02,612 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=24, ppid=20, state=RUNNABLE; OpenRegionProcedure aff2d18d26e1916478e05b25bb5c9a89, server=jenkins-hbase4.apache.org,38097,1676055780236}] 2023-02-10 19:03:02,615 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=25, ppid=17, state=RUNNABLE; OpenRegionProcedure c47924fd805c4df26e6e9e860c542007, server=jenkins-hbase4.apache.org,38097,1676055780236}] 2023-02-10 19:03:02,617 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=fe00f1c4e3fbcd6d7560c2506ad6ca19, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,35609,1676055780283 2023-02-10 19:03:02,617 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,,1676055781936.fe00f1c4e3fbcd6d7560c2506ad6ca19.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676055782616"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676055782616"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676055782616"}]},"ts":"1676055782616"} 2023-02-10 19:03:02,617 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=18 updating hbase:meta row=ab9c3c4ad85b22b109e239684647572c, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,35609,1676055780283 2023-02-10 19:03:02,617 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,t43,1676055781936.ab9c3c4ad85b22b109e239684647572c.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676055782617"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676055782617"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676055782617"}]},"ts":"1676055782617"} 2023-02-10 19:03:02,628 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=19 updating hbase:meta row=4dfcfb14720b0f66e0e9179835dbe61d, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,35609,1676055780283 2023-02-10 19:03:02,628 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,wWV,1676055781936.4dfcfb14720b0f66e0e9179835dbe61d.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676055782628"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676055782628"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676055782628"}]},"ts":"1676055782628"} 2023-02-10 19:03:02,631 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=26, ppid=11, state=RUNNABLE; OpenRegionProcedure fe00f1c4e3fbcd6d7560c2506ad6ca19, server=jenkins-hbase4.apache.org,35609,1676055780283}] 2023-02-10 19:03:02,631 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=27, ppid=18, state=RUNNABLE; OpenRegionProcedure ab9c3c4ad85b22b109e239684647572c, server=jenkins-hbase4.apache.org,35609,1676055780283}] 2023-02-10 19:03:02,632 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=ceccc0adc99b7adc17715506edd714a5, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,35609,1676055780283 2023-02-10 19:03:02,632 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=f3c4392d756ce5e5e061ef2cb63d0fce, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,35609,1676055780283 2023-02-10 19:03:02,632 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,m\\xED\\xED,1676055781936.ceccc0adc99b7adc17715506edd714a5.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676055782632"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676055782632"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676055782632"}]},"ts":"1676055782632"} 2023-02-10 19:03:02,632 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,g\\xA7\\xA7,1676055781936.f3c4392d756ce5e5e061ef2cb63d0fce.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676055782632"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676055782632"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676055782632"}]},"ts":"1676055782632"} 2023-02-10 19:03:02,633 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=28, ppid=19, state=RUNNABLE; OpenRegionProcedure 4dfcfb14720b0f66e0e9179835dbe61d, server=jenkins-hbase4.apache.org,35609,1676055780283}] 2023-02-10 19:03:02,636 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=29, ppid=14, state=RUNNABLE; OpenRegionProcedure f3c4392d756ce5e5e061ef2cb63d0fce, server=jenkins-hbase4.apache.org,35609,1676055780283}] 2023-02-10 19:03:02,636 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=30, ppid=16, state=RUNNABLE; OpenRegionProcedure ceccc0adc99b7adc17715506edd714a5, server=jenkins-hbase4.apache.org,35609,1676055780283}] 2023-02-10 19:03:02,679 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-datanode.properties,hadoop-metrics2.properties 2023-02-10 19:03:02,766 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,d\x84\x84,1676055781936.e06f6220742d6bd40a5b138f872afaa0. 2023-02-10 19:03:02,767 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => e06f6220742d6bd40a5b138f872afaa0, NAME => 'testWithMapReduce,d\x84\x84,1676055781936.e06f6220742d6bd40a5b138f872afaa0.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'} 2023-02-10 19:03:02,767 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce e06f6220742d6bd40a5b138f872afaa0 2023-02-10 19:03:02,767 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,d\x84\x84,1676055781936.e06f6220742d6bd40a5b138f872afaa0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-10 19:03:02,767 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for e06f6220742d6bd40a5b138f872afaa0 2023-02-10 19:03:02,767 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for e06f6220742d6bd40a5b138f872afaa0 2023-02-10 19:03:02,772 INFO [StoreOpener-e06f6220742d6bd40a5b138f872afaa0-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region e06f6220742d6bd40a5b138f872afaa0 2023-02-10 19:03:02,774 DEBUG [StoreOpener-e06f6220742d6bd40a5b138f872afaa0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/data/default/testWithMapReduce/e06f6220742d6bd40a5b138f872afaa0/f1 2023-02-10 19:03:02,774 DEBUG [StoreOpener-e06f6220742d6bd40a5b138f872afaa0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/data/default/testWithMapReduce/e06f6220742d6bd40a5b138f872afaa0/f1 2023-02-10 19:03:02,774 INFO [StoreOpener-e06f6220742d6bd40a5b138f872afaa0-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e06f6220742d6bd40a5b138f872afaa0 columnFamilyName f1 2023-02-10 19:03:02,775 INFO [StoreOpener-e06f6220742d6bd40a5b138f872afaa0-1] regionserver.HStore(310): Store=e06f6220742d6bd40a5b138f872afaa0/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-10 19:03:02,775 INFO [StoreOpener-e06f6220742d6bd40a5b138f872afaa0-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region e06f6220742d6bd40a5b138f872afaa0 2023-02-10 19:03:02,776 DEBUG [StoreOpener-e06f6220742d6bd40a5b138f872afaa0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/data/default/testWithMapReduce/e06f6220742d6bd40a5b138f872afaa0/f2 2023-02-10 19:03:02,776 DEBUG [StoreOpener-e06f6220742d6bd40a5b138f872afaa0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/data/default/testWithMapReduce/e06f6220742d6bd40a5b138f872afaa0/f2 2023-02-10 19:03:02,776 INFO [StoreOpener-e06f6220742d6bd40a5b138f872afaa0-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e06f6220742d6bd40a5b138f872afaa0 columnFamilyName f2 2023-02-10 19:03:02,777 INFO [StoreOpener-e06f6220742d6bd40a5b138f872afaa0-1] regionserver.HStore(310): Store=e06f6220742d6bd40a5b138f872afaa0/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-10 19:03:02,778 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/data/default/testWithMapReduce/e06f6220742d6bd40a5b138f872afaa0 2023-02-10 19:03:02,778 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/data/default/testWithMapReduce/e06f6220742d6bd40a5b138f872afaa0 2023-02-10 19:03:02,780 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-10 19:03:02,781 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for e06f6220742d6bd40a5b138f872afaa0 2023-02-10 19:03:02,784 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/data/default/testWithMapReduce/e06f6220742d6bd40a5b138f872afaa0/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-10 19:03:02,785 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened e06f6220742d6bd40a5b138f872afaa0; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66294457, jitterRate=-0.012135609984397888}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-10 19:03:02,785 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for e06f6220742d6bd40a5b138f872afaa0: Running coprocessor pre-open hook at 1676055782767Writing region info on filesystem at 1676055782767Initializing all the Stores at 1676055782768 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676055782768Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676055782772 (+4 ms)Cleaning up temporary data from old regions at 1676055782779 (+7 ms)Cleaning up detritus from prior splits at 1676055782779Running coprocessor post-open hooks at 1676055782785 (+6 ms)Region opened successfully at 1676055782785 2023-02-10 19:03:02,786 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,d\x84\x84,1676055781936.e06f6220742d6bd40a5b138f872afaa0., pid=21, masterSystemTime=1676055782763 2023-02-10 19:03:02,788 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=e06f6220742d6bd40a5b138f872afaa0, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,38097,1676055780236 2023-02-10 19:03:02,788 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,d\x84\x84,1676055781936.e06f6220742d6bd40a5b138f872afaa0. 2023-02-10 19:03:02,788 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,d\\x84\\x84,1676055781936.e06f6220742d6bd40a5b138f872afaa0.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676055782788"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676055782788"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676055782788"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676055782788"}]},"ts":"1676055782788"} 2023-02-10 19:03:02,789 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,d\x84\x84,1676055781936.e06f6220742d6bd40a5b138f872afaa0. 2023-02-10 19:03:02,789 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,zz{,1676055781936.aff2d18d26e1916478e05b25bb5c9a89. 2023-02-10 19:03:02,789 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => aff2d18d26e1916478e05b25bb5c9a89, NAME => 'testWithMapReduce,zz{,1676055781936.aff2d18d26e1916478e05b25bb5c9a89.', STARTKEY => 'zz{', ENDKEY => ''} 2023-02-10 19:03:02,789 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce aff2d18d26e1916478e05b25bb5c9a89 2023-02-10 19:03:02,789 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,zz{,1676055781936.aff2d18d26e1916478e05b25bb5c9a89.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-10 19:03:02,789 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for aff2d18d26e1916478e05b25bb5c9a89 2023-02-10 19:03:02,789 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for aff2d18d26e1916478e05b25bb5c9a89 2023-02-10 19:03:02,792 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,t43,1676055781936.ab9c3c4ad85b22b109e239684647572c. 2023-02-10 19:03:02,792 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => ab9c3c4ad85b22b109e239684647572c, NAME => 'testWithMapReduce,t43,1676055781936.ab9c3c4ad85b22b109e239684647572c.', STARTKEY => 't43', ENDKEY => 'wWV'} 2023-02-10 19:03:02,793 INFO [StoreOpener-aff2d18d26e1916478e05b25bb5c9a89-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region aff2d18d26e1916478e05b25bb5c9a89 2023-02-10 19:03:02,793 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=21, resume processing ppid=13 2023-02-10 19:03:02,793 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=21, ppid=13, state=SUCCESS; OpenRegionProcedure e06f6220742d6bd40a5b138f872afaa0, server=jenkins-hbase4.apache.org,38097,1676055780236 in 182 msec 2023-02-10 19:03:02,795 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=13, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=e06f6220742d6bd40a5b138f872afaa0, ASSIGN in 356 msec 2023-02-10 19:03:02,795 DEBUG [StoreOpener-aff2d18d26e1916478e05b25bb5c9a89-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/data/default/testWithMapReduce/aff2d18d26e1916478e05b25bb5c9a89/f1 2023-02-10 19:03:02,795 DEBUG [StoreOpener-aff2d18d26e1916478e05b25bb5c9a89-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/data/default/testWithMapReduce/aff2d18d26e1916478e05b25bb5c9a89/f1 2023-02-10 19:03:02,796 INFO [StoreOpener-aff2d18d26e1916478e05b25bb5c9a89-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region aff2d18d26e1916478e05b25bb5c9a89 columnFamilyName f1 2023-02-10 19:03:02,796 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce ab9c3c4ad85b22b109e239684647572c 2023-02-10 19:03:02,796 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,t43,1676055781936.ab9c3c4ad85b22b109e239684647572c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-10 19:03:02,796 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for ab9c3c4ad85b22b109e239684647572c 2023-02-10 19:03:02,796 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for ab9c3c4ad85b22b109e239684647572c 2023-02-10 19:03:02,796 INFO [StoreOpener-aff2d18d26e1916478e05b25bb5c9a89-1] regionserver.HStore(310): Store=aff2d18d26e1916478e05b25bb5c9a89/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-10 19:03:02,797 INFO [StoreOpener-aff2d18d26e1916478e05b25bb5c9a89-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region aff2d18d26e1916478e05b25bb5c9a89 2023-02-10 19:03:02,798 DEBUG [StoreOpener-aff2d18d26e1916478e05b25bb5c9a89-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/data/default/testWithMapReduce/aff2d18d26e1916478e05b25bb5c9a89/f2 2023-02-10 19:03:02,798 DEBUG [StoreOpener-aff2d18d26e1916478e05b25bb5c9a89-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/data/default/testWithMapReduce/aff2d18d26e1916478e05b25bb5c9a89/f2 2023-02-10 19:03:02,799 INFO [StoreOpener-aff2d18d26e1916478e05b25bb5c9a89-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region aff2d18d26e1916478e05b25bb5c9a89 columnFamilyName f2 2023-02-10 19:03:02,799 INFO [StoreOpener-ab9c3c4ad85b22b109e239684647572c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region ab9c3c4ad85b22b109e239684647572c 2023-02-10 19:03:02,799 INFO [StoreOpener-aff2d18d26e1916478e05b25bb5c9a89-1] regionserver.HStore(310): Store=aff2d18d26e1916478e05b25bb5c9a89/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-10 19:03:02,800 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/data/default/testWithMapReduce/aff2d18d26e1916478e05b25bb5c9a89 2023-02-10 19:03:02,801 DEBUG [StoreOpener-ab9c3c4ad85b22b109e239684647572c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/data/default/testWithMapReduce/ab9c3c4ad85b22b109e239684647572c/f1 2023-02-10 19:03:02,801 DEBUG [StoreOpener-ab9c3c4ad85b22b109e239684647572c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/data/default/testWithMapReduce/ab9c3c4ad85b22b109e239684647572c/f1 2023-02-10 19:03:02,801 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/data/default/testWithMapReduce/aff2d18d26e1916478e05b25bb5c9a89 2023-02-10 19:03:02,801 INFO [StoreOpener-ab9c3c4ad85b22b109e239684647572c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ab9c3c4ad85b22b109e239684647572c columnFamilyName f1 2023-02-10 19:03:02,802 INFO [StoreOpener-ab9c3c4ad85b22b109e239684647572c-1] regionserver.HStore(310): Store=ab9c3c4ad85b22b109e239684647572c/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-10 19:03:02,802 INFO [StoreOpener-ab9c3c4ad85b22b109e239684647572c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region ab9c3c4ad85b22b109e239684647572c 2023-02-10 19:03:02,803 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-10 19:03:02,803 DEBUG [StoreOpener-ab9c3c4ad85b22b109e239684647572c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/data/default/testWithMapReduce/ab9c3c4ad85b22b109e239684647572c/f2 2023-02-10 19:03:02,803 DEBUG [StoreOpener-ab9c3c4ad85b22b109e239684647572c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/data/default/testWithMapReduce/ab9c3c4ad85b22b109e239684647572c/f2 2023-02-10 19:03:02,804 INFO [StoreOpener-ab9c3c4ad85b22b109e239684647572c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ab9c3c4ad85b22b109e239684647572c columnFamilyName f2 2023-02-10 19:03:02,804 INFO [StoreOpener-ab9c3c4ad85b22b109e239684647572c-1] regionserver.HStore(310): Store=ab9c3c4ad85b22b109e239684647572c/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-10 19:03:02,804 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for aff2d18d26e1916478e05b25bb5c9a89 2023-02-10 19:03:02,805 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/data/default/testWithMapReduce/ab9c3c4ad85b22b109e239684647572c 2023-02-10 19:03:02,805 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/data/default/testWithMapReduce/ab9c3c4ad85b22b109e239684647572c 2023-02-10 19:03:02,807 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/data/default/testWithMapReduce/aff2d18d26e1916478e05b25bb5c9a89/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-10 19:03:02,807 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened aff2d18d26e1916478e05b25bb5c9a89; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61252689, jitterRate=-0.0872638076543808}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-10 19:03:02,807 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for aff2d18d26e1916478e05b25bb5c9a89: Running coprocessor pre-open hook at 1676055782790Writing region info on filesystem at 1676055782790Initializing all the Stores at 1676055782790Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676055782791 (+1 ms)Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676055782792 (+1 ms)Cleaning up temporary data from old regions at 1676055782802 (+10 ms)Cleaning up detritus from prior splits at 1676055782802Running coprocessor post-open hooks at 1676055782807 (+5 ms)Region opened successfully at 1676055782807 2023-02-10 19:03:02,807 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-10 19:03:02,808 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,zz{,1676055781936.aff2d18d26e1916478e05b25bb5c9a89., pid=24, masterSystemTime=1676055782763 2023-02-10 19:03:02,809 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for ab9c3c4ad85b22b109e239684647572c 2023-02-10 19:03:02,810 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,zz{,1676055781936.aff2d18d26e1916478e05b25bb5c9a89. 2023-02-10 19:03:02,810 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,zz{,1676055781936.aff2d18d26e1916478e05b25bb5c9a89. 2023-02-10 19:03:02,810 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,aaa,1676055781936.d1ba49f10de14d81a2fad0498c59a9b7. 2023-02-10 19:03:02,811 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => d1ba49f10de14d81a2fad0498c59a9b7, NAME => 'testWithMapReduce,aaa,1676055781936.d1ba49f10de14d81a2fad0498c59a9b7.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'} 2023-02-10 19:03:02,811 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce d1ba49f10de14d81a2fad0498c59a9b7 2023-02-10 19:03:02,811 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,aaa,1676055781936.d1ba49f10de14d81a2fad0498c59a9b7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-10 19:03:02,811 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for d1ba49f10de14d81a2fad0498c59a9b7 2023-02-10 19:03:02,811 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=aff2d18d26e1916478e05b25bb5c9a89, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,38097,1676055780236 2023-02-10 19:03:02,811 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for d1ba49f10de14d81a2fad0498c59a9b7 2023-02-10 19:03:02,811 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,zz{,1676055781936.aff2d18d26e1916478e05b25bb5c9a89.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676055782811"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676055782811"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676055782811"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676055782811"}]},"ts":"1676055782811"} 2023-02-10 19:03:02,814 INFO [StoreOpener-d1ba49f10de14d81a2fad0498c59a9b7-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region d1ba49f10de14d81a2fad0498c59a9b7 2023-02-10 19:03:02,814 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/data/default/testWithMapReduce/ab9c3c4ad85b22b109e239684647572c/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-10 19:03:02,815 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened ab9c3c4ad85b22b109e239684647572c; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61954506, jitterRate=-0.07680591940879822}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-10 19:03:02,815 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for ab9c3c4ad85b22b109e239684647572c: Running coprocessor pre-open hook at 1676055782796Writing region info on filesystem at 1676055782796Initializing all the Stores at 1676055782797 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676055782797Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676055782799 (+2 ms)Cleaning up temporary data from old regions at 1676055782806 (+7 ms)Cleaning up detritus from prior splits at 1676055782807 (+1 ms)Running coprocessor post-open hooks at 1676055782815 (+8 ms)Region opened successfully at 1676055782815 2023-02-10 19:03:02,816 DEBUG [StoreOpener-d1ba49f10de14d81a2fad0498c59a9b7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/data/default/testWithMapReduce/d1ba49f10de14d81a2fad0498c59a9b7/f1 2023-02-10 19:03:02,816 DEBUG [StoreOpener-d1ba49f10de14d81a2fad0498c59a9b7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/data/default/testWithMapReduce/d1ba49f10de14d81a2fad0498c59a9b7/f1 2023-02-10 19:03:02,816 INFO [StoreOpener-d1ba49f10de14d81a2fad0498c59a9b7-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d1ba49f10de14d81a2fad0498c59a9b7 columnFamilyName f1 2023-02-10 19:03:02,817 INFO [StoreOpener-d1ba49f10de14d81a2fad0498c59a9b7-1] regionserver.HStore(310): Store=d1ba49f10de14d81a2fad0498c59a9b7/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-10 19:03:02,817 INFO [StoreOpener-d1ba49f10de14d81a2fad0498c59a9b7-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region d1ba49f10de14d81a2fad0498c59a9b7 2023-02-10 19:03:02,817 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,t43,1676055781936.ab9c3c4ad85b22b109e239684647572c., pid=27, masterSystemTime=1676055782786 2023-02-10 19:03:02,818 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=24, resume processing ppid=20 2023-02-10 19:03:02,818 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=24, ppid=20, state=SUCCESS; OpenRegionProcedure aff2d18d26e1916478e05b25bb5c9a89, server=jenkins-hbase4.apache.org,38097,1676055780236 in 202 msec 2023-02-10 19:03:02,820 DEBUG [StoreOpener-d1ba49f10de14d81a2fad0498c59a9b7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/data/default/testWithMapReduce/d1ba49f10de14d81a2fad0498c59a9b7/f2 2023-02-10 19:03:02,820 DEBUG [StoreOpener-d1ba49f10de14d81a2fad0498c59a9b7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/data/default/testWithMapReduce/d1ba49f10de14d81a2fad0498c59a9b7/f2 2023-02-10 19:03:02,820 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=18 updating hbase:meta row=ab9c3c4ad85b22b109e239684647572c, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,35609,1676055780283 2023-02-10 19:03:02,820 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=20, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=aff2d18d26e1916478e05b25bb5c9a89, ASSIGN in 381 msec 2023-02-10 19:03:02,820 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,t43,1676055781936.ab9c3c4ad85b22b109e239684647572c.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676055782820"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676055782820"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676055782820"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676055782820"}]},"ts":"1676055782820"} 2023-02-10 19:03:02,820 INFO [StoreOpener-d1ba49f10de14d81a2fad0498c59a9b7-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d1ba49f10de14d81a2fad0498c59a9b7 columnFamilyName f2 2023-02-10 19:03:02,821 INFO [StoreOpener-d1ba49f10de14d81a2fad0498c59a9b7-1] regionserver.HStore(310): Store=d1ba49f10de14d81a2fad0498c59a9b7/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-10 19:03:02,821 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,t43,1676055781936.ab9c3c4ad85b22b109e239684647572c. 2023-02-10 19:03:02,821 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,t43,1676055781936.ab9c3c4ad85b22b109e239684647572c. 2023-02-10 19:03:02,821 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,,1676055781936.fe00f1c4e3fbcd6d7560c2506ad6ca19. 2023-02-10 19:03:02,822 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => fe00f1c4e3fbcd6d7560c2506ad6ca19, NAME => 'testWithMapReduce,,1676055781936.fe00f1c4e3fbcd6d7560c2506ad6ca19.', STARTKEY => '', ENDKEY => 'aaa'} 2023-02-10 19:03:02,822 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce fe00f1c4e3fbcd6d7560c2506ad6ca19 2023-02-10 19:03:02,822 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676055781936.fe00f1c4e3fbcd6d7560c2506ad6ca19.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-10 19:03:02,822 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for fe00f1c4e3fbcd6d7560c2506ad6ca19 2023-02-10 19:03:02,822 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for fe00f1c4e3fbcd6d7560c2506ad6ca19 2023-02-10 19:03:02,822 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/data/default/testWithMapReduce/d1ba49f10de14d81a2fad0498c59a9b7 2023-02-10 19:03:02,823 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/data/default/testWithMapReduce/d1ba49f10de14d81a2fad0498c59a9b7 2023-02-10 19:03:02,824 INFO [StoreOpener-fe00f1c4e3fbcd6d7560c2506ad6ca19-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region fe00f1c4e3fbcd6d7560c2506ad6ca19 2023-02-10 19:03:02,825 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=27, resume processing ppid=18 2023-02-10 19:03:02,825 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=27, ppid=18, state=SUCCESS; OpenRegionProcedure ab9c3c4ad85b22b109e239684647572c, server=jenkins-hbase4.apache.org,35609,1676055780283 in 195 msec 2023-02-10 19:03:02,826 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-10 19:03:02,827 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=18, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=ab9c3c4ad85b22b109e239684647572c, ASSIGN in 388 msec 2023-02-10 19:03:02,828 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for d1ba49f10de14d81a2fad0498c59a9b7 2023-02-10 19:03:02,828 DEBUG [StoreOpener-fe00f1c4e3fbcd6d7560c2506ad6ca19-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/data/default/testWithMapReduce/fe00f1c4e3fbcd6d7560c2506ad6ca19/f1 2023-02-10 19:03:02,828 DEBUG [StoreOpener-fe00f1c4e3fbcd6d7560c2506ad6ca19-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/data/default/testWithMapReduce/fe00f1c4e3fbcd6d7560c2506ad6ca19/f1 2023-02-10 19:03:02,829 INFO [StoreOpener-fe00f1c4e3fbcd6d7560c2506ad6ca19-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region fe00f1c4e3fbcd6d7560c2506ad6ca19 columnFamilyName f1 2023-02-10 19:03:02,830 INFO [StoreOpener-fe00f1c4e3fbcd6d7560c2506ad6ca19-1] regionserver.HStore(310): Store=fe00f1c4e3fbcd6d7560c2506ad6ca19/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-10 19:03:02,830 INFO [StoreOpener-fe00f1c4e3fbcd6d7560c2506ad6ca19-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region fe00f1c4e3fbcd6d7560c2506ad6ca19 2023-02-10 19:03:02,830 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/data/default/testWithMapReduce/d1ba49f10de14d81a2fad0498c59a9b7/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-10 19:03:02,830 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened d1ba49f10de14d81a2fad0498c59a9b7; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70486931, jitterRate=0.05033712089061737}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-10 19:03:02,831 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for d1ba49f10de14d81a2fad0498c59a9b7: Running coprocessor pre-open hook at 1676055782811Writing region info on filesystem at 1676055782811Initializing all the Stores at 1676055782813 (+2 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676055782814 (+1 ms)Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676055782814Cleaning up temporary data from old regions at 1676055782824 (+10 ms)Cleaning up detritus from prior splits at 1676055782825 (+1 ms)Running coprocessor post-open hooks at 1676055782831 (+6 ms)Region opened successfully at 1676055782831 2023-02-10 19:03:02,832 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,aaa,1676055781936.d1ba49f10de14d81a2fad0498c59a9b7., pid=23, masterSystemTime=1676055782763 2023-02-10 19:03:02,832 DEBUG [StoreOpener-fe00f1c4e3fbcd6d7560c2506ad6ca19-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/data/default/testWithMapReduce/fe00f1c4e3fbcd6d7560c2506ad6ca19/f2 2023-02-10 19:03:02,832 DEBUG [StoreOpener-fe00f1c4e3fbcd6d7560c2506ad6ca19-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/data/default/testWithMapReduce/fe00f1c4e3fbcd6d7560c2506ad6ca19/f2 2023-02-10 19:03:02,833 INFO [StoreOpener-fe00f1c4e3fbcd6d7560c2506ad6ca19-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region fe00f1c4e3fbcd6d7560c2506ad6ca19 columnFamilyName f2 2023-02-10 19:03:02,833 INFO [StoreOpener-fe00f1c4e3fbcd6d7560c2506ad6ca19-1] regionserver.HStore(310): Store=fe00f1c4e3fbcd6d7560c2506ad6ca19/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-10 19:03:02,834 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/data/default/testWithMapReduce/fe00f1c4e3fbcd6d7560c2506ad6ca19 2023-02-10 19:03:02,834 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/data/default/testWithMapReduce/fe00f1c4e3fbcd6d7560c2506ad6ca19 2023-02-10 19:03:02,836 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,aaa,1676055781936.d1ba49f10de14d81a2fad0498c59a9b7. 2023-02-10 19:03:02,836 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=12 updating hbase:meta row=d1ba49f10de14d81a2fad0498c59a9b7, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,38097,1676055780236 2023-02-10 19:03:02,837 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,aaa,1676055781936.d1ba49f10de14d81a2fad0498c59a9b7.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676055782836"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676055782836"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676055782836"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676055782836"}]},"ts":"1676055782836"} 2023-02-10 19:03:02,837 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-10 19:03:02,837 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,aaa,1676055781936.d1ba49f10de14d81a2fad0498c59a9b7. 2023-02-10 19:03:02,837 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,j\xCA\xCA,1676055781936.3c13d5e817a81b6f4b36ab3d9762b76f. 2023-02-10 19:03:02,837 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 3c13d5e817a81b6f4b36ab3d9762b76f, NAME => 'testWithMapReduce,j\xCA\xCA,1676055781936.3c13d5e817a81b6f4b36ab3d9762b76f.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'} 2023-02-10 19:03:02,837 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 3c13d5e817a81b6f4b36ab3d9762b76f 2023-02-10 19:03:02,837 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,j\xCA\xCA,1676055781936.3c13d5e817a81b6f4b36ab3d9762b76f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-10 19:03:02,838 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 3c13d5e817a81b6f4b36ab3d9762b76f 2023-02-10 19:03:02,838 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 3c13d5e817a81b6f4b36ab3d9762b76f 2023-02-10 19:03:02,840 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for fe00f1c4e3fbcd6d7560c2506ad6ca19 2023-02-10 19:03:02,841 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=23, resume processing ppid=12 2023-02-10 19:03:02,841 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=23, ppid=12, state=SUCCESS; OpenRegionProcedure d1ba49f10de14d81a2fad0498c59a9b7, server=jenkins-hbase4.apache.org,38097,1676055780236 in 227 msec 2023-02-10 19:03:02,842 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=12, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=d1ba49f10de14d81a2fad0498c59a9b7, ASSIGN in 404 msec 2023-02-10 19:03:02,844 INFO [StoreOpener-3c13d5e817a81b6f4b36ab3d9762b76f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 3c13d5e817a81b6f4b36ab3d9762b76f 2023-02-10 19:03:02,845 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/data/default/testWithMapReduce/fe00f1c4e3fbcd6d7560c2506ad6ca19/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-10 19:03:02,845 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened fe00f1c4e3fbcd6d7560c2506ad6ca19; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60414432, jitterRate=-0.09975481033325195}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-10 19:03:02,845 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for fe00f1c4e3fbcd6d7560c2506ad6ca19: Running coprocessor pre-open hook at 1676055782822Writing region info on filesystem at 1676055782822Initializing all the Stores at 1676055782823 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676055782823Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676055782823Cleaning up temporary data from old regions at 1676055782835 (+12 ms)Cleaning up detritus from prior splits at 1676055782836 (+1 ms)Running coprocessor post-open hooks at 1676055782845 (+9 ms)Region opened successfully at 1676055782845 2023-02-10 19:03:02,846 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,,1676055781936.fe00f1c4e3fbcd6d7560c2506ad6ca19., pid=26, masterSystemTime=1676055782786 2023-02-10 19:03:02,847 DEBUG [StoreOpener-3c13d5e817a81b6f4b36ab3d9762b76f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/data/default/testWithMapReduce/3c13d5e817a81b6f4b36ab3d9762b76f/f1 2023-02-10 19:03:02,847 DEBUG [StoreOpener-3c13d5e817a81b6f4b36ab3d9762b76f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/data/default/testWithMapReduce/3c13d5e817a81b6f4b36ab3d9762b76f/f1 2023-02-10 19:03:02,848 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,,1676055781936.fe00f1c4e3fbcd6d7560c2506ad6ca19. 2023-02-10 19:03:02,848 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,,1676055781936.fe00f1c4e3fbcd6d7560c2506ad6ca19. 2023-02-10 19:03:02,848 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,g\xA7\xA7,1676055781936.f3c4392d756ce5e5e061ef2cb63d0fce. 2023-02-10 19:03:02,848 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => f3c4392d756ce5e5e061ef2cb63d0fce, NAME => 'testWithMapReduce,g\xA7\xA7,1676055781936.f3c4392d756ce5e5e061ef2cb63d0fce.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'} 2023-02-10 19:03:02,848 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=fe00f1c4e3fbcd6d7560c2506ad6ca19, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,35609,1676055780283 2023-02-10 19:03:02,848 INFO [StoreOpener-3c13d5e817a81b6f4b36ab3d9762b76f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3c13d5e817a81b6f4b36ab3d9762b76f columnFamilyName f1 2023-02-10 19:03:02,848 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,,1676055781936.fe00f1c4e3fbcd6d7560c2506ad6ca19.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676055782848"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676055782848"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676055782848"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676055782848"}]},"ts":"1676055782848"} 2023-02-10 19:03:02,849 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce f3c4392d756ce5e5e061ef2cb63d0fce 2023-02-10 19:03:02,849 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,g\xA7\xA7,1676055781936.f3c4392d756ce5e5e061ef2cb63d0fce.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-10 19:03:02,849 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for f3c4392d756ce5e5e061ef2cb63d0fce 2023-02-10 19:03:02,849 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for f3c4392d756ce5e5e061ef2cb63d0fce 2023-02-10 19:03:02,850 INFO [StoreOpener-3c13d5e817a81b6f4b36ab3d9762b76f-1] regionserver.HStore(310): Store=3c13d5e817a81b6f4b36ab3d9762b76f/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-10 19:03:02,850 INFO [StoreOpener-3c13d5e817a81b6f4b36ab3d9762b76f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 3c13d5e817a81b6f4b36ab3d9762b76f 2023-02-10 19:03:02,852 DEBUG [StoreOpener-3c13d5e817a81b6f4b36ab3d9762b76f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/data/default/testWithMapReduce/3c13d5e817a81b6f4b36ab3d9762b76f/f2 2023-02-10 19:03:02,852 DEBUG [StoreOpener-3c13d5e817a81b6f4b36ab3d9762b76f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/data/default/testWithMapReduce/3c13d5e817a81b6f4b36ab3d9762b76f/f2 2023-02-10 19:03:02,852 INFO [StoreOpener-3c13d5e817a81b6f4b36ab3d9762b76f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3c13d5e817a81b6f4b36ab3d9762b76f columnFamilyName f2 2023-02-10 19:03:02,853 INFO [StoreOpener-3c13d5e817a81b6f4b36ab3d9762b76f-1] regionserver.HStore(310): Store=3c13d5e817a81b6f4b36ab3d9762b76f/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-10 19:03:02,855 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=26, resume processing ppid=11 2023-02-10 19:03:02,855 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=26, ppid=11, state=SUCCESS; OpenRegionProcedure fe00f1c4e3fbcd6d7560c2506ad6ca19, server=jenkins-hbase4.apache.org,35609,1676055780283 in 223 msec 2023-02-10 19:03:02,856 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=fe00f1c4e3fbcd6d7560c2506ad6ca19, ASSIGN in 418 msec 2023-02-10 19:03:02,856 INFO [StoreOpener-f3c4392d756ce5e5e061ef2cb63d0fce-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region f3c4392d756ce5e5e061ef2cb63d0fce 2023-02-10 19:03:02,857 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/data/default/testWithMapReduce/3c13d5e817a81b6f4b36ab3d9762b76f 2023-02-10 19:03:02,857 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/data/default/testWithMapReduce/3c13d5e817a81b6f4b36ab3d9762b76f 2023-02-10 19:03:02,858 DEBUG [StoreOpener-f3c4392d756ce5e5e061ef2cb63d0fce-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/data/default/testWithMapReduce/f3c4392d756ce5e5e061ef2cb63d0fce/f1 2023-02-10 19:03:02,858 DEBUG [StoreOpener-f3c4392d756ce5e5e061ef2cb63d0fce-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/data/default/testWithMapReduce/f3c4392d756ce5e5e061ef2cb63d0fce/f1 2023-02-10 19:03:02,858 INFO [StoreOpener-f3c4392d756ce5e5e061ef2cb63d0fce-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f3c4392d756ce5e5e061ef2cb63d0fce columnFamilyName f1 2023-02-10 19:03:02,859 INFO [StoreOpener-f3c4392d756ce5e5e061ef2cb63d0fce-1] regionserver.HStore(310): Store=f3c4392d756ce5e5e061ef2cb63d0fce/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-10 19:03:02,859 INFO [StoreOpener-f3c4392d756ce5e5e061ef2cb63d0fce-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region f3c4392d756ce5e5e061ef2cb63d0fce 2023-02-10 19:03:02,860 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-10 19:03:02,860 DEBUG [StoreOpener-f3c4392d756ce5e5e061ef2cb63d0fce-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/data/default/testWithMapReduce/f3c4392d756ce5e5e061ef2cb63d0fce/f2 2023-02-10 19:03:02,861 DEBUG [StoreOpener-f3c4392d756ce5e5e061ef2cb63d0fce-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/data/default/testWithMapReduce/f3c4392d756ce5e5e061ef2cb63d0fce/f2 2023-02-10 19:03:02,861 INFO [StoreOpener-f3c4392d756ce5e5e061ef2cb63d0fce-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f3c4392d756ce5e5e061ef2cb63d0fce columnFamilyName f2 2023-02-10 19:03:02,861 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 3c13d5e817a81b6f4b36ab3d9762b76f 2023-02-10 19:03:02,861 INFO [StoreOpener-f3c4392d756ce5e5e061ef2cb63d0fce-1] regionserver.HStore(310): Store=f3c4392d756ce5e5e061ef2cb63d0fce/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-10 19:03:02,862 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/data/default/testWithMapReduce/f3c4392d756ce5e5e061ef2cb63d0fce 2023-02-10 19:03:02,863 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/data/default/testWithMapReduce/f3c4392d756ce5e5e061ef2cb63d0fce 2023-02-10 19:03:02,864 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/data/default/testWithMapReduce/3c13d5e817a81b6f4b36ab3d9762b76f/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-10 19:03:02,865 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 3c13d5e817a81b6f4b36ab3d9762b76f; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60692301, jitterRate=-0.0956142395734787}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-10 19:03:02,865 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 3c13d5e817a81b6f4b36ab3d9762b76f: Running coprocessor pre-open hook at 1676055782838Writing region info on filesystem at 1676055782838Initializing all the Stores at 1676055782839 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676055782839Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676055782844 (+5 ms)Cleaning up temporary data from old regions at 1676055782858 (+14 ms)Cleaning up detritus from prior splits at 1676055782859 (+1 ms)Running coprocessor post-open hooks at 1676055782865 (+6 ms)Region opened successfully at 1676055782865 2023-02-10 19:03:02,865 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-10 19:03:02,866 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,j\xCA\xCA,1676055781936.3c13d5e817a81b6f4b36ab3d9762b76f., pid=22, masterSystemTime=1676055782763 2023-02-10 19:03:02,866 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for f3c4392d756ce5e5e061ef2cb63d0fce 2023-02-10 19:03:02,868 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,j\xCA\xCA,1676055781936.3c13d5e817a81b6f4b36ab3d9762b76f. 2023-02-10 19:03:02,868 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,j\xCA\xCA,1676055781936.3c13d5e817a81b6f4b36ab3d9762b76f. 2023-02-10 19:03:02,868 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,q\x11\x10,1676055781936.c47924fd805c4df26e6e9e860c542007. 2023-02-10 19:03:02,868 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => c47924fd805c4df26e6e9e860c542007, NAME => 'testWithMapReduce,q\x11\x10,1676055781936.c47924fd805c4df26e6e9e860c542007.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'} 2023-02-10 19:03:02,868 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce c47924fd805c4df26e6e9e860c542007 2023-02-10 19:03:02,868 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,q\x11\x10,1676055781936.c47924fd805c4df26e6e9e860c542007.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-10 19:03:02,868 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for c47924fd805c4df26e6e9e860c542007 2023-02-10 19:03:02,868 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for c47924fd805c4df26e6e9e860c542007 2023-02-10 19:03:02,869 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=3c13d5e817a81b6f4b36ab3d9762b76f, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,38097,1676055780236 2023-02-10 19:03:02,869 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,j\\xCA\\xCA,1676055781936.3c13d5e817a81b6f4b36ab3d9762b76f.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676055782868"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676055782868"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676055782868"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676055782868"}]},"ts":"1676055782868"} 2023-02-10 19:03:02,869 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/data/default/testWithMapReduce/f3c4392d756ce5e5e061ef2cb63d0fce/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-10 19:03:02,870 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened f3c4392d756ce5e5e061ef2cb63d0fce; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74094223, jitterRate=0.10408996045589447}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-10 19:03:02,870 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for f3c4392d756ce5e5e061ef2cb63d0fce: Running coprocessor pre-open hook at 1676055782849Writing region info on filesystem at 1676055782849Initializing all the Stores at 1676055782850 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676055782850Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676055782856 (+6 ms)Cleaning up temporary data from old regions at 1676055782864 (+8 ms)Cleaning up detritus from prior splits at 1676055782864Running coprocessor post-open hooks at 1676055782870 (+6 ms)Region opened successfully at 1676055782870 2023-02-10 19:03:02,870 INFO [StoreOpener-c47924fd805c4df26e6e9e860c542007-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region c47924fd805c4df26e6e9e860c542007 2023-02-10 19:03:02,871 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,g\xA7\xA7,1676055781936.f3c4392d756ce5e5e061ef2cb63d0fce., pid=29, masterSystemTime=1676055782786 2023-02-10 19:03:02,874 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=22, resume processing ppid=15 2023-02-10 19:03:02,874 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,g\xA7\xA7,1676055781936.f3c4392d756ce5e5e061ef2cb63d0fce. 2023-02-10 19:03:02,874 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=22, ppid=15, state=SUCCESS; OpenRegionProcedure 3c13d5e817a81b6f4b36ab3d9762b76f, server=jenkins-hbase4.apache.org,38097,1676055780236 in 261 msec 2023-02-10 19:03:02,874 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,g\xA7\xA7,1676055781936.f3c4392d756ce5e5e061ef2cb63d0fce. 2023-02-10 19:03:02,874 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,wWV,1676055781936.4dfcfb14720b0f66e0e9179835dbe61d. 2023-02-10 19:03:02,874 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 4dfcfb14720b0f66e0e9179835dbe61d, NAME => 'testWithMapReduce,wWV,1676055781936.4dfcfb14720b0f66e0e9179835dbe61d.', STARTKEY => 'wWV', ENDKEY => 'zz{'} 2023-02-10 19:03:02,875 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 4dfcfb14720b0f66e0e9179835dbe61d 2023-02-10 19:03:02,875 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,wWV,1676055781936.4dfcfb14720b0f66e0e9179835dbe61d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-10 19:03:02,875 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 4dfcfb14720b0f66e0e9179835dbe61d 2023-02-10 19:03:02,875 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 4dfcfb14720b0f66e0e9179835dbe61d 2023-02-10 19:03:02,875 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=f3c4392d756ce5e5e061ef2cb63d0fce, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,35609,1676055780283 2023-02-10 19:03:02,875 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,g\\xA7\\xA7,1676055781936.f3c4392d756ce5e5e061ef2cb63d0fce.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676055782875"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676055782875"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676055782875"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676055782875"}]},"ts":"1676055782875"} 2023-02-10 19:03:02,876 DEBUG [StoreOpener-c47924fd805c4df26e6e9e860c542007-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/data/default/testWithMapReduce/c47924fd805c4df26e6e9e860c542007/f1 2023-02-10 19:03:02,876 DEBUG [StoreOpener-c47924fd805c4df26e6e9e860c542007-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/data/default/testWithMapReduce/c47924fd805c4df26e6e9e860c542007/f1 2023-02-10 19:03:02,877 INFO [StoreOpener-c47924fd805c4df26e6e9e860c542007-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c47924fd805c4df26e6e9e860c542007 columnFamilyName f1 2023-02-10 19:03:02,877 INFO [StoreOpener-c47924fd805c4df26e6e9e860c542007-1] regionserver.HStore(310): Store=c47924fd805c4df26e6e9e860c542007/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-10 19:03:02,878 INFO [StoreOpener-c47924fd805c4df26e6e9e860c542007-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region c47924fd805c4df26e6e9e860c542007 2023-02-10 19:03:02,878 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=15, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=3c13d5e817a81b6f4b36ab3d9762b76f, ASSIGN in 437 msec 2023-02-10 19:03:02,879 DEBUG [StoreOpener-c47924fd805c4df26e6e9e860c542007-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/data/default/testWithMapReduce/c47924fd805c4df26e6e9e860c542007/f2 2023-02-10 19:03:02,879 DEBUG [StoreOpener-c47924fd805c4df26e6e9e860c542007-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/data/default/testWithMapReduce/c47924fd805c4df26e6e9e860c542007/f2 2023-02-10 19:03:02,879 INFO [StoreOpener-4dfcfb14720b0f66e0e9179835dbe61d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 4dfcfb14720b0f66e0e9179835dbe61d 2023-02-10 19:03:02,880 INFO [StoreOpener-c47924fd805c4df26e6e9e860c542007-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c47924fd805c4df26e6e9e860c542007 columnFamilyName f2 2023-02-10 19:03:02,880 INFO [StoreOpener-c47924fd805c4df26e6e9e860c542007-1] regionserver.HStore(310): Store=c47924fd805c4df26e6e9e860c542007/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-10 19:03:02,881 DEBUG [StoreOpener-4dfcfb14720b0f66e0e9179835dbe61d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/data/default/testWithMapReduce/4dfcfb14720b0f66e0e9179835dbe61d/f1 2023-02-10 19:03:02,881 DEBUG [StoreOpener-4dfcfb14720b0f66e0e9179835dbe61d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/data/default/testWithMapReduce/4dfcfb14720b0f66e0e9179835dbe61d/f1 2023-02-10 19:03:02,881 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=29, resume processing ppid=14 2023-02-10 19:03:02,881 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=29, ppid=14, state=SUCCESS; OpenRegionProcedure f3c4392d756ce5e5e061ef2cb63d0fce, server=jenkins-hbase4.apache.org,35609,1676055780283 in 242 msec 2023-02-10 19:03:02,882 INFO [StoreOpener-4dfcfb14720b0f66e0e9179835dbe61d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4dfcfb14720b0f66e0e9179835dbe61d columnFamilyName f1 2023-02-10 19:03:02,882 INFO [StoreOpener-4dfcfb14720b0f66e0e9179835dbe61d-1] regionserver.HStore(310): Store=4dfcfb14720b0f66e0e9179835dbe61d/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-10 19:03:02,883 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=14, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=f3c4392d756ce5e5e061ef2cb63d0fce, ASSIGN in 444 msec 2023-02-10 19:03:02,883 INFO [StoreOpener-4dfcfb14720b0f66e0e9179835dbe61d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 4dfcfb14720b0f66e0e9179835dbe61d 2023-02-10 19:03:02,883 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/data/default/testWithMapReduce/c47924fd805c4df26e6e9e860c542007 2023-02-10 19:03:02,883 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/data/default/testWithMapReduce/c47924fd805c4df26e6e9e860c542007 2023-02-10 19:03:02,884 DEBUG [StoreOpener-4dfcfb14720b0f66e0e9179835dbe61d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/data/default/testWithMapReduce/4dfcfb14720b0f66e0e9179835dbe61d/f2 2023-02-10 19:03:02,884 DEBUG [StoreOpener-4dfcfb14720b0f66e0e9179835dbe61d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/data/default/testWithMapReduce/4dfcfb14720b0f66e0e9179835dbe61d/f2 2023-02-10 19:03:02,884 INFO [StoreOpener-4dfcfb14720b0f66e0e9179835dbe61d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4dfcfb14720b0f66e0e9179835dbe61d columnFamilyName f2 2023-02-10 19:03:02,885 INFO [StoreOpener-4dfcfb14720b0f66e0e9179835dbe61d-1] regionserver.HStore(310): Store=4dfcfb14720b0f66e0e9179835dbe61d/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-10 19:03:02,886 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/data/default/testWithMapReduce/4dfcfb14720b0f66e0e9179835dbe61d 2023-02-10 19:03:02,886 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-10 19:03:02,887 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/data/default/testWithMapReduce/4dfcfb14720b0f66e0e9179835dbe61d 2023-02-10 19:03:02,889 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for c47924fd805c4df26e6e9e860c542007 2023-02-10 19:03:02,889 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-10 19:03:02,890 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 4dfcfb14720b0f66e0e9179835dbe61d 2023-02-10 19:03:02,894 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/data/default/testWithMapReduce/c47924fd805c4df26e6e9e860c542007/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-10 19:03:02,894 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/data/default/testWithMapReduce/4dfcfb14720b0f66e0e9179835dbe61d/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-10 19:03:02,895 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened c47924fd805c4df26e6e9e860c542007; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59993462, jitterRate=-0.106027752161026}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-10 19:03:02,895 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 4dfcfb14720b0f66e0e9179835dbe61d; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=75168648, jitterRate=0.12010014057159424}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-10 19:03:02,895 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for c47924fd805c4df26e6e9e860c542007: Running coprocessor pre-open hook at 1676055782869Writing region info on filesystem at 1676055782869Initializing all the Stores at 1676055782869Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676055782869Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676055782870 (+1 ms)Cleaning up temporary data from old regions at 1676055782885 (+15 ms)Cleaning up detritus from prior splits at 1676055782885Running coprocessor post-open hooks at 1676055782895 (+10 ms)Region opened successfully at 1676055782895 2023-02-10 19:03:02,895 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 4dfcfb14720b0f66e0e9179835dbe61d: Running coprocessor pre-open hook at 1676055782875Writing region info on filesystem at 1676055782875Initializing all the Stores at 1676055782876 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676055782876Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676055782879 (+3 ms)Cleaning up temporary data from old regions at 1676055782887 (+8 ms)Cleaning up detritus from prior splits at 1676055782888 (+1 ms)Running coprocessor post-open hooks at 1676055782895 (+7 ms)Region opened successfully at 1676055782895 2023-02-10 19:03:02,896 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,wWV,1676055781936.4dfcfb14720b0f66e0e9179835dbe61d., pid=28, masterSystemTime=1676055782786 2023-02-10 19:03:02,896 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,q\x11\x10,1676055781936.c47924fd805c4df26e6e9e860c542007., pid=25, masterSystemTime=1676055782763 2023-02-10 19:03:02,898 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,wWV,1676055781936.4dfcfb14720b0f66e0e9179835dbe61d. 2023-02-10 19:03:02,898 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,wWV,1676055781936.4dfcfb14720b0f66e0e9179835dbe61d. 2023-02-10 19:03:02,898 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,m\xED\xED,1676055781936.ceccc0adc99b7adc17715506edd714a5. 2023-02-10 19:03:02,898 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => ceccc0adc99b7adc17715506edd714a5, NAME => 'testWithMapReduce,m\xED\xED,1676055781936.ceccc0adc99b7adc17715506edd714a5.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'} 2023-02-10 19:03:02,898 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=19 updating hbase:meta row=4dfcfb14720b0f66e0e9179835dbe61d, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,35609,1676055780283 2023-02-10 19:03:02,899 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce ceccc0adc99b7adc17715506edd714a5 2023-02-10 19:03:02,899 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,wWV,1676055781936.4dfcfb14720b0f66e0e9179835dbe61d.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676055782898"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676055782898"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676055782898"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676055782898"}]},"ts":"1676055782898"} 2023-02-10 19:03:02,899 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,m\xED\xED,1676055781936.ceccc0adc99b7adc17715506edd714a5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-10 19:03:02,899 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,q\x11\x10,1676055781936.c47924fd805c4df26e6e9e860c542007. 2023-02-10 19:03:02,899 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for ceccc0adc99b7adc17715506edd714a5 2023-02-10 19:03:02,899 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for ceccc0adc99b7adc17715506edd714a5 2023-02-10 19:03:02,899 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=17 updating hbase:meta row=c47924fd805c4df26e6e9e860c542007, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,38097,1676055780236 2023-02-10 19:03:02,899 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,q\x11\x10,1676055781936.c47924fd805c4df26e6e9e860c542007. 2023-02-10 19:03:02,899 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,q\\x11\\x10,1676055781936.c47924fd805c4df26e6e9e860c542007.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676055782899"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676055782899"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676055782899"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676055782899"}]},"ts":"1676055782899"} 2023-02-10 19:03:02,901 INFO [StoreOpener-ceccc0adc99b7adc17715506edd714a5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region ceccc0adc99b7adc17715506edd714a5 2023-02-10 19:03:02,903 DEBUG [StoreOpener-ceccc0adc99b7adc17715506edd714a5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/data/default/testWithMapReduce/ceccc0adc99b7adc17715506edd714a5/f1 2023-02-10 19:03:02,904 DEBUG [StoreOpener-ceccc0adc99b7adc17715506edd714a5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/data/default/testWithMapReduce/ceccc0adc99b7adc17715506edd714a5/f1 2023-02-10 19:03:02,904 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=28, resume processing ppid=19 2023-02-10 19:03:02,904 INFO [StoreOpener-ceccc0adc99b7adc17715506edd714a5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ceccc0adc99b7adc17715506edd714a5 columnFamilyName f1 2023-02-10 19:03:02,904 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=28, ppid=19, state=SUCCESS; OpenRegionProcedure 4dfcfb14720b0f66e0e9179835dbe61d, server=jenkins-hbase4.apache.org,35609,1676055780283 in 268 msec 2023-02-10 19:03:02,905 INFO [StoreOpener-ceccc0adc99b7adc17715506edd714a5-1] regionserver.HStore(310): Store=ceccc0adc99b7adc17715506edd714a5/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-10 19:03:02,905 INFO [StoreOpener-ceccc0adc99b7adc17715506edd714a5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region ceccc0adc99b7adc17715506edd714a5 2023-02-10 19:03:02,906 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=25, resume processing ppid=17 2023-02-10 19:03:02,906 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=19, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=4dfcfb14720b0f66e0e9179835dbe61d, ASSIGN in 467 msec 2023-02-10 19:03:02,906 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=25, ppid=17, state=SUCCESS; OpenRegionProcedure c47924fd805c4df26e6e9e860c542007, server=jenkins-hbase4.apache.org,38097,1676055780236 in 288 msec 2023-02-10 19:03:02,907 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=c47924fd805c4df26e6e9e860c542007, ASSIGN in 469 msec 2023-02-10 19:03:02,907 DEBUG [StoreOpener-ceccc0adc99b7adc17715506edd714a5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/data/default/testWithMapReduce/ceccc0adc99b7adc17715506edd714a5/f2 2023-02-10 19:03:02,907 DEBUG [StoreOpener-ceccc0adc99b7adc17715506edd714a5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/data/default/testWithMapReduce/ceccc0adc99b7adc17715506edd714a5/f2 2023-02-10 19:03:02,908 INFO [StoreOpener-ceccc0adc99b7adc17715506edd714a5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ceccc0adc99b7adc17715506edd714a5 columnFamilyName f2 2023-02-10 19:03:02,908 INFO [StoreOpener-ceccc0adc99b7adc17715506edd714a5-1] regionserver.HStore(310): Store=ceccc0adc99b7adc17715506edd714a5/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-10 19:03:02,909 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/data/default/testWithMapReduce/ceccc0adc99b7adc17715506edd714a5 2023-02-10 19:03:02,909 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/data/default/testWithMapReduce/ceccc0adc99b7adc17715506edd714a5 2023-02-10 19:03:02,911 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-10 19:03:02,912 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for ceccc0adc99b7adc17715506edd714a5 2023-02-10 19:03:02,914 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/data/default/testWithMapReduce/ceccc0adc99b7adc17715506edd714a5/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-10 19:03:02,914 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened ceccc0adc99b7adc17715506edd714a5; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67548093, jitterRate=0.006545022130012512}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-10 19:03:02,915 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for ceccc0adc99b7adc17715506edd714a5: Running coprocessor pre-open hook at 1676055782899Writing region info on filesystem at 1676055782899Initializing all the Stores at 1676055782901 (+2 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676055782901Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676055782901Cleaning up temporary data from old regions at 1676055782910 (+9 ms)Cleaning up detritus from prior splits at 1676055782910Running coprocessor post-open hooks at 1676055782915 (+5 ms)Region opened successfully at 1676055782915 2023-02-10 19:03:02,915 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,m\xED\xED,1676055781936.ceccc0adc99b7adc17715506edd714a5., pid=30, masterSystemTime=1676055782786 2023-02-10 19:03:02,917 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,m\xED\xED,1676055781936.ceccc0adc99b7adc17715506edd714a5. 2023-02-10 19:03:02,917 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,m\xED\xED,1676055781936.ceccc0adc99b7adc17715506edd714a5. 2023-02-10 19:03:02,917 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=ceccc0adc99b7adc17715506edd714a5, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,35609,1676055780283 2023-02-10 19:03:02,918 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,m\\xED\\xED,1676055781936.ceccc0adc99b7adc17715506edd714a5.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676055782917"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676055782917"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676055782917"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676055782917"}]},"ts":"1676055782917"} 2023-02-10 19:03:02,921 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=30, resume processing ppid=16 2023-02-10 19:03:02,921 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=30, ppid=16, state=SUCCESS; OpenRegionProcedure ceccc0adc99b7adc17715506edd714a5, server=jenkins-hbase4.apache.org,35609,1676055780283 in 283 msec 2023-02-10 19:03:02,923 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=16, resume processing ppid=10 2023-02-10 19:03:02,923 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=ceccc0adc99b7adc17715506edd714a5, ASSIGN in 484 msec 2023-02-10 19:03:02,924 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-10 19:03:02,924 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676055782924"}]},"ts":"1676055782924"} 2023-02-10 19:03:02,925 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=ENABLED in hbase:meta 2023-02-10 19:03:02,927 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_POST_OPERATION 2023-02-10 19:03:02,929 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=10, state=SUCCESS; CreateTableProcedure table=testWithMapReduce in 990 msec 2023-02-10 19:03:03,050 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40103] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-10 19:03:03,050 INFO [Listener at localhost/35877] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testWithMapReduce, procId: 10 completed 2023-02-10 19:03:03,050 DEBUG [Listener at localhost/35877] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testWithMapReduce get assigned. Timeout = 60000ms 2023-02-10 19:03:03,050 INFO [Listener at localhost/35877] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-10 19:03:03,054 INFO [Listener at localhost/35877] hbase.HBaseTestingUtility(3484): All regions for table testWithMapReduce assigned to meta. Checking AM states. 2023-02-10 19:03:03,054 INFO [Listener at localhost/35877] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-10 19:03:03,055 INFO [Listener at localhost/35877] hbase.HBaseTestingUtility(3504): All regions for table testWithMapReduce assigned. 2023-02-10 19:03:03,055 INFO [Listener at localhost/35877] mapreduce.TableSnapshotInputFormatTestBase(207): put some stuff in the table 2023-02-10 19:03:03,111 DEBUG [hconnection-0x64951b6-shared-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-10 19:03:03,135 INFO [RS-EventLoopGroup-7-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60646, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-10 19:03:03,148 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35609] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 8788 Client: jenkins//172.31.14.131 first region in multi=testWithMapReduce,g\xA7\xA7,1676055781936.f3c4392d756ce5e5e061ef2cb63d0fce. 2023-02-10 19:03:03,149 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38097] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 8788 Client: jenkins//172.31.14.131 first region in multi=testWithMapReduce,aaa,1676055781936.d1ba49f10de14d81a2fad0498c59a9b7. 2023-02-10 19:03:03,246 INFO [Listener at localhost/35877] mapreduce.TableSnapshotInputFormatTestBase(214): snapshot 2023-02-10 19:03:03,246 INFO [Listener at localhost/35877] snapshot.SnapshotTestingUtils(396): taking snapshot. 2023-02-10 19:03:03,247 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40103] master.MasterRpcServices(1580): Client=jenkins//172.31.14.131 snapshot request for:{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-10 19:03:03,247 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40103] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1676055783247 (current time:1676055783247). 2023-02-10 19:03:03,247 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40103] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-02-10 19:03:03,248 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40103] zookeeper.ReadOnlyZKClient(139): Connect 0x1cc4c6b0 to 127.0.0.1:55517 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-10 19:03:03,254 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40103] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@a0060f0, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-10 19:03:03,255 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40103] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-10 19:03:03,256 INFO [RS-EventLoopGroup-8-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34904, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-10 19:03:03,258 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40103] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1cc4c6b0 to 127.0.0.1:55517 2023-02-10 19:03:03,258 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40103] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-10 19:03:03,258 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40103] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-02-10 19:03:03,258 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40103] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-10 19:03:03,261 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40103] procedure2.ProcedureExecutor(1029): Stored pid=31, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-10 19:03:03,262 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=31, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-10 19:03:03,262 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=31, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE; timeout=600000, timestamp=1676056383262 2023-02-10 19:03:03,264 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40103] snapshot.SnapshotManager(653): Started snapshot: { ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-10 19:03:03,264 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot testWithMapReduceAndOfflineHBaseMultiRegion C_M_SNAPSHOT_TABLE on table testWithMapReduce 2023-02-10 19:03:03,265 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=31, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-10 19:03:03,265 DEBUG [Listener at localhost/35877] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-02-10 19:03:03,265 DEBUG [Listener at localhost/35877] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-02-10 19:03:03,266 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-10 19:03:03,267 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=31, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE in 5 msec 2023-02-10 19:03:03,267 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-10 19:03:03,268 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=32, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED; timeout=600000, timestamp=1676056383268 2023-02-10 19:03:03,366 DEBUG [Listener at localhost/35877] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-10 19:03:03,367 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40103] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-10 19:03:03,367 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40103] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-10 19:03:03,367 DEBUG [Listener at localhost/35877] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-02-10 19:03:03,568 DEBUG [Listener at localhost/35877] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-10 19:03:03,569 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40103] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-10 19:03:03,569 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40103] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-10 19:03:03,570 DEBUG [Listener at localhost/35877] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-02-10 19:03:03,693 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-10 19:03:03,693 INFO [(jenkins-hbase4.apache.org,40103,1676055780155)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' 2023-02-10 19:03:03,693 DEBUG [(jenkins-hbase4.apache.org,40103,1676055780155)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-10 19:03:03,693 DEBUG [(jenkins-hbase4.apache.org,40103,1676055780155)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' starting 'acquire' 2023-02-10 19:03:03,693 DEBUG [(jenkins-hbase4.apache.org,40103,1676055780155)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMapReduceAndOfflineHBaseMultiRegion', kicking off acquire phase on members. 2023-02-10 19:03:03,694 DEBUG [(jenkins-hbase4.apache.org,40103,1676055780155)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40103-0x1003f9d84e20000, quorum=127.0.0.1:55517, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-10 19:03:03,694 DEBUG [(jenkins-hbase4.apache.org,40103,1676055780155)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-10 19:03:03,696 DEBUG [Listener at localhost/35877-EventThread] zookeeper.ZKWatcher(600): regionserver:38097-0x1003f9d84e20001, quorum=127.0.0.1:55517, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-10 19:03:03,696 DEBUG [Listener at localhost/35877-EventThread] zookeeper.ZKWatcher(600): regionserver:35609-0x1003f9d84e20002, quorum=127.0.0.1:55517, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-10 19:03:03,696 DEBUG [(jenkins-hbase4.apache.org,40103,1676055780155)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,38097,1676055780236 2023-02-10 19:03:03,696 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-10 19:03:03,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-10 19:03:03,696 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-10 19:03:03,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-10 19:03:03,696 DEBUG [(jenkins-hbase4.apache.org,40103,1676055780155)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40103-0x1003f9d84e20000, quorum=127.0.0.1:55517, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,38097,1676055780236 2023-02-10 19:03:03,697 DEBUG [(jenkins-hbase4.apache.org,40103,1676055780155)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,35609,1676055780283 2023-02-10 19:03:03,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-10 19:03:03,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-10 19:03:03,697 DEBUG [(jenkins-hbase4.apache.org,40103,1676055780155)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40103-0x1003f9d84e20000, quorum=127.0.0.1:55517, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,35609,1676055780283 2023-02-10 19:03:03,697 DEBUG [(jenkins-hbase4.apache.org,40103,1676055780155)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-10 19:03:03,697 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38097-0x1003f9d84e20001, quorum=127.0.0.1:55517, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-10 19:03:03,697 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35609-0x1003f9d84e20002, quorum=127.0.0.1:55517, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-10 19:03:03,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 81 2023-02-10 19:03:03,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-10 19:03:03,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 81 2023-02-10 19:03:03,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-10 19:03:03,698 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMapReduceAndOfflineHBaseMultiRegion from table testWithMapReduce type FLUSH 2023-02-10 19:03:03,698 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMapReduceAndOfflineHBaseMultiRegion from table testWithMapReduce type FLUSH 2023-02-10 19:03:03,698 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-10 19:03:03,698 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-10 19:03:03,698 DEBUG [member: 'jenkins-hbase4.apache.org,35609,1676055780283' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' with timeout 300000ms 2023-02-10 19:03:03,698 DEBUG [member: 'jenkins-hbase4.apache.org,35609,1676055780283' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-10 19:03:03,698 DEBUG [member: 'jenkins-hbase4.apache.org,38097,1676055780236' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' with timeout 300000ms 2023-02-10 19:03:03,699 DEBUG [member: 'jenkins-hbase4.apache.org,35609,1676055780283' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' starting 'acquire' stage 2023-02-10 19:03:03,699 DEBUG [member: 'jenkins-hbase4.apache.org,38097,1676055780236' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-10 19:03:03,699 DEBUG [member: 'jenkins-hbase4.apache.org,35609,1676055780283' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' locally acquired 2023-02-10 19:03:03,700 DEBUG [member: 'jenkins-hbase4.apache.org,38097,1676055780236' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' starting 'acquire' stage 2023-02-10 19:03:03,700 DEBUG [member: 'jenkins-hbase4.apache.org,35609,1676055780283' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35609,1676055780283' joining acquired barrier for procedure (testWithMapReduceAndOfflineHBaseMultiRegion) in zk 2023-02-10 19:03:03,700 DEBUG [member: 'jenkins-hbase4.apache.org,38097,1676055780236' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' locally acquired 2023-02-10 19:03:03,700 DEBUG [member: 'jenkins-hbase4.apache.org,38097,1676055780236' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38097,1676055780236' joining acquired barrier for procedure (testWithMapReduceAndOfflineHBaseMultiRegion) in zk 2023-02-10 19:03:03,701 DEBUG [Listener at localhost/35877-EventThread] zookeeper.ZKWatcher(600): master:40103-0x1003f9d84e20000, quorum=127.0.0.1:55517, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,35609,1676055780283 2023-02-10 19:03:03,701 DEBUG [member: 'jenkins-hbase4.apache.org,35609,1676055780283' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-10 19:03:03,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,35609,1676055780283 2023-02-10 19:03:03,702 DEBUG [member: 'jenkins-hbase4.apache.org,38097,1676055780236' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-10 19:03:03,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-10 19:03:03,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-10 19:03:03,702 DEBUG [Listener at localhost/35877-EventThread] zookeeper.ZKWatcher(600): master:40103-0x1003f9d84e20000, quorum=127.0.0.1:55517, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,38097,1676055780236 2023-02-10 19:03:03,702 DEBUG [member: 'jenkins-hbase4.apache.org,35609,1676055780283' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35609-0x1003f9d84e20002, quorum=127.0.0.1:55517, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-10 19:03:03,702 DEBUG [member: 'jenkins-hbase4.apache.org,35609,1676055780283' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-10 19:03:03,702 DEBUG [member: 'jenkins-hbase4.apache.org,38097,1676055780236' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38097-0x1003f9d84e20001, quorum=127.0.0.1:55517, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-10 19:03:03,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-10 19:03:03,702 DEBUG [member: 'jenkins-hbase4.apache.org,38097,1676055780236' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-10 19:03:03,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-10 19:03:03,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-10 19:03:03,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35609,1676055780283 2023-02-10 19:03:03,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38097,1676055780236 2023-02-10 19:03:03,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-10 19:03:03,704 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35609,1676055780283' joining acquired barrier for procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' on coordinator 2023-02-10 19:03:03,704 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@603238f8[Count = 1] remaining members to acquire global barrier 2023-02-10 19:03:03,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,38097,1676055780236 2023-02-10 19:03:03,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-10 19:03:03,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-10 19:03:03,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-10 19:03:03,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-10 19:03:03,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-10 19:03:03,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35609,1676055780283 2023-02-10 19:03:03,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38097,1676055780236 2023-02-10 19:03:03,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-10 19:03:03,707 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38097,1676055780236' joining acquired barrier for procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' on coordinator 2023-02-10 19:03:03,707 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@603238f8[Count = 0] remaining members to acquire global barrier 2023-02-10 19:03:03,707 DEBUG [(jenkins-hbase4.apache.org,40103,1676055780155)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' starting 'in-barrier' execution. 2023-02-10 19:03:03,707 DEBUG [(jenkins-hbase4.apache.org,40103,1676055780155)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-10 19:03:03,708 DEBUG [Listener at localhost/35877-EventThread] zookeeper.ZKWatcher(600): regionserver:35609-0x1003f9d84e20002, quorum=127.0.0.1:55517, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-10 19:03:03,708 DEBUG [Listener at localhost/35877-EventThread] zookeeper.ZKWatcher(600): regionserver:38097-0x1003f9d84e20001, quorum=127.0.0.1:55517, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-10 19:03:03,708 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-10 19:03:03,708 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-10 19:03:03,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-10 19:03:03,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-10 19:03:03,708 DEBUG [(jenkins-hbase4.apache.org,40103,1676055780155)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40103-0x1003f9d84e20000, quorum=127.0.0.1:55517, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,35609,1676055780283 2023-02-10 19:03:03,708 DEBUG [member: 'jenkins-hbase4.apache.org,38097,1676055780236' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' received 'reached' from coordinator. 2023-02-10 19:03:03,708 DEBUG [member: 'jenkins-hbase4.apache.org,35609,1676055780283' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' received 'reached' from coordinator. 2023-02-10 19:03:03,709 DEBUG [(jenkins-hbase4.apache.org,40103,1676055780155)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40103-0x1003f9d84e20000, quorum=127.0.0.1:55517, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,38097,1676055780236 2023-02-10 19:03:03,709 DEBUG [(jenkins-hbase4.apache.org,40103,1676055780155)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-10 19:03:03,711 DEBUG [rs(jenkins-hbase4.apache.org,38097,1676055780236)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,d\x84\x84,1676055781936.e06f6220742d6bd40a5b138f872afaa0. 2023-02-10 19:03:03,711 DEBUG [rs(jenkins-hbase4.apache.org,35609,1676055780283)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,,1676055781936.fe00f1c4e3fbcd6d7560c2506ad6ca19. 2023-02-10 19:03:03,711 DEBUG [rs(jenkins-hbase4.apache.org,35609,1676055780283)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,,1676055781936.fe00f1c4e3fbcd6d7560c2506ad6ca19. started... 2023-02-10 19:03:03,711 DEBUG [rs(jenkins-hbase4.apache.org,38097,1676055780236)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,d\x84\x84,1676055781936.e06f6220742d6bd40a5b138f872afaa0. started... 2023-02-10 19:03:03,711 DEBUG [rs(jenkins-hbase4.apache.org,38097,1676055780236)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,zz{,1676055781936.aff2d18d26e1916478e05b25bb5c9a89. 2023-02-10 19:03:03,712 DEBUG [rs(jenkins-hbase4.apache.org,35609,1676055780283)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for fe00f1c4e3fbcd6d7560c2506ad6ca19: 2023-02-10 19:03:03,716 DEBUG [member: 'jenkins-hbase4.apache.org,38097,1676055780236' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 5 regions 2023-02-10 19:03:03,716 DEBUG [member: 'jenkins-hbase4.apache.org,38097,1676055780236' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-10 19:03:03,716 DEBUG [rs(jenkins-hbase4.apache.org,38097,1676055780236)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,aaa,1676055781936.d1ba49f10de14d81a2fad0498c59a9b7. 2023-02-10 19:03:03,716 DEBUG [rs(jenkins-hbase4.apache.org,35609,1676055780283)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,,1676055781936.fe00f1c4e3fbcd6d7560c2506ad6ca19.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-10 19:03:03,713 DEBUG [rs(jenkins-hbase4.apache.org,35609,1676055780283)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,wWV,1676055781936.4dfcfb14720b0f66e0e9179835dbe61d. 2023-02-10 19:03:03,712 DEBUG [rs(jenkins-hbase4.apache.org,38097,1676055780236)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,zz{,1676055781936.aff2d18d26e1916478e05b25bb5c9a89. started... 2023-02-10 19:03:03,716 DEBUG [rs(jenkins-hbase4.apache.org,35609,1676055780283)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,wWV,1676055781936.4dfcfb14720b0f66e0e9179835dbe61d. started... 2023-02-10 19:03:03,716 DEBUG [rs(jenkins-hbase4.apache.org,35609,1676055780283)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,m\xED\xED,1676055781936.ceccc0adc99b7adc17715506edd714a5. 2023-02-10 19:03:03,718 DEBUG [rs(jenkins-hbase4.apache.org,35609,1676055780283)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,m\xED\xED,1676055781936.ceccc0adc99b7adc17715506edd714a5. started... 2023-02-10 19:03:03,718 INFO [rs(jenkins-hbase4.apache.org,35609,1676055780283)-snapshot-pool-1] regionserver.HRegion(2744): Flushing 4dfcfb14720b0f66e0e9179835dbe61d 2/2 column families, dataSize=158.44 KB heapSize=549.75 KB 2023-02-10 19:03:03,719 INFO [rs(jenkins-hbase4.apache.org,35609,1676055780283)-snapshot-pool-2] regionserver.HRegion(2744): Flushing ceccc0adc99b7adc17715506edd714a5 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-10 19:03:03,716 DEBUG [rs(jenkins-hbase4.apache.org,35609,1676055780283)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-10 19:03:03,719 DEBUG [rs(jenkins-hbase4.apache.org,35609,1676055780283)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-10 19:03:03,719 DEBUG [rs(jenkins-hbase4.apache.org,35609,1676055780283)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-10 19:03:03,716 DEBUG [member: 'jenkins-hbase4.apache.org,35609,1676055780283' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 5 regions 2023-02-10 19:03:03,727 DEBUG [member: 'jenkins-hbase4.apache.org,35609,1676055780283' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-10 19:03:03,716 INFO [rs(jenkins-hbase4.apache.org,38097,1676055780236)-snapshot-pool-0] regionserver.HRegion(2744): Flushing e06f6220742d6bd40a5b138f872afaa0 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-10 19:03:03,716 DEBUG [rs(jenkins-hbase4.apache.org,38097,1676055780236)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,aaa,1676055781936.d1ba49f10de14d81a2fad0498c59a9b7. started... 2023-02-10 19:03:03,717 DEBUG [rs(jenkins-hbase4.apache.org,38097,1676055780236)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for aff2d18d26e1916478e05b25bb5c9a89: 2023-02-10 19:03:03,728 DEBUG [rs(jenkins-hbase4.apache.org,38097,1676055780236)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,zz{,1676055781936.aff2d18d26e1916478e05b25bb5c9a89.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-10 19:03:03,728 DEBUG [rs(jenkins-hbase4.apache.org,38097,1676055780236)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-10 19:03:03,728 DEBUG [rs(jenkins-hbase4.apache.org,38097,1676055780236)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-10 19:03:03,728 DEBUG [rs(jenkins-hbase4.apache.org,38097,1676055780236)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-10 19:03:03,733 INFO [rs(jenkins-hbase4.apache.org,38097,1676055780236)-snapshot-pool-2] regionserver.HRegion(2744): Flushing d1ba49f10de14d81a2fad0498c59a9b7 2/2 column families, dataSize=158.44 KB heapSize=549.75 KB 2023-02-10 19:03:03,768 INFO [rs(jenkins-hbase4.apache.org,35609,1676055780283)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/data/default/testWithMapReduce/4dfcfb14720b0f66e0e9179835dbe61d/.tmp/f1/fa0d2a3dbfa94f5faefc2e0d02f62ec6 2023-02-10 19:03:03,787 INFO [rs(jenkins-hbase4.apache.org,35609,1676055780283)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/data/default/testWithMapReduce/ceccc0adc99b7adc17715506edd714a5/.tmp/f1/e20c54d0951f49df8d8836bff53e605f 2023-02-10 19:03:03,788 DEBUG [rs(jenkins-hbase4.apache.org,38097,1676055780236)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,zz{,1676055781936.aff2d18d26e1916478e05b25bb5c9a89. completed. 2023-02-10 19:03:03,788 DEBUG [rs(jenkins-hbase4.apache.org,38097,1676055780236)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,zz{,1676055781936.aff2d18d26e1916478e05b25bb5c9a89. 2023-02-10 19:03:03,788 DEBUG [rs(jenkins-hbase4.apache.org,38097,1676055780236)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,j\xCA\xCA,1676055781936.3c13d5e817a81b6f4b36ab3d9762b76f. 2023-02-10 19:03:03,788 DEBUG [member: 'jenkins-hbase4.apache.org,38097,1676055780236' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/5 local region snapshots. 2023-02-10 19:03:03,788 DEBUG [rs(jenkins-hbase4.apache.org,38097,1676055780236)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,j\xCA\xCA,1676055781936.3c13d5e817a81b6f4b36ab3d9762b76f. started... 2023-02-10 19:03:03,791 INFO [rs(jenkins-hbase4.apache.org,38097,1676055780236)-snapshot-pool-1] regionserver.HRegion(2744): Flushing 3c13d5e817a81b6f4b36ab3d9762b76f 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-10 19:03:03,816 INFO [rs(jenkins-hbase4.apache.org,38097,1676055780236)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/data/default/testWithMapReduce/e06f6220742d6bd40a5b138f872afaa0/.tmp/f1/395efa06554f4fa38285f073a745a45a 2023-02-10 19:03:03,836 INFO [rs(jenkins-hbase4.apache.org,38097,1676055780236)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/data/default/testWithMapReduce/d1ba49f10de14d81a2fad0498c59a9b7/.tmp/f1/b67edbff65be4ab5ba42b8fb675d5d2b 2023-02-10 19:03:03,841 INFO [rs(jenkins-hbase4.apache.org,35609,1676055780283)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/data/default/testWithMapReduce/4dfcfb14720b0f66e0e9179835dbe61d/.tmp/f2/a798a04a435444beb147cc2980bdea9f 2023-02-10 19:03:03,847 DEBUG [rs(jenkins-hbase4.apache.org,35609,1676055780283)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/data/default/testWithMapReduce/4dfcfb14720b0f66e0e9179835dbe61d/.tmp/f1/fa0d2a3dbfa94f5faefc2e0d02f62ec6 as hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/data/default/testWithMapReduce/4dfcfb14720b0f66e0e9179835dbe61d/f1/fa0d2a3dbfa94f5faefc2e0d02f62ec6 2023-02-10 19:03:03,851 INFO [rs(jenkins-hbase4.apache.org,35609,1676055780283)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/data/default/testWithMapReduce/4dfcfb14720b0f66e0e9179835dbe61d/f1/fa0d2a3dbfa94f5faefc2e0d02f62ec6, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-10 19:03:03,852 DEBUG [rs(jenkins-hbase4.apache.org,35609,1676055780283)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/data/default/testWithMapReduce/4dfcfb14720b0f66e0e9179835dbe61d/.tmp/f2/a798a04a435444beb147cc2980bdea9f as hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/data/default/testWithMapReduce/4dfcfb14720b0f66e0e9179835dbe61d/f2/a798a04a435444beb147cc2980bdea9f 2023-02-10 19:03:03,859 INFO [rs(jenkins-hbase4.apache.org,35609,1676055780283)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/data/default/testWithMapReduce/4dfcfb14720b0f66e0e9179835dbe61d/f2/a798a04a435444beb147cc2980bdea9f, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-10 19:03:03,860 INFO [rs(jenkins-hbase4.apache.org,35609,1676055780283)-snapshot-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~158.44 KB/162240, heapSize ~549.72 KB/562912, currentSize=0 B/0 for 4dfcfb14720b0f66e0e9179835dbe61d in 142ms, sequenceid=5, compaction requested=false 2023-02-10 19:03:03,860 DEBUG [rs(jenkins-hbase4.apache.org,35609,1676055780283)-snapshot-pool-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testWithMapReduce' 2023-02-10 19:03:03,861 DEBUG [rs(jenkins-hbase4.apache.org,35609,1676055780283)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for 4dfcfb14720b0f66e0e9179835dbe61d: 2023-02-10 19:03:03,862 DEBUG [rs(jenkins-hbase4.apache.org,35609,1676055780283)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,wWV,1676055781936.4dfcfb14720b0f66e0e9179835dbe61d.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-10 19:03:03,862 DEBUG [rs(jenkins-hbase4.apache.org,35609,1676055780283)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-10 19:03:03,862 DEBUG [rs(jenkins-hbase4.apache.org,35609,1676055780283)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/data/default/testWithMapReduce/4dfcfb14720b0f66e0e9179835dbe61d/f1/fa0d2a3dbfa94f5faefc2e0d02f62ec6] hfiles 2023-02-10 19:03:03,862 DEBUG [rs(jenkins-hbase4.apache.org,35609,1676055780283)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/data/default/testWithMapReduce/4dfcfb14720b0f66e0e9179835dbe61d/f1/fa0d2a3dbfa94f5faefc2e0d02f62ec6 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-10 19:03:03,862 DEBUG [rs(jenkins-hbase4.apache.org,35609,1676055780283)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/data/default/testWithMapReduce/4dfcfb14720b0f66e0e9179835dbe61d/f2/a798a04a435444beb147cc2980bdea9f] hfiles 2023-02-10 19:03:03,862 DEBUG [rs(jenkins-hbase4.apache.org,35609,1676055780283)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/data/default/testWithMapReduce/4dfcfb14720b0f66e0e9179835dbe61d/f2/a798a04a435444beb147cc2980bdea9f for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-10 19:03:03,868 INFO [rs(jenkins-hbase4.apache.org,38097,1676055780236)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/data/default/testWithMapReduce/3c13d5e817a81b6f4b36ab3d9762b76f/.tmp/f1/4dfbd9571a5643aaae8ff1af04c39568 2023-02-10 19:03:03,870 DEBUG [Listener at localhost/35877] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-10 19:03:03,872 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40103] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-10 19:03:03,872 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40103] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-10 19:03:03,872 DEBUG [Listener at localhost/35877] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-02-10 19:03:03,890 INFO [rs(jenkins-hbase4.apache.org,38097,1676055780236)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/data/default/testWithMapReduce/e06f6220742d6bd40a5b138f872afaa0/.tmp/f2/8b54d5d9e3e24c3a80bb17ba71bf956d 2023-02-10 19:03:03,896 INFO [rs(jenkins-hbase4.apache.org,38097,1676055780236)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/data/default/testWithMapReduce/d1ba49f10de14d81a2fad0498c59a9b7/.tmp/f2/bd610f877a144f18943d0bad3fd9dd5a 2023-02-10 19:03:03,897 DEBUG [rs(jenkins-hbase4.apache.org,38097,1676055780236)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/data/default/testWithMapReduce/e06f6220742d6bd40a5b138f872afaa0/.tmp/f1/395efa06554f4fa38285f073a745a45a as hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/data/default/testWithMapReduce/e06f6220742d6bd40a5b138f872afaa0/f1/395efa06554f4fa38285f073a745a45a 2023-02-10 19:03:03,905 DEBUG [rs(jenkins-hbase4.apache.org,38097,1676055780236)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/data/default/testWithMapReduce/d1ba49f10de14d81a2fad0498c59a9b7/.tmp/f1/b67edbff65be4ab5ba42b8fb675d5d2b as hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/data/default/testWithMapReduce/d1ba49f10de14d81a2fad0498c59a9b7/f1/b67edbff65be4ab5ba42b8fb675d5d2b 2023-02-10 19:03:03,906 INFO [rs(jenkins-hbase4.apache.org,38097,1676055780236)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/data/default/testWithMapReduce/e06f6220742d6bd40a5b138f872afaa0/f1/395efa06554f4fa38285f073a745a45a, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-10 19:03:03,906 DEBUG [rs(jenkins-hbase4.apache.org,38097,1676055780236)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/data/default/testWithMapReduce/e06f6220742d6bd40a5b138f872afaa0/.tmp/f2/8b54d5d9e3e24c3a80bb17ba71bf956d as hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/data/default/testWithMapReduce/e06f6220742d6bd40a5b138f872afaa0/f2/8b54d5d9e3e24c3a80bb17ba71bf956d 2023-02-10 19:03:03,913 DEBUG [rs(jenkins-hbase4.apache.org,35609,1676055780283)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,wWV,1676055781936.4dfcfb14720b0f66e0e9179835dbe61d. completed. 2023-02-10 19:03:03,913 DEBUG [rs(jenkins-hbase4.apache.org,35609,1676055780283)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,wWV,1676055781936.4dfcfb14720b0f66e0e9179835dbe61d. 2023-02-10 19:03:03,913 DEBUG [rs(jenkins-hbase4.apache.org,35609,1676055780283)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,g\xA7\xA7,1676055781936.f3c4392d756ce5e5e061ef2cb63d0fce. 2023-02-10 19:03:03,913 DEBUG [member: 'jenkins-hbase4.apache.org,35609,1676055780283' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/5 local region snapshots. 2023-02-10 19:03:03,913 DEBUG [rs(jenkins-hbase4.apache.org,35609,1676055780283)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,g\xA7\xA7,1676055781936.f3c4392d756ce5e5e061ef2cb63d0fce. started... 2023-02-10 19:03:03,913 INFO [rs(jenkins-hbase4.apache.org,35609,1676055780283)-snapshot-pool-1] regionserver.HRegion(2744): Flushing f3c4392d756ce5e5e061ef2cb63d0fce 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-10 19:03:03,915 INFO [rs(jenkins-hbase4.apache.org,38097,1676055780236)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/data/default/testWithMapReduce/d1ba49f10de14d81a2fad0498c59a9b7/f1/b67edbff65be4ab5ba42b8fb675d5d2b, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-10 19:03:03,916 INFO [rs(jenkins-hbase4.apache.org,38097,1676055780236)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/data/default/testWithMapReduce/e06f6220742d6bd40a5b138f872afaa0/f2/8b54d5d9e3e24c3a80bb17ba71bf956d, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-10 19:03:03,916 DEBUG [rs(jenkins-hbase4.apache.org,38097,1676055780236)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/data/default/testWithMapReduce/d1ba49f10de14d81a2fad0498c59a9b7/.tmp/f2/bd610f877a144f18943d0bad3fd9dd5a as hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/data/default/testWithMapReduce/d1ba49f10de14d81a2fad0498c59a9b7/f2/bd610f877a144f18943d0bad3fd9dd5a 2023-02-10 19:03:03,917 INFO [rs(jenkins-hbase4.apache.org,38097,1676055780236)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for e06f6220742d6bd40a5b138f872afaa0 in 201ms, sequenceid=5, compaction requested=false 2023-02-10 19:03:03,921 DEBUG [rs(jenkins-hbase4.apache.org,38097,1676055780236)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for e06f6220742d6bd40a5b138f872afaa0: 2023-02-10 19:03:03,921 DEBUG [rs(jenkins-hbase4.apache.org,38097,1676055780236)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,d\x84\x84,1676055781936.e06f6220742d6bd40a5b138f872afaa0.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-10 19:03:03,921 DEBUG [rs(jenkins-hbase4.apache.org,38097,1676055780236)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-10 19:03:03,921 DEBUG [rs(jenkins-hbase4.apache.org,38097,1676055780236)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/data/default/testWithMapReduce/e06f6220742d6bd40a5b138f872afaa0/f1/395efa06554f4fa38285f073a745a45a] hfiles 2023-02-10 19:03:03,921 DEBUG [rs(jenkins-hbase4.apache.org,38097,1676055780236)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/data/default/testWithMapReduce/e06f6220742d6bd40a5b138f872afaa0/f1/395efa06554f4fa38285f073a745a45a for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-10 19:03:03,921 DEBUG [rs(jenkins-hbase4.apache.org,38097,1676055780236)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/data/default/testWithMapReduce/e06f6220742d6bd40a5b138f872afaa0/f2/8b54d5d9e3e24c3a80bb17ba71bf956d] hfiles 2023-02-10 19:03:03,921 DEBUG [rs(jenkins-hbase4.apache.org,38097,1676055780236)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/data/default/testWithMapReduce/e06f6220742d6bd40a5b138f872afaa0/f2/8b54d5d9e3e24c3a80bb17ba71bf956d for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-10 19:03:03,929 INFO [rs(jenkins-hbase4.apache.org,38097,1676055780236)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/data/default/testWithMapReduce/d1ba49f10de14d81a2fad0498c59a9b7/f2/bd610f877a144f18943d0bad3fd9dd5a, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-10 19:03:03,930 INFO [rs(jenkins-hbase4.apache.org,38097,1676055780236)-snapshot-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~158.44 KB/162240, heapSize ~549.72 KB/562912, currentSize=0 B/0 for d1ba49f10de14d81a2fad0498c59a9b7 in 198ms, sequenceid=5, compaction requested=false 2023-02-10 19:03:03,930 DEBUG [rs(jenkins-hbase4.apache.org,38097,1676055780236)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for d1ba49f10de14d81a2fad0498c59a9b7: 2023-02-10 19:03:03,930 DEBUG [rs(jenkins-hbase4.apache.org,38097,1676055780236)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,aaa,1676055781936.d1ba49f10de14d81a2fad0498c59a9b7.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-10 19:03:03,930 DEBUG [rs(jenkins-hbase4.apache.org,38097,1676055780236)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-10 19:03:03,930 DEBUG [rs(jenkins-hbase4.apache.org,38097,1676055780236)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/data/default/testWithMapReduce/d1ba49f10de14d81a2fad0498c59a9b7/f1/b67edbff65be4ab5ba42b8fb675d5d2b] hfiles 2023-02-10 19:03:03,930 DEBUG [rs(jenkins-hbase4.apache.org,38097,1676055780236)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/data/default/testWithMapReduce/d1ba49f10de14d81a2fad0498c59a9b7/f1/b67edbff65be4ab5ba42b8fb675d5d2b for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-10 19:03:03,930 DEBUG [rs(jenkins-hbase4.apache.org,38097,1676055780236)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/data/default/testWithMapReduce/d1ba49f10de14d81a2fad0498c59a9b7/f2/bd610f877a144f18943d0bad3fd9dd5a] hfiles 2023-02-10 19:03:03,931 DEBUG [rs(jenkins-hbase4.apache.org,38097,1676055780236)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/data/default/testWithMapReduce/d1ba49f10de14d81a2fad0498c59a9b7/f2/bd610f877a144f18943d0bad3fd9dd5a for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-10 19:03:03,956 DEBUG [rs(jenkins-hbase4.apache.org,38097,1676055780236)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,d\x84\x84,1676055781936.e06f6220742d6bd40a5b138f872afaa0. completed. 2023-02-10 19:03:03,956 DEBUG [rs(jenkins-hbase4.apache.org,38097,1676055780236)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,d\x84\x84,1676055781936.e06f6220742d6bd40a5b138f872afaa0. 2023-02-10 19:03:03,956 INFO [rs(jenkins-hbase4.apache.org,35609,1676055780283)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/data/default/testWithMapReduce/f3c4392d756ce5e5e061ef2cb63d0fce/.tmp/f1/b809dc233ec14237929a2e2d18d14f13 2023-02-10 19:03:03,956 DEBUG [member: 'jenkins-hbase4.apache.org,38097,1676055780236' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 2/5 local region snapshots. 2023-02-10 19:03:03,956 DEBUG [rs(jenkins-hbase4.apache.org,38097,1676055780236)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,q\x11\x10,1676055781936.c47924fd805c4df26e6e9e860c542007. 2023-02-10 19:03:03,957 DEBUG [rs(jenkins-hbase4.apache.org,38097,1676055780236)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,q\x11\x10,1676055781936.c47924fd805c4df26e6e9e860c542007. started... 2023-02-10 19:03:03,957 INFO [rs(jenkins-hbase4.apache.org,38097,1676055780236)-snapshot-pool-0] regionserver.HRegion(2744): Flushing c47924fd805c4df26e6e9e860c542007 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-10 19:03:03,956 INFO [rs(jenkins-hbase4.apache.org,38097,1676055780236)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/data/default/testWithMapReduce/3c13d5e817a81b6f4b36ab3d9762b76f/.tmp/f2/9ecfde10768445ecbcac71e07d50753f 2023-02-10 19:03:03,962 DEBUG [rs(jenkins-hbase4.apache.org,38097,1676055780236)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,aaa,1676055781936.d1ba49f10de14d81a2fad0498c59a9b7. completed. 2023-02-10 19:03:03,962 DEBUG [rs(jenkins-hbase4.apache.org,38097,1676055780236)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,aaa,1676055781936.d1ba49f10de14d81a2fad0498c59a9b7. 2023-02-10 19:03:03,962 DEBUG [member: 'jenkins-hbase4.apache.org,38097,1676055780236' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 3/5 local region snapshots. 2023-02-10 19:03:03,967 DEBUG [rs(jenkins-hbase4.apache.org,38097,1676055780236)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/data/default/testWithMapReduce/3c13d5e817a81b6f4b36ab3d9762b76f/.tmp/f1/4dfbd9571a5643aaae8ff1af04c39568 as hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/data/default/testWithMapReduce/3c13d5e817a81b6f4b36ab3d9762b76f/f1/4dfbd9571a5643aaae8ff1af04c39568 2023-02-10 19:03:03,973 INFO [rs(jenkins-hbase4.apache.org,38097,1676055780236)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/data/default/testWithMapReduce/3c13d5e817a81b6f4b36ab3d9762b76f/f1/4dfbd9571a5643aaae8ff1af04c39568, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-10 19:03:03,976 DEBUG [rs(jenkins-hbase4.apache.org,38097,1676055780236)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/data/default/testWithMapReduce/3c13d5e817a81b6f4b36ab3d9762b76f/.tmp/f2/9ecfde10768445ecbcac71e07d50753f as hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/data/default/testWithMapReduce/3c13d5e817a81b6f4b36ab3d9762b76f/f2/9ecfde10768445ecbcac71e07d50753f 2023-02-10 19:03:03,981 INFO [rs(jenkins-hbase4.apache.org,38097,1676055780236)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/data/default/testWithMapReduce/3c13d5e817a81b6f4b36ab3d9762b76f/f2/9ecfde10768445ecbcac71e07d50753f, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-10 19:03:03,982 INFO [rs(jenkins-hbase4.apache.org,38097,1676055780236)-snapshot-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 3c13d5e817a81b6f4b36ab3d9762b76f in 191ms, sequenceid=5, compaction requested=false 2023-02-10 19:03:03,982 DEBUG [rs(jenkins-hbase4.apache.org,38097,1676055780236)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for 3c13d5e817a81b6f4b36ab3d9762b76f: 2023-02-10 19:03:03,982 DEBUG [rs(jenkins-hbase4.apache.org,38097,1676055780236)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,j\xCA\xCA,1676055781936.3c13d5e817a81b6f4b36ab3d9762b76f.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-10 19:03:03,982 DEBUG [rs(jenkins-hbase4.apache.org,38097,1676055780236)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-10 19:03:03,982 DEBUG [rs(jenkins-hbase4.apache.org,38097,1676055780236)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/data/default/testWithMapReduce/3c13d5e817a81b6f4b36ab3d9762b76f/f1/4dfbd9571a5643aaae8ff1af04c39568] hfiles 2023-02-10 19:03:03,982 DEBUG [rs(jenkins-hbase4.apache.org,38097,1676055780236)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/data/default/testWithMapReduce/3c13d5e817a81b6f4b36ab3d9762b76f/f1/4dfbd9571a5643aaae8ff1af04c39568 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-10 19:03:03,982 DEBUG [rs(jenkins-hbase4.apache.org,38097,1676055780236)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/data/default/testWithMapReduce/3c13d5e817a81b6f4b36ab3d9762b76f/f2/9ecfde10768445ecbcac71e07d50753f] hfiles 2023-02-10 19:03:03,982 DEBUG [rs(jenkins-hbase4.apache.org,38097,1676055780236)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/data/default/testWithMapReduce/3c13d5e817a81b6f4b36ab3d9762b76f/f2/9ecfde10768445ecbcac71e07d50753f for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-10 19:03:03,988 INFO [rs(jenkins-hbase4.apache.org,35609,1676055780283)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/data/default/testWithMapReduce/f3c4392d756ce5e5e061ef2cb63d0fce/.tmp/f2/7bdb0c53fd7b467397d5ffdb9243be37 2023-02-10 19:03:03,993 DEBUG [rs(jenkins-hbase4.apache.org,35609,1676055780283)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/data/default/testWithMapReduce/f3c4392d756ce5e5e061ef2cb63d0fce/.tmp/f1/b809dc233ec14237929a2e2d18d14f13 as hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/data/default/testWithMapReduce/f3c4392d756ce5e5e061ef2cb63d0fce/f1/b809dc233ec14237929a2e2d18d14f13 2023-02-10 19:03:03,998 DEBUG [rs(jenkins-hbase4.apache.org,38097,1676055780236)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,j\xCA\xCA,1676055781936.3c13d5e817a81b6f4b36ab3d9762b76f. completed. 2023-02-10 19:03:03,998 DEBUG [rs(jenkins-hbase4.apache.org,38097,1676055780236)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,j\xCA\xCA,1676055781936.3c13d5e817a81b6f4b36ab3d9762b76f. 2023-02-10 19:03:03,998 DEBUG [member: 'jenkins-hbase4.apache.org,38097,1676055780236' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 4/5 local region snapshots. 2023-02-10 19:03:03,999 INFO [rs(jenkins-hbase4.apache.org,35609,1676055780283)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/data/default/testWithMapReduce/f3c4392d756ce5e5e061ef2cb63d0fce/f1/b809dc233ec14237929a2e2d18d14f13, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-10 19:03:04,000 DEBUG [rs(jenkins-hbase4.apache.org,35609,1676055780283)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/data/default/testWithMapReduce/f3c4392d756ce5e5e061ef2cb63d0fce/.tmp/f2/7bdb0c53fd7b467397d5ffdb9243be37 as hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/data/default/testWithMapReduce/f3c4392d756ce5e5e061ef2cb63d0fce/f2/7bdb0c53fd7b467397d5ffdb9243be37 2023-02-10 19:03:04,005 INFO [rs(jenkins-hbase4.apache.org,35609,1676055780283)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/data/default/testWithMapReduce/f3c4392d756ce5e5e061ef2cb63d0fce/f2/7bdb0c53fd7b467397d5ffdb9243be37, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-10 19:03:04,006 INFO [rs(jenkins-hbase4.apache.org,35609,1676055780283)-snapshot-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for f3c4392d756ce5e5e061ef2cb63d0fce in 93ms, sequenceid=5, compaction requested=false 2023-02-10 19:03:04,006 DEBUG [rs(jenkins-hbase4.apache.org,35609,1676055780283)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for f3c4392d756ce5e5e061ef2cb63d0fce: 2023-02-10 19:03:04,006 DEBUG [rs(jenkins-hbase4.apache.org,35609,1676055780283)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,g\xA7\xA7,1676055781936.f3c4392d756ce5e5e061ef2cb63d0fce.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-10 19:03:04,006 DEBUG [rs(jenkins-hbase4.apache.org,35609,1676055780283)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-10 19:03:04,007 DEBUG [rs(jenkins-hbase4.apache.org,35609,1676055780283)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/data/default/testWithMapReduce/f3c4392d756ce5e5e061ef2cb63d0fce/f1/b809dc233ec14237929a2e2d18d14f13] hfiles 2023-02-10 19:03:04,007 DEBUG [rs(jenkins-hbase4.apache.org,35609,1676055780283)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/data/default/testWithMapReduce/f3c4392d756ce5e5e061ef2cb63d0fce/f1/b809dc233ec14237929a2e2d18d14f13 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-10 19:03:04,007 DEBUG [rs(jenkins-hbase4.apache.org,35609,1676055780283)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/data/default/testWithMapReduce/f3c4392d756ce5e5e061ef2cb63d0fce/f2/7bdb0c53fd7b467397d5ffdb9243be37] hfiles 2023-02-10 19:03:04,007 DEBUG [rs(jenkins-hbase4.apache.org,35609,1676055780283)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/data/default/testWithMapReduce/f3c4392d756ce5e5e061ef2cb63d0fce/f2/7bdb0c53fd7b467397d5ffdb9243be37 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-10 19:03:04,018 DEBUG [rs(jenkins-hbase4.apache.org,35609,1676055780283)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,g\xA7\xA7,1676055781936.f3c4392d756ce5e5e061ef2cb63d0fce. completed. 2023-02-10 19:03:04,018 DEBUG [rs(jenkins-hbase4.apache.org,35609,1676055780283)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,g\xA7\xA7,1676055781936.f3c4392d756ce5e5e061ef2cb63d0fce. 2023-02-10 19:03:04,018 DEBUG [rs(jenkins-hbase4.apache.org,35609,1676055780283)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,t43,1676055781936.ab9c3c4ad85b22b109e239684647572c. 2023-02-10 19:03:04,018 DEBUG [member: 'jenkins-hbase4.apache.org,35609,1676055780283' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 2/5 local region snapshots. 2023-02-10 19:03:04,018 DEBUG [rs(jenkins-hbase4.apache.org,35609,1676055780283)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,t43,1676055781936.ab9c3c4ad85b22b109e239684647572c. started... 2023-02-10 19:03:04,019 INFO [rs(jenkins-hbase4.apache.org,35609,1676055780283)-snapshot-pool-1] regionserver.HRegion(2744): Flushing ab9c3c4ad85b22b109e239684647572c 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-10 19:03:04,033 INFO [rs(jenkins-hbase4.apache.org,35609,1676055780283)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/data/default/testWithMapReduce/ab9c3c4ad85b22b109e239684647572c/.tmp/f1/058fe4570d8947a79c55109ff7319ed0 2023-02-10 19:03:04,052 INFO [rs(jenkins-hbase4.apache.org,35609,1676055780283)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/data/default/testWithMapReduce/ab9c3c4ad85b22b109e239684647572c/.tmp/f2/d4712dc7f55a449e9dfa7b3ef7c14110 2023-02-10 19:03:04,058 DEBUG [rs(jenkins-hbase4.apache.org,35609,1676055780283)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/data/default/testWithMapReduce/ab9c3c4ad85b22b109e239684647572c/.tmp/f1/058fe4570d8947a79c55109ff7319ed0 as hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/data/default/testWithMapReduce/ab9c3c4ad85b22b109e239684647572c/f1/058fe4570d8947a79c55109ff7319ed0 2023-02-10 19:03:04,064 INFO [rs(jenkins-hbase4.apache.org,35609,1676055780283)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/data/default/testWithMapReduce/ab9c3c4ad85b22b109e239684647572c/f1/058fe4570d8947a79c55109ff7319ed0, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-10 19:03:04,064 DEBUG [rs(jenkins-hbase4.apache.org,35609,1676055780283)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/data/default/testWithMapReduce/ab9c3c4ad85b22b109e239684647572c/.tmp/f2/d4712dc7f55a449e9dfa7b3ef7c14110 as hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/data/default/testWithMapReduce/ab9c3c4ad85b22b109e239684647572c/f2/d4712dc7f55a449e9dfa7b3ef7c14110 2023-02-10 19:03:04,070 INFO [rs(jenkins-hbase4.apache.org,35609,1676055780283)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/data/default/testWithMapReduce/ab9c3c4ad85b22b109e239684647572c/f2/d4712dc7f55a449e9dfa7b3ef7c14110, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-10 19:03:04,071 INFO [rs(jenkins-hbase4.apache.org,35609,1676055780283)-snapshot-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for ab9c3c4ad85b22b109e239684647572c in 52ms, sequenceid=5, compaction requested=false 2023-02-10 19:03:04,071 DEBUG [rs(jenkins-hbase4.apache.org,35609,1676055780283)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for ab9c3c4ad85b22b109e239684647572c: 2023-02-10 19:03:04,071 DEBUG [rs(jenkins-hbase4.apache.org,35609,1676055780283)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,t43,1676055781936.ab9c3c4ad85b22b109e239684647572c.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-10 19:03:04,072 DEBUG [rs(jenkins-hbase4.apache.org,35609,1676055780283)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-10 19:03:04,072 DEBUG [rs(jenkins-hbase4.apache.org,35609,1676055780283)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/data/default/testWithMapReduce/ab9c3c4ad85b22b109e239684647572c/f1/058fe4570d8947a79c55109ff7319ed0] hfiles 2023-02-10 19:03:04,072 DEBUG [rs(jenkins-hbase4.apache.org,35609,1676055780283)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/data/default/testWithMapReduce/ab9c3c4ad85b22b109e239684647572c/f1/058fe4570d8947a79c55109ff7319ed0 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-10 19:03:04,072 DEBUG [rs(jenkins-hbase4.apache.org,35609,1676055780283)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/data/default/testWithMapReduce/ab9c3c4ad85b22b109e239684647572c/f2/d4712dc7f55a449e9dfa7b3ef7c14110] hfiles 2023-02-10 19:03:04,072 DEBUG [rs(jenkins-hbase4.apache.org,35609,1676055780283)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/data/default/testWithMapReduce/ab9c3c4ad85b22b109e239684647572c/f2/d4712dc7f55a449e9dfa7b3ef7c14110 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-10 19:03:04,081 DEBUG [rs(jenkins-hbase4.apache.org,35609,1676055780283)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,t43,1676055781936.ab9c3c4ad85b22b109e239684647572c. completed. 2023-02-10 19:03:04,081 DEBUG [rs(jenkins-hbase4.apache.org,35609,1676055780283)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,t43,1676055781936.ab9c3c4ad85b22b109e239684647572c. 2023-02-10 19:03:04,082 DEBUG [member: 'jenkins-hbase4.apache.org,35609,1676055780283' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 3/5 local region snapshots. 2023-02-10 19:03:04,163 DEBUG [rs(jenkins-hbase4.apache.org,35609,1676055780283)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,,1676055781936.fe00f1c4e3fbcd6d7560c2506ad6ca19. completed. 2023-02-10 19:03:04,163 DEBUG [rs(jenkins-hbase4.apache.org,35609,1676055780283)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,,1676055781936.fe00f1c4e3fbcd6d7560c2506ad6ca19. 2023-02-10 19:03:04,163 DEBUG [member: 'jenkins-hbase4.apache.org,35609,1676055780283' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 4/5 local region snapshots. 2023-02-10 19:03:04,266 INFO [rs(jenkins-hbase4.apache.org,35609,1676055780283)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/data/default/testWithMapReduce/ceccc0adc99b7adc17715506edd714a5/.tmp/f2/ed218713da0842fc9dfc23a8505bdd34 2023-02-10 19:03:04,273 DEBUG [rs(jenkins-hbase4.apache.org,35609,1676055780283)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/data/default/testWithMapReduce/ceccc0adc99b7adc17715506edd714a5/.tmp/f1/e20c54d0951f49df8d8836bff53e605f as hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/data/default/testWithMapReduce/ceccc0adc99b7adc17715506edd714a5/f1/e20c54d0951f49df8d8836bff53e605f 2023-02-10 19:03:04,278 INFO [rs(jenkins-hbase4.apache.org,35609,1676055780283)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/data/default/testWithMapReduce/ceccc0adc99b7adc17715506edd714a5/f1/e20c54d0951f49df8d8836bff53e605f, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-10 19:03:04,278 DEBUG [rs(jenkins-hbase4.apache.org,35609,1676055780283)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/data/default/testWithMapReduce/ceccc0adc99b7adc17715506edd714a5/.tmp/f2/ed218713da0842fc9dfc23a8505bdd34 as hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/data/default/testWithMapReduce/ceccc0adc99b7adc17715506edd714a5/f2/ed218713da0842fc9dfc23a8505bdd34 2023-02-10 19:03:04,284 INFO [rs(jenkins-hbase4.apache.org,35609,1676055780283)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/data/default/testWithMapReduce/ceccc0adc99b7adc17715506edd714a5/f2/ed218713da0842fc9dfc23a8505bdd34, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-10 19:03:04,285 INFO [rs(jenkins-hbase4.apache.org,35609,1676055780283)-snapshot-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for ceccc0adc99b7adc17715506edd714a5 in 565ms, sequenceid=5, compaction requested=false 2023-02-10 19:03:04,285 DEBUG [rs(jenkins-hbase4.apache.org,35609,1676055780283)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for ceccc0adc99b7adc17715506edd714a5: 2023-02-10 19:03:04,285 DEBUG [rs(jenkins-hbase4.apache.org,35609,1676055780283)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,m\xED\xED,1676055781936.ceccc0adc99b7adc17715506edd714a5.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-10 19:03:04,285 DEBUG [rs(jenkins-hbase4.apache.org,35609,1676055780283)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-10 19:03:04,285 DEBUG [rs(jenkins-hbase4.apache.org,35609,1676055780283)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/data/default/testWithMapReduce/ceccc0adc99b7adc17715506edd714a5/f1/e20c54d0951f49df8d8836bff53e605f] hfiles 2023-02-10 19:03:04,285 DEBUG [rs(jenkins-hbase4.apache.org,35609,1676055780283)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/data/default/testWithMapReduce/ceccc0adc99b7adc17715506edd714a5/f1/e20c54d0951f49df8d8836bff53e605f for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-10 19:03:04,285 DEBUG [rs(jenkins-hbase4.apache.org,35609,1676055780283)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/data/default/testWithMapReduce/ceccc0adc99b7adc17715506edd714a5/f2/ed218713da0842fc9dfc23a8505bdd34] hfiles 2023-02-10 19:03:04,285 DEBUG [rs(jenkins-hbase4.apache.org,35609,1676055780283)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/data/default/testWithMapReduce/ceccc0adc99b7adc17715506edd714a5/f2/ed218713da0842fc9dfc23a8505bdd34 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-10 19:03:04,295 DEBUG [rs(jenkins-hbase4.apache.org,35609,1676055780283)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,m\xED\xED,1676055781936.ceccc0adc99b7adc17715506edd714a5. completed. 2023-02-10 19:03:04,295 DEBUG [rs(jenkins-hbase4.apache.org,35609,1676055780283)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,m\xED\xED,1676055781936.ceccc0adc99b7adc17715506edd714a5. 2023-02-10 19:03:04,295 DEBUG [member: 'jenkins-hbase4.apache.org,35609,1676055780283' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 5/5 local region snapshots. 2023-02-10 19:03:04,295 DEBUG [member: 'jenkins-hbase4.apache.org,35609,1676055780283' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 5 local region snapshots. 2023-02-10 19:03:04,295 DEBUG [member: 'jenkins-hbase4.apache.org,35609,1676055780283' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,35609,1676055780283 2023-02-10 19:03:04,295 DEBUG [member: 'jenkins-hbase4.apache.org,35609,1676055780283' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' locally completed 2023-02-10 19:03:04,295 DEBUG [member: 'jenkins-hbase4.apache.org,35609,1676055780283' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' completed for member 'jenkins-hbase4.apache.org,35609,1676055780283' in zk 2023-02-10 19:03:04,297 DEBUG [Listener at localhost/35877-EventThread] zookeeper.ZKWatcher(600): master:40103-0x1003f9d84e20000, quorum=127.0.0.1:55517, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,35609,1676055780283 2023-02-10 19:03:04,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,35609,1676055780283 2023-02-10 19:03:04,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-10 19:03:04,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-10 19:03:04,297 DEBUG [member: 'jenkins-hbase4.apache.org,35609,1676055780283' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' has notified controller of completion 2023-02-10 19:03:04,297 DEBUG [member: 'jenkins-hbase4.apache.org,35609,1676055780283' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-10 19:03:04,297 DEBUG [member: 'jenkins-hbase4.apache.org,35609,1676055780283' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' completed. 2023-02-10 19:03:04,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-10 19:03:04,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-10 19:03:04,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-10 19:03:04,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35609,1676055780283 2023-02-10 19:03:04,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38097,1676055780236 2023-02-10 19:03:04,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-10 19:03:04,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-10 19:03:04,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35609,1676055780283 2023-02-10 19:03:04,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' member 'jenkins-hbase4.apache.org,35609,1676055780283': 2023-02-10 19:03:04,301 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35609,1676055780283' released barrier for procedure'testWithMapReduceAndOfflineHBaseMultiRegion', counting down latch. Waiting for 1 more 2023-02-10 19:03:04,372 DEBUG [Listener at localhost/35877] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-10 19:03:04,374 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40103] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-10 19:03:04,374 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40103] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-10 19:03:04,375 DEBUG [Listener at localhost/35877] client.HBaseAdmin(2428): (#5) Sleeping: 1000ms while waiting for snapshot completion. 2023-02-10 19:03:04,389 INFO [rs(jenkins-hbase4.apache.org,38097,1676055780236)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/data/default/testWithMapReduce/c47924fd805c4df26e6e9e860c542007/.tmp/f1/3e01724064a848b2914128a2594b074d 2023-02-10 19:03:04,410 INFO [rs(jenkins-hbase4.apache.org,38097,1676055780236)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/data/default/testWithMapReduce/c47924fd805c4df26e6e9e860c542007/.tmp/f2/a8bc1ab2688a4c29b2b059f44dfa6d5a 2023-02-10 19:03:04,416 DEBUG [rs(jenkins-hbase4.apache.org,38097,1676055780236)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/data/default/testWithMapReduce/c47924fd805c4df26e6e9e860c542007/.tmp/f1/3e01724064a848b2914128a2594b074d as hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/data/default/testWithMapReduce/c47924fd805c4df26e6e9e860c542007/f1/3e01724064a848b2914128a2594b074d 2023-02-10 19:03:04,420 INFO [rs(jenkins-hbase4.apache.org,38097,1676055780236)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/data/default/testWithMapReduce/c47924fd805c4df26e6e9e860c542007/f1/3e01724064a848b2914128a2594b074d, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-10 19:03:04,421 DEBUG [rs(jenkins-hbase4.apache.org,38097,1676055780236)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/data/default/testWithMapReduce/c47924fd805c4df26e6e9e860c542007/.tmp/f2/a8bc1ab2688a4c29b2b059f44dfa6d5a as hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/data/default/testWithMapReduce/c47924fd805c4df26e6e9e860c542007/f2/a8bc1ab2688a4c29b2b059f44dfa6d5a 2023-02-10 19:03:04,425 INFO [rs(jenkins-hbase4.apache.org,38097,1676055780236)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/data/default/testWithMapReduce/c47924fd805c4df26e6e9e860c542007/f2/a8bc1ab2688a4c29b2b059f44dfa6d5a, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-10 19:03:04,426 INFO [rs(jenkins-hbase4.apache.org,38097,1676055780236)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for c47924fd805c4df26e6e9e860c542007 in 469ms, sequenceid=5, compaction requested=false 2023-02-10 19:03:04,426 DEBUG [rs(jenkins-hbase4.apache.org,38097,1676055780236)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for c47924fd805c4df26e6e9e860c542007: 2023-02-10 19:03:04,427 DEBUG [rs(jenkins-hbase4.apache.org,38097,1676055780236)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,q\x11\x10,1676055781936.c47924fd805c4df26e6e9e860c542007.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-10 19:03:04,427 DEBUG [rs(jenkins-hbase4.apache.org,38097,1676055780236)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-10 19:03:04,427 DEBUG [rs(jenkins-hbase4.apache.org,38097,1676055780236)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/data/default/testWithMapReduce/c47924fd805c4df26e6e9e860c542007/f1/3e01724064a848b2914128a2594b074d] hfiles 2023-02-10 19:03:04,427 DEBUG [rs(jenkins-hbase4.apache.org,38097,1676055780236)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/data/default/testWithMapReduce/c47924fd805c4df26e6e9e860c542007/f1/3e01724064a848b2914128a2594b074d for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-10 19:03:04,427 DEBUG [rs(jenkins-hbase4.apache.org,38097,1676055780236)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/data/default/testWithMapReduce/c47924fd805c4df26e6e9e860c542007/f2/a8bc1ab2688a4c29b2b059f44dfa6d5a] hfiles 2023-02-10 19:03:04,427 DEBUG [rs(jenkins-hbase4.apache.org,38097,1676055780236)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/data/default/testWithMapReduce/c47924fd805c4df26e6e9e860c542007/f2/a8bc1ab2688a4c29b2b059f44dfa6d5a for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-10 19:03:04,437 DEBUG [rs(jenkins-hbase4.apache.org,38097,1676055780236)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,q\x11\x10,1676055781936.c47924fd805c4df26e6e9e860c542007. completed. 2023-02-10 19:03:04,437 DEBUG [rs(jenkins-hbase4.apache.org,38097,1676055780236)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,q\x11\x10,1676055781936.c47924fd805c4df26e6e9e860c542007. 2023-02-10 19:03:04,437 DEBUG [member: 'jenkins-hbase4.apache.org,38097,1676055780236' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 5/5 local region snapshots. 2023-02-10 19:03:04,437 DEBUG [member: 'jenkins-hbase4.apache.org,38097,1676055780236' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 5 local region snapshots. 2023-02-10 19:03:04,437 DEBUG [member: 'jenkins-hbase4.apache.org,38097,1676055780236' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,38097,1676055780236 2023-02-10 19:03:04,437 DEBUG [member: 'jenkins-hbase4.apache.org,38097,1676055780236' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' locally completed 2023-02-10 19:03:04,437 DEBUG [member: 'jenkins-hbase4.apache.org,38097,1676055780236' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' completed for member 'jenkins-hbase4.apache.org,38097,1676055780236' in zk 2023-02-10 19:03:04,439 DEBUG [member: 'jenkins-hbase4.apache.org,38097,1676055780236' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' has notified controller of completion 2023-02-10 19:03:04,439 DEBUG [Listener at localhost/35877-EventThread] zookeeper.ZKWatcher(600): master:40103-0x1003f9d84e20000, quorum=127.0.0.1:55517, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,38097,1676055780236 2023-02-10 19:03:04,439 DEBUG [member: 'jenkins-hbase4.apache.org,38097,1676055780236' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-10 19:03:04,439 DEBUG [member: 'jenkins-hbase4.apache.org,38097,1676055780236' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' completed. 2023-02-10 19:03:04,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,38097,1676055780236 2023-02-10 19:03:04,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-10 19:03:04,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-10 19:03:04,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-10 19:03:04,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-10 19:03:04,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-10 19:03:04,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35609,1676055780283 2023-02-10 19:03:04,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38097,1676055780236 2023-02-10 19:03:04,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-10 19:03:04,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-10 19:03:04,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35609,1676055780283 2023-02-10 19:03:04,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38097,1676055780236 2023-02-10 19:03:04,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' member 'jenkins-hbase4.apache.org,38097,1676055780236': 2023-02-10 19:03:04,443 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38097,1676055780236' released barrier for procedure'testWithMapReduceAndOfflineHBaseMultiRegion', counting down latch. Waiting for 0 more 2023-02-10 19:03:04,443 INFO [(jenkins-hbase4.apache.org,40103,1676055780155)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' execution completed 2023-02-10 19:03:04,443 DEBUG [(jenkins-hbase4.apache.org,40103,1676055780155)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-10 19:03:04,443 DEBUG [(jenkins-hbase4.apache.org,40103,1676055780155)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-10 19:03:04,443 DEBUG [(jenkins-hbase4.apache.org,40103,1676055780155)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-10 19:03:04,443 INFO [(jenkins-hbase4.apache.org,40103,1676055780155)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMapReduceAndOfflineHBaseMultiRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-02-10 19:03:04,445 DEBUG [Listener at localhost/35877-EventThread] zookeeper.ZKWatcher(600): regionserver:35609-0x1003f9d84e20002, quorum=127.0.0.1:55517, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-10 19:03:04,445 DEBUG [Listener at localhost/35877-EventThread] zookeeper.ZKWatcher(600): regionserver:38097-0x1003f9d84e20001, quorum=127.0.0.1:55517, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-10 19:03:04,445 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-10 19:03:04,445 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-10 19:03:04,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-10 19:03:04,445 DEBUG [Listener at localhost/35877-EventThread] zookeeper.ZKWatcher(600): regionserver:38097-0x1003f9d84e20001, quorum=127.0.0.1:55517, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-10 19:03:04,445 DEBUG [Listener at localhost/35877-EventThread] zookeeper.ZKWatcher(600): regionserver:35609-0x1003f9d84e20002, quorum=127.0.0.1:55517, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-10 19:03:04,445 DEBUG [Listener at localhost/35877-EventThread] zookeeper.ZKWatcher(600): master:40103-0x1003f9d84e20000, quorum=127.0.0.1:55517, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-10 19:03:04,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-10 19:03:04,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-10 19:03:04,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-10 19:03:04,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-10 19:03:04,445 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-10 19:03:04,445 DEBUG [(jenkins-hbase4.apache.org,40103,1676055780155)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40103-0x1003f9d84e20000, quorum=127.0.0.1:55517, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,35609,1676055780283 2023-02-10 19:03:04,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-10 19:03:04,445 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-10 19:03:04,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-10 19:03:04,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-10 19:03:04,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-10 19:03:04,446 DEBUG [(jenkins-hbase4.apache.org,40103,1676055780155)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40103-0x1003f9d84e20000, quorum=127.0.0.1:55517, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,38097,1676055780236 2023-02-10 19:03:04,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-10 19:03:04,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-10 19:03:04,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-10 19:03:04,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-10 19:03:04,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35609,1676055780283 2023-02-10 19:03:04,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38097,1676055780236 2023-02-10 19:03:04,447 DEBUG [(jenkins-hbase4.apache.org,40103,1676055780155)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40103-0x1003f9d84e20000, quorum=127.0.0.1:55517, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,35609,1676055780283 2023-02-10 19:03:04,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-10 19:03:04,448 DEBUG [(jenkins-hbase4.apache.org,40103,1676055780155)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40103-0x1003f9d84e20000, quorum=127.0.0.1:55517, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,38097,1676055780236 2023-02-10 19:03:04,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-10 19:03:04,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35609,1676055780283 2023-02-10 19:03:04,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38097,1676055780236 2023-02-10 19:03:04,456 DEBUG [Listener at localhost/35877-EventThread] zookeeper.ZKWatcher(600): master:40103-0x1003f9d84e20000, quorum=127.0.0.1:55517, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,38097,1676055780236 2023-02-10 19:03:04,457 DEBUG [Listener at localhost/35877-EventThread] zookeeper.ZKWatcher(600): regionserver:35609-0x1003f9d84e20002, quorum=127.0.0.1:55517, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-10 19:03:04,457 DEBUG [Listener at localhost/35877-EventThread] zookeeper.ZKWatcher(600): master:40103-0x1003f9d84e20000, quorum=127.0.0.1:55517, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-10 19:03:04,457 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-10 19:03:04,457 DEBUG [Listener at localhost/35877-EventThread] zookeeper.ZKWatcher(600): regionserver:38097-0x1003f9d84e20001, quorum=127.0.0.1:55517, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-10 19:03:04,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-10 19:03:04,457 DEBUG [Listener at localhost/35877-EventThread] zookeeper.ZKWatcher(600): master:40103-0x1003f9d84e20000, quorum=127.0.0.1:55517, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,35609,1676055780283 2023-02-10 19:03:04,457 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-10 19:03:04,457 DEBUG [(jenkins-hbase4.apache.org,40103,1676055780155)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-10 19:03:04,457 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-10 19:03:04,457 DEBUG [Listener at localhost/35877-EventThread] zookeeper.ZKWatcher(600): regionserver:35609-0x1003f9d84e20002, quorum=127.0.0.1:55517, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-10 19:03:04,457 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-10 19:03:04,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-10 19:03:04,458 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-10 19:03:04,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-10 19:03:04,457 DEBUG [Listener at localhost/35877-EventThread] zookeeper.ZKWatcher(600): regionserver:38097-0x1003f9d84e20001, quorum=127.0.0.1:55517, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-10 19:03:04,457 DEBUG [Listener at localhost/35877-EventThread] zookeeper.ZKWatcher(600): master:40103-0x1003f9d84e20000, quorum=127.0.0.1:55517, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-10 19:03:04,458 DEBUG [Listener at localhost/35877-EventThread] zookeeper.ZKWatcher(600): master:40103-0x1003f9d84e20000, quorum=127.0.0.1:55517, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,38097,1676055780236 2023-02-10 19:03:04,458 DEBUG [Listener at localhost/35877-EventThread] zookeeper.ZKWatcher(600): master:40103-0x1003f9d84e20000, quorum=127.0.0.1:55517, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-10 19:03:04,458 DEBUG [Listener at localhost/35877-EventThread] zookeeper.ZKWatcher(600): master:40103-0x1003f9d84e20000, quorum=127.0.0.1:55517, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,35609,1676055780283 2023-02-10 19:03:04,458 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-10 19:03:04,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-10 19:03:04,458 DEBUG [Listener at localhost/35877-EventThread] zookeeper.ZKWatcher(600): master:40103-0x1003f9d84e20000, quorum=127.0.0.1:55517, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-10 19:03:04,459 DEBUG [Listener at localhost/35877-EventThread] zookeeper.ZKWatcher(600): master:40103-0x1003f9d84e20000, quorum=127.0.0.1:55517, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-10 19:03:04,459 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/.hbase-snapshot/.tmp/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-10 19:03:04,702 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/.hbase-snapshot/.tmp/testWithMapReduceAndOfflineHBaseMultiRegion to hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/.hbase-snapshot/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-10 19:03:04,729 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot testWithMapReduceAndOfflineHBaseMultiRegion of table testWithMapReduce completed 2023-02-10 19:03:04,729 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/.hbase-snapshot/.tmp/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-10 19:03:04,730 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/.hbase-snapshot/.tmp/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-10 19:03:04,730 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot testWithMapReduceAndOfflineHBaseMultiRegion C_M_SNAPSHOT_TABLE on table testWithMapReduce at 1676055783264Consolidate snapshot: testWithMapReduceAndOfflineHBaseMultiRegion at 1676055784457 (+1193 ms)Loading Region manifests for testWithMapReduceAndOfflineHBaseMultiRegion at 1676055784458 (+1 ms)Writing data manifest for testWithMapReduceAndOfflineHBaseMultiRegion at 1676055784672 (+214 ms)Verifying snapshot: testWithMapReduceAndOfflineHBaseMultiRegion at 1676055784685 (+13 ms)Snapshot testWithMapReduceAndOfflineHBaseMultiRegion of table testWithMapReduce completed at 1676055784729 (+44 ms) 2023-02-10 19:03:04,732 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=32, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-10 19:03:04,733 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=32, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED in 1.4670 sec 2023-02-10 19:03:05,375 DEBUG [Listener at localhost/35877] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-10 19:03:05,376 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40103] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-10 19:03:05,377 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40103] snapshot.SnapshotManager(401): Snapshot '{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' has completed, notifying client. 2023-02-10 19:03:05,377 INFO [Listener at localhost/35877] snapshot.SnapshotTestingUtils(399): Confirming snapshot exists. 2023-02-10 19:03:05,382 INFO [Listener at localhost/35877] snapshot.SnapshotTestingUtils(406): validating snapshot. 2023-02-10 19:03:05,389 INFO [Listener at localhost/35877] mapreduce.TableSnapshotInputFormatTestBase(218): load different values 2023-02-10 19:03:05,424 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38097] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 8788 Client: jenkins//172.31.14.131 first region in multi=testWithMapReduce,aaa,1676055781936.d1ba49f10de14d81a2fad0498c59a9b7. 2023-02-10 19:03:05,426 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35609] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 8788 Client: jenkins//172.31.14.131 first region in multi=testWithMapReduce,g\xA7\xA7,1676055781936.f3c4392d756ce5e5e061ef2cb63d0fce. 2023-02-10 19:03:05,512 INFO [Listener at localhost/35877] mapreduce.TableSnapshotInputFormatTestBase(222): cause flush to create new files in the region 2023-02-10 19:03:05,520 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40103] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-10 19:03:05,548 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40103] procedure.ProcedureCoordinator(165): Submitting procedure testWithMapReduce 2023-02-10 19:03:05,561 INFO [(jenkins-hbase4.apache.org,40103,1676055780155)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMapReduce' 2023-02-10 19:03:05,562 DEBUG [(jenkins-hbase4.apache.org,40103,1676055780155)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-10 19:03:05,563 DEBUG [(jenkins-hbase4.apache.org,40103,1676055780155)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMapReduce' starting 'acquire' 2023-02-10 19:03:05,563 DEBUG [(jenkins-hbase4.apache.org,40103,1676055780155)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMapReduce', kicking off acquire phase on members. 2023-02-10 19:03:05,564 DEBUG [(jenkins-hbase4.apache.org,40103,1676055780155)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40103-0x1003f9d84e20000, quorum=127.0.0.1:55517, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-10 19:03:05,564 DEBUG [(jenkins-hbase4.apache.org,40103,1676055780155)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-10 19:03:05,566 DEBUG [Listener at localhost/35877-EventThread] zookeeper.ZKWatcher(600): regionserver:38097-0x1003f9d84e20001, quorum=127.0.0.1:55517, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-10 19:03:05,566 DEBUG [Listener at localhost/35877-EventThread] zookeeper.ZKWatcher(600): regionserver:35609-0x1003f9d84e20002, quorum=127.0.0.1:55517, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-10 19:03:05,566 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-10 19:03:05,566 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-10 19:03:05,566 DEBUG [(jenkins-hbase4.apache.org,40103,1676055780155)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,38097,1676055780236 2023-02-10 19:03:05,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-10 19:03:05,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-10 19:03:05,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-10 19:03:05,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-10 19:03:05,567 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38097-0x1003f9d84e20001, quorum=127.0.0.1:55517, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-10 19:03:05,568 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35609-0x1003f9d84e20002, quorum=127.0.0.1:55517, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-10 19:03:05,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-10 19:03:05,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-10 19:03:05,568 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMapReduce 2023-02-10 19:03:05,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-10 19:03:05,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-10 19:03:05,569 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMapReduce 2023-02-10 19:03:05,569 DEBUG [(jenkins-hbase4.apache.org,40103,1676055780155)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40103-0x1003f9d84e20000, quorum=127.0.0.1:55517, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,38097,1676055780236 2023-02-10 19:03:05,569 DEBUG [(jenkins-hbase4.apache.org,40103,1676055780155)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,35609,1676055780283 2023-02-10 19:03:05,569 DEBUG [(jenkins-hbase4.apache.org,40103,1676055780155)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40103-0x1003f9d84e20000, quorum=127.0.0.1:55517, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,35609,1676055780283 2023-02-10 19:03:05,569 DEBUG [(jenkins-hbase4.apache.org,40103,1676055780155)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-10 19:03:05,572 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduce 2023-02-10 19:03:05,578 DEBUG [member: 'jenkins-hbase4.apache.org,38097,1676055780236' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduce' with timeout 60000ms 2023-02-10 19:03:05,578 DEBUG [member: 'jenkins-hbase4.apache.org,38097,1676055780236' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-10 19:03:05,588 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduce 2023-02-10 19:03:05,605 DEBUG [member: 'jenkins-hbase4.apache.org,38097,1676055780236' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduce' starting 'acquire' stage 2023-02-10 19:03:05,605 DEBUG [member: 'jenkins-hbase4.apache.org,35609,1676055780283' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduce' with timeout 60000ms 2023-02-10 19:03:05,605 DEBUG [member: 'jenkins-hbase4.apache.org,35609,1676055780283' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-10 19:03:05,615 DEBUG [member: 'jenkins-hbase4.apache.org,35609,1676055780283' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduce' starting 'acquire' stage 2023-02-10 19:03:05,615 DEBUG [rs(jenkins-hbase4.apache.org,38097,1676055780236)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,d\x84\x84,1676055781936.e06f6220742d6bd40a5b138f872afaa0. 2023-02-10 19:03:05,615 DEBUG [rs(jenkins-hbase4.apache.org,38097,1676055780236)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,d\x84\x84,1676055781936.e06f6220742d6bd40a5b138f872afaa0. started... 2023-02-10 19:03:05,615 DEBUG [rs(jenkins-hbase4.apache.org,38097,1676055780236)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,zz{,1676055781936.aff2d18d26e1916478e05b25bb5c9a89. 2023-02-10 19:03:05,615 DEBUG [rs(jenkins-hbase4.apache.org,38097,1676055780236)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,zz{,1676055781936.aff2d18d26e1916478e05b25bb5c9a89. started... 2023-02-10 19:03:05,615 DEBUG [rs(jenkins-hbase4.apache.org,38097,1676055780236)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for aff2d18d26e1916478e05b25bb5c9a89: 2023-02-10 19:03:05,615 INFO [rs(jenkins-hbase4.apache.org,38097,1676055780236)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing e06f6220742d6bd40a5b138f872afaa0 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-10 19:03:05,615 DEBUG [rs(jenkins-hbase4.apache.org,38097,1676055780236)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,zz{,1676055781936.aff2d18d26e1916478e05b25bb5c9a89. 2023-02-10 19:03:05,616 DEBUG [rs(jenkins-hbase4.apache.org,38097,1676055780236)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,aaa,1676055781936.d1ba49f10de14d81a2fad0498c59a9b7. 2023-02-10 19:03:05,616 DEBUG [rs(jenkins-hbase4.apache.org,38097,1676055780236)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,aaa,1676055781936.d1ba49f10de14d81a2fad0498c59a9b7. started... 2023-02-10 19:03:05,616 INFO [rs(jenkins-hbase4.apache.org,38097,1676055780236)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing d1ba49f10de14d81a2fad0498c59a9b7 2/2 column families, dataSize=248.22 KB heapSize=634.25 KB 2023-02-10 19:03:05,616 DEBUG [member: 'jenkins-hbase4.apache.org,38097,1676055780236' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 5 regions 2023-02-10 19:03:05,617 DEBUG [member: 'jenkins-hbase4.apache.org,38097,1676055780236' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-10 19:03:05,617 DEBUG [rs(jenkins-hbase4.apache.org,35609,1676055780283)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,,1676055781936.fe00f1c4e3fbcd6d7560c2506ad6ca19. 2023-02-10 19:03:05,617 DEBUG [rs(jenkins-hbase4.apache.org,38097,1676055780236)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,j\xCA\xCA,1676055781936.3c13d5e817a81b6f4b36ab3d9762b76f. 2023-02-10 19:03:05,617 DEBUG [rs(jenkins-hbase4.apache.org,35609,1676055780283)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,wWV,1676055781936.4dfcfb14720b0f66e0e9179835dbe61d. 2023-02-10 19:03:05,617 DEBUG [member: 'jenkins-hbase4.apache.org,35609,1676055780283' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 5 regions 2023-02-10 19:03:05,617 DEBUG [member: 'jenkins-hbase4.apache.org,35609,1676055780283' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-10 19:03:05,617 DEBUG [member: 'jenkins-hbase4.apache.org,38097,1676055780236' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/5 local region flush tasks. 2023-02-10 19:03:05,617 DEBUG [rs(jenkins-hbase4.apache.org,35609,1676055780283)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,m\xED\xED,1676055781936.ceccc0adc99b7adc17715506edd714a5. 2023-02-10 19:03:05,617 DEBUG [rs(jenkins-hbase4.apache.org,35609,1676055780283)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,wWV,1676055781936.4dfcfb14720b0f66e0e9179835dbe61d. started... 2023-02-10 19:03:05,617 DEBUG [rs(jenkins-hbase4.apache.org,38097,1676055780236)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,j\xCA\xCA,1676055781936.3c13d5e817a81b6f4b36ab3d9762b76f. started... 2023-02-10 19:03:05,617 DEBUG [rs(jenkins-hbase4.apache.org,35609,1676055780283)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,,1676055781936.fe00f1c4e3fbcd6d7560c2506ad6ca19. started... 2023-02-10 19:03:05,618 DEBUG [rs(jenkins-hbase4.apache.org,35609,1676055780283)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,m\xED\xED,1676055781936.ceccc0adc99b7adc17715506edd714a5. started... 2023-02-10 19:03:05,619 DEBUG [rs(jenkins-hbase4.apache.org,35609,1676055780283)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for fe00f1c4e3fbcd6d7560c2506ad6ca19: 2023-02-10 19:03:05,619 INFO [rs(jenkins-hbase4.apache.org,35609,1676055780283)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing ceccc0adc99b7adc17715506edd714a5 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-10 19:03:05,619 INFO [rs(jenkins-hbase4.apache.org,38097,1676055780236)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 3c13d5e817a81b6f4b36ab3d9762b76f 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-10 19:03:05,619 DEBUG [rs(jenkins-hbase4.apache.org,35609,1676055780283)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,,1676055781936.fe00f1c4e3fbcd6d7560c2506ad6ca19. 2023-02-10 19:03:05,619 DEBUG [rs(jenkins-hbase4.apache.org,35609,1676055780283)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,g\xA7\xA7,1676055781936.f3c4392d756ce5e5e061ef2cb63d0fce. 2023-02-10 19:03:05,619 DEBUG [rs(jenkins-hbase4.apache.org,35609,1676055780283)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,g\xA7\xA7,1676055781936.f3c4392d756ce5e5e061ef2cb63d0fce. started... 2023-02-10 19:03:05,619 DEBUG [member: 'jenkins-hbase4.apache.org,35609,1676055780283' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/5 local region flush tasks. 2023-02-10 19:03:05,619 INFO [rs(jenkins-hbase4.apache.org,35609,1676055780283)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 4dfcfb14720b0f66e0e9179835dbe61d 2/2 column families, dataSize=248.22 KB heapSize=634.25 KB 2023-02-10 19:03:05,619 INFO [rs(jenkins-hbase4.apache.org,35609,1676055780283)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing f3c4392d756ce5e5e061ef2cb63d0fce 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-10 19:03:05,660 INFO [rs(jenkins-hbase4.apache.org,35609,1676055780283)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/data/default/testWithMapReduce/4dfcfb14720b0f66e0e9179835dbe61d/.tmp/f1/028d35de949c475aaf2b190454e0ef87 2023-02-10 19:03:05,672 INFO [rs(jenkins-hbase4.apache.org,38097,1676055780236)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/data/default/testWithMapReduce/e06f6220742d6bd40a5b138f872afaa0/.tmp/f1/b40ad3556b2d48769b85558834828b0e 2023-02-10 19:03:05,697 INFO [rs(jenkins-hbase4.apache.org,38097,1676055780236)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/data/default/testWithMapReduce/d1ba49f10de14d81a2fad0498c59a9b7/.tmp/f1/4cfbaa4c85104c76bc4bc9505781b36c 2023-02-10 19:03:05,700 INFO [rs(jenkins-hbase4.apache.org,35609,1676055780283)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/data/default/testWithMapReduce/ceccc0adc99b7adc17715506edd714a5/.tmp/f1/479c9fed1377487d967e92b398984517 2023-02-10 19:03:05,700 INFO [rs(jenkins-hbase4.apache.org,35609,1676055780283)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/data/default/testWithMapReduce/f3c4392d756ce5e5e061ef2cb63d0fce/.tmp/f1/624d71c79e074f26b8b82d7e780a6127 2023-02-10 19:03:05,700 INFO [rs(jenkins-hbase4.apache.org,38097,1676055780236)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/data/default/testWithMapReduce/3c13d5e817a81b6f4b36ab3d9762b76f/.tmp/f1/9bd91c70801c4c7eb7e266c5f7eca6bb 2023-02-10 19:03:05,708 INFO [rs(jenkins-hbase4.apache.org,35609,1676055780283)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/data/default/testWithMapReduce/4dfcfb14720b0f66e0e9179835dbe61d/.tmp/f2/bcc4779f3cc041edb46abe060c11f1a1 2023-02-10 19:03:05,728 INFO [rs(jenkins-hbase4.apache.org,38097,1676055780236)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/data/default/testWithMapReduce/e06f6220742d6bd40a5b138f872afaa0/.tmp/f2/5e852a0fff6e4fb1bcb8b55aa1e692ff 2023-02-10 19:03:05,728 DEBUG [rs(jenkins-hbase4.apache.org,35609,1676055780283)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/data/default/testWithMapReduce/4dfcfb14720b0f66e0e9179835dbe61d/.tmp/f1/028d35de949c475aaf2b190454e0ef87 as hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/data/default/testWithMapReduce/4dfcfb14720b0f66e0e9179835dbe61d/f1/028d35de949c475aaf2b190454e0ef87 2023-02-10 19:03:05,736 DEBUG [rs(jenkins-hbase4.apache.org,38097,1676055780236)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/data/default/testWithMapReduce/e06f6220742d6bd40a5b138f872afaa0/.tmp/f1/b40ad3556b2d48769b85558834828b0e as hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/data/default/testWithMapReduce/e06f6220742d6bd40a5b138f872afaa0/f1/b40ad3556b2d48769b85558834828b0e 2023-02-10 19:03:05,740 INFO [rs(jenkins-hbase4.apache.org,35609,1676055780283)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/data/default/testWithMapReduce/4dfcfb14720b0f66e0e9179835dbe61d/f1/028d35de949c475aaf2b190454e0ef87, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-10 19:03:05,741 INFO [rs(jenkins-hbase4.apache.org,38097,1676055780236)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/data/default/testWithMapReduce/e06f6220742d6bd40a5b138f872afaa0/f1/b40ad3556b2d48769b85558834828b0e, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-10 19:03:05,741 DEBUG [rs(jenkins-hbase4.apache.org,35609,1676055780283)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/data/default/testWithMapReduce/4dfcfb14720b0f66e0e9179835dbe61d/.tmp/f2/bcc4779f3cc041edb46abe060c11f1a1 as hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/data/default/testWithMapReduce/4dfcfb14720b0f66e0e9179835dbe61d/f2/bcc4779f3cc041edb46abe060c11f1a1 2023-02-10 19:03:05,742 DEBUG [rs(jenkins-hbase4.apache.org,38097,1676055780236)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/data/default/testWithMapReduce/e06f6220742d6bd40a5b138f872afaa0/.tmp/f2/5e852a0fff6e4fb1bcb8b55aa1e692ff as hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/data/default/testWithMapReduce/e06f6220742d6bd40a5b138f872afaa0/f2/5e852a0fff6e4fb1bcb8b55aa1e692ff 2023-02-10 19:03:05,747 INFO [rs(jenkins-hbase4.apache.org,35609,1676055780283)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/data/default/testWithMapReduce/4dfcfb14720b0f66e0e9179835dbe61d/f2/bcc4779f3cc041edb46abe060c11f1a1, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-10 19:03:05,748 INFO [rs(jenkins-hbase4.apache.org,38097,1676055780236)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/data/default/testWithMapReduce/e06f6220742d6bd40a5b138f872afaa0/f2/5e852a0fff6e4fb1bcb8b55aa1e692ff, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-10 19:03:05,748 INFO [rs(jenkins-hbase4.apache.org,38097,1676055780236)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/data/default/testWithMapReduce/3c13d5e817a81b6f4b36ab3d9762b76f/.tmp/f2/143de338082c442ebb32f63141f14bc9 2023-02-10 19:03:05,749 INFO [rs(jenkins-hbase4.apache.org,35609,1676055780283)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~248.22 KB/254176, heapSize ~634.22 KB/649440, currentSize=0 B/0 for 4dfcfb14720b0f66e0e9179835dbe61d in 130ms, sequenceid=9, compaction requested=false 2023-02-10 19:03:05,749 DEBUG [rs(jenkins-hbase4.apache.org,35609,1676055780283)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 4dfcfb14720b0f66e0e9179835dbe61d: 2023-02-10 19:03:05,749 DEBUG [rs(jenkins-hbase4.apache.org,35609,1676055780283)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,wWV,1676055781936.4dfcfb14720b0f66e0e9179835dbe61d. 2023-02-10 19:03:05,749 DEBUG [rs(jenkins-hbase4.apache.org,35609,1676055780283)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,t43,1676055781936.ab9c3c4ad85b22b109e239684647572c. 2023-02-10 19:03:05,749 DEBUG [member: 'jenkins-hbase4.apache.org,35609,1676055780283' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/5 local region flush tasks. 2023-02-10 19:03:05,749 INFO [rs(jenkins-hbase4.apache.org,38097,1676055780236)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for e06f6220742d6bd40a5b138f872afaa0 in 134ms, sequenceid=9, compaction requested=false 2023-02-10 19:03:05,749 DEBUG [rs(jenkins-hbase4.apache.org,38097,1676055780236)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for e06f6220742d6bd40a5b138f872afaa0: 2023-02-10 19:03:05,749 DEBUG [rs(jenkins-hbase4.apache.org,38097,1676055780236)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,d\x84\x84,1676055781936.e06f6220742d6bd40a5b138f872afaa0. 2023-02-10 19:03:05,749 DEBUG [rs(jenkins-hbase4.apache.org,35609,1676055780283)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,t43,1676055781936.ab9c3c4ad85b22b109e239684647572c. started... 2023-02-10 19:03:05,750 INFO [rs(jenkins-hbase4.apache.org,35609,1676055780283)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing ab9c3c4ad85b22b109e239684647572c 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-10 19:03:05,756 DEBUG [rs(jenkins-hbase4.apache.org,38097,1676055780236)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,q\x11\x10,1676055781936.c47924fd805c4df26e6e9e860c542007. 2023-02-10 19:03:05,756 DEBUG [member: 'jenkins-hbase4.apache.org,38097,1676055780236' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/5 local region flush tasks. 2023-02-10 19:03:05,756 DEBUG [rs(jenkins-hbase4.apache.org,38097,1676055780236)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,q\x11\x10,1676055781936.c47924fd805c4df26e6e9e860c542007. started... 2023-02-10 19:03:05,756 INFO [rs(jenkins-hbase4.apache.org,38097,1676055780236)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing c47924fd805c4df26e6e9e860c542007 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-10 19:03:05,758 DEBUG [rs(jenkins-hbase4.apache.org,38097,1676055780236)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/data/default/testWithMapReduce/3c13d5e817a81b6f4b36ab3d9762b76f/.tmp/f1/9bd91c70801c4c7eb7e266c5f7eca6bb as hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/data/default/testWithMapReduce/3c13d5e817a81b6f4b36ab3d9762b76f/f1/9bd91c70801c4c7eb7e266c5f7eca6bb 2023-02-10 19:03:05,767 INFO [rs(jenkins-hbase4.apache.org,38097,1676055780236)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/data/default/testWithMapReduce/3c13d5e817a81b6f4b36ab3d9762b76f/f1/9bd91c70801c4c7eb7e266c5f7eca6bb, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-10 19:03:05,768 DEBUG [rs(jenkins-hbase4.apache.org,38097,1676055780236)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/data/default/testWithMapReduce/3c13d5e817a81b6f4b36ab3d9762b76f/.tmp/f2/143de338082c442ebb32f63141f14bc9 as hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/data/default/testWithMapReduce/3c13d5e817a81b6f4b36ab3d9762b76f/f2/143de338082c442ebb32f63141f14bc9 2023-02-10 19:03:05,771 INFO [rs(jenkins-hbase4.apache.org,35609,1676055780283)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/data/default/testWithMapReduce/ab9c3c4ad85b22b109e239684647572c/.tmp/f1/71238a412d2743479236248a745e3fc2 2023-02-10 19:03:05,773 INFO [rs(jenkins-hbase4.apache.org,38097,1676055780236)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/data/default/testWithMapReduce/3c13d5e817a81b6f4b36ab3d9762b76f/f2/143de338082c442ebb32f63141f14bc9, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-10 19:03:05,774 INFO [rs(jenkins-hbase4.apache.org,38097,1676055780236)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 3c13d5e817a81b6f4b36ab3d9762b76f in 155ms, sequenceid=9, compaction requested=false 2023-02-10 19:03:05,775 DEBUG [rs(jenkins-hbase4.apache.org,38097,1676055780236)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 3c13d5e817a81b6f4b36ab3d9762b76f: 2023-02-10 19:03:05,775 DEBUG [rs(jenkins-hbase4.apache.org,38097,1676055780236)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,j\xCA\xCA,1676055781936.3c13d5e817a81b6f4b36ab3d9762b76f. 2023-02-10 19:03:05,775 DEBUG [member: 'jenkins-hbase4.apache.org,38097,1676055780236' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/5 local region flush tasks. 2023-02-10 19:03:05,780 INFO [rs(jenkins-hbase4.apache.org,38097,1676055780236)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/data/default/testWithMapReduce/c47924fd805c4df26e6e9e860c542007/.tmp/f1/c426ff6e69b9414dafc4acb3abd6ae4f 2023-02-10 19:03:05,803 INFO [rs(jenkins-hbase4.apache.org,35609,1676055780283)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/data/default/testWithMapReduce/ab9c3c4ad85b22b109e239684647572c/.tmp/f2/1b08897c19264da698e51ea5dc974ff1 2023-02-10 19:03:05,805 INFO [rs(jenkins-hbase4.apache.org,38097,1676055780236)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/data/default/testWithMapReduce/c47924fd805c4df26e6e9e860c542007/.tmp/f2/192d49b6ab27447fada8738d0f54beab 2023-02-10 19:03:05,810 DEBUG [rs(jenkins-hbase4.apache.org,35609,1676055780283)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/data/default/testWithMapReduce/ab9c3c4ad85b22b109e239684647572c/.tmp/f1/71238a412d2743479236248a745e3fc2 as hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/data/default/testWithMapReduce/ab9c3c4ad85b22b109e239684647572c/f1/71238a412d2743479236248a745e3fc2 2023-02-10 19:03:05,811 DEBUG [rs(jenkins-hbase4.apache.org,38097,1676055780236)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/data/default/testWithMapReduce/c47924fd805c4df26e6e9e860c542007/.tmp/f1/c426ff6e69b9414dafc4acb3abd6ae4f as hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/data/default/testWithMapReduce/c47924fd805c4df26e6e9e860c542007/f1/c426ff6e69b9414dafc4acb3abd6ae4f 2023-02-10 19:03:05,816 INFO [rs(jenkins-hbase4.apache.org,38097,1676055780236)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/data/default/testWithMapReduce/c47924fd805c4df26e6e9e860c542007/f1/c426ff6e69b9414dafc4acb3abd6ae4f, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-10 19:03:05,816 INFO [rs(jenkins-hbase4.apache.org,35609,1676055780283)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/data/default/testWithMapReduce/ab9c3c4ad85b22b109e239684647572c/f1/71238a412d2743479236248a745e3fc2, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-10 19:03:05,817 DEBUG [rs(jenkins-hbase4.apache.org,38097,1676055780236)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/data/default/testWithMapReduce/c47924fd805c4df26e6e9e860c542007/.tmp/f2/192d49b6ab27447fada8738d0f54beab as hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/data/default/testWithMapReduce/c47924fd805c4df26e6e9e860c542007/f2/192d49b6ab27447fada8738d0f54beab 2023-02-10 19:03:05,818 DEBUG [rs(jenkins-hbase4.apache.org,35609,1676055780283)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/data/default/testWithMapReduce/ab9c3c4ad85b22b109e239684647572c/.tmp/f2/1b08897c19264da698e51ea5dc974ff1 as hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/data/default/testWithMapReduce/ab9c3c4ad85b22b109e239684647572c/f2/1b08897c19264da698e51ea5dc974ff1 2023-02-10 19:03:05,824 INFO [rs(jenkins-hbase4.apache.org,38097,1676055780236)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/data/default/testWithMapReduce/c47924fd805c4df26e6e9e860c542007/f2/192d49b6ab27447fada8738d0f54beab, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-10 19:03:05,825 INFO [rs(jenkins-hbase4.apache.org,38097,1676055780236)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for c47924fd805c4df26e6e9e860c542007 in 69ms, sequenceid=9, compaction requested=false 2023-02-10 19:03:05,825 DEBUG [rs(jenkins-hbase4.apache.org,38097,1676055780236)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for c47924fd805c4df26e6e9e860c542007: 2023-02-10 19:03:05,825 INFO [rs(jenkins-hbase4.apache.org,35609,1676055780283)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/data/default/testWithMapReduce/ab9c3c4ad85b22b109e239684647572c/f2/1b08897c19264da698e51ea5dc974ff1, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-10 19:03:05,825 DEBUG [rs(jenkins-hbase4.apache.org,38097,1676055780236)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,q\x11\x10,1676055781936.c47924fd805c4df26e6e9e860c542007. 2023-02-10 19:03:05,825 DEBUG [member: 'jenkins-hbase4.apache.org,38097,1676055780236' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 4/5 local region flush tasks. 2023-02-10 19:03:05,826 INFO [rs(jenkins-hbase4.apache.org,35609,1676055780283)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for ab9c3c4ad85b22b109e239684647572c in 77ms, sequenceid=9, compaction requested=false 2023-02-10 19:03:05,826 DEBUG [rs(jenkins-hbase4.apache.org,35609,1676055780283)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for ab9c3c4ad85b22b109e239684647572c: 2023-02-10 19:03:05,826 DEBUG [rs(jenkins-hbase4.apache.org,35609,1676055780283)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,t43,1676055781936.ab9c3c4ad85b22b109e239684647572c. 2023-02-10 19:03:05,827 DEBUG [member: 'jenkins-hbase4.apache.org,35609,1676055780283' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/5 local region flush tasks. 2023-02-10 19:03:06,144 INFO [rs(jenkins-hbase4.apache.org,35609,1676055780283)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/data/default/testWithMapReduce/f3c4392d756ce5e5e061ef2cb63d0fce/.tmp/f2/1c345fada5684ebe98fa35d2734b6684 2023-02-10 19:03:06,150 DEBUG [rs(jenkins-hbase4.apache.org,35609,1676055780283)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/data/default/testWithMapReduce/f3c4392d756ce5e5e061ef2cb63d0fce/.tmp/f1/624d71c79e074f26b8b82d7e780a6127 as hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/data/default/testWithMapReduce/f3c4392d756ce5e5e061ef2cb63d0fce/f1/624d71c79e074f26b8b82d7e780a6127 2023-02-10 19:03:06,154 INFO [rs(jenkins-hbase4.apache.org,35609,1676055780283)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/data/default/testWithMapReduce/f3c4392d756ce5e5e061ef2cb63d0fce/f1/624d71c79e074f26b8b82d7e780a6127, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-10 19:03:06,155 DEBUG [rs(jenkins-hbase4.apache.org,35609,1676055780283)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/data/default/testWithMapReduce/f3c4392d756ce5e5e061ef2cb63d0fce/.tmp/f2/1c345fada5684ebe98fa35d2734b6684 as hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/data/default/testWithMapReduce/f3c4392d756ce5e5e061ef2cb63d0fce/f2/1c345fada5684ebe98fa35d2734b6684 2023-02-10 19:03:06,159 INFO [rs(jenkins-hbase4.apache.org,35609,1676055780283)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/data/default/testWithMapReduce/f3c4392d756ce5e5e061ef2cb63d0fce/f2/1c345fada5684ebe98fa35d2734b6684, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-10 19:03:06,160 INFO [rs(jenkins-hbase4.apache.org,35609,1676055780283)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for f3c4392d756ce5e5e061ef2cb63d0fce in 541ms, sequenceid=9, compaction requested=false 2023-02-10 19:03:06,160 DEBUG [rs(jenkins-hbase4.apache.org,35609,1676055780283)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for f3c4392d756ce5e5e061ef2cb63d0fce: 2023-02-10 19:03:06,160 DEBUG [rs(jenkins-hbase4.apache.org,35609,1676055780283)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,g\xA7\xA7,1676055781936.f3c4392d756ce5e5e061ef2cb63d0fce. 2023-02-10 19:03:06,160 DEBUG [member: 'jenkins-hbase4.apache.org,35609,1676055780283' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 4/5 local region flush tasks. 2023-02-10 19:03:06,163 INFO [rs(jenkins-hbase4.apache.org,38097,1676055780236)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/data/default/testWithMapReduce/d1ba49f10de14d81a2fad0498c59a9b7/.tmp/f2/28ce0d8fbedb4463ae44ec33242bb35c 2023-02-10 19:03:06,163 INFO [rs(jenkins-hbase4.apache.org,35609,1676055780283)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/data/default/testWithMapReduce/ceccc0adc99b7adc17715506edd714a5/.tmp/f2/a6dceb4a78de4a4e8c118dcdae395a92 2023-02-10 19:03:06,169 DEBUG [rs(jenkins-hbase4.apache.org,35609,1676055780283)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/data/default/testWithMapReduce/ceccc0adc99b7adc17715506edd714a5/.tmp/f1/479c9fed1377487d967e92b398984517 as hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/data/default/testWithMapReduce/ceccc0adc99b7adc17715506edd714a5/f1/479c9fed1377487d967e92b398984517 2023-02-10 19:03:06,169 DEBUG [rs(jenkins-hbase4.apache.org,38097,1676055780236)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/data/default/testWithMapReduce/d1ba49f10de14d81a2fad0498c59a9b7/.tmp/f1/4cfbaa4c85104c76bc4bc9505781b36c as hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/data/default/testWithMapReduce/d1ba49f10de14d81a2fad0498c59a9b7/f1/4cfbaa4c85104c76bc4bc9505781b36c 2023-02-10 19:03:06,174 INFO [rs(jenkins-hbase4.apache.org,35609,1676055780283)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/data/default/testWithMapReduce/ceccc0adc99b7adc17715506edd714a5/f1/479c9fed1377487d967e92b398984517, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-10 19:03:06,175 INFO [rs(jenkins-hbase4.apache.org,38097,1676055780236)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/data/default/testWithMapReduce/d1ba49f10de14d81a2fad0498c59a9b7/f1/4cfbaa4c85104c76bc4bc9505781b36c, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-10 19:03:06,175 DEBUG [rs(jenkins-hbase4.apache.org,35609,1676055780283)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/data/default/testWithMapReduce/ceccc0adc99b7adc17715506edd714a5/.tmp/f2/a6dceb4a78de4a4e8c118dcdae395a92 as hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/data/default/testWithMapReduce/ceccc0adc99b7adc17715506edd714a5/f2/a6dceb4a78de4a4e8c118dcdae395a92 2023-02-10 19:03:06,176 DEBUG [rs(jenkins-hbase4.apache.org,38097,1676055780236)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/data/default/testWithMapReduce/d1ba49f10de14d81a2fad0498c59a9b7/.tmp/f2/28ce0d8fbedb4463ae44ec33242bb35c as hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/data/default/testWithMapReduce/d1ba49f10de14d81a2fad0498c59a9b7/f2/28ce0d8fbedb4463ae44ec33242bb35c 2023-02-10 19:03:06,181 INFO [rs(jenkins-hbase4.apache.org,38097,1676055780236)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/data/default/testWithMapReduce/d1ba49f10de14d81a2fad0498c59a9b7/f2/28ce0d8fbedb4463ae44ec33242bb35c, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-10 19:03:06,181 INFO [rs(jenkins-hbase4.apache.org,35609,1676055780283)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/data/default/testWithMapReduce/ceccc0adc99b7adc17715506edd714a5/f2/a6dceb4a78de4a4e8c118dcdae395a92, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-10 19:03:06,182 INFO [rs(jenkins-hbase4.apache.org,35609,1676055780283)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for ceccc0adc99b7adc17715506edd714a5 in 563ms, sequenceid=9, compaction requested=false 2023-02-10 19:03:06,182 INFO [rs(jenkins-hbase4.apache.org,38097,1676055780236)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~248.22 KB/254176, heapSize ~634.22 KB/649440, currentSize=0 B/0 for d1ba49f10de14d81a2fad0498c59a9b7 in 566ms, sequenceid=9, compaction requested=false 2023-02-10 19:03:06,182 DEBUG [rs(jenkins-hbase4.apache.org,35609,1676055780283)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for ceccc0adc99b7adc17715506edd714a5: 2023-02-10 19:03:06,182 DEBUG [rs(jenkins-hbase4.apache.org,38097,1676055780236)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for d1ba49f10de14d81a2fad0498c59a9b7: 2023-02-10 19:03:06,182 DEBUG [rs(jenkins-hbase4.apache.org,38097,1676055780236)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,aaa,1676055781936.d1ba49f10de14d81a2fad0498c59a9b7. 2023-02-10 19:03:06,182 DEBUG [rs(jenkins-hbase4.apache.org,35609,1676055780283)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,m\xED\xED,1676055781936.ceccc0adc99b7adc17715506edd714a5. 2023-02-10 19:03:06,182 DEBUG [member: 'jenkins-hbase4.apache.org,38097,1676055780236' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 5/5 local region flush tasks. 2023-02-10 19:03:06,182 DEBUG [member: 'jenkins-hbase4.apache.org,35609,1676055780283' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 5/5 local region flush tasks. 2023-02-10 19:03:06,183 DEBUG [member: 'jenkins-hbase4.apache.org,35609,1676055780283' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 5 local region flush tasks. 2023-02-10 19:03:06,182 DEBUG [member: 'jenkins-hbase4.apache.org,38097,1676055780236' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 5 local region flush tasks. 2023-02-10 19:03:06,183 DEBUG [member: 'jenkins-hbase4.apache.org,38097,1676055780236' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,38097,1676055780236 2023-02-10 19:03:06,183 DEBUG [member: 'jenkins-hbase4.apache.org,35609,1676055780283' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,35609,1676055780283 2023-02-10 19:03:06,183 DEBUG [member: 'jenkins-hbase4.apache.org,38097,1676055780236' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduce' locally acquired 2023-02-10 19:03:06,183 DEBUG [member: 'jenkins-hbase4.apache.org,38097,1676055780236' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38097,1676055780236' joining acquired barrier for procedure (testWithMapReduce) in zk 2023-02-10 19:03:06,183 DEBUG [member: 'jenkins-hbase4.apache.org,35609,1676055780283' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduce' locally acquired 2023-02-10 19:03:06,183 DEBUG [member: 'jenkins-hbase4.apache.org,35609,1676055780283' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35609,1676055780283' joining acquired barrier for procedure (testWithMapReduce) in zk 2023-02-10 19:03:06,184 DEBUG [member: 'jenkins-hbase4.apache.org,35609,1676055780283' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-10 19:03:06,184 DEBUG [member: 'jenkins-hbase4.apache.org,38097,1676055780236' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-10 19:03:06,184 DEBUG [Listener at localhost/35877-EventThread] zookeeper.ZKWatcher(600): master:40103-0x1003f9d84e20000, quorum=127.0.0.1:55517, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,35609,1676055780283 2023-02-10 19:03:06,185 DEBUG [Listener at localhost/35877-EventThread] zookeeper.ZKWatcher(600): master:40103-0x1003f9d84e20000, quorum=127.0.0.1:55517, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,38097,1676055780236 2023-02-10 19:03:06,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,35609,1676055780283 2023-02-10 19:03:06,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-10 19:03:06,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-10 19:03:06,185 DEBUG [member: 'jenkins-hbase4.apache.org,35609,1676055780283' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35609-0x1003f9d84e20002, quorum=127.0.0.1:55517, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce 2023-02-10 19:03:06,185 DEBUG [member: 'jenkins-hbase4.apache.org,35609,1676055780283' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduce' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-10 19:03:06,185 DEBUG [member: 'jenkins-hbase4.apache.org,38097,1676055780236' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38097-0x1003f9d84e20001, quorum=127.0.0.1:55517, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce 2023-02-10 19:03:06,185 DEBUG [member: 'jenkins-hbase4.apache.org,38097,1676055780236' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduce' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-10 19:03:06,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-10 19:03:06,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-10 19:03:06,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-10 19:03:06,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35609,1676055780283 2023-02-10 19:03:06,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38097,1676055780236 2023-02-10 19:03:06,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-10 19:03:06,186 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35609,1676055780283' joining acquired barrier for procedure 'testWithMapReduce' on coordinator 2023-02-10 19:03:06,186 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@640da026[Count = 1] remaining members to acquire global barrier 2023-02-10 19:03:06,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,38097,1676055780236 2023-02-10 19:03:06,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-10 19:03:06,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-10 19:03:06,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-10 19:03:06,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-10 19:03:06,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-10 19:03:06,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35609,1676055780283 2023-02-10 19:03:06,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38097,1676055780236 2023-02-10 19:03:06,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-10 19:03:06,188 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38097,1676055780236' joining acquired barrier for procedure 'testWithMapReduce' on coordinator 2023-02-10 19:03:06,188 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@640da026[Count = 0] remaining members to acquire global barrier 2023-02-10 19:03:06,188 DEBUG [(jenkins-hbase4.apache.org,40103,1676055780155)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMapReduce' starting 'in-barrier' execution. 2023-02-10 19:03:06,188 DEBUG [(jenkins-hbase4.apache.org,40103,1676055780155)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-10 19:03:06,194 DEBUG [Listener at localhost/35877-EventThread] zookeeper.ZKWatcher(600): regionserver:38097-0x1003f9d84e20001, quorum=127.0.0.1:55517, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-10 19:03:06,194 DEBUG [Listener at localhost/35877-EventThread] zookeeper.ZKWatcher(600): regionserver:35609-0x1003f9d84e20002, quorum=127.0.0.1:55517, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-10 19:03:06,194 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-10 19:03:06,194 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-10 19:03:06,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-10 19:03:06,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-10 19:03:06,195 DEBUG [member: 'jenkins-hbase4.apache.org,38097,1676055780236' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduce' received 'reached' from coordinator. 2023-02-10 19:03:06,195 DEBUG [member: 'jenkins-hbase4.apache.org,35609,1676055780283' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduce' received 'reached' from coordinator. 2023-02-10 19:03:06,195 DEBUG [member: 'jenkins-hbase4.apache.org,35609,1676055780283' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduce' locally completed 2023-02-10 19:03:06,195 DEBUG [member: 'jenkins-hbase4.apache.org,38097,1676055780236' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduce' locally completed 2023-02-10 19:03:06,195 DEBUG [member: 'jenkins-hbase4.apache.org,38097,1676055780236' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduce' completed for member 'jenkins-hbase4.apache.org,38097,1676055780236' in zk 2023-02-10 19:03:06,194 DEBUG [(jenkins-hbase4.apache.org,40103,1676055780155)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40103-0x1003f9d84e20000, quorum=127.0.0.1:55517, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,35609,1676055780283 2023-02-10 19:03:06,195 DEBUG [member: 'jenkins-hbase4.apache.org,35609,1676055780283' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduce' completed for member 'jenkins-hbase4.apache.org,35609,1676055780283' in zk 2023-02-10 19:03:06,195 DEBUG [(jenkins-hbase4.apache.org,40103,1676055780155)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40103-0x1003f9d84e20000, quorum=127.0.0.1:55517, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,38097,1676055780236 2023-02-10 19:03:06,195 DEBUG [(jenkins-hbase4.apache.org,40103,1676055780155)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-10 19:03:06,196 DEBUG [member: 'jenkins-hbase4.apache.org,38097,1676055780236' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduce' has notified controller of completion 2023-02-10 19:03:06,196 DEBUG [member: 'jenkins-hbase4.apache.org,38097,1676055780236' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-10 19:03:06,196 DEBUG [Listener at localhost/35877-EventThread] zookeeper.ZKWatcher(600): master:40103-0x1003f9d84e20000, quorum=127.0.0.1:55517, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,38097,1676055780236 2023-02-10 19:03:06,196 DEBUG [member: 'jenkins-hbase4.apache.org,38097,1676055780236' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduce' completed. 2023-02-10 19:03:06,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,38097,1676055780236 2023-02-10 19:03:06,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-10 19:03:06,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-10 19:03:06,197 DEBUG [member: 'jenkins-hbase4.apache.org,35609,1676055780283' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduce' has notified controller of completion 2023-02-10 19:03:06,197 DEBUG [member: 'jenkins-hbase4.apache.org,35609,1676055780283' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-10 19:03:06,197 DEBUG [Listener at localhost/35877-EventThread] zookeeper.ZKWatcher(600): master:40103-0x1003f9d84e20000, quorum=127.0.0.1:55517, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,35609,1676055780283 2023-02-10 19:03:06,197 DEBUG [member: 'jenkins-hbase4.apache.org,35609,1676055780283' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduce' completed. 2023-02-10 19:03:06,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-10 19:03:06,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-10 19:03:06,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-10 19:03:06,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35609,1676055780283 2023-02-10 19:03:06,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38097,1676055780236 2023-02-10 19:03:06,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-10 19:03:06,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-10 19:03:06,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38097,1676055780236 2023-02-10 19:03:06,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35609,1676055780283 2023-02-10 19:03:06,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduce' member 'jenkins-hbase4.apache.org,38097,1676055780236': 2023-02-10 19:03:06,201 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38097,1676055780236' released barrier for procedure'testWithMapReduce', counting down latch. Waiting for 1 more 2023-02-10 19:03:06,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,35609,1676055780283 2023-02-10 19:03:06,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-10 19:03:06,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-10 19:03:06,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-10 19:03:06,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-10 19:03:06,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-10 19:03:06,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35609,1676055780283 2023-02-10 19:03:06,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38097,1676055780236 2023-02-10 19:03:06,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-10 19:03:06,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-10 19:03:06,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38097,1676055780236 2023-02-10 19:03:06,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35609,1676055780283 2023-02-10 19:03:06,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduce' member 'jenkins-hbase4.apache.org,35609,1676055780283': 2023-02-10 19:03:06,203 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35609,1676055780283' released barrier for procedure'testWithMapReduce', counting down latch. Waiting for 0 more 2023-02-10 19:03:06,203 INFO [(jenkins-hbase4.apache.org,40103,1676055780155)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMapReduce' execution completed 2023-02-10 19:03:06,204 DEBUG [(jenkins-hbase4.apache.org,40103,1676055780155)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-10 19:03:06,204 DEBUG [(jenkins-hbase4.apache.org,40103,1676055780155)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-10 19:03:06,204 DEBUG [(jenkins-hbase4.apache.org,40103,1676055780155)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMapReduce 2023-02-10 19:03:06,204 INFO [(jenkins-hbase4.apache.org,40103,1676055780155)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMapReduceincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-10 19:03:06,205 DEBUG [Listener at localhost/35877-EventThread] zookeeper.ZKWatcher(600): regionserver:35609-0x1003f9d84e20002, quorum=127.0.0.1:55517, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-10 19:03:06,205 DEBUG [Listener at localhost/35877-EventThread] zookeeper.ZKWatcher(600): regionserver:38097-0x1003f9d84e20001, quorum=127.0.0.1:55517, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-10 19:03:06,205 DEBUG [Listener at localhost/35877-EventThread] zookeeper.ZKWatcher(600): master:40103-0x1003f9d84e20000, quorum=127.0.0.1:55517, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-10 19:03:06,205 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-10 19:03:06,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-10 19:03:06,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-10 19:03:06,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-10 19:03:06,205 DEBUG [Listener at localhost/35877-EventThread] zookeeper.ZKWatcher(600): regionserver:38097-0x1003f9d84e20001, quorum=127.0.0.1:55517, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-10 19:03:06,205 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-10 19:03:06,205 DEBUG [Listener at localhost/35877-EventThread] zookeeper.ZKWatcher(600): regionserver:35609-0x1003f9d84e20002, quorum=127.0.0.1:55517, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-10 19:03:06,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-10 19:03:06,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-10 19:03:06,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-10 19:03:06,206 DEBUG [(jenkins-hbase4.apache.org,40103,1676055780155)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40103-0x1003f9d84e20000, quorum=127.0.0.1:55517, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,35609,1676055780283 2023-02-10 19:03:06,206 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-10 19:03:06,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-10 19:03:06,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-10 19:03:06,206 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-10 19:03:06,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-10 19:03:06,206 DEBUG [(jenkins-hbase4.apache.org,40103,1676055780155)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40103-0x1003f9d84e20000, quorum=127.0.0.1:55517, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,38097,1676055780236 2023-02-10 19:03:06,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-10 19:03:06,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-10 19:03:06,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-10 19:03:06,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-10 19:03:06,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35609,1676055780283 2023-02-10 19:03:06,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38097,1676055780236 2023-02-10 19:03:06,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-10 19:03:06,208 DEBUG [(jenkins-hbase4.apache.org,40103,1676055780155)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40103-0x1003f9d84e20000, quorum=127.0.0.1:55517, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,38097,1676055780236 2023-02-10 19:03:06,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-10 19:03:06,208 DEBUG [(jenkins-hbase4.apache.org,40103,1676055780155)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40103-0x1003f9d84e20000, quorum=127.0.0.1:55517, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,35609,1676055780283 2023-02-10 19:03:06,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38097,1676055780236 2023-02-10 19:03:06,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35609,1676055780283 2023-02-10 19:03:06,212 DEBUG [Listener at localhost/35877-EventThread] zookeeper.ZKWatcher(600): master:40103-0x1003f9d84e20000, quorum=127.0.0.1:55517, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,38097,1676055780236 2023-02-10 19:03:06,212 DEBUG [Listener at localhost/35877-EventThread] zookeeper.ZKWatcher(600): master:40103-0x1003f9d84e20000, quorum=127.0.0.1:55517, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-10 19:03:06,212 DEBUG [Listener at localhost/35877-EventThread] zookeeper.ZKWatcher(600): regionserver:38097-0x1003f9d84e20001, quorum=127.0.0.1:55517, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-10 19:03:06,212 DEBUG [Listener at localhost/35877-EventThread] zookeeper.ZKWatcher(600): master:40103-0x1003f9d84e20000, quorum=127.0.0.1:55517, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,35609,1676055780283 2023-02-10 19:03:06,212 DEBUG [Listener at localhost/35877-EventThread] zookeeper.ZKWatcher(600): regionserver:35609-0x1003f9d84e20002, quorum=127.0.0.1:55517, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-10 19:03:06,212 DEBUG [Listener at localhost/35877-EventThread] zookeeper.ZKWatcher(600): master:40103-0x1003f9d84e20000, quorum=127.0.0.1:55517, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-10 19:03:06,212 DEBUG [Listener at localhost/35877-EventThread] zookeeper.ZKWatcher(600): regionserver:35609-0x1003f9d84e20002, quorum=127.0.0.1:55517, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-10 19:03:06,212 DEBUG [(jenkins-hbase4.apache.org,40103,1676055780155)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-10 19:03:06,212 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-10 19:03:06,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-10 19:03:06,212 DEBUG [Listener at localhost/35877-EventThread] zookeeper.ZKWatcher(600): regionserver:38097-0x1003f9d84e20001, quorum=127.0.0.1:55517, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-10 19:03:06,212 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40103] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testWithMapReduce' 2023-02-10 19:03:06,213 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40103] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-10 19:03:06,212 DEBUG [Listener at localhost/35877-EventThread] zookeeper.ZKWatcher(600): master:40103-0x1003f9d84e20000, quorum=127.0.0.1:55517, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,35609,1676055780283 2023-02-10 19:03:06,212 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-10 19:03:06,214 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-10 19:03:06,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-10 19:03:06,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-10 19:03:06,214 DEBUG [Listener at localhost/35877-EventThread] zookeeper.ZKWatcher(600): master:40103-0x1003f9d84e20000, quorum=127.0.0.1:55517, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-10 19:03:06,214 DEBUG [Listener at localhost/35877-EventThread] zookeeper.ZKWatcher(600): master:40103-0x1003f9d84e20000, quorum=127.0.0.1:55517, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,38097,1676055780236 2023-02-10 19:03:06,214 DEBUG [Listener at localhost/35877-EventThread] zookeeper.ZKWatcher(600): master:40103-0x1003f9d84e20000, quorum=127.0.0.1:55517, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-10 19:03:06,214 DEBUG [Listener at localhost/35877-EventThread] zookeeper.ZKWatcher(600): master:40103-0x1003f9d84e20000, quorum=127.0.0.1:55517, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-10 19:03:06,214 DEBUG [Listener at localhost/35877] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testWithMapReduce'' to complete. (max 20000 ms per retry) 2023-02-10 19:03:06,214 DEBUG [Listener at localhost/35877] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-10 19:03:06,214 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-10 19:03:06,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-10 19:03:06,314 DEBUG [Listener at localhost/35877] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-10 19:03:06,316 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40103] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-10 19:03:06,316 INFO [Listener at localhost/35877] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-10 19:03:06,316 DEBUG [Listener at localhost/35877] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5516db8d to 127.0.0.1:55517 2023-02-10 19:03:06,317 DEBUG [Listener at localhost/35877] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-10 19:03:06,317 DEBUG [Listener at localhost/35877] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-02-10 19:03:06,317 DEBUG [Listener at localhost/35877] util.JVMClusterUtil(257): Found active master hash=1138506016, stopped=false 2023-02-10 19:03:06,317 INFO [Listener at localhost/35877] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,40103,1676055780155 2023-02-10 19:03:06,319 DEBUG [Listener at localhost/35877-EventThread] zookeeper.ZKWatcher(600): regionserver:35609-0x1003f9d84e20002, quorum=127.0.0.1:55517, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-10 19:03:06,319 INFO [Listener at localhost/35877] procedure2.ProcedureExecutor(629): Stopping 2023-02-10 19:03:06,319 DEBUG [Listener at localhost/35877-EventThread] zookeeper.ZKWatcher(600): regionserver:38097-0x1003f9d84e20001, quorum=127.0.0.1:55517, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-10 19:03:06,319 DEBUG [Listener at localhost/35877-EventThread] zookeeper.ZKWatcher(600): master:40103-0x1003f9d84e20000, quorum=127.0.0.1:55517, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-10 19:03:06,320 DEBUG [Listener at localhost/35877] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7bba4cf6 to 127.0.0.1:55517 2023-02-10 19:03:06,320 DEBUG [Listener at localhost/35877] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-10 19:03:06,320 DEBUG [Listener at localhost/35877-EventThread] zookeeper.ZKWatcher(600): master:40103-0x1003f9d84e20000, quorum=127.0.0.1:55517, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-10 19:03:06,320 INFO [Listener at localhost/35877] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,38097,1676055780236' ***** 2023-02-10 19:03:06,321 INFO [Listener at localhost/35877] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-10 19:03:06,320 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35609-0x1003f9d84e20002, quorum=127.0.0.1:55517, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-10 19:03:06,321 INFO [Listener at localhost/35877] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,35609,1676055780283' ***** 2023-02-10 19:03:06,321 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:40103-0x1003f9d84e20000, quorum=127.0.0.1:55517, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-10 19:03:06,320 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38097-0x1003f9d84e20001, quorum=127.0.0.1:55517, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-10 19:03:06,321 INFO [Listener at localhost/35877] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-10 19:03:06,321 INFO [RS:0;jenkins-hbase4:38097] regionserver.HeapMemoryManager(220): Stopping 2023-02-10 19:03:06,321 INFO [RS:0;jenkins-hbase4:38097] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-10 19:03:06,321 INFO [RS:1;jenkins-hbase4:35609] regionserver.HeapMemoryManager(220): Stopping 2023-02-10 19:03:06,321 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-10 19:03:06,322 INFO [RS:1;jenkins-hbase4:35609] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-10 19:03:06,322 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-10 19:03:06,322 INFO [RS:1;jenkins-hbase4:35609] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-10 19:03:06,321 INFO [RS:0;jenkins-hbase4:38097] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-10 19:03:06,323 INFO [RS:1;jenkins-hbase4:35609] regionserver.HRegionServer(3304): Received CLOSE for fe00f1c4e3fbcd6d7560c2506ad6ca19 2023-02-10 19:03:06,323 INFO [RS:0;jenkins-hbase4:38097] regionserver.HRegionServer(3304): Received CLOSE for e06f6220742d6bd40a5b138f872afaa0 2023-02-10 19:03:06,323 INFO [RS:1;jenkins-hbase4:35609] regionserver.HRegionServer(3304): Received CLOSE for 4dfcfb14720b0f66e0e9179835dbe61d 2023-02-10 19:03:06,324 INFO [RS:0;jenkins-hbase4:38097] regionserver.HRegionServer(3304): Received CLOSE for aff2d18d26e1916478e05b25bb5c9a89 2023-02-10 19:03:06,324 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing fe00f1c4e3fbcd6d7560c2506ad6ca19, disabling compactions & flushes 2023-02-10 19:03:06,324 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing e06f6220742d6bd40a5b138f872afaa0, disabling compactions & flushes 2023-02-10 19:03:06,324 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676055781936.fe00f1c4e3fbcd6d7560c2506ad6ca19. 2023-02-10 19:03:06,324 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,d\x84\x84,1676055781936.e06f6220742d6bd40a5b138f872afaa0. 2023-02-10 19:03:06,324 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676055781936.fe00f1c4e3fbcd6d7560c2506ad6ca19. 2023-02-10 19:03:06,324 INFO [RS:1;jenkins-hbase4:35609] regionserver.HRegionServer(3304): Received CLOSE for ceccc0adc99b7adc17715506edd714a5 2023-02-10 19:03:06,324 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676055781936.fe00f1c4e3fbcd6d7560c2506ad6ca19. after waiting 0 ms 2023-02-10 19:03:06,324 INFO [RS:1;jenkins-hbase4:35609] regionserver.HRegionServer(3304): Received CLOSE for f3c4392d756ce5e5e061ef2cb63d0fce 2023-02-10 19:03:06,324 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676055781936.fe00f1c4e3fbcd6d7560c2506ad6ca19. 2023-02-10 19:03:06,324 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,d\x84\x84,1676055781936.e06f6220742d6bd40a5b138f872afaa0. 2023-02-10 19:03:06,324 INFO [RS:0;jenkins-hbase4:38097] regionserver.HRegionServer(3304): Received CLOSE for d1ba49f10de14d81a2fad0498c59a9b7 2023-02-10 19:03:06,324 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,d\x84\x84,1676055781936.e06f6220742d6bd40a5b138f872afaa0. after waiting 0 ms 2023-02-10 19:03:06,324 INFO [RS:0;jenkins-hbase4:38097] regionserver.HRegionServer(3304): Received CLOSE for 3c13d5e817a81b6f4b36ab3d9762b76f 2023-02-10 19:03:06,324 INFO [RS:1;jenkins-hbase4:35609] regionserver.HRegionServer(3304): Received CLOSE for ab9c3c4ad85b22b109e239684647572c 2023-02-10 19:03:06,324 INFO [RS:0;jenkins-hbase4:38097] regionserver.HRegionServer(3304): Received CLOSE for c47924fd805c4df26e6e9e860c542007 2023-02-10 19:03:06,324 INFO [RS:1;jenkins-hbase4:35609] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,35609,1676055780283 2023-02-10 19:03:06,324 INFO [RS:0;jenkins-hbase4:38097] regionserver.HRegionServer(3304): Received CLOSE for 4301231127f63d0413cb613f701e56a2 2023-02-10 19:03:06,324 DEBUG [RS:1;jenkins-hbase4:35609] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6748b647 to 127.0.0.1:55517 2023-02-10 19:03:06,324 INFO [RS:0;jenkins-hbase4:38097] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,38097,1676055780236 2023-02-10 19:03:06,324 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,d\x84\x84,1676055781936.e06f6220742d6bd40a5b138f872afaa0. 2023-02-10 19:03:06,324 DEBUG [RS:0;jenkins-hbase4:38097] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x71a33668 to 127.0.0.1:55517 2023-02-10 19:03:06,324 DEBUG [RS:0;jenkins-hbase4:38097] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-10 19:03:06,325 INFO [RS:0;jenkins-hbase4:38097] regionserver.HRegionServer(1475): Waiting on 6 regions to close 2023-02-10 19:03:06,325 DEBUG [RS:0;jenkins-hbase4:38097] regionserver.HRegionServer(1479): Online Regions={e06f6220742d6bd40a5b138f872afaa0=testWithMapReduce,d\x84\x84,1676055781936.e06f6220742d6bd40a5b138f872afaa0., aff2d18d26e1916478e05b25bb5c9a89=testWithMapReduce,zz{,1676055781936.aff2d18d26e1916478e05b25bb5c9a89., d1ba49f10de14d81a2fad0498c59a9b7=testWithMapReduce,aaa,1676055781936.d1ba49f10de14d81a2fad0498c59a9b7., 3c13d5e817a81b6f4b36ab3d9762b76f=testWithMapReduce,j\xCA\xCA,1676055781936.3c13d5e817a81b6f4b36ab3d9762b76f., c47924fd805c4df26e6e9e860c542007=testWithMapReduce,q\x11\x10,1676055781936.c47924fd805c4df26e6e9e860c542007., 4301231127f63d0413cb613f701e56a2=hbase:namespace,,1676055781343.4301231127f63d0413cb613f701e56a2.} 2023-02-10 19:03:06,325 DEBUG [RS:0;jenkins-hbase4:38097] regionserver.HRegionServer(1505): Waiting on 3c13d5e817a81b6f4b36ab3d9762b76f, 4301231127f63d0413cb613f701e56a2, aff2d18d26e1916478e05b25bb5c9a89, c47924fd805c4df26e6e9e860c542007, d1ba49f10de14d81a2fad0498c59a9b7, e06f6220742d6bd40a5b138f872afaa0 2023-02-10 19:03:06,324 DEBUG [RS:1;jenkins-hbase4:35609] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-10 19:03:06,326 INFO [RS:1;jenkins-hbase4:35609] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-10 19:03:06,326 INFO [RS:1;jenkins-hbase4:35609] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-10 19:03:06,326 INFO [RS:1;jenkins-hbase4:35609] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-10 19:03:06,326 INFO [RS:1;jenkins-hbase4:35609] regionserver.HRegionServer(3304): Received CLOSE for 1588230740 2023-02-10 19:03:06,326 INFO [RS:1;jenkins-hbase4:35609] regionserver.HRegionServer(1475): Waiting on 6 regions to close 2023-02-10 19:03:06,327 DEBUG [RS:1;jenkins-hbase4:35609] regionserver.HRegionServer(1479): Online Regions={fe00f1c4e3fbcd6d7560c2506ad6ca19=testWithMapReduce,,1676055781936.fe00f1c4e3fbcd6d7560c2506ad6ca19., 4dfcfb14720b0f66e0e9179835dbe61d=testWithMapReduce,wWV,1676055781936.4dfcfb14720b0f66e0e9179835dbe61d., ceccc0adc99b7adc17715506edd714a5=testWithMapReduce,m\xED\xED,1676055781936.ceccc0adc99b7adc17715506edd714a5., f3c4392d756ce5e5e061ef2cb63d0fce=testWithMapReduce,g\xA7\xA7,1676055781936.f3c4392d756ce5e5e061ef2cb63d0fce., ab9c3c4ad85b22b109e239684647572c=testWithMapReduce,t43,1676055781936.ab9c3c4ad85b22b109e239684647572c., 1588230740=hbase:meta,,1.1588230740} 2023-02-10 19:03:06,327 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-10 19:03:06,327 DEBUG [RS:1;jenkins-hbase4:35609] regionserver.HRegionServer(1505): Waiting on 1588230740, 4dfcfb14720b0f66e0e9179835dbe61d, ab9c3c4ad85b22b109e239684647572c, ceccc0adc99b7adc17715506edd714a5, f3c4392d756ce5e5e061ef2cb63d0fce, fe00f1c4e3fbcd6d7560c2506ad6ca19 2023-02-10 19:03:06,327 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-10 19:03:06,327 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-10 19:03:06,327 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-10 19:03:06,327 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-10 19:03:06,327 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 1588230740 3/3 column families, dataSize=13.95 KB heapSize=23.05 KB 2023-02-10 19:03:06,336 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/data/default/testWithMapReduce/fe00f1c4e3fbcd6d7560c2506ad6ca19/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-02-10 19:03:06,338 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/data/default/testWithMapReduce/e06f6220742d6bd40a5b138f872afaa0/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-10 19:03:06,339 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,d\x84\x84,1676055781936.e06f6220742d6bd40a5b138f872afaa0. 2023-02-10 19:03:06,339 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for e06f6220742d6bd40a5b138f872afaa0: Waiting for close lock at 1676055786324Running coprocessor pre-close hooks at 1676055786324Disabling compacts and flushes for region at 1676055786324Disabling writes for close at 1676055786324Writing region close event to WAL at 1676055786335 (+11 ms)Running coprocessor post-close hooks at 1676055786339 (+4 ms)Closed at 1676055786339 2023-02-10 19:03:06,339 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,d\x84\x84,1676055781936.e06f6220742d6bd40a5b138f872afaa0. 2023-02-10 19:03:06,339 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing aff2d18d26e1916478e05b25bb5c9a89, disabling compactions & flushes 2023-02-10 19:03:06,339 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,zz{,1676055781936.aff2d18d26e1916478e05b25bb5c9a89. 2023-02-10 19:03:06,339 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,zz{,1676055781936.aff2d18d26e1916478e05b25bb5c9a89. 2023-02-10 19:03:06,339 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,zz{,1676055781936.aff2d18d26e1916478e05b25bb5c9a89. after waiting 0 ms 2023-02-10 19:03:06,339 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,zz{,1676055781936.aff2d18d26e1916478e05b25bb5c9a89. 2023-02-10 19:03:06,340 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,,1676055781936.fe00f1c4e3fbcd6d7560c2506ad6ca19. 2023-02-10 19:03:06,340 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for fe00f1c4e3fbcd6d7560c2506ad6ca19: Waiting for close lock at 1676055786324Running coprocessor pre-close hooks at 1676055786324Disabling compacts and flushes for region at 1676055786324Disabling writes for close at 1676055786324Writing region close event to WAL at 1676055786324Running coprocessor post-close hooks at 1676055786340 (+16 ms)Closed at 1676055786340 2023-02-10 19:03:06,340 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,,1676055781936.fe00f1c4e3fbcd6d7560c2506ad6ca19. 2023-02-10 19:03:06,341 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 4dfcfb14720b0f66e0e9179835dbe61d, disabling compactions & flushes 2023-02-10 19:03:06,341 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,wWV,1676055781936.4dfcfb14720b0f66e0e9179835dbe61d. 2023-02-10 19:03:06,341 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,wWV,1676055781936.4dfcfb14720b0f66e0e9179835dbe61d. 2023-02-10 19:03:06,341 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,wWV,1676055781936.4dfcfb14720b0f66e0e9179835dbe61d. after waiting 0 ms 2023-02-10 19:03:06,341 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,wWV,1676055781936.4dfcfb14720b0f66e0e9179835dbe61d. 2023-02-10 19:03:06,350 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/data/default/testWithMapReduce/aff2d18d26e1916478e05b25bb5c9a89/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-02-10 19:03:06,350 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,zz{,1676055781936.aff2d18d26e1916478e05b25bb5c9a89. 2023-02-10 19:03:06,351 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for aff2d18d26e1916478e05b25bb5c9a89: Waiting for close lock at 1676055786339Running coprocessor pre-close hooks at 1676055786339Disabling compacts and flushes for region at 1676055786339Disabling writes for close at 1676055786339Writing region close event to WAL at 1676055786340 (+1 ms)Running coprocessor post-close hooks at 1676055786350 (+10 ms)Closed at 1676055786350 2023-02-10 19:03:06,351 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,zz{,1676055781936.aff2d18d26e1916478e05b25bb5c9a89. 2023-02-10 19:03:06,351 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing d1ba49f10de14d81a2fad0498c59a9b7, disabling compactions & flushes 2023-02-10 19:03:06,351 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,aaa,1676055781936.d1ba49f10de14d81a2fad0498c59a9b7. 2023-02-10 19:03:06,351 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,aaa,1676055781936.d1ba49f10de14d81a2fad0498c59a9b7. 2023-02-10 19:03:06,351 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,aaa,1676055781936.d1ba49f10de14d81a2fad0498c59a9b7. after waiting 0 ms 2023-02-10 19:03:06,351 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,aaa,1676055781936.d1ba49f10de14d81a2fad0498c59a9b7. 2023-02-10 19:03:06,352 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/data/default/testWithMapReduce/4dfcfb14720b0f66e0e9179835dbe61d/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-10 19:03:06,355 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,wWV,1676055781936.4dfcfb14720b0f66e0e9179835dbe61d. 2023-02-10 19:03:06,355 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 4dfcfb14720b0f66e0e9179835dbe61d: Waiting for close lock at 1676055786341Running coprocessor pre-close hooks at 1676055786341Disabling compacts and flushes for region at 1676055786341Disabling writes for close at 1676055786341Writing region close event to WAL at 1676055786347 (+6 ms)Running coprocessor post-close hooks at 1676055786355 (+8 ms)Closed at 1676055786355 2023-02-10 19:03:06,355 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,wWV,1676055781936.4dfcfb14720b0f66e0e9179835dbe61d. 2023-02-10 19:03:06,356 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing ceccc0adc99b7adc17715506edd714a5, disabling compactions & flushes 2023-02-10 19:03:06,357 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,m\xED\xED,1676055781936.ceccc0adc99b7adc17715506edd714a5. 2023-02-10 19:03:06,357 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,m\xED\xED,1676055781936.ceccc0adc99b7adc17715506edd714a5. 2023-02-10 19:03:06,357 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,m\xED\xED,1676055781936.ceccc0adc99b7adc17715506edd714a5. after waiting 0 ms 2023-02-10 19:03:06,357 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,m\xED\xED,1676055781936.ceccc0adc99b7adc17715506edd714a5. 2023-02-10 19:03:06,366 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-10 19:03:06,366 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-10 19:03:06,369 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=13.76 KB at sequenceid=32 (bloomFilter=false), to=hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/data/hbase/meta/1588230740/.tmp/info/b7a163429916493f9df36d894a5c846a 2023-02-10 19:03:06,372 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/data/default/testWithMapReduce/d1ba49f10de14d81a2fad0498c59a9b7/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-10 19:03:06,373 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,aaa,1676055781936.d1ba49f10de14d81a2fad0498c59a9b7. 2023-02-10 19:03:06,374 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for d1ba49f10de14d81a2fad0498c59a9b7: Waiting for close lock at 1676055786351Running coprocessor pre-close hooks at 1676055786351Disabling compacts and flushes for region at 1676055786351Disabling writes for close at 1676055786351Writing region close event to WAL at 1676055786357 (+6 ms)Running coprocessor post-close hooks at 1676055786373 (+16 ms)Closed at 1676055786373 2023-02-10 19:03:06,374 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,aaa,1676055781936.d1ba49f10de14d81a2fad0498c59a9b7. 2023-02-10 19:03:06,374 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 3c13d5e817a81b6f4b36ab3d9762b76f, disabling compactions & flushes 2023-02-10 19:03:06,374 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,j\xCA\xCA,1676055781936.3c13d5e817a81b6f4b36ab3d9762b76f. 2023-02-10 19:03:06,374 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,j\xCA\xCA,1676055781936.3c13d5e817a81b6f4b36ab3d9762b76f. 2023-02-10 19:03:06,374 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,j\xCA\xCA,1676055781936.3c13d5e817a81b6f4b36ab3d9762b76f. after waiting 0 ms 2023-02-10 19:03:06,374 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,j\xCA\xCA,1676055781936.3c13d5e817a81b6f4b36ab3d9762b76f. 2023-02-10 19:03:06,378 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/data/default/testWithMapReduce/ceccc0adc99b7adc17715506edd714a5/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-10 19:03:06,378 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,m\xED\xED,1676055781936.ceccc0adc99b7adc17715506edd714a5. 2023-02-10 19:03:06,379 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/data/default/testWithMapReduce/3c13d5e817a81b6f4b36ab3d9762b76f/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-10 19:03:06,379 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for ceccc0adc99b7adc17715506edd714a5: Waiting for close lock at 1676055786356Running coprocessor pre-close hooks at 1676055786356Disabling compacts and flushes for region at 1676055786356Disabling writes for close at 1676055786357 (+1 ms)Writing region close event to WAL at 1676055786369 (+12 ms)Running coprocessor post-close hooks at 1676055786378 (+9 ms)Closed at 1676055786378 2023-02-10 19:03:06,379 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,m\xED\xED,1676055781936.ceccc0adc99b7adc17715506edd714a5. 2023-02-10 19:03:06,379 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing f3c4392d756ce5e5e061ef2cb63d0fce, disabling compactions & flushes 2023-02-10 19:03:06,379 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,g\xA7\xA7,1676055781936.f3c4392d756ce5e5e061ef2cb63d0fce. 2023-02-10 19:03:06,379 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,g\xA7\xA7,1676055781936.f3c4392d756ce5e5e061ef2cb63d0fce. 2023-02-10 19:03:06,379 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,g\xA7\xA7,1676055781936.f3c4392d756ce5e5e061ef2cb63d0fce. after waiting 0 ms 2023-02-10 19:03:06,379 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,g\xA7\xA7,1676055781936.f3c4392d756ce5e5e061ef2cb63d0fce. 2023-02-10 19:03:06,379 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,j\xCA\xCA,1676055781936.3c13d5e817a81b6f4b36ab3d9762b76f. 2023-02-10 19:03:06,379 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 3c13d5e817a81b6f4b36ab3d9762b76f: Waiting for close lock at 1676055786374Running coprocessor pre-close hooks at 1676055786374Disabling compacts and flushes for region at 1676055786374Disabling writes for close at 1676055786374Writing region close event to WAL at 1676055786375 (+1 ms)Running coprocessor post-close hooks at 1676055786379 (+4 ms)Closed at 1676055786379 2023-02-10 19:03:06,379 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,j\xCA\xCA,1676055781936.3c13d5e817a81b6f4b36ab3d9762b76f. 2023-02-10 19:03:06,379 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing c47924fd805c4df26e6e9e860c542007, disabling compactions & flushes 2023-02-10 19:03:06,379 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,q\x11\x10,1676055781936.c47924fd805c4df26e6e9e860c542007. 2023-02-10 19:03:06,379 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,q\x11\x10,1676055781936.c47924fd805c4df26e6e9e860c542007. 2023-02-10 19:03:06,380 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,q\x11\x10,1676055781936.c47924fd805c4df26e6e9e860c542007. after waiting 0 ms 2023-02-10 19:03:06,380 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,q\x11\x10,1676055781936.c47924fd805c4df26e6e9e860c542007. 2023-02-10 19:03:06,385 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/data/default/testWithMapReduce/f3c4392d756ce5e5e061ef2cb63d0fce/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-10 19:03:06,386 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,g\xA7\xA7,1676055781936.f3c4392d756ce5e5e061ef2cb63d0fce. 2023-02-10 19:03:06,387 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for f3c4392d756ce5e5e061ef2cb63d0fce: Waiting for close lock at 1676055786379Running coprocessor pre-close hooks at 1676055786379Disabling compacts and flushes for region at 1676055786379Disabling writes for close at 1676055786379Writing region close event to WAL at 1676055786382 (+3 ms)Running coprocessor post-close hooks at 1676055786386 (+4 ms)Closed at 1676055786386 2023-02-10 19:03:06,387 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,g\xA7\xA7,1676055781936.f3c4392d756ce5e5e061ef2cb63d0fce. 2023-02-10 19:03:06,387 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing ab9c3c4ad85b22b109e239684647572c, disabling compactions & flushes 2023-02-10 19:03:06,387 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,t43,1676055781936.ab9c3c4ad85b22b109e239684647572c. 2023-02-10 19:03:06,387 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,t43,1676055781936.ab9c3c4ad85b22b109e239684647572c. 2023-02-10 19:03:06,387 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,t43,1676055781936.ab9c3c4ad85b22b109e239684647572c. after waiting 0 ms 2023-02-10 19:03:06,387 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,t43,1676055781936.ab9c3c4ad85b22b109e239684647572c. 2023-02-10 19:03:06,388 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/data/default/testWithMapReduce/c47924fd805c4df26e6e9e860c542007/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-10 19:03:06,389 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,q\x11\x10,1676055781936.c47924fd805c4df26e6e9e860c542007. 2023-02-10 19:03:06,389 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for c47924fd805c4df26e6e9e860c542007: Waiting for close lock at 1676055786379Running coprocessor pre-close hooks at 1676055786379Disabling compacts and flushes for region at 1676055786379Disabling writes for close at 1676055786380 (+1 ms)Writing region close event to WAL at 1676055786384 (+4 ms)Running coprocessor post-close hooks at 1676055786389 (+5 ms)Closed at 1676055786389 2023-02-10 19:03:06,389 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,q\x11\x10,1676055781936.c47924fd805c4df26e6e9e860c542007. 2023-02-10 19:03:06,389 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 4301231127f63d0413cb613f701e56a2, disabling compactions & flushes 2023-02-10 19:03:06,389 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676055781343.4301231127f63d0413cb613f701e56a2. 2023-02-10 19:03:06,389 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676055781343.4301231127f63d0413cb613f701e56a2. 2023-02-10 19:03:06,389 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676055781343.4301231127f63d0413cb613f701e56a2. after waiting 0 ms 2023-02-10 19:03:06,389 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676055781343.4301231127f63d0413cb613f701e56a2. 2023-02-10 19:03:06,389 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 4301231127f63d0413cb613f701e56a2 1/1 column families, dataSize=78 B heapSize=488 B 2023-02-10 19:03:06,393 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/data/default/testWithMapReduce/ab9c3c4ad85b22b109e239684647572c/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-10 19:03:06,394 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,t43,1676055781936.ab9c3c4ad85b22b109e239684647572c. 2023-02-10 19:03:06,394 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for ab9c3c4ad85b22b109e239684647572c: Waiting for close lock at 1676055786387Running coprocessor pre-close hooks at 1676055786387Disabling compacts and flushes for region at 1676055786387Disabling writes for close at 1676055786387Writing region close event to WAL at 1676055786389 (+2 ms)Running coprocessor post-close hooks at 1676055786394 (+5 ms)Closed at 1676055786394 2023-02-10 19:03:06,394 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,t43,1676055781936.ab9c3c4ad85b22b109e239684647572c. 2023-02-10 19:03:06,397 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=192 B at sequenceid=32 (bloomFilter=false), to=hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/data/hbase/meta/1588230740/.tmp/table/5b3f977711224059a01a00dbe98dd79d 2023-02-10 19:03:06,401 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/data/hbase/namespace/4301231127f63d0413cb613f701e56a2/.tmp/info/77e6e314f210481db1ab5796261f3319 2023-02-10 19:03:06,402 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/data/hbase/meta/1588230740/.tmp/info/b7a163429916493f9df36d894a5c846a as hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/data/hbase/meta/1588230740/info/b7a163429916493f9df36d894a5c846a 2023-02-10 19:03:06,406 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/data/hbase/namespace/4301231127f63d0413cb613f701e56a2/.tmp/info/77e6e314f210481db1ab5796261f3319 as hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/data/hbase/namespace/4301231127f63d0413cb613f701e56a2/info/77e6e314f210481db1ab5796261f3319 2023-02-10 19:03:06,407 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/data/hbase/meta/1588230740/info/b7a163429916493f9df36d894a5c846a, entries=110, sequenceid=32, filesize=18.7 K 2023-02-10 19:03:06,409 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/data/hbase/meta/1588230740/.tmp/table/5b3f977711224059a01a00dbe98dd79d as hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/data/hbase/meta/1588230740/table/5b3f977711224059a01a00dbe98dd79d 2023-02-10 19:03:06,413 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/data/hbase/namespace/4301231127f63d0413cb613f701e56a2/info/77e6e314f210481db1ab5796261f3319, entries=2, sequenceid=6, filesize=4.8 K 2023-02-10 19:03:06,416 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 4301231127f63d0413cb613f701e56a2 in 27ms, sequenceid=6, compaction requested=false 2023-02-10 19:03:06,416 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-02-10 19:03:06,417 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/data/hbase/meta/1588230740/table/5b3f977711224059a01a00dbe98dd79d, entries=4, sequenceid=32, filesize=4.8 K 2023-02-10 19:03:06,418 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~13.95 KB/14280, heapSize ~22.77 KB/23312, currentSize=0 B/0 for 1588230740 in 91ms, sequenceid=32, compaction requested=false 2023-02-10 19:03:06,418 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-02-10 19:03:06,424 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/data/hbase/meta/1588230740/recovered.edits/35.seqid, newMaxSeqId=35, maxSeqId=1 2023-02-10 19:03:06,424 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-10 19:03:06,425 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-10 19:03:06,425 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1676055786327Running coprocessor pre-close hooks at 1676055786327Disabling compacts and flushes for region at 1676055786327Disabling writes for close at 1676055786327Obtaining lock to block concurrent updates at 1676055786327Preparing flush snapshotting stores in 1588230740 at 1676055786327Finished memstore snapshotting hbase:meta,,1.1588230740, syncing WAL and waiting on mvcc, flushsize=dataSize=14280, getHeapSize=23552, getOffHeapSize=0, getCellsCount=114 at 1676055786329 (+2 ms)Flushing stores of hbase:meta,,1.1588230740 at 1676055786331 (+2 ms)Flushing 1588230740/info: creating writer at 1676055786332 (+1 ms)Flushing 1588230740/info: appending metadata at 1676055786344 (+12 ms)Flushing 1588230740/info: closing flushed file at 1676055786346 (+2 ms)Flushing 1588230740/table: creating writer at 1676055786383 (+37 ms)Flushing 1588230740/table: appending metadata at 1676055786385 (+2 ms)Flushing 1588230740/table: closing flushed file at 1676055786386 (+1 ms)Flushing 1588230740/info: reopening flushed file at 1676055786403 (+17 ms)Flushing 1588230740/table: reopening flushed file at 1676055786410 (+7 ms)Finished flush of dataSize ~13.95 KB/14280, heapSize ~22.77 KB/23312, currentSize=0 B/0 for 1588230740 in 91ms, sequenceid=32, compaction requested=false at 1676055786418 (+8 ms)Writing region close event to WAL at 1676055786420 (+2 ms)Running coprocessor post-close hooks at 1676055786424 (+4 ms)Closed at 1676055786425 (+1 ms) 2023-02-10 19:03:06,425 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-02-10 19:03:06,428 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/data/hbase/namespace/4301231127f63d0413cb613f701e56a2/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-02-10 19:03:06,429 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676055781343.4301231127f63d0413cb613f701e56a2. 2023-02-10 19:03:06,429 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 4301231127f63d0413cb613f701e56a2: Waiting for close lock at 1676055786389Running coprocessor pre-close hooks at 1676055786389Disabling compacts and flushes for region at 1676055786389Disabling writes for close at 1676055786389Obtaining lock to block concurrent updates at 1676055786390 (+1 ms)Preparing flush snapshotting stores in 4301231127f63d0413cb613f701e56a2 at 1676055786390Finished memstore snapshotting hbase:namespace,,1676055781343.4301231127f63d0413cb613f701e56a2., syncing WAL and waiting on mvcc, flushsize=dataSize=78, getHeapSize=472, getOffHeapSize=0, getCellsCount=2 at 1676055786390Flushing stores of hbase:namespace,,1676055781343.4301231127f63d0413cb613f701e56a2. at 1676055786390Flushing 4301231127f63d0413cb613f701e56a2/info: creating writer at 1676055786390Flushing 4301231127f63d0413cb613f701e56a2/info: appending metadata at 1676055786393 (+3 ms)Flushing 4301231127f63d0413cb613f701e56a2/info: closing flushed file at 1676055786393Flushing 4301231127f63d0413cb613f701e56a2/info: reopening flushed file at 1676055786407 (+14 ms)Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 4301231127f63d0413cb613f701e56a2 in 27ms, sequenceid=6, compaction requested=false at 1676055786416 (+9 ms)Writing region close event to WAL at 1676055786418 (+2 ms)Running coprocessor post-close hooks at 1676055786428 (+10 ms)Closed at 1676055786429 (+1 ms) 2023-02-10 19:03:06,429 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1676055781343.4301231127f63d0413cb613f701e56a2. 2023-02-10 19:03:06,525 INFO [RS:0;jenkins-hbase4:38097] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,38097,1676055780236; all regions closed. 2023-02-10 19:03:06,527 INFO [RS:1;jenkins-hbase4:35609] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,35609,1676055780283; all regions closed. 2023-02-10 19:03:06,532 DEBUG [RS:0;jenkins-hbase4:38097] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/oldWALs 2023-02-10 19:03:06,533 INFO [RS:0;jenkins-hbase4:38097] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C38097%2C1676055780236:(num 1676055781714) 2023-02-10 19:03:06,533 DEBUG [RS:0;jenkins-hbase4:38097] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-10 19:03:06,533 INFO [RS:0;jenkins-hbase4:38097] regionserver.LeaseManager(133): Closed leases 2023-02-10 19:03:06,533 INFO [RS:0;jenkins-hbase4:38097] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-02-10 19:03:06,533 INFO [RS:0;jenkins-hbase4:38097] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-10 19:03:06,533 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-10 19:03:06,533 INFO [RS:0;jenkins-hbase4:38097] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-10 19:03:06,533 DEBUG [RS:1;jenkins-hbase4:35609] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/oldWALs 2023-02-10 19:03:06,533 INFO [RS:0;jenkins-hbase4:38097] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-10 19:03:06,533 INFO [RS:1;jenkins-hbase4:35609] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C35609%2C1676055780283.meta:.meta(num 1676055781271) 2023-02-10 19:03:06,534 INFO [RS:0;jenkins-hbase4:38097] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:38097 2023-02-10 19:03:06,537 DEBUG [Listener at localhost/35877-EventThread] zookeeper.ZKWatcher(600): regionserver:35609-0x1003f9d84e20002, quorum=127.0.0.1:55517, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,38097,1676055780236 2023-02-10 19:03:06,537 DEBUG [Listener at localhost/35877-EventThread] zookeeper.ZKWatcher(600): master:40103-0x1003f9d84e20000, quorum=127.0.0.1:55517, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-10 19:03:06,537 DEBUG [Listener at localhost/35877-EventThread] zookeeper.ZKWatcher(600): regionserver:35609-0x1003f9d84e20002, quorum=127.0.0.1:55517, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-10 19:03:06,538 DEBUG [Listener at localhost/35877-EventThread] zookeeper.ZKWatcher(600): regionserver:38097-0x1003f9d84e20001, quorum=127.0.0.1:55517, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,38097,1676055780236 2023-02-10 19:03:06,538 DEBUG [Listener at localhost/35877-EventThread] zookeeper.ZKWatcher(600): regionserver:38097-0x1003f9d84e20001, quorum=127.0.0.1:55517, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-10 19:03:06,539 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,38097,1676055780236] 2023-02-10 19:03:06,539 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,38097,1676055780236; numProcessing=1 2023-02-10 19:03:06,541 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,38097,1676055780236 already deleted, retry=false 2023-02-10 19:03:06,541 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,38097,1676055780236 expired; onlineServers=1 2023-02-10 19:03:06,541 DEBUG [RS:1;jenkins-hbase4:35609] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/oldWALs 2023-02-10 19:03:06,541 INFO [RS:1;jenkins-hbase4:35609] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C35609%2C1676055780283:(num 1676055782038) 2023-02-10 19:03:06,541 DEBUG [RS:1;jenkins-hbase4:35609] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-10 19:03:06,541 INFO [RS:1;jenkins-hbase4:35609] regionserver.LeaseManager(133): Closed leases 2023-02-10 19:03:06,542 INFO [RS:1;jenkins-hbase4:35609] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-02-10 19:03:06,542 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-10 19:03:06,542 INFO [RS:1;jenkins-hbase4:35609] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:35609 2023-02-10 19:03:06,545 DEBUG [Listener at localhost/35877-EventThread] zookeeper.ZKWatcher(600): regionserver:35609-0x1003f9d84e20002, quorum=127.0.0.1:55517, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,35609,1676055780283 2023-02-10 19:03:06,545 DEBUG [Listener at localhost/35877-EventThread] zookeeper.ZKWatcher(600): master:40103-0x1003f9d84e20000, quorum=127.0.0.1:55517, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-10 19:03:06,546 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,35609,1676055780283] 2023-02-10 19:03:06,546 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,35609,1676055780283; numProcessing=2 2023-02-10 19:03:06,547 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,35609,1676055780283 already deleted, retry=false 2023-02-10 19:03:06,548 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,35609,1676055780283 expired; onlineServers=0 2023-02-10 19:03:06,548 INFO [RegionServerTracker-0] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,40103,1676055780155' ***** 2023-02-10 19:03:06,548 INFO [RegionServerTracker-0] regionserver.HRegionServer(2310): STOPPED: Cluster shutdown set; onlineServer=0 2023-02-10 19:03:06,549 DEBUG [M:0;jenkins-hbase4:40103] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2e1331b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-10 19:03:06,549 INFO [M:0;jenkins-hbase4:40103] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,40103,1676055780155 2023-02-10 19:03:06,549 INFO [M:0;jenkins-hbase4:40103] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,40103,1676055780155; all regions closed. 2023-02-10 19:03:06,549 DEBUG [M:0;jenkins-hbase4:40103] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-10 19:03:06,549 DEBUG [M:0;jenkins-hbase4:40103] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-02-10 19:03:06,549 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-02-10 19:03:06,549 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676055780886] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676055780886,5,FailOnTimeoutGroup] 2023-02-10 19:03:06,549 DEBUG [M:0;jenkins-hbase4:40103] cleaner.HFileCleaner(317): Stopping file delete threads 2023-02-10 19:03:06,549 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676055780886] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676055780886,5,FailOnTimeoutGroup] 2023-02-10 19:03:06,550 INFO [M:0;jenkins-hbase4:40103] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-02-10 19:03:06,550 INFO [M:0;jenkins-hbase4:40103] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-02-10 19:03:06,550 INFO [M:0;jenkins-hbase4:40103] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-02-10 19:03:06,551 DEBUG [M:0;jenkins-hbase4:40103] master.HMaster(1502): Stopping service threads 2023-02-10 19:03:06,551 INFO [M:0;jenkins-hbase4:40103] procedure2.RemoteProcedureDispatcher(118): Stopping procedure remote dispatcher 2023-02-10 19:03:06,551 DEBUG [Listener at localhost/35877-EventThread] zookeeper.ZKWatcher(600): master:40103-0x1003f9d84e20000, quorum=127.0.0.1:55517, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-02-10 19:03:06,551 ERROR [M:0;jenkins-hbase4:40103] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-02-10 19:03:06,551 DEBUG [Listener at localhost/35877-EventThread] zookeeper.ZKWatcher(600): master:40103-0x1003f9d84e20000, quorum=127.0.0.1:55517, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-10 19:03:06,551 INFO [M:0;jenkins-hbase4:40103] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-02-10 19:03:06,552 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-02-10 19:03:06,552 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:40103-0x1003f9d84e20000, quorum=127.0.0.1:55517, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-10 19:03:06,552 DEBUG [M:0;jenkins-hbase4:40103] zookeeper.ZKUtil(398): master:40103-0x1003f9d84e20000, quorum=127.0.0.1:55517, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-02-10 19:03:06,552 WARN [M:0;jenkins-hbase4:40103] master.ActiveMasterManager(323): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-02-10 19:03:06,552 INFO [M:0;jenkins-hbase4:40103] assignment.AssignmentManager(315): Stopping assignment manager 2023-02-10 19:03:06,553 INFO [M:0;jenkins-hbase4:40103] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-02-10 19:03:06,553 DEBUG [M:0;jenkins-hbase4:40103] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-10 19:03:06,553 INFO [M:0;jenkins-hbase4:40103] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-10 19:03:06,553 DEBUG [M:0;jenkins-hbase4:40103] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-10 19:03:06,553 DEBUG [M:0;jenkins-hbase4:40103] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-10 19:03:06,553 DEBUG [M:0;jenkins-hbase4:40103] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-10 19:03:06,553 INFO [M:0;jenkins-hbase4:40103] regionserver.HRegion(2744): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=100.94 KB heapSize=120.63 KB 2023-02-10 19:03:06,563 INFO [M:0;jenkins-hbase4:40103] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=100.94 KB at sequenceid=218 (bloomFilter=true), to=hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/80e15b276cee4585992b96cc16070d3f 2023-02-10 19:03:06,568 DEBUG [M:0;jenkins-hbase4:40103] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/80e15b276cee4585992b96cc16070d3f as hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/80e15b276cee4585992b96cc16070d3f 2023-02-10 19:03:06,573 INFO [M:0;jenkins-hbase4:40103] regionserver.HStore(1080): Added hdfs://localhost:34605/user/jenkins/test-data/562a96ee-5931-8e35-b83d-6bc44090eb91/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/80e15b276cee4585992b96cc16070d3f, entries=31, sequenceid=218, filesize=9.0 K 2023-02-10 19:03:06,574 INFO [M:0;jenkins-hbase4:40103] regionserver.HRegion(2947): Finished flush of dataSize ~100.94 KB/103362, heapSize ~120.62 KB/123512, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 21ms, sequenceid=218, compaction requested=false 2023-02-10 19:03:06,575 INFO [M:0;jenkins-hbase4:40103] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-10 19:03:06,575 DEBUG [M:0;jenkins-hbase4:40103] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1676055786553Disabling compacts and flushes for region at 1676055786553Disabling writes for close at 1676055786553Obtaining lock to block concurrent updates at 1676055786553Preparing flush snapshotting stores in 1595e783b53d99cd5eef43b6debb2682 at 1676055786553Finished memstore snapshotting master:store,,1.1595e783b53d99cd5eef43b6debb2682., syncing WAL and waiting on mvcc, flushsize=dataSize=103362, getHeapSize=123512, getOffHeapSize=0, getCellsCount=263 at 1676055786553Flushing stores of master:store,,1.1595e783b53d99cd5eef43b6debb2682. at 1676055786554 (+1 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: creating writer at 1676055786554Flushing 1595e783b53d99cd5eef43b6debb2682/proc: appending metadata at 1676055786557 (+3 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: closing flushed file at 1676055786557Flushing 1595e783b53d99cd5eef43b6debb2682/proc: reopening flushed file at 1676055786569 (+12 ms)Finished flush of dataSize ~100.94 KB/103362, heapSize ~120.62 KB/123512, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 21ms, sequenceid=218, compaction requested=false at 1676055786574 (+5 ms)Writing region close event to WAL at 1676055786575 (+1 ms)Closed at 1676055786575 2023-02-10 19:03:06,578 INFO [M:0;jenkins-hbase4:40103] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-02-10 19:03:06,578 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-10 19:03:06,579 INFO [M:0;jenkins-hbase4:40103] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:40103 2023-02-10 19:03:06,582 DEBUG [M:0;jenkins-hbase4:40103] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,40103,1676055780155 already deleted, retry=false 2023-02-10 19:03:06,820 DEBUG [Listener at localhost/35877-EventThread] zookeeper.ZKWatcher(600): master:40103-0x1003f9d84e20000, quorum=127.0.0.1:55517, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-10 19:03:06,820 INFO [M:0;jenkins-hbase4:40103] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,40103,1676055780155; zookeeper connection closed. 2023-02-10 19:03:06,820 ERROR [Listener at localhost/35877-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@568ae39d rejected from java.util.concurrent.ThreadPoolExecutor@52b56d94[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 56] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-10 19:03:06,821 DEBUG [Listener at localhost/35877-EventThread] zookeeper.ZKWatcher(600): master:40103-0x1003f9d84e20000, quorum=127.0.0.1:55517, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-10 19:03:06,821 ERROR [Listener at localhost/35877-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@277db792 rejected from java.util.concurrent.ThreadPoolExecutor@52b56d94[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 56] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-10 19:03:06,920 DEBUG [Listener at localhost/35877-EventThread] zookeeper.ZKWatcher(600): regionserver:35609-0x1003f9d84e20002, quorum=127.0.0.1:55517, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-10 19:03:06,920 INFO [RS:1;jenkins-hbase4:35609] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,35609,1676055780283; zookeeper connection closed. 2023-02-10 19:03:06,921 ERROR [Listener at localhost/35877-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@e36193a rejected from java.util.concurrent.ThreadPoolExecutor@a099c24[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 19] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-10 19:03:06,921 DEBUG [Listener at localhost/35877-EventThread] zookeeper.ZKWatcher(600): regionserver:35609-0x1003f9d84e20002, quorum=127.0.0.1:55517, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-10 19:03:06,921 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@2f18c6d8] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@2f18c6d8 2023-02-10 19:03:06,921 ERROR [Listener at localhost/35877-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@404f06e3 rejected from java.util.concurrent.ThreadPoolExecutor@a099c24[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 19] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-10 19:03:07,021 DEBUG [Listener at localhost/35877-EventThread] zookeeper.ZKWatcher(600): regionserver:38097-0x1003f9d84e20001, quorum=127.0.0.1:55517, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-10 19:03:07,021 INFO [RS:0;jenkins-hbase4:38097] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,38097,1676055780236; zookeeper connection closed. 2023-02-10 19:03:07,021 ERROR [Listener at localhost/35877-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@31885f4e rejected from java.util.concurrent.ThreadPoolExecutor@35b7dda7[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-10 19:03:07,021 DEBUG [Listener at localhost/35877-EventThread] zookeeper.ZKWatcher(600): regionserver:38097-0x1003f9d84e20001, quorum=127.0.0.1:55517, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-10 19:03:07,021 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@40549af2] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@40549af2 2023-02-10 19:03:07,021 ERROR [Listener at localhost/35877-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@328eacba rejected from java.util.concurrent.ThreadPoolExecutor@35b7dda7[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-10 19:03:07,021 INFO [Listener at localhost/35877] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 2 regionserver(s) complete 2023-02-10 19:03:07,108 DEBUG [Listener at localhost/35877] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapred.TestTableSnapshotInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3335ac0e-fb88-6eb8-b993-c028993dd2d7/hadoop-2704490817178126250.jar 2023-02-10 19:03:07,113 INFO [Listener at localhost/35877] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "testWithMapReduceAndOfflineHBaseMultiRegion" table: "testWithMapReduce" creation_time: 1676055783247 type: FLUSH version: 2 ttl: 0 2023-02-10 19:03:07,114 DEBUG [Listener at localhost/35877] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost:34605/user/jenkins/test-data/cdb8cff8-4bcc-a25f-b430-f9a2ac74b842/testWithMapReduceAndOfflineHBaseMultiRegion/e52e1c73-9ae2-4d51-ab19-a6aa6cd1ac37/data/default/testWithMapReduce 2023-02-10 19:03:07,114 INFO [Listener at localhost/35877] snapshot.RestoreSnapshotHelper(239): region to add: fe00f1c4e3fbcd6d7560c2506ad6ca19 2023-02-10 19:03:07,115 INFO [Listener at localhost/35877] snapshot.RestoreSnapshotHelper(239): region to add: 4dfcfb14720b0f66e0e9179835dbe61d 2023-02-10 19:03:07,115 INFO [Listener at localhost/35877] snapshot.RestoreSnapshotHelper(239): region to add: aff2d18d26e1916478e05b25bb5c9a89 2023-02-10 19:03:07,115 INFO [Listener at localhost/35877] snapshot.RestoreSnapshotHelper(239): region to add: e06f6220742d6bd40a5b138f872afaa0 2023-02-10 19:03:07,115 INFO [Listener at localhost/35877] snapshot.RestoreSnapshotHelper(239): region to add: ceccc0adc99b7adc17715506edd714a5 2023-02-10 19:03:07,115 INFO [Listener at localhost/35877] snapshot.RestoreSnapshotHelper(239): region to add: d1ba49f10de14d81a2fad0498c59a9b7 2023-02-10 19:03:07,115 INFO [Listener at localhost/35877] snapshot.RestoreSnapshotHelper(239): region to add: f3c4392d756ce5e5e061ef2cb63d0fce 2023-02-10 19:03:07,115 INFO [Listener at localhost/35877] snapshot.RestoreSnapshotHelper(239): region to add: ab9c3c4ad85b22b109e239684647572c 2023-02-10 19:03:07,115 INFO [Listener at localhost/35877] snapshot.RestoreSnapshotHelper(239): region to add: 3c13d5e817a81b6f4b36ab3d9762b76f 2023-02-10 19:03:07,115 INFO [Listener at localhost/35877] snapshot.RestoreSnapshotHelper(239): region to add: c47924fd805c4df26e6e9e860c542007 2023-02-10 19:03:07,115 INFO [Listener at localhost/35877] snapshot.RestoreSnapshotHelper(585): clone region=fe00f1c4e3fbcd6d7560c2506ad6ca19 as fe00f1c4e3fbcd6d7560c2506ad6ca19 in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-10 19:03:07,116 INFO [Listener at localhost/35877] snapshot.RestoreSnapshotHelper(585): clone region=4dfcfb14720b0f66e0e9179835dbe61d as 4dfcfb14720b0f66e0e9179835dbe61d in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-10 19:03:07,116 INFO [Listener at localhost/35877] snapshot.RestoreSnapshotHelper(585): clone region=aff2d18d26e1916478e05b25bb5c9a89 as aff2d18d26e1916478e05b25bb5c9a89 in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-10 19:03:07,116 INFO [Listener at localhost/35877] snapshot.RestoreSnapshotHelper(585): clone region=e06f6220742d6bd40a5b138f872afaa0 as e06f6220742d6bd40a5b138f872afaa0 in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-10 19:03:07,116 INFO [Listener at localhost/35877] snapshot.RestoreSnapshotHelper(585): clone region=ceccc0adc99b7adc17715506edd714a5 as ceccc0adc99b7adc17715506edd714a5 in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-10 19:03:07,116 INFO [Listener at localhost/35877] snapshot.RestoreSnapshotHelper(585): clone region=d1ba49f10de14d81a2fad0498c59a9b7 as d1ba49f10de14d81a2fad0498c59a9b7 in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-10 19:03:07,116 INFO [Listener at localhost/35877] snapshot.RestoreSnapshotHelper(585): clone region=f3c4392d756ce5e5e061ef2cb63d0fce as f3c4392d756ce5e5e061ef2cb63d0fce in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-10 19:03:07,116 INFO [Listener at localhost/35877] snapshot.RestoreSnapshotHelper(585): clone region=ab9c3c4ad85b22b109e239684647572c as ab9c3c4ad85b22b109e239684647572c in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-10 19:03:07,116 INFO [Listener at localhost/35877] snapshot.RestoreSnapshotHelper(585): clone region=3c13d5e817a81b6f4b36ab3d9762b76f as 3c13d5e817a81b6f4b36ab3d9762b76f in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-10 19:03:07,116 INFO [Listener at localhost/35877] snapshot.RestoreSnapshotHelper(585): clone region=c47924fd805c4df26e6e9e860c542007 as c47924fd805c4df26e6e9e860c542007 in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-10 19:03:07,118 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(7671): creating {ENCODED => ab9c3c4ad85b22b109e239684647572c, NAME => 'testWithMapReduce,t43,1676055781936.ab9c3c4ad85b22b109e239684647572c.', STARTKEY => 't43', ENDKEY => 'wWV'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:34605/user/jenkins/test-data/cdb8cff8-4bcc-a25f-b430-f9a2ac74b842/testWithMapReduceAndOfflineHBaseMultiRegion/e52e1c73-9ae2-4d51-ab19-a6aa6cd1ac37 2023-02-10 19:03:07,118 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(7671): creating {ENCODED => d1ba49f10de14d81a2fad0498c59a9b7, NAME => 'testWithMapReduce,aaa,1676055781936.d1ba49f10de14d81a2fad0498c59a9b7.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:34605/user/jenkins/test-data/cdb8cff8-4bcc-a25f-b430-f9a2ac74b842/testWithMapReduceAndOfflineHBaseMultiRegion/e52e1c73-9ae2-4d51-ab19-a6aa6cd1ac37 2023-02-10 19:03:07,118 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(7671): creating {ENCODED => aff2d18d26e1916478e05b25bb5c9a89, NAME => 'testWithMapReduce,zz{,1676055781936.aff2d18d26e1916478e05b25bb5c9a89.', STARTKEY => 'zz{', ENDKEY => ''}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:34605/user/jenkins/test-data/cdb8cff8-4bcc-a25f-b430-f9a2ac74b842/testWithMapReduceAndOfflineHBaseMultiRegion/e52e1c73-9ae2-4d51-ab19-a6aa6cd1ac37 2023-02-10 19:03:07,119 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(7671): creating {ENCODED => e06f6220742d6bd40a5b138f872afaa0, NAME => 'testWithMapReduce,d\x84\x84,1676055781936.e06f6220742d6bd40a5b138f872afaa0.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:34605/user/jenkins/test-data/cdb8cff8-4bcc-a25f-b430-f9a2ac74b842/testWithMapReduceAndOfflineHBaseMultiRegion/e52e1c73-9ae2-4d51-ab19-a6aa6cd1ac37 2023-02-10 19:03:07,119 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(7671): creating {ENCODED => ceccc0adc99b7adc17715506edd714a5, NAME => 'testWithMapReduce,m\xED\xED,1676055781936.ceccc0adc99b7adc17715506edd714a5.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:34605/user/jenkins/test-data/cdb8cff8-4bcc-a25f-b430-f9a2ac74b842/testWithMapReduceAndOfflineHBaseMultiRegion/e52e1c73-9ae2-4d51-ab19-a6aa6cd1ac37 2023-02-10 19:03:07,119 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(7671): creating {ENCODED => fe00f1c4e3fbcd6d7560c2506ad6ca19, NAME => 'testWithMapReduce,,1676055781936.fe00f1c4e3fbcd6d7560c2506ad6ca19.', STARTKEY => '', ENDKEY => 'aaa'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:34605/user/jenkins/test-data/cdb8cff8-4bcc-a25f-b430-f9a2ac74b842/testWithMapReduceAndOfflineHBaseMultiRegion/e52e1c73-9ae2-4d51-ab19-a6aa6cd1ac37 2023-02-10 19:03:07,119 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(7671): creating {ENCODED => 4dfcfb14720b0f66e0e9179835dbe61d, NAME => 'testWithMapReduce,wWV,1676055781936.4dfcfb14720b0f66e0e9179835dbe61d.', STARTKEY => 'wWV', ENDKEY => 'zz{'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:34605/user/jenkins/test-data/cdb8cff8-4bcc-a25f-b430-f9a2ac74b842/testWithMapReduceAndOfflineHBaseMultiRegion/e52e1c73-9ae2-4d51-ab19-a6aa6cd1ac37 2023-02-10 19:03:07,119 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(7671): creating {ENCODED => f3c4392d756ce5e5e061ef2cb63d0fce, NAME => 'testWithMapReduce,g\xA7\xA7,1676055781936.f3c4392d756ce5e5e061ef2cb63d0fce.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:34605/user/jenkins/test-data/cdb8cff8-4bcc-a25f-b430-f9a2ac74b842/testWithMapReduceAndOfflineHBaseMultiRegion/e52e1c73-9ae2-4d51-ab19-a6aa6cd1ac37 2023-02-10 19:03:07,150 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(865): Instantiated testWithMapReduce,d\x84\x84,1676055781936.e06f6220742d6bd40a5b138f872afaa0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-10 19:03:07,150 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(865): Instantiated testWithMapReduce,m\xED\xED,1676055781936.ceccc0adc99b7adc17715506edd714a5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-10 19:03:07,150 INFO [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 395efa06554f4fa38285f073a745a45a from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-10 19:03:07,150 INFO [RestoreSnapshot-pool-4] snapshot.RestoreSnapshotHelper(628): Adding HFileLink e20c54d0951f49df8d8836bff53e605f from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-10 19:03:07,150 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,zz{,1676055781936.aff2d18d26e1916478e05b25bb5c9a89.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-10 19:03:07,150 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1603): Closing aff2d18d26e1916478e05b25bb5c9a89, disabling compactions & flushes 2023-02-10 19:03:07,150 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,zz{,1676055781936.aff2d18d26e1916478e05b25bb5c9a89. 2023-02-10 19:03:07,150 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,zz{,1676055781936.aff2d18d26e1916478e05b25bb5c9a89. 2023-02-10 19:03:07,150 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,zz{,1676055781936.aff2d18d26e1916478e05b25bb5c9a89. after waiting 0 ms 2023-02-10 19:03:07,151 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,zz{,1676055781936.aff2d18d26e1916478e05b25bb5c9a89. 2023-02-10 19:03:07,151 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,zz{,1676055781936.aff2d18d26e1916478e05b25bb5c9a89. 2023-02-10 19:03:07,151 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1557): Region close journal for aff2d18d26e1916478e05b25bb5c9a89: Waiting for close lock at 1676055787150Disabling compacts and flushes for region at 1676055787150Disabling writes for close at 1676055787151 (+1 ms)Writing region close event to WAL at 1676055787151Closed at 1676055787151 2023-02-10 19:03:07,151 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(865): Instantiated testWithMapReduce,g\xA7\xA7,1676055781936.f3c4392d756ce5e5e061ef2cb63d0fce.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-10 19:03:07,151 INFO [RestoreSnapshot-pool-6] snapshot.RestoreSnapshotHelper(628): Adding HFileLink b809dc233ec14237929a2e2d18d14f13 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-10 19:03:07,151 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(865): Instantiated testWithMapReduce,t43,1676055781936.ab9c3c4ad85b22b109e239684647572c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-10 19:03:07,151 INFO [RestoreSnapshot-pool-7] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 058fe4570d8947a79c55109ff7319ed0 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-10 19:03:07,151 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(7671): creating {ENCODED => 3c13d5e817a81b6f4b36ab3d9762b76f, NAME => 'testWithMapReduce,j\xCA\xCA,1676055781936.3c13d5e817a81b6f4b36ab3d9762b76f.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:34605/user/jenkins/test-data/cdb8cff8-4bcc-a25f-b430-f9a2ac74b842/testWithMapReduceAndOfflineHBaseMultiRegion/e52e1c73-9ae2-4d51-ab19-a6aa6cd1ac37 2023-02-10 19:03:07,155 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(865): Instantiated testWithMapReduce,aaa,1676055781936.d1ba49f10de14d81a2fad0498c59a9b7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-10 19:03:07,155 INFO [RestoreSnapshot-pool-5] snapshot.RestoreSnapshotHelper(628): Adding HFileLink b67edbff65be4ab5ba42b8fb675d5d2b from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-10 19:03:07,156 INFO [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 8b54d5d9e3e24c3a80bb17ba71bf956d from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-10 19:03:07,156 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,wWV,1676055781936.4dfcfb14720b0f66e0e9179835dbe61d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-10 19:03:07,156 INFO [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(628): Adding HFileLink fa0d2a3dbfa94f5faefc2e0d02f62ec6 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-10 19:03:07,156 INFO [RestoreSnapshot-pool-4] snapshot.RestoreSnapshotHelper(628): Adding HFileLink ed218713da0842fc9dfc23a8505bdd34 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-10 19:03:07,157 INFO [RestoreSnapshot-pool-6] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 7bdb0c53fd7b467397d5ffdb9243be37 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-10 19:03:07,158 INFO [RestoreSnapshot-pool-7] snapshot.RestoreSnapshotHelper(628): Adding HFileLink d4712dc7f55a449e9dfa7b3ef7c14110 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-10 19:03:07,158 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676055781936.fe00f1c4e3fbcd6d7560c2506ad6ca19.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-10 19:03:07,158 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1603): Closing fe00f1c4e3fbcd6d7560c2506ad6ca19, disabling compactions & flushes 2023-02-10 19:03:07,158 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676055781936.fe00f1c4e3fbcd6d7560c2506ad6ca19. 2023-02-10 19:03:07,158 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676055781936.fe00f1c4e3fbcd6d7560c2506ad6ca19. 2023-02-10 19:03:07,158 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676055781936.fe00f1c4e3fbcd6d7560c2506ad6ca19. after waiting 0 ms 2023-02-10 19:03:07,158 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676055781936.fe00f1c4e3fbcd6d7560c2506ad6ca19. 2023-02-10 19:03:07,158 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,,1676055781936.fe00f1c4e3fbcd6d7560c2506ad6ca19. 2023-02-10 19:03:07,158 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1557): Region close journal for fe00f1c4e3fbcd6d7560c2506ad6ca19: Waiting for close lock at 1676055787158Disabling compacts and flushes for region at 1676055787158Disabling writes for close at 1676055787158Writing region close event to WAL at 1676055787158Closed at 1676055787158 2023-02-10 19:03:07,159 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(7671): creating {ENCODED => c47924fd805c4df26e6e9e860c542007, NAME => 'testWithMapReduce,q\x11\x10,1676055781936.c47924fd805c4df26e6e9e860c542007.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:34605/user/jenkins/test-data/cdb8cff8-4bcc-a25f-b430-f9a2ac74b842/testWithMapReduceAndOfflineHBaseMultiRegion/e52e1c73-9ae2-4d51-ab19-a6aa6cd1ac37 2023-02-10 19:03:07,160 INFO [RestoreSnapshot-pool-5] snapshot.RestoreSnapshotHelper(628): Adding HFileLink bd610f877a144f18943d0bad3fd9dd5a from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-10 19:03:07,162 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1603): Closing e06f6220742d6bd40a5b138f872afaa0, disabling compactions & flushes 2023-02-10 19:03:07,162 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(1625): Closing region testWithMapReduce,d\x84\x84,1676055781936.e06f6220742d6bd40a5b138f872afaa0. 2023-02-10 19:03:07,162 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,d\x84\x84,1676055781936.e06f6220742d6bd40a5b138f872afaa0. 2023-02-10 19:03:07,162 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,d\x84\x84,1676055781936.e06f6220742d6bd40a5b138f872afaa0. after waiting 0 ms 2023-02-10 19:03:07,162 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,d\x84\x84,1676055781936.e06f6220742d6bd40a5b138f872afaa0. 2023-02-10 19:03:07,162 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(1837): Closed testWithMapReduce,d\x84\x84,1676055781936.e06f6220742d6bd40a5b138f872afaa0. 2023-02-10 19:03:07,162 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1557): Region close journal for e06f6220742d6bd40a5b138f872afaa0: Waiting for close lock at 1676055787162Disabling compacts and flushes for region at 1676055787162Disabling writes for close at 1676055787162Writing region close event to WAL at 1676055787162Closed at 1676055787162 2023-02-10 19:03:07,162 INFO [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(628): Adding HFileLink a798a04a435444beb147cc2980bdea9f from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-10 19:03:07,162 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1603): Closing ab9c3c4ad85b22b109e239684647572c, disabling compactions & flushes 2023-02-10 19:03:07,162 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(1625): Closing region testWithMapReduce,t43,1676055781936.ab9c3c4ad85b22b109e239684647572c. 2023-02-10 19:03:07,162 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,t43,1676055781936.ab9c3c4ad85b22b109e239684647572c. 2023-02-10 19:03:07,162 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,t43,1676055781936.ab9c3c4ad85b22b109e239684647572c. after waiting 0 ms 2023-02-10 19:03:07,162 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,t43,1676055781936.ab9c3c4ad85b22b109e239684647572c. 2023-02-10 19:03:07,162 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(1837): Closed testWithMapReduce,t43,1676055781936.ab9c3c4ad85b22b109e239684647572c. 2023-02-10 19:03:07,163 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1557): Region close journal for ab9c3c4ad85b22b109e239684647572c: Waiting for close lock at 1676055787162Disabling compacts and flushes for region at 1676055787162Disabling writes for close at 1676055787162Writing region close event to WAL at 1676055787162Closed at 1676055787162 2023-02-10 19:03:07,172 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1603): Closing ceccc0adc99b7adc17715506edd714a5, disabling compactions & flushes 2023-02-10 19:03:07,172 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(1625): Closing region testWithMapReduce,m\xED\xED,1676055781936.ceccc0adc99b7adc17715506edd714a5. 2023-02-10 19:03:07,172 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,m\xED\xED,1676055781936.ceccc0adc99b7adc17715506edd714a5. 2023-02-10 19:03:07,172 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,m\xED\xED,1676055781936.ceccc0adc99b7adc17715506edd714a5. after waiting 0 ms 2023-02-10 19:03:07,172 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,m\xED\xED,1676055781936.ceccc0adc99b7adc17715506edd714a5. 2023-02-10 19:03:07,172 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(1837): Closed testWithMapReduce,m\xED\xED,1676055781936.ceccc0adc99b7adc17715506edd714a5. 2023-02-10 19:03:07,172 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1557): Region close journal for ceccc0adc99b7adc17715506edd714a5: Waiting for close lock at 1676055787172Disabling compacts and flushes for region at 1676055787172Disabling writes for close at 1676055787172Writing region close event to WAL at 1676055787172Closed at 1676055787172 2023-02-10 19:03:07,173 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1603): Closing d1ba49f10de14d81a2fad0498c59a9b7, disabling compactions & flushes 2023-02-10 19:03:07,173 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(1625): Closing region testWithMapReduce,aaa,1676055781936.d1ba49f10de14d81a2fad0498c59a9b7. 2023-02-10 19:03:07,173 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,aaa,1676055781936.d1ba49f10de14d81a2fad0498c59a9b7. 2023-02-10 19:03:07,173 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,aaa,1676055781936.d1ba49f10de14d81a2fad0498c59a9b7. after waiting 0 ms 2023-02-10 19:03:07,173 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,aaa,1676055781936.d1ba49f10de14d81a2fad0498c59a9b7. 2023-02-10 19:03:07,173 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(1837): Closed testWithMapReduce,aaa,1676055781936.d1ba49f10de14d81a2fad0498c59a9b7. 2023-02-10 19:03:07,173 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1557): Region close journal for d1ba49f10de14d81a2fad0498c59a9b7: Waiting for close lock at 1676055787173Disabling compacts and flushes for region at 1676055787173Disabling writes for close at 1676055787173Writing region close event to WAL at 1676055787173Closed at 1676055787173 2023-02-10 19:03:07,174 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1603): Closing 4dfcfb14720b0f66e0e9179835dbe61d, disabling compactions & flushes 2023-02-10 19:03:07,174 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,wWV,1676055781936.4dfcfb14720b0f66e0e9179835dbe61d. 2023-02-10 19:03:07,174 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,wWV,1676055781936.4dfcfb14720b0f66e0e9179835dbe61d. 2023-02-10 19:03:07,174 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,wWV,1676055781936.4dfcfb14720b0f66e0e9179835dbe61d. after waiting 0 ms 2023-02-10 19:03:07,174 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,wWV,1676055781936.4dfcfb14720b0f66e0e9179835dbe61d. 2023-02-10 19:03:07,174 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,wWV,1676055781936.4dfcfb14720b0f66e0e9179835dbe61d. 2023-02-10 19:03:07,174 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1557): Region close journal for 4dfcfb14720b0f66e0e9179835dbe61d: Waiting for close lock at 1676055787174Disabling compacts and flushes for region at 1676055787174Disabling writes for close at 1676055787174Writing region close event to WAL at 1676055787174Closed at 1676055787174 2023-02-10 19:03:07,174 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1603): Closing f3c4392d756ce5e5e061ef2cb63d0fce, disabling compactions & flushes 2023-02-10 19:03:07,174 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(1625): Closing region testWithMapReduce,g\xA7\xA7,1676055781936.f3c4392d756ce5e5e061ef2cb63d0fce. 2023-02-10 19:03:07,174 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,g\xA7\xA7,1676055781936.f3c4392d756ce5e5e061ef2cb63d0fce. 2023-02-10 19:03:07,174 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,g\xA7\xA7,1676055781936.f3c4392d756ce5e5e061ef2cb63d0fce. after waiting 0 ms 2023-02-10 19:03:07,174 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,g\xA7\xA7,1676055781936.f3c4392d756ce5e5e061ef2cb63d0fce. 2023-02-10 19:03:07,175 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(1837): Closed testWithMapReduce,g\xA7\xA7,1676055781936.f3c4392d756ce5e5e061ef2cb63d0fce. 2023-02-10 19:03:07,175 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1557): Region close journal for f3c4392d756ce5e5e061ef2cb63d0fce: Waiting for close lock at 1676055787174Disabling compacts and flushes for region at 1676055787174Disabling writes for close at 1676055787174Writing region close event to WAL at 1676055787175 (+1 ms)Closed at 1676055787175 2023-02-10 19:03:07,177 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,q\x11\x10,1676055781936.c47924fd805c4df26e6e9e860c542007.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-10 19:03:07,177 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 3e01724064a848b2914128a2594b074d from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-10 19:03:07,177 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,j\xCA\xCA,1676055781936.3c13d5e817a81b6f4b36ab3d9762b76f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-10 19:03:07,177 INFO [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 4dfbd9571a5643aaae8ff1af04c39568 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-10 19:03:07,179 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink a8bc1ab2688a4c29b2b059f44dfa6d5a from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-10 19:03:07,179 INFO [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 9ecfde10768445ecbcac71e07d50753f from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-10 19:03:07,181 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1603): Closing c47924fd805c4df26e6e9e860c542007, disabling compactions & flushes 2023-02-10 19:03:07,181 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,q\x11\x10,1676055781936.c47924fd805c4df26e6e9e860c542007. 2023-02-10 19:03:07,181 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,q\x11\x10,1676055781936.c47924fd805c4df26e6e9e860c542007. 2023-02-10 19:03:07,181 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1603): Closing 3c13d5e817a81b6f4b36ab3d9762b76f, disabling compactions & flushes 2023-02-10 19:03:07,181 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,q\x11\x10,1676055781936.c47924fd805c4df26e6e9e860c542007. after waiting 0 ms 2023-02-10 19:03:07,181 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,q\x11\x10,1676055781936.c47924fd805c4df26e6e9e860c542007. 2023-02-10 19:03:07,181 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,j\xCA\xCA,1676055781936.3c13d5e817a81b6f4b36ab3d9762b76f. 2023-02-10 19:03:07,181 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,j\xCA\xCA,1676055781936.3c13d5e817a81b6f4b36ab3d9762b76f. 2023-02-10 19:03:07,181 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,q\x11\x10,1676055781936.c47924fd805c4df26e6e9e860c542007. 2023-02-10 19:03:07,181 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,j\xCA\xCA,1676055781936.3c13d5e817a81b6f4b36ab3d9762b76f. after waiting 0 ms 2023-02-10 19:03:07,181 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,j\xCA\xCA,1676055781936.3c13d5e817a81b6f4b36ab3d9762b76f. 2023-02-10 19:03:07,181 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1557): Region close journal for c47924fd805c4df26e6e9e860c542007: Waiting for close lock at 1676055787181Disabling compacts and flushes for region at 1676055787181Disabling writes for close at 1676055787181Writing region close event to WAL at 1676055787181Closed at 1676055787181 2023-02-10 19:03:07,181 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,j\xCA\xCA,1676055781936.3c13d5e817a81b6f4b36ab3d9762b76f. 2023-02-10 19:03:07,181 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1557): Region close journal for 3c13d5e817a81b6f4b36ab3d9762b76f: Waiting for close lock at 1676055787181Disabling compacts and flushes for region at 1676055787181Disabling writes for close at 1676055787181Writing region close event to WAL at 1676055787181Closed at 1676055787181 2023-02-10 19:03:07,181 INFO [Listener at localhost/35877] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "testWithMapReduceAndOfflineHBaseMultiRegion" table: "testWithMapReduce" creation_time: 1676055783247 type: FLUSH version: 2 ttl: 0 2023-02-10 19:03:07,182 DEBUG [Listener at localhost/35877] snapshot.RestoreSnapshotHelper(832): Restored table dir:hdfs://localhost:34605/user/jenkins/test-data/cdb8cff8-4bcc-a25f-b430-f9a2ac74b842/testWithMapReduceAndOfflineHBaseMultiRegion/e52e1c73-9ae2-4d51-ab19-a6aa6cd1ac37 2023-02-10 19:03:07,182 DEBUG [Listener at localhost/35877] util.CommonFSUtils(682): File system contents for path hdfs://localhost:34605/user/jenkins/test-data/cdb8cff8-4bcc-a25f-b430-f9a2ac74b842/testWithMapReduceAndOfflineHBaseMultiRegion/e52e1c73-9ae2-4d51-ab19-a6aa6cd1ac37 2023-02-10 19:03:07,182 DEBUG [Listener at localhost/35877] util.CommonFSUtils(699): |-data/ 2023-02-10 19:03:07,183 DEBUG [Listener at localhost/35877] util.CommonFSUtils(699): |----default/ 2023-02-10 19:03:07,183 DEBUG [Listener at localhost/35877] util.CommonFSUtils(699): |-------testWithMapReduce/ 2023-02-10 19:03:07,184 DEBUG [Listener at localhost/35877] util.CommonFSUtils(699): |----------3c13d5e817a81b6f4b36ab3d9762b76f/ 2023-02-10 19:03:07,184 DEBUG [Listener at localhost/35877] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-10 19:03:07,184 DEBUG [Listener at localhost/35877] util.CommonFSUtils(699): |-------------f1/ 2023-02-10 19:03:07,185 DEBUG [Listener at localhost/35877] util.CommonFSUtils(702): |----------------testWithMapReduce=3c13d5e817a81b6f4b36ab3d9762b76f-4dfbd9571a5643aaae8ff1af04c39568 2023-02-10 19:03:07,185 DEBUG [Listener at localhost/35877] util.CommonFSUtils(699): |-------------f2/ 2023-02-10 19:03:07,185 DEBUG [Listener at localhost/35877] util.CommonFSUtils(702): |----------------testWithMapReduce=3c13d5e817a81b6f4b36ab3d9762b76f-9ecfde10768445ecbcac71e07d50753f 2023-02-10 19:03:07,185 DEBUG [Listener at localhost/35877] util.CommonFSUtils(699): |----------4dfcfb14720b0f66e0e9179835dbe61d/ 2023-02-10 19:03:07,186 DEBUG [Listener at localhost/35877] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-10 19:03:07,186 DEBUG [Listener at localhost/35877] util.CommonFSUtils(699): |-------------f1/ 2023-02-10 19:03:07,186 DEBUG [Listener at localhost/35877] util.CommonFSUtils(702): |----------------testWithMapReduce=4dfcfb14720b0f66e0e9179835dbe61d-fa0d2a3dbfa94f5faefc2e0d02f62ec6 2023-02-10 19:03:07,187 DEBUG [Listener at localhost/35877] util.CommonFSUtils(699): |-------------f2/ 2023-02-10 19:03:07,187 DEBUG [Listener at localhost/35877] util.CommonFSUtils(702): |----------------testWithMapReduce=4dfcfb14720b0f66e0e9179835dbe61d-a798a04a435444beb147cc2980bdea9f 2023-02-10 19:03:07,187 DEBUG [Listener at localhost/35877] util.CommonFSUtils(699): |----------ab9c3c4ad85b22b109e239684647572c/ 2023-02-10 19:03:07,188 DEBUG [Listener at localhost/35877] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-10 19:03:07,188 DEBUG [Listener at localhost/35877] util.CommonFSUtils(699): |-------------f1/ 2023-02-10 19:03:07,188 DEBUG [Listener at localhost/35877] util.CommonFSUtils(702): |----------------testWithMapReduce=ab9c3c4ad85b22b109e239684647572c-058fe4570d8947a79c55109ff7319ed0 2023-02-10 19:03:07,188 DEBUG [Listener at localhost/35877] util.CommonFSUtils(699): |-------------f2/ 2023-02-10 19:03:07,189 DEBUG [Listener at localhost/35877] util.CommonFSUtils(702): |----------------testWithMapReduce=ab9c3c4ad85b22b109e239684647572c-d4712dc7f55a449e9dfa7b3ef7c14110 2023-02-10 19:03:07,189 DEBUG [Listener at localhost/35877] util.CommonFSUtils(699): |----------aff2d18d26e1916478e05b25bb5c9a89/ 2023-02-10 19:03:07,189 DEBUG [Listener at localhost/35877] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-10 19:03:07,189 DEBUG [Listener at localhost/35877] util.CommonFSUtils(699): |----------c47924fd805c4df26e6e9e860c542007/ 2023-02-10 19:03:07,190 DEBUG [Listener at localhost/35877] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-10 19:03:07,190 DEBUG [Listener at localhost/35877] util.CommonFSUtils(699): |-------------f1/ 2023-02-10 19:03:07,191 DEBUG [Listener at localhost/35877] util.CommonFSUtils(702): |----------------testWithMapReduce=c47924fd805c4df26e6e9e860c542007-3e01724064a848b2914128a2594b074d 2023-02-10 19:03:07,191 DEBUG [Listener at localhost/35877] util.CommonFSUtils(699): |-------------f2/ 2023-02-10 19:03:07,191 DEBUG [Listener at localhost/35877] util.CommonFSUtils(702): |----------------testWithMapReduce=c47924fd805c4df26e6e9e860c542007-a8bc1ab2688a4c29b2b059f44dfa6d5a 2023-02-10 19:03:07,191 DEBUG [Listener at localhost/35877] util.CommonFSUtils(699): |----------ceccc0adc99b7adc17715506edd714a5/ 2023-02-10 19:03:07,192 DEBUG [Listener at localhost/35877] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-10 19:03:07,192 DEBUG [Listener at localhost/35877] util.CommonFSUtils(699): |-------------f1/ 2023-02-10 19:03:07,192 DEBUG [Listener at localhost/35877] util.CommonFSUtils(702): |----------------testWithMapReduce=ceccc0adc99b7adc17715506edd714a5-e20c54d0951f49df8d8836bff53e605f 2023-02-10 19:03:07,192 DEBUG [Listener at localhost/35877] util.CommonFSUtils(699): |-------------f2/ 2023-02-10 19:03:07,193 DEBUG [Listener at localhost/35877] util.CommonFSUtils(702): |----------------testWithMapReduce=ceccc0adc99b7adc17715506edd714a5-ed218713da0842fc9dfc23a8505bdd34 2023-02-10 19:03:07,193 DEBUG [Listener at localhost/35877] util.CommonFSUtils(699): |----------d1ba49f10de14d81a2fad0498c59a9b7/ 2023-02-10 19:03:07,194 DEBUG [Listener at localhost/35877] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-10 19:03:07,194 DEBUG [Listener at localhost/35877] util.CommonFSUtils(699): |-------------f1/ 2023-02-10 19:03:07,194 DEBUG [Listener at localhost/35877] util.CommonFSUtils(702): |----------------testWithMapReduce=d1ba49f10de14d81a2fad0498c59a9b7-b67edbff65be4ab5ba42b8fb675d5d2b 2023-02-10 19:03:07,194 DEBUG [Listener at localhost/35877] util.CommonFSUtils(699): |-------------f2/ 2023-02-10 19:03:07,195 DEBUG [Listener at localhost/35877] util.CommonFSUtils(702): |----------------testWithMapReduce=d1ba49f10de14d81a2fad0498c59a9b7-bd610f877a144f18943d0bad3fd9dd5a 2023-02-10 19:03:07,195 DEBUG [Listener at localhost/35877] util.CommonFSUtils(699): |----------e06f6220742d6bd40a5b138f872afaa0/ 2023-02-10 19:03:07,195 DEBUG [Listener at localhost/35877] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-10 19:03:07,195 DEBUG [Listener at localhost/35877] util.CommonFSUtils(699): |-------------f1/ 2023-02-10 19:03:07,196 DEBUG [Listener at localhost/35877] util.CommonFSUtils(702): |----------------testWithMapReduce=e06f6220742d6bd40a5b138f872afaa0-395efa06554f4fa38285f073a745a45a 2023-02-10 19:03:07,196 DEBUG [Listener at localhost/35877] util.CommonFSUtils(699): |-------------f2/ 2023-02-10 19:03:07,196 DEBUG [Listener at localhost/35877] util.CommonFSUtils(702): |----------------testWithMapReduce=e06f6220742d6bd40a5b138f872afaa0-8b54d5d9e3e24c3a80bb17ba71bf956d 2023-02-10 19:03:07,196 DEBUG [Listener at localhost/35877] util.CommonFSUtils(699): |----------f3c4392d756ce5e5e061ef2cb63d0fce/ 2023-02-10 19:03:07,197 DEBUG [Listener at localhost/35877] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-10 19:03:07,197 DEBUG [Listener at localhost/35877] util.CommonFSUtils(699): |-------------f1/ 2023-02-10 19:03:07,197 DEBUG [Listener at localhost/35877] util.CommonFSUtils(702): |----------------testWithMapReduce=f3c4392d756ce5e5e061ef2cb63d0fce-b809dc233ec14237929a2e2d18d14f13 2023-02-10 19:03:07,197 DEBUG [Listener at localhost/35877] util.CommonFSUtils(699): |-------------f2/ 2023-02-10 19:03:07,198 DEBUG [Listener at localhost/35877] util.CommonFSUtils(702): |----------------testWithMapReduce=f3c4392d756ce5e5e061ef2cb63d0fce-7bdb0c53fd7b467397d5ffdb9243be37 2023-02-10 19:03:07,198 DEBUG [Listener at localhost/35877] util.CommonFSUtils(699): |----------fe00f1c4e3fbcd6d7560c2506ad6ca19/ 2023-02-10 19:03:07,198 DEBUG [Listener at localhost/35877] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-10 19:03:07,198 DEBUG [Listener at localhost/35877] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.17-SNAPSHOT.jar 2023-02-10 19:03:07,199 DEBUG [Listener at localhost/35877] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.17-SNAPSHOT.jar 2023-02-10 19:03:07,199 DEBUG [Listener at localhost/35877] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.17-SNAPSHOT.jar 2023-02-10 19:03:07,199 DEBUG [Listener at localhost/35877] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.17-SNAPSHOT.jar 2023-02-10 19:03:07,200 DEBUG [Listener at localhost/35877] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.17-SNAPSHOT.jar 2023-02-10 19:03:07,200 DEBUG [Listener at localhost/35877] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.17-SNAPSHOT.jar 2023-02-10 19:03:07,200 DEBUG [Listener at localhost/35877] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.17-SNAPSHOT.jar 2023-02-10 19:03:07,266 DEBUG [Listener at localhost/35877] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3335ac0e-fb88-6eb8-b993-c028993dd2d7/hadoop-2505305414881451452.jar 2023-02-10 19:03:07,267 DEBUG [Listener at localhost/35877] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.17-SNAPSHOT.jar 2023-02-10 19:03:07,267 DEBUG [Listener at localhost/35877] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.17-SNAPSHOT.jar 2023-02-10 19:03:07,268 DEBUG [Listener at localhost/35877] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.17-SNAPSHOT.jar 2023-02-10 19:03:07,268 DEBUG [Listener at localhost/35877] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.17-SNAPSHOT.jar 2023-02-10 19:03:07,268 DEBUG [Listener at localhost/35877] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.17-SNAPSHOT.jar 2023-02-10 19:03:07,269 DEBUG [Listener at localhost/35877] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.17-SNAPSHOT.jar 2023-02-10 19:03:07,269 DEBUG [Listener at localhost/35877] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-02-10 19:03:07,269 DEBUG [Listener at localhost/35877] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-02-10 19:03:07,270 DEBUG [Listener at localhost/35877] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-02-10 19:03:07,270 DEBUG [Listener at localhost/35877] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-02-10 19:03:07,270 DEBUG [Listener at localhost/35877] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-02-10 19:03:07,271 DEBUG [Listener at localhost/35877] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-02-10 19:03:07,271 DEBUG [Listener at localhost/35877] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-02-10 19:03:07,272 DEBUG [Listener at localhost/35877] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-02-10 19:03:07,272 DEBUG [Listener at localhost/35877] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-02-10 19:03:07,272 DEBUG [Listener at localhost/35877] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-02-10 19:03:07,273 DEBUG [Listener at localhost/35877] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.io.ImmutableBytesWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.17-SNAPSHOT.jar 2023-02-10 19:03:07,273 DEBUG [Listener at localhost/35877] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.NullWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-10 19:03:07,273 DEBUG [Listener at localhost/35877] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-10 19:03:07,274 DEBUG [Listener at localhost/35877] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-10 19:03:07,274 DEBUG [Listener at localhost/35877] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapred.lib.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-02-10 19:03:07,339 DEBUG [Listener at localhost/35877] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapred.TableSnapshotInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3335ac0e-fb88-6eb8-b993-c028993dd2d7/hadoop-609530941547989952.jar 2023-02-10 19:03:07,340 DEBUG [Listener at localhost/35877] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapred.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-02-10 19:03:07,345 WARN [Listener at localhost/35877] mapreduce.JobResourceUploader(142): Hadoop command-line option parsing not performed. Implement the Tool interface and execute your application with ToolRunner to remedy this. 2023-02-10 19:03:07,376 INFO [Listener at localhost/35877] mapreduce.TableSnapshotInputFormatImpl(392): Provided Scan has DEFAULT ReadType, updating STREAM for Snapshot-based InputFormat 2023-02-10 19:03:07,475 WARN [Listener at localhost/35877] fs.FileUtil(850): Command 'ln -s /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3335ac0e-fb88-6eb8-b993-c028993dd2d7/mapreduce.cluster.local.dir/1676055787444/libjars /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/*' failed 1 with: ln: failed to create symbolic link '/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/*': No such file or directory 2023-02-10 19:03:07,475 WARN [Listener at localhost/35877] mapred.LocalDistributedCacheManager(202): Failed to create symlink: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3335ac0e-fb88-6eb8-b993-c028993dd2d7/mapreduce.cluster.local.dir/1676055787444/libjars <- /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/* 2023-02-10 19:03:07,510 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,t43,1676055781936.ab9c3c4ad85b22b109e239684647572c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-10 19:03:07,510 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-10 19:03:07,511 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-10 19:03:07,513 INFO [StoreOpener-ab9c3c4ad85b22b109e239684647572c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region ab9c3c4ad85b22b109e239684647572c 2023-02-10 19:03:07,514 DEBUG [StoreOpener-ab9c3c4ad85b22b109e239684647572c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34605/user/jenkins/test-data/cdb8cff8-4bcc-a25f-b430-f9a2ac74b842/testWithMapReduceAndOfflineHBaseMultiRegion/e52e1c73-9ae2-4d51-ab19-a6aa6cd1ac37/data/default/testWithMapReduce/ab9c3c4ad85b22b109e239684647572c/f1 2023-02-10 19:03:07,514 INFO [StoreOpener-ab9c3c4ad85b22b109e239684647572c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ab9c3c4ad85b22b109e239684647572c columnFamilyName f1 2023-02-10 19:03:07,519 DEBUG [StoreOpener-ab9c3c4ad85b22b109e239684647572c-1] regionserver.HStore(539): loaded hdfs://localhost:34605/user/jenkins/test-data/cdb8cff8-4bcc-a25f-b430-f9a2ac74b842/testWithMapReduceAndOfflineHBaseMultiRegion/e52e1c73-9ae2-4d51-ab19-a6aa6cd1ac37/data/default/testWithMapReduce/ab9c3c4ad85b22b109e239684647572c/f1/testWithMapReduce=ab9c3c4ad85b22b109e239684647572c-058fe4570d8947a79c55109ff7319ed0 2023-02-10 19:03:07,519 INFO [StoreOpener-ab9c3c4ad85b22b109e239684647572c-1] regionserver.HStore(310): Store=ab9c3c4ad85b22b109e239684647572c/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-10 19:03:07,519 INFO [StoreOpener-ab9c3c4ad85b22b109e239684647572c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region ab9c3c4ad85b22b109e239684647572c 2023-02-10 19:03:07,520 DEBUG [StoreOpener-ab9c3c4ad85b22b109e239684647572c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34605/user/jenkins/test-data/cdb8cff8-4bcc-a25f-b430-f9a2ac74b842/testWithMapReduceAndOfflineHBaseMultiRegion/e52e1c73-9ae2-4d51-ab19-a6aa6cd1ac37/data/default/testWithMapReduce/ab9c3c4ad85b22b109e239684647572c/f2 2023-02-10 19:03:07,520 INFO [StoreOpener-ab9c3c4ad85b22b109e239684647572c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ab9c3c4ad85b22b109e239684647572c columnFamilyName f2 2023-02-10 19:03:07,525 DEBUG [StoreOpener-ab9c3c4ad85b22b109e239684647572c-1] regionserver.HStore(539): loaded hdfs://localhost:34605/user/jenkins/test-data/cdb8cff8-4bcc-a25f-b430-f9a2ac74b842/testWithMapReduceAndOfflineHBaseMultiRegion/e52e1c73-9ae2-4d51-ab19-a6aa6cd1ac37/data/default/testWithMapReduce/ab9c3c4ad85b22b109e239684647572c/f2/testWithMapReduce=ab9c3c4ad85b22b109e239684647572c-d4712dc7f55a449e9dfa7b3ef7c14110 2023-02-10 19:03:07,525 INFO [StoreOpener-ab9c3c4ad85b22b109e239684647572c-1] regionserver.HStore(310): Store=ab9c3c4ad85b22b109e239684647572c/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-10 19:03:07,526 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-10 19:03:07,526 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened ab9c3c4ad85b22b109e239684647572c; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72595032, jitterRate=0.08175027370452881}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-10 19:03:07,526 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for ab9c3c4ad85b22b109e239684647572c: Writing region info on filesystem at 1676055787511Initializing all the Stores at 1676055787512 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676055787512Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676055787512Region opened successfully at 1676055787526 (+14 ms) 2023-02-10 19:03:07,563 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing ab9c3c4ad85b22b109e239684647572c, disabling compactions & flushes 2023-02-10 19:03:07,564 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,t43,1676055781936.ab9c3c4ad85b22b109e239684647572c. 2023-02-10 19:03:07,564 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,t43,1676055781936.ab9c3c4ad85b22b109e239684647572c. 2023-02-10 19:03:07,564 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,t43,1676055781936.ab9c3c4ad85b22b109e239684647572c. after waiting 0 ms 2023-02-10 19:03:07,564 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,t43,1676055781936.ab9c3c4ad85b22b109e239684647572c. 2023-02-10 19:03:07,565 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,t43,1676055781936.ab9c3c4ad85b22b109e239684647572c. 2023-02-10 19:03:07,565 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for ab9c3c4ad85b22b109e239684647572c: Waiting for close lock at 1676055787563Disabling compacts and flushes for region at 1676055787563Disabling writes for close at 1676055787564 (+1 ms)Writing region close event to WAL at 1676055787565 (+1 ms)Closed at 1676055787565 2023-02-10 19:03:07,569 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,wWV,1676055781936.4dfcfb14720b0f66e0e9179835dbe61d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-10 19:03:07,569 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-10 19:03:07,570 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-10 19:03:07,572 INFO [StoreOpener-4dfcfb14720b0f66e0e9179835dbe61d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 4dfcfb14720b0f66e0e9179835dbe61d 2023-02-10 19:03:07,573 DEBUG [StoreOpener-4dfcfb14720b0f66e0e9179835dbe61d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34605/user/jenkins/test-data/cdb8cff8-4bcc-a25f-b430-f9a2ac74b842/testWithMapReduceAndOfflineHBaseMultiRegion/e52e1c73-9ae2-4d51-ab19-a6aa6cd1ac37/data/default/testWithMapReduce/4dfcfb14720b0f66e0e9179835dbe61d/f1 2023-02-10 19:03:07,573 INFO [StoreOpener-4dfcfb14720b0f66e0e9179835dbe61d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4dfcfb14720b0f66e0e9179835dbe61d columnFamilyName f1 2023-02-10 19:03:07,579 DEBUG [StoreOpener-4dfcfb14720b0f66e0e9179835dbe61d-1] regionserver.HStore(539): loaded hdfs://localhost:34605/user/jenkins/test-data/cdb8cff8-4bcc-a25f-b430-f9a2ac74b842/testWithMapReduceAndOfflineHBaseMultiRegion/e52e1c73-9ae2-4d51-ab19-a6aa6cd1ac37/data/default/testWithMapReduce/4dfcfb14720b0f66e0e9179835dbe61d/f1/testWithMapReduce=4dfcfb14720b0f66e0e9179835dbe61d-fa0d2a3dbfa94f5faefc2e0d02f62ec6 2023-02-10 19:03:07,579 INFO [StoreOpener-4dfcfb14720b0f66e0e9179835dbe61d-1] regionserver.HStore(310): Store=4dfcfb14720b0f66e0e9179835dbe61d/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-10 19:03:07,579 INFO [StoreOpener-4dfcfb14720b0f66e0e9179835dbe61d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 4dfcfb14720b0f66e0e9179835dbe61d 2023-02-10 19:03:07,580 DEBUG [StoreOpener-4dfcfb14720b0f66e0e9179835dbe61d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34605/user/jenkins/test-data/cdb8cff8-4bcc-a25f-b430-f9a2ac74b842/testWithMapReduceAndOfflineHBaseMultiRegion/e52e1c73-9ae2-4d51-ab19-a6aa6cd1ac37/data/default/testWithMapReduce/4dfcfb14720b0f66e0e9179835dbe61d/f2 2023-02-10 19:03:07,580 INFO [StoreOpener-4dfcfb14720b0f66e0e9179835dbe61d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4dfcfb14720b0f66e0e9179835dbe61d columnFamilyName f2 2023-02-10 19:03:07,585 DEBUG [StoreOpener-4dfcfb14720b0f66e0e9179835dbe61d-1] regionserver.HStore(539): loaded hdfs://localhost:34605/user/jenkins/test-data/cdb8cff8-4bcc-a25f-b430-f9a2ac74b842/testWithMapReduceAndOfflineHBaseMultiRegion/e52e1c73-9ae2-4d51-ab19-a6aa6cd1ac37/data/default/testWithMapReduce/4dfcfb14720b0f66e0e9179835dbe61d/f2/testWithMapReduce=4dfcfb14720b0f66e0e9179835dbe61d-a798a04a435444beb147cc2980bdea9f 2023-02-10 19:03:07,585 INFO [StoreOpener-4dfcfb14720b0f66e0e9179835dbe61d-1] regionserver.HStore(310): Store=4dfcfb14720b0f66e0e9179835dbe61d/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-10 19:03:07,586 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-10 19:03:07,586 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 4dfcfb14720b0f66e0e9179835dbe61d; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62081083, jitterRate=-0.07491977512836456}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-10 19:03:07,586 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 4dfcfb14720b0f66e0e9179835dbe61d: Writing region info on filesystem at 1676055787570Initializing all the Stores at 1676055787571 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676055787571Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676055787571Region opened successfully at 1676055787586 (+15 ms) 2023-02-10 19:03:07,618 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 4dfcfb14720b0f66e0e9179835dbe61d, disabling compactions & flushes 2023-02-10 19:03:07,618 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,wWV,1676055781936.4dfcfb14720b0f66e0e9179835dbe61d. 2023-02-10 19:03:07,618 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,wWV,1676055781936.4dfcfb14720b0f66e0e9179835dbe61d. 2023-02-10 19:03:07,618 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,wWV,1676055781936.4dfcfb14720b0f66e0e9179835dbe61d. after waiting 0 ms 2023-02-10 19:03:07,618 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,wWV,1676055781936.4dfcfb14720b0f66e0e9179835dbe61d. 2023-02-10 19:03:07,619 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,wWV,1676055781936.4dfcfb14720b0f66e0e9179835dbe61d. 2023-02-10 19:03:07,619 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 4dfcfb14720b0f66e0e9179835dbe61d: Waiting for close lock at 1676055787618Disabling compacts and flushes for region at 1676055787618Disabling writes for close at 1676055787618Writing region close event to WAL at 1676055787619 (+1 ms)Closed at 1676055787619 2023-02-10 19:03:07,623 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,q\x11\x10,1676055781936.c47924fd805c4df26e6e9e860c542007.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-10 19:03:07,623 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-10 19:03:07,625 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-10 19:03:07,626 INFO [StoreOpener-c47924fd805c4df26e6e9e860c542007-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region c47924fd805c4df26e6e9e860c542007 2023-02-10 19:03:07,627 DEBUG [StoreOpener-c47924fd805c4df26e6e9e860c542007-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34605/user/jenkins/test-data/cdb8cff8-4bcc-a25f-b430-f9a2ac74b842/testWithMapReduceAndOfflineHBaseMultiRegion/e52e1c73-9ae2-4d51-ab19-a6aa6cd1ac37/data/default/testWithMapReduce/c47924fd805c4df26e6e9e860c542007/f1 2023-02-10 19:03:07,628 INFO [StoreOpener-c47924fd805c4df26e6e9e860c542007-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c47924fd805c4df26e6e9e860c542007 columnFamilyName f1 2023-02-10 19:03:07,634 DEBUG [StoreOpener-c47924fd805c4df26e6e9e860c542007-1] regionserver.HStore(539): loaded hdfs://localhost:34605/user/jenkins/test-data/cdb8cff8-4bcc-a25f-b430-f9a2ac74b842/testWithMapReduceAndOfflineHBaseMultiRegion/e52e1c73-9ae2-4d51-ab19-a6aa6cd1ac37/data/default/testWithMapReduce/c47924fd805c4df26e6e9e860c542007/f1/testWithMapReduce=c47924fd805c4df26e6e9e860c542007-3e01724064a848b2914128a2594b074d 2023-02-10 19:03:07,634 INFO [StoreOpener-c47924fd805c4df26e6e9e860c542007-1] regionserver.HStore(310): Store=c47924fd805c4df26e6e9e860c542007/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-10 19:03:07,635 INFO [StoreOpener-c47924fd805c4df26e6e9e860c542007-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region c47924fd805c4df26e6e9e860c542007 2023-02-10 19:03:07,635 DEBUG [StoreOpener-c47924fd805c4df26e6e9e860c542007-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34605/user/jenkins/test-data/cdb8cff8-4bcc-a25f-b430-f9a2ac74b842/testWithMapReduceAndOfflineHBaseMultiRegion/e52e1c73-9ae2-4d51-ab19-a6aa6cd1ac37/data/default/testWithMapReduce/c47924fd805c4df26e6e9e860c542007/f2 2023-02-10 19:03:07,636 INFO [StoreOpener-c47924fd805c4df26e6e9e860c542007-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c47924fd805c4df26e6e9e860c542007 columnFamilyName f2 2023-02-10 19:03:07,641 DEBUG [StoreOpener-c47924fd805c4df26e6e9e860c542007-1] regionserver.HStore(539): loaded hdfs://localhost:34605/user/jenkins/test-data/cdb8cff8-4bcc-a25f-b430-f9a2ac74b842/testWithMapReduceAndOfflineHBaseMultiRegion/e52e1c73-9ae2-4d51-ab19-a6aa6cd1ac37/data/default/testWithMapReduce/c47924fd805c4df26e6e9e860c542007/f2/testWithMapReduce=c47924fd805c4df26e6e9e860c542007-a8bc1ab2688a4c29b2b059f44dfa6d5a 2023-02-10 19:03:07,641 INFO [StoreOpener-c47924fd805c4df26e6e9e860c542007-1] regionserver.HStore(310): Store=c47924fd805c4df26e6e9e860c542007/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-10 19:03:07,641 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-10 19:03:07,641 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened c47924fd805c4df26e6e9e860c542007; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=75476931, jitterRate=0.12469391524791718}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-10 19:03:07,641 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for c47924fd805c4df26e6e9e860c542007: Writing region info on filesystem at 1676055787625Initializing all the Stores at 1676055787626 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676055787626Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676055787626Region opened successfully at 1676055787641 (+15 ms) 2023-02-10 19:03:07,671 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing c47924fd805c4df26e6e9e860c542007, disabling compactions & flushes 2023-02-10 19:03:07,671 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,q\x11\x10,1676055781936.c47924fd805c4df26e6e9e860c542007. 2023-02-10 19:03:07,672 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,q\x11\x10,1676055781936.c47924fd805c4df26e6e9e860c542007. 2023-02-10 19:03:07,672 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,q\x11\x10,1676055781936.c47924fd805c4df26e6e9e860c542007. after waiting 0 ms 2023-02-10 19:03:07,672 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,q\x11\x10,1676055781936.c47924fd805c4df26e6e9e860c542007. 2023-02-10 19:03:07,674 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,q\x11\x10,1676055781936.c47924fd805c4df26e6e9e860c542007. 2023-02-10 19:03:07,674 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for c47924fd805c4df26e6e9e860c542007: Waiting for close lock at 1676055787671Disabling compacts and flushes for region at 1676055787671Disabling writes for close at 1676055787672 (+1 ms)Writing region close event to WAL at 1676055787674 (+2 ms)Closed at 1676055787674 2023-02-10 19:03:07,678 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,j\xCA\xCA,1676055781936.3c13d5e817a81b6f4b36ab3d9762b76f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-10 19:03:07,678 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-10 19:03:07,680 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-10 19:03:07,682 INFO [StoreOpener-3c13d5e817a81b6f4b36ab3d9762b76f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 3c13d5e817a81b6f4b36ab3d9762b76f 2023-02-10 19:03:07,683 DEBUG [StoreOpener-3c13d5e817a81b6f4b36ab3d9762b76f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34605/user/jenkins/test-data/cdb8cff8-4bcc-a25f-b430-f9a2ac74b842/testWithMapReduceAndOfflineHBaseMultiRegion/e52e1c73-9ae2-4d51-ab19-a6aa6cd1ac37/data/default/testWithMapReduce/3c13d5e817a81b6f4b36ab3d9762b76f/f1 2023-02-10 19:03:07,683 INFO [StoreOpener-3c13d5e817a81b6f4b36ab3d9762b76f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3c13d5e817a81b6f4b36ab3d9762b76f columnFamilyName f1 2023-02-10 19:03:07,688 DEBUG [StoreOpener-3c13d5e817a81b6f4b36ab3d9762b76f-1] regionserver.HStore(539): loaded hdfs://localhost:34605/user/jenkins/test-data/cdb8cff8-4bcc-a25f-b430-f9a2ac74b842/testWithMapReduceAndOfflineHBaseMultiRegion/e52e1c73-9ae2-4d51-ab19-a6aa6cd1ac37/data/default/testWithMapReduce/3c13d5e817a81b6f4b36ab3d9762b76f/f1/testWithMapReduce=3c13d5e817a81b6f4b36ab3d9762b76f-4dfbd9571a5643aaae8ff1af04c39568 2023-02-10 19:03:07,688 INFO [StoreOpener-3c13d5e817a81b6f4b36ab3d9762b76f-1] regionserver.HStore(310): Store=3c13d5e817a81b6f4b36ab3d9762b76f/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-10 19:03:07,688 INFO [StoreOpener-3c13d5e817a81b6f4b36ab3d9762b76f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 3c13d5e817a81b6f4b36ab3d9762b76f 2023-02-10 19:03:07,689 DEBUG [StoreOpener-3c13d5e817a81b6f4b36ab3d9762b76f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34605/user/jenkins/test-data/cdb8cff8-4bcc-a25f-b430-f9a2ac74b842/testWithMapReduceAndOfflineHBaseMultiRegion/e52e1c73-9ae2-4d51-ab19-a6aa6cd1ac37/data/default/testWithMapReduce/3c13d5e817a81b6f4b36ab3d9762b76f/f2 2023-02-10 19:03:07,690 INFO [StoreOpener-3c13d5e817a81b6f4b36ab3d9762b76f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3c13d5e817a81b6f4b36ab3d9762b76f columnFamilyName f2 2023-02-10 19:03:07,695 DEBUG [StoreOpener-3c13d5e817a81b6f4b36ab3d9762b76f-1] regionserver.HStore(539): loaded hdfs://localhost:34605/user/jenkins/test-data/cdb8cff8-4bcc-a25f-b430-f9a2ac74b842/testWithMapReduceAndOfflineHBaseMultiRegion/e52e1c73-9ae2-4d51-ab19-a6aa6cd1ac37/data/default/testWithMapReduce/3c13d5e817a81b6f4b36ab3d9762b76f/f2/testWithMapReduce=3c13d5e817a81b6f4b36ab3d9762b76f-9ecfde10768445ecbcac71e07d50753f 2023-02-10 19:03:07,695 INFO [StoreOpener-3c13d5e817a81b6f4b36ab3d9762b76f-1] regionserver.HStore(310): Store=3c13d5e817a81b6f4b36ab3d9762b76f/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-10 19:03:07,695 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-10 19:03:07,695 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 3c13d5e817a81b6f4b36ab3d9762b76f; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65105448, jitterRate=-0.029853224754333496}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-10 19:03:07,696 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 3c13d5e817a81b6f4b36ab3d9762b76f: Writing region info on filesystem at 1676055787680Initializing all the Stores at 1676055787681 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676055787681Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676055787681Region opened successfully at 1676055787696 (+15 ms) 2023-02-10 19:03:07,733 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 3c13d5e817a81b6f4b36ab3d9762b76f, disabling compactions & flushes 2023-02-10 19:03:07,733 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,j\xCA\xCA,1676055781936.3c13d5e817a81b6f4b36ab3d9762b76f. 2023-02-10 19:03:07,733 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,j\xCA\xCA,1676055781936.3c13d5e817a81b6f4b36ab3d9762b76f. 2023-02-10 19:03:07,734 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,j\xCA\xCA,1676055781936.3c13d5e817a81b6f4b36ab3d9762b76f. after waiting 0 ms 2023-02-10 19:03:07,734 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,j\xCA\xCA,1676055781936.3c13d5e817a81b6f4b36ab3d9762b76f. 2023-02-10 19:03:07,736 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,j\xCA\xCA,1676055781936.3c13d5e817a81b6f4b36ab3d9762b76f. 2023-02-10 19:03:07,736 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 3c13d5e817a81b6f4b36ab3d9762b76f: Waiting for close lock at 1676055787733Disabling compacts and flushes for region at 1676055787733Disabling writes for close at 1676055787734 (+1 ms)Writing region close event to WAL at 1676055787736 (+2 ms)Closed at 1676055787736 2023-02-10 19:03:07,740 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,m\xED\xED,1676055781936.ceccc0adc99b7adc17715506edd714a5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-10 19:03:07,740 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-10 19:03:07,748 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-10 19:03:07,750 INFO [StoreOpener-ceccc0adc99b7adc17715506edd714a5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region ceccc0adc99b7adc17715506edd714a5 2023-02-10 19:03:07,751 DEBUG [StoreOpener-ceccc0adc99b7adc17715506edd714a5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34605/user/jenkins/test-data/cdb8cff8-4bcc-a25f-b430-f9a2ac74b842/testWithMapReduceAndOfflineHBaseMultiRegion/e52e1c73-9ae2-4d51-ab19-a6aa6cd1ac37/data/default/testWithMapReduce/ceccc0adc99b7adc17715506edd714a5/f1 2023-02-10 19:03:07,751 INFO [StoreOpener-ceccc0adc99b7adc17715506edd714a5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ceccc0adc99b7adc17715506edd714a5 columnFamilyName f1 2023-02-10 19:03:07,756 DEBUG [StoreOpener-ceccc0adc99b7adc17715506edd714a5-1] regionserver.HStore(539): loaded hdfs://localhost:34605/user/jenkins/test-data/cdb8cff8-4bcc-a25f-b430-f9a2ac74b842/testWithMapReduceAndOfflineHBaseMultiRegion/e52e1c73-9ae2-4d51-ab19-a6aa6cd1ac37/data/default/testWithMapReduce/ceccc0adc99b7adc17715506edd714a5/f1/testWithMapReduce=ceccc0adc99b7adc17715506edd714a5-e20c54d0951f49df8d8836bff53e605f 2023-02-10 19:03:07,757 INFO [StoreOpener-ceccc0adc99b7adc17715506edd714a5-1] regionserver.HStore(310): Store=ceccc0adc99b7adc17715506edd714a5/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-10 19:03:07,757 INFO [StoreOpener-ceccc0adc99b7adc17715506edd714a5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region ceccc0adc99b7adc17715506edd714a5 2023-02-10 19:03:07,758 DEBUG [StoreOpener-ceccc0adc99b7adc17715506edd714a5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34605/user/jenkins/test-data/cdb8cff8-4bcc-a25f-b430-f9a2ac74b842/testWithMapReduceAndOfflineHBaseMultiRegion/e52e1c73-9ae2-4d51-ab19-a6aa6cd1ac37/data/default/testWithMapReduce/ceccc0adc99b7adc17715506edd714a5/f2 2023-02-10 19:03:07,758 INFO [StoreOpener-ceccc0adc99b7adc17715506edd714a5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ceccc0adc99b7adc17715506edd714a5 columnFamilyName f2 2023-02-10 19:03:07,763 DEBUG [StoreOpener-ceccc0adc99b7adc17715506edd714a5-1] regionserver.HStore(539): loaded hdfs://localhost:34605/user/jenkins/test-data/cdb8cff8-4bcc-a25f-b430-f9a2ac74b842/testWithMapReduceAndOfflineHBaseMultiRegion/e52e1c73-9ae2-4d51-ab19-a6aa6cd1ac37/data/default/testWithMapReduce/ceccc0adc99b7adc17715506edd714a5/f2/testWithMapReduce=ceccc0adc99b7adc17715506edd714a5-ed218713da0842fc9dfc23a8505bdd34 2023-02-10 19:03:07,763 INFO [StoreOpener-ceccc0adc99b7adc17715506edd714a5-1] regionserver.HStore(310): Store=ceccc0adc99b7adc17715506edd714a5/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-10 19:03:07,763 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-10 19:03:07,764 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened ceccc0adc99b7adc17715506edd714a5; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65304505, jitterRate=-0.026887044310569763}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-10 19:03:07,764 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for ceccc0adc99b7adc17715506edd714a5: Writing region info on filesystem at 1676055787748Initializing all the Stores at 1676055787749 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676055787749Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676055787749Region opened successfully at 1676055787764 (+15 ms) 2023-02-10 19:03:07,791 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing ceccc0adc99b7adc17715506edd714a5, disabling compactions & flushes 2023-02-10 19:03:07,792 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,m\xED\xED,1676055781936.ceccc0adc99b7adc17715506edd714a5. 2023-02-10 19:03:07,792 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,m\xED\xED,1676055781936.ceccc0adc99b7adc17715506edd714a5. 2023-02-10 19:03:07,792 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,m\xED\xED,1676055781936.ceccc0adc99b7adc17715506edd714a5. after waiting 0 ms 2023-02-10 19:03:07,792 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,m\xED\xED,1676055781936.ceccc0adc99b7adc17715506edd714a5. 2023-02-10 19:03:07,792 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,m\xED\xED,1676055781936.ceccc0adc99b7adc17715506edd714a5. 2023-02-10 19:03:07,792 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for ceccc0adc99b7adc17715506edd714a5: Waiting for close lock at 1676055787791Disabling compacts and flushes for region at 1676055787791Disabling writes for close at 1676055787792 (+1 ms)Writing region close event to WAL at 1676055787792Closed at 1676055787792 2023-02-10 19:03:07,796 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,aaa,1676055781936.d1ba49f10de14d81a2fad0498c59a9b7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-10 19:03:07,796 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-10 19:03:07,798 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-10 19:03:07,800 INFO [StoreOpener-d1ba49f10de14d81a2fad0498c59a9b7-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region d1ba49f10de14d81a2fad0498c59a9b7 2023-02-10 19:03:07,801 DEBUG [StoreOpener-d1ba49f10de14d81a2fad0498c59a9b7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34605/user/jenkins/test-data/cdb8cff8-4bcc-a25f-b430-f9a2ac74b842/testWithMapReduceAndOfflineHBaseMultiRegion/e52e1c73-9ae2-4d51-ab19-a6aa6cd1ac37/data/default/testWithMapReduce/d1ba49f10de14d81a2fad0498c59a9b7/f1 2023-02-10 19:03:07,801 INFO [StoreOpener-d1ba49f10de14d81a2fad0498c59a9b7-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d1ba49f10de14d81a2fad0498c59a9b7 columnFamilyName f1 2023-02-10 19:03:07,805 DEBUG [StoreOpener-d1ba49f10de14d81a2fad0498c59a9b7-1] regionserver.HStore(539): loaded hdfs://localhost:34605/user/jenkins/test-data/cdb8cff8-4bcc-a25f-b430-f9a2ac74b842/testWithMapReduceAndOfflineHBaseMultiRegion/e52e1c73-9ae2-4d51-ab19-a6aa6cd1ac37/data/default/testWithMapReduce/d1ba49f10de14d81a2fad0498c59a9b7/f1/testWithMapReduce=d1ba49f10de14d81a2fad0498c59a9b7-b67edbff65be4ab5ba42b8fb675d5d2b 2023-02-10 19:03:07,806 INFO [StoreOpener-d1ba49f10de14d81a2fad0498c59a9b7-1] regionserver.HStore(310): Store=d1ba49f10de14d81a2fad0498c59a9b7/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-10 19:03:07,806 INFO [StoreOpener-d1ba49f10de14d81a2fad0498c59a9b7-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region d1ba49f10de14d81a2fad0498c59a9b7 2023-02-10 19:03:07,806 DEBUG [StoreOpener-d1ba49f10de14d81a2fad0498c59a9b7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34605/user/jenkins/test-data/cdb8cff8-4bcc-a25f-b430-f9a2ac74b842/testWithMapReduceAndOfflineHBaseMultiRegion/e52e1c73-9ae2-4d51-ab19-a6aa6cd1ac37/data/default/testWithMapReduce/d1ba49f10de14d81a2fad0498c59a9b7/f2 2023-02-10 19:03:07,807 INFO [StoreOpener-d1ba49f10de14d81a2fad0498c59a9b7-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d1ba49f10de14d81a2fad0498c59a9b7 columnFamilyName f2 2023-02-10 19:03:07,810 DEBUG [StoreOpener-d1ba49f10de14d81a2fad0498c59a9b7-1] regionserver.HStore(539): loaded hdfs://localhost:34605/user/jenkins/test-data/cdb8cff8-4bcc-a25f-b430-f9a2ac74b842/testWithMapReduceAndOfflineHBaseMultiRegion/e52e1c73-9ae2-4d51-ab19-a6aa6cd1ac37/data/default/testWithMapReduce/d1ba49f10de14d81a2fad0498c59a9b7/f2/testWithMapReduce=d1ba49f10de14d81a2fad0498c59a9b7-bd610f877a144f18943d0bad3fd9dd5a 2023-02-10 19:03:07,811 INFO [StoreOpener-d1ba49f10de14d81a2fad0498c59a9b7-1] regionserver.HStore(310): Store=d1ba49f10de14d81a2fad0498c59a9b7/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-10 19:03:07,811 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-10 19:03:07,811 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened d1ba49f10de14d81a2fad0498c59a9b7; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67795146, jitterRate=0.010226398706436157}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-10 19:03:07,811 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for d1ba49f10de14d81a2fad0498c59a9b7: Writing region info on filesystem at 1676055787799Initializing all the Stores at 1676055787799Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676055787799Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676055787799Region opened successfully at 1676055787811 (+12 ms) 2023-02-10 19:03:07,841 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing d1ba49f10de14d81a2fad0498c59a9b7, disabling compactions & flushes 2023-02-10 19:03:07,841 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,aaa,1676055781936.d1ba49f10de14d81a2fad0498c59a9b7. 2023-02-10 19:03:07,841 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,aaa,1676055781936.d1ba49f10de14d81a2fad0498c59a9b7. 2023-02-10 19:03:07,841 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,aaa,1676055781936.d1ba49f10de14d81a2fad0498c59a9b7. after waiting 0 ms 2023-02-10 19:03:07,841 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,aaa,1676055781936.d1ba49f10de14d81a2fad0498c59a9b7. 2023-02-10 19:03:07,842 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,aaa,1676055781936.d1ba49f10de14d81a2fad0498c59a9b7. 2023-02-10 19:03:07,842 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for d1ba49f10de14d81a2fad0498c59a9b7: Waiting for close lock at 1676055787841Disabling compacts and flushes for region at 1676055787841Disabling writes for close at 1676055787841Writing region close event to WAL at 1676055787842 (+1 ms)Closed at 1676055787842 2023-02-10 19:03:07,844 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,zz{,1676055781936.aff2d18d26e1916478e05b25bb5c9a89.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-10 19:03:07,845 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-10 19:03:07,846 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-10 19:03:07,847 INFO [StoreOpener-aff2d18d26e1916478e05b25bb5c9a89-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region aff2d18d26e1916478e05b25bb5c9a89 2023-02-10 19:03:07,849 DEBUG [StoreOpener-aff2d18d26e1916478e05b25bb5c9a89-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34605/user/jenkins/test-data/cdb8cff8-4bcc-a25f-b430-f9a2ac74b842/testWithMapReduceAndOfflineHBaseMultiRegion/e52e1c73-9ae2-4d51-ab19-a6aa6cd1ac37/data/default/testWithMapReduce/aff2d18d26e1916478e05b25bb5c9a89/f1 2023-02-10 19:03:07,849 INFO [StoreOpener-aff2d18d26e1916478e05b25bb5c9a89-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region aff2d18d26e1916478e05b25bb5c9a89 columnFamilyName f1 2023-02-10 19:03:07,849 INFO [StoreOpener-aff2d18d26e1916478e05b25bb5c9a89-1] regionserver.HStore(310): Store=aff2d18d26e1916478e05b25bb5c9a89/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-10 19:03:07,850 INFO [StoreOpener-aff2d18d26e1916478e05b25bb5c9a89-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region aff2d18d26e1916478e05b25bb5c9a89 2023-02-10 19:03:07,851 DEBUG [StoreOpener-aff2d18d26e1916478e05b25bb5c9a89-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34605/user/jenkins/test-data/cdb8cff8-4bcc-a25f-b430-f9a2ac74b842/testWithMapReduceAndOfflineHBaseMultiRegion/e52e1c73-9ae2-4d51-ab19-a6aa6cd1ac37/data/default/testWithMapReduce/aff2d18d26e1916478e05b25bb5c9a89/f2 2023-02-10 19:03:07,851 INFO [StoreOpener-aff2d18d26e1916478e05b25bb5c9a89-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region aff2d18d26e1916478e05b25bb5c9a89 columnFamilyName f2 2023-02-10 19:03:07,851 INFO [StoreOpener-aff2d18d26e1916478e05b25bb5c9a89-1] regionserver.HStore(310): Store=aff2d18d26e1916478e05b25bb5c9a89/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-10 19:03:07,852 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-10 19:03:07,852 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened aff2d18d26e1916478e05b25bb5c9a89; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63973120, jitterRate=-0.046726226806640625}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-10 19:03:07,852 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for aff2d18d26e1916478e05b25bb5c9a89: Writing region info on filesystem at 1676055787846Initializing all the Stores at 1676055787846Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676055787847 (+1 ms)Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676055787847Region opened successfully at 1676055787852 (+5 ms) 2023-02-10 19:03:07,869 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing aff2d18d26e1916478e05b25bb5c9a89, disabling compactions & flushes 2023-02-10 19:03:07,869 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,zz{,1676055781936.aff2d18d26e1916478e05b25bb5c9a89. 2023-02-10 19:03:07,869 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,zz{,1676055781936.aff2d18d26e1916478e05b25bb5c9a89. 2023-02-10 19:03:07,869 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,zz{,1676055781936.aff2d18d26e1916478e05b25bb5c9a89. after waiting 0 ms 2023-02-10 19:03:07,869 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,zz{,1676055781936.aff2d18d26e1916478e05b25bb5c9a89. 2023-02-10 19:03:07,870 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,zz{,1676055781936.aff2d18d26e1916478e05b25bb5c9a89. 2023-02-10 19:03:07,870 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for aff2d18d26e1916478e05b25bb5c9a89: Waiting for close lock at 1676055787869Disabling compacts and flushes for region at 1676055787869Disabling writes for close at 1676055787869Writing region close event to WAL at 1676055787870 (+1 ms)Closed at 1676055787870 2023-02-10 19:03:07,873 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,d\x84\x84,1676055781936.e06f6220742d6bd40a5b138f872afaa0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-10 19:03:07,873 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-10 19:03:07,874 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-10 19:03:07,876 INFO [StoreOpener-e06f6220742d6bd40a5b138f872afaa0-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region e06f6220742d6bd40a5b138f872afaa0 2023-02-10 19:03:07,877 DEBUG [StoreOpener-e06f6220742d6bd40a5b138f872afaa0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34605/user/jenkins/test-data/cdb8cff8-4bcc-a25f-b430-f9a2ac74b842/testWithMapReduceAndOfflineHBaseMultiRegion/e52e1c73-9ae2-4d51-ab19-a6aa6cd1ac37/data/default/testWithMapReduce/e06f6220742d6bd40a5b138f872afaa0/f1 2023-02-10 19:03:07,877 INFO [StoreOpener-e06f6220742d6bd40a5b138f872afaa0-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e06f6220742d6bd40a5b138f872afaa0 columnFamilyName f1 2023-02-10 19:03:07,882 DEBUG [StoreOpener-e06f6220742d6bd40a5b138f872afaa0-1] regionserver.HStore(539): loaded hdfs://localhost:34605/user/jenkins/test-data/cdb8cff8-4bcc-a25f-b430-f9a2ac74b842/testWithMapReduceAndOfflineHBaseMultiRegion/e52e1c73-9ae2-4d51-ab19-a6aa6cd1ac37/data/default/testWithMapReduce/e06f6220742d6bd40a5b138f872afaa0/f1/testWithMapReduce=e06f6220742d6bd40a5b138f872afaa0-395efa06554f4fa38285f073a745a45a 2023-02-10 19:03:07,882 INFO [StoreOpener-e06f6220742d6bd40a5b138f872afaa0-1] regionserver.HStore(310): Store=e06f6220742d6bd40a5b138f872afaa0/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-10 19:03:07,882 INFO [StoreOpener-e06f6220742d6bd40a5b138f872afaa0-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region e06f6220742d6bd40a5b138f872afaa0 2023-02-10 19:03:07,883 DEBUG [StoreOpener-e06f6220742d6bd40a5b138f872afaa0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34605/user/jenkins/test-data/cdb8cff8-4bcc-a25f-b430-f9a2ac74b842/testWithMapReduceAndOfflineHBaseMultiRegion/e52e1c73-9ae2-4d51-ab19-a6aa6cd1ac37/data/default/testWithMapReduce/e06f6220742d6bd40a5b138f872afaa0/f2 2023-02-10 19:03:07,884 INFO [StoreOpener-e06f6220742d6bd40a5b138f872afaa0-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e06f6220742d6bd40a5b138f872afaa0 columnFamilyName f2 2023-02-10 19:03:07,888 DEBUG [StoreOpener-e06f6220742d6bd40a5b138f872afaa0-1] regionserver.HStore(539): loaded hdfs://localhost:34605/user/jenkins/test-data/cdb8cff8-4bcc-a25f-b430-f9a2ac74b842/testWithMapReduceAndOfflineHBaseMultiRegion/e52e1c73-9ae2-4d51-ab19-a6aa6cd1ac37/data/default/testWithMapReduce/e06f6220742d6bd40a5b138f872afaa0/f2/testWithMapReduce=e06f6220742d6bd40a5b138f872afaa0-8b54d5d9e3e24c3a80bb17ba71bf956d 2023-02-10 19:03:07,888 INFO [StoreOpener-e06f6220742d6bd40a5b138f872afaa0-1] regionserver.HStore(310): Store=e06f6220742d6bd40a5b138f872afaa0/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-10 19:03:07,888 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-10 19:03:07,888 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened e06f6220742d6bd40a5b138f872afaa0; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70756132, jitterRate=0.054348528385162354}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-10 19:03:07,888 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for e06f6220742d6bd40a5b138f872afaa0: Writing region info on filesystem at 1676055787874Initializing all the Stores at 1676055787875 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676055787875Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676055787875Region opened successfully at 1676055787888 (+13 ms) 2023-02-10 19:03:07,922 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing e06f6220742d6bd40a5b138f872afaa0, disabling compactions & flushes 2023-02-10 19:03:07,922 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,d\x84\x84,1676055781936.e06f6220742d6bd40a5b138f872afaa0. 2023-02-10 19:03:07,922 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,d\x84\x84,1676055781936.e06f6220742d6bd40a5b138f872afaa0. 2023-02-10 19:03:07,922 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,d\x84\x84,1676055781936.e06f6220742d6bd40a5b138f872afaa0. after waiting 0 ms 2023-02-10 19:03:07,922 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,d\x84\x84,1676055781936.e06f6220742d6bd40a5b138f872afaa0. 2023-02-10 19:03:07,923 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,d\x84\x84,1676055781936.e06f6220742d6bd40a5b138f872afaa0. 2023-02-10 19:03:07,923 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for e06f6220742d6bd40a5b138f872afaa0: Waiting for close lock at 1676055787922Disabling compacts and flushes for region at 1676055787922Disabling writes for close at 1676055787922Writing region close event to WAL at 1676055787923 (+1 ms)Closed at 1676055787923 2023-02-10 19:03:07,925 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,g\xA7\xA7,1676055781936.f3c4392d756ce5e5e061ef2cb63d0fce.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-10 19:03:07,926 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-10 19:03:07,927 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-10 19:03:07,928 INFO [StoreOpener-f3c4392d756ce5e5e061ef2cb63d0fce-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region f3c4392d756ce5e5e061ef2cb63d0fce 2023-02-10 19:03:07,929 DEBUG [StoreOpener-f3c4392d756ce5e5e061ef2cb63d0fce-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34605/user/jenkins/test-data/cdb8cff8-4bcc-a25f-b430-f9a2ac74b842/testWithMapReduceAndOfflineHBaseMultiRegion/e52e1c73-9ae2-4d51-ab19-a6aa6cd1ac37/data/default/testWithMapReduce/f3c4392d756ce5e5e061ef2cb63d0fce/f1 2023-02-10 19:03:07,930 INFO [StoreOpener-f3c4392d756ce5e5e061ef2cb63d0fce-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f3c4392d756ce5e5e061ef2cb63d0fce columnFamilyName f1 2023-02-10 19:03:07,934 DEBUG [StoreOpener-f3c4392d756ce5e5e061ef2cb63d0fce-1] regionserver.HStore(539): loaded hdfs://localhost:34605/user/jenkins/test-data/cdb8cff8-4bcc-a25f-b430-f9a2ac74b842/testWithMapReduceAndOfflineHBaseMultiRegion/e52e1c73-9ae2-4d51-ab19-a6aa6cd1ac37/data/default/testWithMapReduce/f3c4392d756ce5e5e061ef2cb63d0fce/f1/testWithMapReduce=f3c4392d756ce5e5e061ef2cb63d0fce-b809dc233ec14237929a2e2d18d14f13 2023-02-10 19:03:07,934 INFO [StoreOpener-f3c4392d756ce5e5e061ef2cb63d0fce-1] regionserver.HStore(310): Store=f3c4392d756ce5e5e061ef2cb63d0fce/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-10 19:03:07,934 INFO [StoreOpener-f3c4392d756ce5e5e061ef2cb63d0fce-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region f3c4392d756ce5e5e061ef2cb63d0fce 2023-02-10 19:03:07,935 DEBUG [StoreOpener-f3c4392d756ce5e5e061ef2cb63d0fce-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34605/user/jenkins/test-data/cdb8cff8-4bcc-a25f-b430-f9a2ac74b842/testWithMapReduceAndOfflineHBaseMultiRegion/e52e1c73-9ae2-4d51-ab19-a6aa6cd1ac37/data/default/testWithMapReduce/f3c4392d756ce5e5e061ef2cb63d0fce/f2 2023-02-10 19:03:07,936 INFO [StoreOpener-f3c4392d756ce5e5e061ef2cb63d0fce-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f3c4392d756ce5e5e061ef2cb63d0fce columnFamilyName f2 2023-02-10 19:03:07,940 DEBUG [StoreOpener-f3c4392d756ce5e5e061ef2cb63d0fce-1] regionserver.HStore(539): loaded hdfs://localhost:34605/user/jenkins/test-data/cdb8cff8-4bcc-a25f-b430-f9a2ac74b842/testWithMapReduceAndOfflineHBaseMultiRegion/e52e1c73-9ae2-4d51-ab19-a6aa6cd1ac37/data/default/testWithMapReduce/f3c4392d756ce5e5e061ef2cb63d0fce/f2/testWithMapReduce=f3c4392d756ce5e5e061ef2cb63d0fce-7bdb0c53fd7b467397d5ffdb9243be37 2023-02-10 19:03:07,940 INFO [StoreOpener-f3c4392d756ce5e5e061ef2cb63d0fce-1] regionserver.HStore(310): Store=f3c4392d756ce5e5e061ef2cb63d0fce/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-10 19:03:07,940 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-10 19:03:07,940 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened f3c4392d756ce5e5e061ef2cb63d0fce; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68926613, jitterRate=0.027086570858955383}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-10 19:03:07,940 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for f3c4392d756ce5e5e061ef2cb63d0fce: Writing region info on filesystem at 1676055787927Initializing all the Stores at 1676055787928 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676055787928Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676055787928Region opened successfully at 1676055787940 (+12 ms) 2023-02-10 19:03:07,967 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing f3c4392d756ce5e5e061ef2cb63d0fce, disabling compactions & flushes 2023-02-10 19:03:07,967 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,g\xA7\xA7,1676055781936.f3c4392d756ce5e5e061ef2cb63d0fce. 2023-02-10 19:03:07,967 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,g\xA7\xA7,1676055781936.f3c4392d756ce5e5e061ef2cb63d0fce. 2023-02-10 19:03:07,967 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,g\xA7\xA7,1676055781936.f3c4392d756ce5e5e061ef2cb63d0fce. after waiting 0 ms 2023-02-10 19:03:07,967 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,g\xA7\xA7,1676055781936.f3c4392d756ce5e5e061ef2cb63d0fce. 2023-02-10 19:03:07,968 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,g\xA7\xA7,1676055781936.f3c4392d756ce5e5e061ef2cb63d0fce. 2023-02-10 19:03:07,968 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for f3c4392d756ce5e5e061ef2cb63d0fce: Waiting for close lock at 1676055787967Disabling compacts and flushes for region at 1676055787967Disabling writes for close at 1676055787967Writing region close event to WAL at 1676055787968 (+1 ms)Closed at 1676055787968 2023-02-10 19:03:07,971 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676055781936.fe00f1c4e3fbcd6d7560c2506ad6ca19.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-10 19:03:07,972 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-10 19:03:07,977 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-10 19:03:07,980 INFO [StoreOpener-fe00f1c4e3fbcd6d7560c2506ad6ca19-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region fe00f1c4e3fbcd6d7560c2506ad6ca19 2023-02-10 19:03:07,982 DEBUG [StoreOpener-fe00f1c4e3fbcd6d7560c2506ad6ca19-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34605/user/jenkins/test-data/cdb8cff8-4bcc-a25f-b430-f9a2ac74b842/testWithMapReduceAndOfflineHBaseMultiRegion/e52e1c73-9ae2-4d51-ab19-a6aa6cd1ac37/data/default/testWithMapReduce/fe00f1c4e3fbcd6d7560c2506ad6ca19/f1 2023-02-10 19:03:07,982 INFO [StoreOpener-fe00f1c4e3fbcd6d7560c2506ad6ca19-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region fe00f1c4e3fbcd6d7560c2506ad6ca19 columnFamilyName f1 2023-02-10 19:03:07,983 INFO [StoreOpener-fe00f1c4e3fbcd6d7560c2506ad6ca19-1] regionserver.HStore(310): Store=fe00f1c4e3fbcd6d7560c2506ad6ca19/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-10 19:03:07,983 INFO [StoreOpener-fe00f1c4e3fbcd6d7560c2506ad6ca19-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region fe00f1c4e3fbcd6d7560c2506ad6ca19 2023-02-10 19:03:07,984 DEBUG [StoreOpener-fe00f1c4e3fbcd6d7560c2506ad6ca19-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34605/user/jenkins/test-data/cdb8cff8-4bcc-a25f-b430-f9a2ac74b842/testWithMapReduceAndOfflineHBaseMultiRegion/e52e1c73-9ae2-4d51-ab19-a6aa6cd1ac37/data/default/testWithMapReduce/fe00f1c4e3fbcd6d7560c2506ad6ca19/f2 2023-02-10 19:03:07,985 INFO [StoreOpener-fe00f1c4e3fbcd6d7560c2506ad6ca19-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region fe00f1c4e3fbcd6d7560c2506ad6ca19 columnFamilyName f2 2023-02-10 19:03:07,985 INFO [StoreOpener-fe00f1c4e3fbcd6d7560c2506ad6ca19-1] regionserver.HStore(310): Store=fe00f1c4e3fbcd6d7560c2506ad6ca19/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-10 19:03:07,985 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-10 19:03:07,986 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened fe00f1c4e3fbcd6d7560c2506ad6ca19; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61564917, jitterRate=-0.08261124789714813}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-10 19:03:07,986 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for fe00f1c4e3fbcd6d7560c2506ad6ca19: Writing region info on filesystem at 1676055787977Initializing all the Stores at 1676055787978 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676055787978Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676055787979 (+1 ms)Region opened successfully at 1676055787986 (+7 ms) 2023-02-10 19:03:08,004 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing fe00f1c4e3fbcd6d7560c2506ad6ca19, disabling compactions & flushes 2023-02-10 19:03:08,004 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676055781936.fe00f1c4e3fbcd6d7560c2506ad6ca19. 2023-02-10 19:03:08,004 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676055781936.fe00f1c4e3fbcd6d7560c2506ad6ca19. 2023-02-10 19:03:08,005 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676055781936.fe00f1c4e3fbcd6d7560c2506ad6ca19. after waiting 0 ms 2023-02-10 19:03:08,005 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676055781936.fe00f1c4e3fbcd6d7560c2506ad6ca19. 2023-02-10 19:03:08,005 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,,1676055781936.fe00f1c4e3fbcd6d7560c2506ad6ca19. 2023-02-10 19:03:08,005 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for fe00f1c4e3fbcd6d7560c2506ad6ca19: Waiting for close lock at 1676055788004Disabling compacts and flushes for region at 1676055788004Disabling writes for close at 1676055788005 (+1 ms)Writing region close event to WAL at 1676055788005Closed at 1676055788005 2023-02-10 19:03:08,270 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-datanode.properties,hadoop-metrics2.properties 2023-02-10 19:03:08,513 INFO [Listener at localhost/35877] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-02-10 19:03:08,514 WARN [Listener at localhost/35877] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-10 19:03:08,545 INFO [Listener at localhost/35877] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-10 19:03:08,650 WARN [BP-103896456-172.31.14.131-1676055779416 heartbeating to localhost/127.0.0.1:34605] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-10 19:03:08,650 WARN [BP-103896456-172.31.14.131-1676055779416 heartbeating to localhost/127.0.0.1:34605] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-103896456-172.31.14.131-1676055779416 (Datanode Uuid 6440fdca-19c5-4754-beea-92350679d0e7) service to localhost/127.0.0.1:34605 2023-02-10 19:03:08,651 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3335ac0e-fb88-6eb8-b993-c028993dd2d7/cluster_c25d0905-9b0f-64e8-fbc0-da8b20564564/dfs/data/data3/current/BP-103896456-172.31.14.131-1676055779416] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-10 19:03:08,651 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3335ac0e-fb88-6eb8-b993-c028993dd2d7/cluster_c25d0905-9b0f-64e8-fbc0-da8b20564564/dfs/data/data4/current/BP-103896456-172.31.14.131-1676055779416] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-10 19:03:08,653 WARN [Listener at localhost/35877] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-10 19:03:08,655 INFO [Listener at localhost/35877] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-10 19:03:08,758 WARN [BP-103896456-172.31.14.131-1676055779416 heartbeating to localhost/127.0.0.1:34605] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-10 19:03:08,759 WARN [BP-103896456-172.31.14.131-1676055779416 heartbeating to localhost/127.0.0.1:34605] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-103896456-172.31.14.131-1676055779416 (Datanode Uuid cb616b07-e100-41ac-a67a-7d33ff65a0b4) service to localhost/127.0.0.1:34605 2023-02-10 19:03:08,761 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3335ac0e-fb88-6eb8-b993-c028993dd2d7/cluster_c25d0905-9b0f-64e8-fbc0-da8b20564564/dfs/data/data1/current/BP-103896456-172.31.14.131-1676055779416] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-10 19:03:08,761 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3335ac0e-fb88-6eb8-b993-c028993dd2d7/cluster_c25d0905-9b0f-64e8-fbc0-da8b20564564/dfs/data/data2/current/BP-103896456-172.31.14.131-1676055779416] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-10 19:03:08,772 INFO [Listener at localhost/35877] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-10 19:03:08,893 INFO [Listener at localhost/35877] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-02-10 19:03:08,935 INFO [Listener at localhost/35877] hbase.HBaseTestingUtility(1293): Minicluster is down 2023-02-10 19:03:08,947 INFO [Listener at localhost/35877] hbase.ResourceChecker(175): after: mapred.TestTableSnapshotInputFormat#testWithMapReduceAndOfflineHBaseMultiRegion Thread=152 (was 101) Potentially hanging thread: LeaseRenewer:jenkins@localhost:34605 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-9-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-8-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-6-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-6-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-7-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-6-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-6 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-5 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/35877 java.lang.Thread.dumpThreads(Native Method) java.lang.Thread.getAllStackTraces(Thread.java:1615) org.apache.hadoop.hbase.ResourceCheckerJUnitListener$ThreadResourceAnalyzer.getVal(ResourceCheckerJUnitListener.java:49) org.apache.hadoop.hbase.ResourceChecker.fill(ResourceChecker.java:110) org.apache.hadoop.hbase.ResourceChecker.fillEndings(ResourceChecker.java:104) org.apache.hadoop.hbase.ResourceChecker.end(ResourceChecker.java:206) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.end(ResourceCheckerJUnitListener.java:165) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.testFinished(ResourceCheckerJUnitListener.java:185) org.junit.runner.notification.SynchronizedRunListener.testFinished(SynchronizedRunListener.java:87) org.junit.runner.notification.RunNotifier$9.notifyListener(RunNotifier.java:225) org.junit.runner.notification.RunNotifier$SafeNotifier.run(RunNotifier.java:72) org.junit.runner.notification.RunNotifier.fireTestFinished(RunNotifier.java:222) org.junit.internal.runners.model.EachTestNotifier.fireTestFinished(EachTestNotifier.java:38) org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:372) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) org.apache.hadoop.hbase.SystemExitRule$1.evaluate(SystemExitRule.java:39) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-8-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1688088802) connection to localhost/127.0.0.1:34605 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: IPC Client (1688088802) connection to localhost/127.0.0.1:34605 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS-EventLoopGroup-8-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-7-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1688088802) connection to localhost/127.0.0.1:34605 from jenkins.hfs.2 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-8-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-9-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-8-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-6-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.3@localhost:34605 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-7-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-4 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-6-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Timer for 'DataNode' metrics system java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: RS-EventLoopGroup-7-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-7-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.2@localhost:34605 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-6-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-8-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1688088802) connection to localhost/127.0.0.1:34605 from jenkins.hfs.3 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: (jenkins-hbase4.apache.org,40103,1676055780155)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-9-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-7-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=534 (was 532) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=394 (was 353) - SystemLoadAverage LEAK? -, ProcessCount=167 (was 167), AvailableMemoryMB=3536 (was 3753) 2023-02-10 19:03:08,958 INFO [Listener at localhost/35877] hbase.ResourceChecker(147): before: mapred.TestTableSnapshotInputFormat#testInitTableSnapshotMapperJobConfig Thread=152, OpenFileDescriptor=534, MaxFileDescriptor=60000, SystemLoadAverage=394, ProcessCount=167, AvailableMemoryMB=3536 2023-02-10 19:03:08,968 INFO [Listener at localhost/35877] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.log.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3335ac0e-fb88-6eb8-b993-c028993dd2d7/hadoop.log.dir so I do NOT create it in target/test-data/3bb8cb07-c3f3-574d-cc77-c22264857571 2023-02-10 19:03:08,968 WARN [Listener at localhost/35877] hbase.HBaseTestingUtility(449): hadoop.log.dir property value differs in configuration and system: Configuration=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/../logs while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3335ac0e-fb88-6eb8-b993-c028993dd2d7/hadoop.log.dir Erasing configuration value by system value. 2023-02-10 19:03:08,968 INFO [Listener at localhost/35877] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.tmp.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3335ac0e-fb88-6eb8-b993-c028993dd2d7/hadoop.tmp.dir so I do NOT create it in target/test-data/3bb8cb07-c3f3-574d-cc77-c22264857571 2023-02-10 19:03:08,968 WARN [Listener at localhost/35877] hbase.HBaseTestingUtility(449): hadoop.tmp.dir property value differs in configuration and system: Configuration=/tmp/hadoop-jenkins while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3335ac0e-fb88-6eb8-b993-c028993dd2d7/hadoop.tmp.dir Erasing configuration value by system value. 2023-02-10 19:03:08,969 DEBUG [Listener at localhost/35877] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3bb8cb07-c3f3-574d-cc77-c22264857571 2023-02-10 19:03:08,969 INFO [Listener at localhost/35877] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=2, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=true, createWALDir=false} 2023-02-10 19:03:08,969 INFO [Listener at localhost/35877] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3bb8cb07-c3f3-574d-cc77-c22264857571/cluster_e6b355cb-f938-a09e-4337-e00c222fe318, deleteOnExit=true 2023-02-10 19:03:08,969 INFO [Listener at localhost/35877] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-02-10 19:03:08,969 INFO [Listener at localhost/35877] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3bb8cb07-c3f3-574d-cc77-c22264857571/test.cache.data in system properties and HBase conf 2023-02-10 19:03:08,969 INFO [Listener at localhost/35877] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3bb8cb07-c3f3-574d-cc77-c22264857571/hadoop.tmp.dir in system properties and HBase conf 2023-02-10 19:03:08,969 INFO [Listener at localhost/35877] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3bb8cb07-c3f3-574d-cc77-c22264857571/hadoop.log.dir in system properties and HBase conf 2023-02-10 19:03:08,969 INFO [Listener at localhost/35877] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3bb8cb07-c3f3-574d-cc77-c22264857571/mapreduce.cluster.local.dir in system properties and HBase conf 2023-02-10 19:03:08,969 INFO [Listener at localhost/35877] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3bb8cb07-c3f3-574d-cc77-c22264857571/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-02-10 19:03:08,969 INFO [Listener at localhost/35877] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-02-10 19:03:08,970 DEBUG [Listener at localhost/35877] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-02-10 19:03:08,970 INFO [Listener at localhost/35877] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3bb8cb07-c3f3-574d-cc77-c22264857571/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-02-10 19:03:08,970 INFO [Listener at localhost/35877] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3bb8cb07-c3f3-574d-cc77-c22264857571/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-02-10 19:03:08,970 INFO [Listener at localhost/35877] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3bb8cb07-c3f3-574d-cc77-c22264857571/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-02-10 19:03:08,970 INFO [Listener at localhost/35877] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3bb8cb07-c3f3-574d-cc77-c22264857571/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-10 19:03:08,970 INFO [Listener at localhost/35877] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3bb8cb07-c3f3-574d-cc77-c22264857571/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-02-10 19:03:08,970 INFO [Listener at localhost/35877] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3bb8cb07-c3f3-574d-cc77-c22264857571/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-02-10 19:03:08,970 INFO [Listener at localhost/35877] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3bb8cb07-c3f3-574d-cc77-c22264857571/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-10 19:03:08,970 INFO [Listener at localhost/35877] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3bb8cb07-c3f3-574d-cc77-c22264857571/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-10 19:03:08,970 INFO [Listener at localhost/35877] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3bb8cb07-c3f3-574d-cc77-c22264857571/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-02-10 19:03:08,971 INFO [Listener at localhost/35877] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3bb8cb07-c3f3-574d-cc77-c22264857571/nfs.dump.dir in system properties and HBase conf 2023-02-10 19:03:08,971 INFO [Listener at localhost/35877] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3bb8cb07-c3f3-574d-cc77-c22264857571/java.io.tmpdir in system properties and HBase conf 2023-02-10 19:03:08,971 INFO [Listener at localhost/35877] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3bb8cb07-c3f3-574d-cc77-c22264857571/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-10 19:03:08,971 INFO [Listener at localhost/35877] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3bb8cb07-c3f3-574d-cc77-c22264857571/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-02-10 19:03:08,971 INFO [Listener at localhost/35877] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3bb8cb07-c3f3-574d-cc77-c22264857571/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-02-10 19:03:08,975 WARN [Listener at localhost/35877] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-10 19:03:08,975 WARN [Listener at localhost/35877] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-10 19:03:09,015 WARN [Listener at localhost/35877] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-10 19:03:09,017 INFO [Listener at localhost/35877] log.Slf4jLog(67): jetty-6.1.26 2023-02-10 19:03:09,024 INFO [Listener at localhost/35877] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3bb8cb07-c3f3-574d-cc77-c22264857571/java.io.tmpdir/Jetty_localhost_46457_hdfs____.2vosoy/webapp 2023-02-10 19:03:09,119 INFO [Listener at localhost/35877] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:46457 2023-02-10 19:03:09,123 WARN [Listener at localhost/35877] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-10 19:03:09,123 WARN [Listener at localhost/35877] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-10 19:03:09,170 WARN [Listener at localhost/33161] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-10 19:03:09,186 WARN [Listener at localhost/33161] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-10 19:03:09,189 WARN [Listener at localhost/33161] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-10 19:03:09,191 INFO [Listener at localhost/33161] log.Slf4jLog(67): jetty-6.1.26 2023-02-10 19:03:09,195 INFO [Listener at localhost/33161] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3bb8cb07-c3f3-574d-cc77-c22264857571/java.io.tmpdir/Jetty_localhost_34927_datanode____.bdj0ik/webapp 2023-02-10 19:03:09,287 INFO [Listener at localhost/33161] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:34927 2023-02-10 19:03:09,296 WARN [Listener at localhost/44681] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-10 19:03:09,311 WARN [Listener at localhost/44681] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-10 19:03:09,315 WARN [Listener at localhost/44681] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-10 19:03:09,316 INFO [Listener at localhost/44681] log.Slf4jLog(67): jetty-6.1.26 2023-02-10 19:03:09,324 INFO [Listener at localhost/44681] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3bb8cb07-c3f3-574d-cc77-c22264857571/java.io.tmpdir/Jetty_localhost_35531_datanode____.rrhr6w/webapp 2023-02-10 19:03:09,447 INFO [Listener at localhost/44681] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:35531 2023-02-10 19:03:09,454 WARN [Listener at localhost/45079] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-10 19:03:09,677 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xf5fee6dd0d5e9001: Processing first storage report for DS-8d00709e-eee8-4462-aefc-1a2c96b3d9a1 from datanode 02736bdf-6fa0-49e5-a732-415ab3a895a1 2023-02-10 19:03:09,677 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xf5fee6dd0d5e9001: from storage DS-8d00709e-eee8-4462-aefc-1a2c96b3d9a1 node DatanodeRegistration(127.0.0.1:39673, datanodeUuid=02736bdf-6fa0-49e5-a732-415ab3a895a1, infoPort=36921, infoSecurePort=0, ipcPort=44681, storageInfo=lv=-57;cid=testClusterID;nsid=1663608958;c=1676055788978), blocks: 0, hasStaleStorage: true, processing time: 1 msecs, invalidatedBlocks: 0 2023-02-10 19:03:09,677 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xf5fee6dd0d5e9001: Processing first storage report for DS-ca2aa3d0-f012-437a-9f34-847e378b391d from datanode 02736bdf-6fa0-49e5-a732-415ab3a895a1 2023-02-10 19:03:09,677 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xf5fee6dd0d5e9001: from storage DS-ca2aa3d0-f012-437a-9f34-847e378b391d node DatanodeRegistration(127.0.0.1:39673, datanodeUuid=02736bdf-6fa0-49e5-a732-415ab3a895a1, infoPort=36921, infoSecurePort=0, ipcPort=44681, storageInfo=lv=-57;cid=testClusterID;nsid=1663608958;c=1676055788978), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-10 19:03:09,775 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x17176ef7ef82e9d3: Processing first storage report for DS-be45c795-6594-4f73-abcb-bd2441d5aef7 from datanode 4f55802e-a8a6-4645-8a5b-fff778355560 2023-02-10 19:03:09,775 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x17176ef7ef82e9d3: from storage DS-be45c795-6594-4f73-abcb-bd2441d5aef7 node DatanodeRegistration(127.0.0.1:40603, datanodeUuid=4f55802e-a8a6-4645-8a5b-fff778355560, infoPort=39041, infoSecurePort=0, ipcPort=45079, storageInfo=lv=-57;cid=testClusterID;nsid=1663608958;c=1676055788978), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-10 19:03:09,775 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x17176ef7ef82e9d3: Processing first storage report for DS-419a5a8d-04f4-49df-9135-63d757a27e46 from datanode 4f55802e-a8a6-4645-8a5b-fff778355560 2023-02-10 19:03:09,775 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x17176ef7ef82e9d3: from storage DS-419a5a8d-04f4-49df-9135-63d757a27e46 node DatanodeRegistration(127.0.0.1:40603, datanodeUuid=4f55802e-a8a6-4645-8a5b-fff778355560, infoPort=39041, infoSecurePort=0, ipcPort=45079, storageInfo=lv=-57;cid=testClusterID;nsid=1663608958;c=1676055788978), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-10 19:03:09,867 DEBUG [Listener at localhost/45079] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3bb8cb07-c3f3-574d-cc77-c22264857571 2023-02-10 19:03:09,869 INFO [Listener at localhost/45079] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3bb8cb07-c3f3-574d-cc77-c22264857571/cluster_e6b355cb-f938-a09e-4337-e00c222fe318/zookeeper_0, clientPort=52327, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3bb8cb07-c3f3-574d-cc77-c22264857571/cluster_e6b355cb-f938-a09e-4337-e00c222fe318/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3bb8cb07-c3f3-574d-cc77-c22264857571/cluster_e6b355cb-f938-a09e-4337-e00c222fe318/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-02-10 19:03:09,870 INFO [Listener at localhost/45079] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=52327 2023-02-10 19:03:09,870 INFO [Listener at localhost/45079] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-10 19:03:09,871 INFO [Listener at localhost/45079] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-10 19:03:09,884 INFO [Listener at localhost/45079] util.FSUtils(479): Created version file at hdfs://localhost:33161/user/jenkins/test-data/6c75f688-f587-1f47-1e81-0b91f31623af with version=8 2023-02-10 19:03:09,885 INFO [Listener at localhost/45079] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-10 19:03:09,886 INFO [Listener at localhost/45079] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-10 19:03:09,887 INFO [Listener at localhost/45079] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:33161/user/jenkins/test-data/9cb1bb7f-01ef-8444-0230-c92db88a1e31/hbase-staging 2023-02-10 19:03:09,889 INFO [Listener at localhost/45079] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-02-10 19:03:09,890 INFO [Listener at localhost/45079] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-10 19:03:09,890 INFO [Listener at localhost/45079] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-10 19:03:09,890 INFO [Listener at localhost/45079] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-10 19:03:09,890 INFO [Listener at localhost/45079] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-10 19:03:09,890 INFO [Listener at localhost/45079] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-10 19:03:09,890 INFO [Listener at localhost/45079] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-02-10 19:03:09,892 INFO [Listener at localhost/45079] ipc.NettyRpcServer(120): Bind to /172.31.14.131:46421 2023-02-10 19:03:09,892 INFO [Listener at localhost/45079] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-10 19:03:09,893 INFO [Listener at localhost/45079] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-10 19:03:09,894 INFO [Listener at localhost/45079] zookeeper.RecoverableZooKeeper(93): Process identifier=master:46421 connecting to ZooKeeper ensemble=127.0.0.1:52327 2023-02-10 19:03:09,907 DEBUG [Listener at localhost/45079-EventThread] zookeeper.ZKWatcher(600): master:464210x0, quorum=127.0.0.1:52327, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-10 19:03:09,909 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): master:46421-0x1003f9daaf10000 connected 2023-02-10 19:03:09,922 DEBUG [Listener at localhost/45079] zookeeper.ZKUtil(164): master:46421-0x1003f9daaf10000, quorum=127.0.0.1:52327, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-10 19:03:09,923 DEBUG [Listener at localhost/45079] zookeeper.ZKUtil(164): master:46421-0x1003f9daaf10000, quorum=127.0.0.1:52327, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-10 19:03:09,923 DEBUG [Listener at localhost/45079] zookeeper.ZKUtil(164): master:46421-0x1003f9daaf10000, quorum=127.0.0.1:52327, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-10 19:03:09,924 DEBUG [Listener at localhost/45079] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=46421 2023-02-10 19:03:09,928 DEBUG [Listener at localhost/45079] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=46421 2023-02-10 19:03:09,928 DEBUG [Listener at localhost/45079] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=46421 2023-02-10 19:03:09,932 DEBUG [Listener at localhost/45079] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=46421 2023-02-10 19:03:09,932 DEBUG [Listener at localhost/45079] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=46421 2023-02-10 19:03:09,932 INFO [Listener at localhost/45079] master.HMaster(439): hbase.rootdir=hdfs://localhost:33161/user/jenkins/test-data/6c75f688-f587-1f47-1e81-0b91f31623af, hbase.cluster.distributed=false 2023-02-10 19:03:09,944 INFO [Listener at localhost/45079] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-10 19:03:09,945 INFO [Listener at localhost/45079] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-10 19:03:09,945 INFO [Listener at localhost/45079] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-10 19:03:09,945 INFO [Listener at localhost/45079] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-10 19:03:09,945 INFO [Listener at localhost/45079] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-10 19:03:09,945 INFO [Listener at localhost/45079] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-10 19:03:09,945 INFO [Listener at localhost/45079] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-10 19:03:09,947 INFO [Listener at localhost/45079] ipc.NettyRpcServer(120): Bind to /172.31.14.131:37711 2023-02-10 19:03:09,947 INFO [Listener at localhost/45079] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-10 19:03:09,948 DEBUG [Listener at localhost/45079] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-10 19:03:09,948 INFO [Listener at localhost/45079] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-10 19:03:09,949 INFO [Listener at localhost/45079] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-10 19:03:09,950 INFO [Listener at localhost/45079] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:37711 connecting to ZooKeeper ensemble=127.0.0.1:52327 2023-02-10 19:03:09,953 DEBUG [Listener at localhost/45079-EventThread] zookeeper.ZKWatcher(600): regionserver:377110x0, quorum=127.0.0.1:52327, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-10 19:03:09,956 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:37711-0x1003f9daaf10001 connected 2023-02-10 19:03:09,956 DEBUG [Listener at localhost/45079] zookeeper.ZKUtil(164): regionserver:37711-0x1003f9daaf10001, quorum=127.0.0.1:52327, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-10 19:03:09,957 DEBUG [Listener at localhost/45079] zookeeper.ZKUtil(164): regionserver:37711-0x1003f9daaf10001, quorum=127.0.0.1:52327, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-10 19:03:09,957 DEBUG [Listener at localhost/45079] zookeeper.ZKUtil(164): regionserver:37711-0x1003f9daaf10001, quorum=127.0.0.1:52327, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-10 19:03:09,960 DEBUG [Listener at localhost/45079] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=37711 2023-02-10 19:03:09,960 DEBUG [Listener at localhost/45079] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=37711 2023-02-10 19:03:09,960 DEBUG [Listener at localhost/45079] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=37711 2023-02-10 19:03:09,964 DEBUG [Listener at localhost/45079] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=37711 2023-02-10 19:03:09,964 DEBUG [Listener at localhost/45079] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=37711 2023-02-10 19:03:09,975 INFO [Listener at localhost/45079] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-10 19:03:09,975 INFO [Listener at localhost/45079] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-10 19:03:09,975 INFO [Listener at localhost/45079] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-10 19:03:09,975 INFO [Listener at localhost/45079] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-10 19:03:09,975 INFO [Listener at localhost/45079] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-10 19:03:09,975 INFO [Listener at localhost/45079] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-10 19:03:09,975 INFO [Listener at localhost/45079] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-10 19:03:09,977 INFO [Listener at localhost/45079] ipc.NettyRpcServer(120): Bind to /172.31.14.131:39215 2023-02-10 19:03:09,977 INFO [Listener at localhost/45079] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-10 19:03:09,978 DEBUG [Listener at localhost/45079] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-10 19:03:09,979 INFO [Listener at localhost/45079] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-10 19:03:09,980 INFO [Listener at localhost/45079] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-10 19:03:09,980 INFO [Listener at localhost/45079] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:39215 connecting to ZooKeeper ensemble=127.0.0.1:52327 2023-02-10 19:03:09,983 DEBUG [Listener at localhost/45079-EventThread] zookeeper.ZKWatcher(600): regionserver:392150x0, quorum=127.0.0.1:52327, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-10 19:03:09,986 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:39215-0x1003f9daaf10002 connected 2023-02-10 19:03:09,986 DEBUG [Listener at localhost/45079] zookeeper.ZKUtil(164): regionserver:39215-0x1003f9daaf10002, quorum=127.0.0.1:52327, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-10 19:03:09,987 DEBUG [Listener at localhost/45079] zookeeper.ZKUtil(164): regionserver:39215-0x1003f9daaf10002, quorum=127.0.0.1:52327, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-10 19:03:09,988 DEBUG [Listener at localhost/45079] zookeeper.ZKUtil(164): regionserver:39215-0x1003f9daaf10002, quorum=127.0.0.1:52327, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-10 19:03:09,990 DEBUG [Listener at localhost/45079] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=39215 2023-02-10 19:03:09,992 DEBUG [Listener at localhost/45079] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=39215 2023-02-10 19:03:09,996 DEBUG [Listener at localhost/45079] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=39215 2023-02-10 19:03:09,996 DEBUG [Listener at localhost/45079] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=39215 2023-02-10 19:03:10,000 DEBUG [Listener at localhost/45079] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=39215 2023-02-10 19:03:10,001 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2158): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,46421,1676055789889 2023-02-10 19:03:10,002 DEBUG [Listener at localhost/45079-EventThread] zookeeper.ZKWatcher(600): master:46421-0x1003f9daaf10000, quorum=127.0.0.1:52327, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-10 19:03:10,003 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:46421-0x1003f9daaf10000, quorum=127.0.0.1:52327, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,46421,1676055789889 2023-02-10 19:03:10,005 DEBUG [Listener at localhost/45079-EventThread] zookeeper.ZKWatcher(600): master:46421-0x1003f9daaf10000, quorum=127.0.0.1:52327, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-10 19:03:10,005 DEBUG [Listener at localhost/45079-EventThread] zookeeper.ZKWatcher(600): regionserver:39215-0x1003f9daaf10002, quorum=127.0.0.1:52327, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-10 19:03:10,005 DEBUG [Listener at localhost/45079-EventThread] zookeeper.ZKWatcher(600): master:46421-0x1003f9daaf10000, quorum=127.0.0.1:52327, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-10 19:03:10,005 DEBUG [Listener at localhost/45079-EventThread] zookeeper.ZKWatcher(600): regionserver:37711-0x1003f9daaf10001, quorum=127.0.0.1:52327, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-10 19:03:10,006 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:46421-0x1003f9daaf10000, quorum=127.0.0.1:52327, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-10 19:03:10,008 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(224): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,46421,1676055789889 from backup master directory 2023-02-10 19:03:10,008 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:46421-0x1003f9daaf10000, quorum=127.0.0.1:52327, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-10 19:03:10,009 DEBUG [Listener at localhost/45079-EventThread] zookeeper.ZKWatcher(600): master:46421-0x1003f9daaf10000, quorum=127.0.0.1:52327, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,46421,1676055789889 2023-02-10 19:03:10,009 DEBUG [Listener at localhost/45079-EventThread] zookeeper.ZKWatcher(600): master:46421-0x1003f9daaf10000, quorum=127.0.0.1:52327, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-10 19:03:10,009 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-10 19:03:10,009 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(234): Registered as active master=jenkins-hbase4.apache.org,46421,1676055789889 2023-02-10 19:03:10,056 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(628): Created cluster ID file at hdfs://localhost:33161/user/jenkins/test-data/6c75f688-f587-1f47-1e81-0b91f31623af/hbase.id with ID: 9081c364-a308-47c9-abf9-4e83b896d3d7 2023-02-10 19:03:10,066 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-10 19:03:10,069 DEBUG [Listener at localhost/45079-EventThread] zookeeper.ZKWatcher(600): master:46421-0x1003f9daaf10000, quorum=127.0.0.1:52327, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-10 19:03:10,080 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x3313bcff to 127.0.0.1:52327 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-10 19:03:10,088 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@462f1da5, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-10 19:03:10,089 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-10 19:03:10,089 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-02-10 19:03:10,089 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-10 19:03:10,091 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7689): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:33161/user/jenkins/test-data/6c75f688-f587-1f47-1e81-0b91f31623af/MasterData/data/master/store-tmp 2023-02-10 19:03:10,098 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-10 19:03:10,098 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-10 19:03:10,098 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-10 19:03:10,098 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-10 19:03:10,098 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-10 19:03:10,098 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-10 19:03:10,098 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-10 19:03:10,098 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1676055790098Disabling compacts and flushes for region at 1676055790098Disabling writes for close at 1676055790098Writing region close event to WAL at 1676055790098Closed at 1676055790098 2023-02-10 19:03:10,099 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:33161/user/jenkins/test-data/6c75f688-f587-1f47-1e81-0b91f31623af/MasterData/WALs/jenkins-hbase4.apache.org,46421,1676055789889 2023-02-10 19:03:10,101 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C46421%2C1676055789889, suffix=, logDir=hdfs://localhost:33161/user/jenkins/test-data/6c75f688-f587-1f47-1e81-0b91f31623af/MasterData/WALs/jenkins-hbase4.apache.org,46421,1676055789889, archiveDir=hdfs://localhost:33161/user/jenkins/test-data/6c75f688-f587-1f47-1e81-0b91f31623af/MasterData/oldWALs, maxLogs=10 2023-02-10 19:03:10,119 DEBUG [RS-EventLoopGroup-11-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40603,DS-be45c795-6594-4f73-abcb-bd2441d5aef7,DISK] 2023-02-10 19:03:10,119 DEBUG [RS-EventLoopGroup-11-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39673,DS-8d00709e-eee8-4462-aefc-1a2c96b3d9a1,DISK] 2023-02-10 19:03:10,121 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/6c75f688-f587-1f47-1e81-0b91f31623af/MasterData/WALs/jenkins-hbase4.apache.org,46421,1676055789889/jenkins-hbase4.apache.org%2C46421%2C1676055789889.1676055790102 2023-02-10 19:03:10,122 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:39673,DS-8d00709e-eee8-4462-aefc-1a2c96b3d9a1,DISK], DatanodeInfoWithStorage[127.0.0.1:40603,DS-be45c795-6594-4f73-abcb-bd2441d5aef7,DISK]] 2023-02-10 19:03:10,122 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7850): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-02-10 19:03:10,122 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-10 19:03:10,122 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7890): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-02-10 19:03:10,122 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7893): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-02-10 19:03:10,123 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-02-10 19:03:10,124 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33161/user/jenkins/test-data/6c75f688-f587-1f47-1e81-0b91f31623af/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-02-10 19:03:10,125 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-02-10 19:03:10,125 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-10 19:03:10,126 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33161/user/jenkins/test-data/6c75f688-f587-1f47-1e81-0b91f31623af/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-10 19:03:10,126 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33161/user/jenkins/test-data/6c75f688-f587-1f47-1e81-0b91f31623af/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-10 19:03:10,128 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1054): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-02-10 19:03:10,130 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33161/user/jenkins/test-data/6c75f688-f587-1f47-1e81-0b91f31623af/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-10 19:03:10,130 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1071): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71475572, jitterRate=0.06506901979446411}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-10 19:03:10,130 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(964): Region open journal for 1595e783b53d99cd5eef43b6debb2682: Writing region info on filesystem at 1676055790122Initializing all the Stores at 1676055790123 (+1 ms)Instantiating store for column family {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676055790123Cleaning up temporary data from old regions at 1676055790126 (+3 ms)Cleaning up detritus from prior splits at 1676055790127 (+1 ms)Region opened successfully at 1676055790130 (+3 ms) 2023-02-10 19:03:10,131 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-02-10 19:03:10,132 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-02-10 19:03:10,132 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-02-10 19:03:10,132 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-02-10 19:03:10,133 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 0 msec 2023-02-10 19:03:10,133 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 0 msec 2023-02-10 19:03:10,133 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(95): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-02-10 19:03:10,134 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-02-10 19:03:10,135 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-02-10 19:03:10,145 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-02-10 19:03:10,145 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-02-10 19:03:10,145 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:46421-0x1003f9daaf10000, quorum=127.0.0.1:52327, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-02-10 19:03:10,146 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-02-10 19:03:10,146 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:46421-0x1003f9daaf10000, quorum=127.0.0.1:52327, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-02-10 19:03:10,149 DEBUG [Listener at localhost/45079-EventThread] zookeeper.ZKWatcher(600): master:46421-0x1003f9daaf10000, quorum=127.0.0.1:52327, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-10 19:03:10,149 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:46421-0x1003f9daaf10000, quorum=127.0.0.1:52327, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-02-10 19:03:10,149 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:46421-0x1003f9daaf10000, quorum=127.0.0.1:52327, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-02-10 19:03:10,150 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:46421-0x1003f9daaf10000, quorum=127.0.0.1:52327, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-02-10 19:03:10,151 DEBUG [Listener at localhost/45079-EventThread] zookeeper.ZKWatcher(600): master:46421-0x1003f9daaf10000, quorum=127.0.0.1:52327, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-10 19:03:10,151 DEBUG [Listener at localhost/45079-EventThread] zookeeper.ZKWatcher(600): regionserver:37711-0x1003f9daaf10001, quorum=127.0.0.1:52327, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-10 19:03:10,151 DEBUG [Listener at localhost/45079-EventThread] zookeeper.ZKWatcher(600): master:46421-0x1003f9daaf10000, quorum=127.0.0.1:52327, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-10 19:03:10,151 DEBUG [Listener at localhost/45079-EventThread] zookeeper.ZKWatcher(600): regionserver:39215-0x1003f9daaf10002, quorum=127.0.0.1:52327, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-10 19:03:10,152 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(739): Active/primary master=jenkins-hbase4.apache.org,46421,1676055789889, sessionid=0x1003f9daaf10000, setting cluster-up flag (Was=false) 2023-02-10 19:03:10,156 DEBUG [Listener at localhost/45079-EventThread] zookeeper.ZKWatcher(600): master:46421-0x1003f9daaf10000, quorum=127.0.0.1:52327, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-10 19:03:10,160 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-02-10 19:03:10,161 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,46421,1676055789889 2023-02-10 19:03:10,164 DEBUG [Listener at localhost/45079-EventThread] zookeeper.ZKWatcher(600): master:46421-0x1003f9daaf10000, quorum=127.0.0.1:52327, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-10 19:03:10,167 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-02-10 19:03:10,168 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,46421,1676055789889 2023-02-10 19:03:10,168 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:33161/user/jenkins/test-data/6c75f688-f587-1f47-1e81-0b91f31623af/.hbase-snapshot/.tmp 2023-02-10 19:03:10,170 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-02-10 19:03:10,170 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-10 19:03:10,170 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-10 19:03:10,170 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-10 19:03:10,170 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-10 19:03:10,170 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-02-10 19:03:10,170 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-10 19:03:10,170 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-10 19:03:10,170 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-10 19:03:10,175 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1676055820175 2023-02-10 19:03:10,175 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-02-10 19:03:10,175 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-02-10 19:03:10,175 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-02-10 19:03:10,175 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-02-10 19:03:10,175 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-02-10 19:03:10,175 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-02-10 19:03:10,175 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-02-10 19:03:10,175 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-02-10 19:03:10,175 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-10 19:03:10,176 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-02-10 19:03:10,176 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-02-10 19:03:10,176 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-02-10 19:03:10,177 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-10 19:03:10,180 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-02-10 19:03:10,180 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-02-10 19:03:10,180 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676055790180,5,FailOnTimeoutGroup] 2023-02-10 19:03:10,180 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676055790180,5,FailOnTimeoutGroup] 2023-02-10 19:03:10,181 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-10 19:03:10,181 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1451): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-02-10 19:03:10,181 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-02-10 19:03:10,181 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-02-10 19:03:10,188 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:33161/user/jenkins/test-data/6c75f688-f587-1f47-1e81-0b91f31623af/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-10 19:03:10,189 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:33161/user/jenkins/test-data/6c75f688-f587-1f47-1e81-0b91f31623af/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-10 19:03:10,189 INFO [PEWorker-1] regionserver.HRegion(7671): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33161/user/jenkins/test-data/6c75f688-f587-1f47-1e81-0b91f31623af 2023-02-10 19:03:10,199 DEBUG [PEWorker-1] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-10 19:03:10,200 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-10 19:03:10,201 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33161/user/jenkins/test-data/6c75f688-f587-1f47-1e81-0b91f31623af/data/hbase/meta/1588230740/info 2023-02-10 19:03:10,201 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-10 19:03:10,202 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-10 19:03:10,202 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-10 19:03:10,204 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33161/user/jenkins/test-data/6c75f688-f587-1f47-1e81-0b91f31623af/data/hbase/meta/1588230740/rep_barrier 2023-02-10 19:03:10,204 INFO [RS:1;jenkins-hbase4:39215] regionserver.HRegionServer(952): ClusterId : 9081c364-a308-47c9-abf9-4e83b896d3d7 2023-02-10 19:03:10,204 INFO [RS:0;jenkins-hbase4:37711] regionserver.HRegionServer(952): ClusterId : 9081c364-a308-47c9-abf9-4e83b896d3d7 2023-02-10 19:03:10,204 DEBUG [RS:1;jenkins-hbase4:39215] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-10 19:03:10,204 DEBUG [RS:0;jenkins-hbase4:37711] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-10 19:03:10,204 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-10 19:03:10,204 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-10 19:03:10,204 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-10 19:03:10,205 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33161/user/jenkins/test-data/6c75f688-f587-1f47-1e81-0b91f31623af/data/hbase/meta/1588230740/table 2023-02-10 19:03:10,206 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-10 19:03:10,206 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-10 19:03:10,207 DEBUG [RS:1;jenkins-hbase4:39215] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-10 19:03:10,207 DEBUG [RS:0;jenkins-hbase4:37711] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-10 19:03:10,207 DEBUG [RS:1;jenkins-hbase4:39215] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-10 19:03:10,207 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33161/user/jenkins/test-data/6c75f688-f587-1f47-1e81-0b91f31623af/data/hbase/meta/1588230740 2023-02-10 19:03:10,207 DEBUG [RS:0;jenkins-hbase4:37711] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-10 19:03:10,207 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33161/user/jenkins/test-data/6c75f688-f587-1f47-1e81-0b91f31623af/data/hbase/meta/1588230740 2023-02-10 19:03:10,209 DEBUG [RS:1;jenkins-hbase4:39215] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-10 19:03:10,210 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-10 19:03:10,211 DEBUG [RS:0;jenkins-hbase4:37711] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-10 19:03:10,211 DEBUG [RS:1;jenkins-hbase4:39215] zookeeper.ReadOnlyZKClient(139): Connect 0x55b4ddde to 127.0.0.1:52327 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-10 19:03:10,211 DEBUG [RS:0;jenkins-hbase4:37711] zookeeper.ReadOnlyZKClient(139): Connect 0x11033117 to 127.0.0.1:52327 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-10 19:03:10,213 DEBUG [PEWorker-1] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-10 19:03:10,217 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33161/user/jenkins/test-data/6c75f688-f587-1f47-1e81-0b91f31623af/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-10 19:03:10,218 INFO [PEWorker-1] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67674605, jitterRate=0.008430197834968567}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-10 19:03:10,218 DEBUG [PEWorker-1] regionserver.HRegion(964): Region open journal for 1588230740: Writing region info on filesystem at 1676055790199Initializing all the Stores at 1676055790199Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676055790199Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676055790200 (+1 ms)Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676055790200Cleaning up temporary data from old regions at 1676055790208 (+8 ms)Cleaning up detritus from prior splits at 1676055790208Region opened successfully at 1676055790218 (+10 ms) 2023-02-10 19:03:10,218 DEBUG [PEWorker-1] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-10 19:03:10,219 INFO [PEWorker-1] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-10 19:03:10,219 DEBUG [PEWorker-1] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-10 19:03:10,219 DEBUG [PEWorker-1] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-10 19:03:10,219 DEBUG [PEWorker-1] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-10 19:03:10,219 INFO [PEWorker-1] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-10 19:03:10,219 DEBUG [RS:1;jenkins-hbase4:39215] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5b733918, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-10 19:03:10,219 DEBUG [PEWorker-1] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1676055790218Disabling compacts and flushes for region at 1676055790218Disabling writes for close at 1676055790219 (+1 ms)Writing region close event to WAL at 1676055790219Closed at 1676055790219 2023-02-10 19:03:10,219 DEBUG [RS:1;jenkins-hbase4:39215] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5f4cb6ae, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-10 19:03:10,220 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-02-10 19:03:10,220 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-02-10 19:03:10,220 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-02-10 19:03:10,222 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-02-10 19:03:10,222 DEBUG [RS:0;jenkins-hbase4:37711] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1fc4dd47, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-10 19:03:10,223 DEBUG [RS:0;jenkins-hbase4:37711] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1bfb5a67, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-10 19:03:10,224 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-02-10 19:03:10,232 DEBUG [RS:1;jenkins-hbase4:39215] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:39215 2023-02-10 19:03:10,232 INFO [RS:1;jenkins-hbase4:39215] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-10 19:03:10,232 INFO [RS:1;jenkins-hbase4:39215] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-10 19:03:10,233 DEBUG [RS:1;jenkins-hbase4:39215] regionserver.HRegionServer(1023): About to register with Master. 2023-02-10 19:03:10,233 INFO [RS:1;jenkins-hbase4:39215] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,46421,1676055789889 with isa=jenkins-hbase4.apache.org/172.31.14.131:39215, startcode=1676055789974 2023-02-10 19:03:10,233 DEBUG [RS:1;jenkins-hbase4:39215] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-10 19:03:10,234 DEBUG [RS:0;jenkins-hbase4:37711] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:37711 2023-02-10 19:03:10,234 INFO [RS:0;jenkins-hbase4:37711] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-10 19:03:10,234 INFO [RS:0;jenkins-hbase4:37711] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-10 19:03:10,234 DEBUG [RS:0;jenkins-hbase4:37711] regionserver.HRegionServer(1023): About to register with Master. 2023-02-10 19:03:10,234 INFO [RS:0;jenkins-hbase4:37711] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,46421,1676055789889 with isa=jenkins-hbase4.apache.org/172.31.14.131:37711, startcode=1676055789944 2023-02-10 19:03:10,234 DEBUG [RS:0;jenkins-hbase4:37711] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-10 19:03:10,236 INFO [RS-EventLoopGroup-9-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49591, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.5 (auth:SIMPLE), service=RegionServerStatusService 2023-02-10 19:03:10,237 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46421] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,39215,1676055789974 2023-02-10 19:03:10,237 INFO [RS-EventLoopGroup-9-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60161, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.4 (auth:SIMPLE), service=RegionServerStatusService 2023-02-10 19:03:10,238 DEBUG [RS:1;jenkins-hbase4:39215] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:33161/user/jenkins/test-data/6c75f688-f587-1f47-1e81-0b91f31623af 2023-02-10 19:03:10,238 DEBUG [RS:1;jenkins-hbase4:39215] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:33161 2023-02-10 19:03:10,238 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46421] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,37711,1676055789944 2023-02-10 19:03:10,238 DEBUG [RS:1;jenkins-hbase4:39215] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-10 19:03:10,238 DEBUG [RS:0;jenkins-hbase4:37711] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:33161/user/jenkins/test-data/6c75f688-f587-1f47-1e81-0b91f31623af 2023-02-10 19:03:10,238 DEBUG [RS:0;jenkins-hbase4:37711] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:33161 2023-02-10 19:03:10,238 DEBUG [RS:0;jenkins-hbase4:37711] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-10 19:03:10,239 DEBUG [Listener at localhost/45079-EventThread] zookeeper.ZKWatcher(600): master:46421-0x1003f9daaf10000, quorum=127.0.0.1:52327, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-10 19:03:10,242 DEBUG [RS:1;jenkins-hbase4:39215] zookeeper.ZKUtil(162): regionserver:39215-0x1003f9daaf10002, quorum=127.0.0.1:52327, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,39215,1676055789974 2023-02-10 19:03:10,242 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,37711,1676055789944] 2023-02-10 19:03:10,242 WARN [RS:1;jenkins-hbase4:39215] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-10 19:03:10,242 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,39215,1676055789974] 2023-02-10 19:03:10,243 INFO [RS:1;jenkins-hbase4:39215] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-10 19:03:10,243 DEBUG [RS:0;jenkins-hbase4:37711] zookeeper.ZKUtil(162): regionserver:37711-0x1003f9daaf10001, quorum=127.0.0.1:52327, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,37711,1676055789944 2023-02-10 19:03:10,243 DEBUG [RS:1;jenkins-hbase4:39215] regionserver.HRegionServer(1947): logDir=hdfs://localhost:33161/user/jenkins/test-data/6c75f688-f587-1f47-1e81-0b91f31623af/WALs/jenkins-hbase4.apache.org,39215,1676055789974 2023-02-10 19:03:10,243 WARN [RS:0;jenkins-hbase4:37711] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-10 19:03:10,243 INFO [RS:0;jenkins-hbase4:37711] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-10 19:03:10,243 DEBUG [RS:0;jenkins-hbase4:37711] regionserver.HRegionServer(1947): logDir=hdfs://localhost:33161/user/jenkins/test-data/6c75f688-f587-1f47-1e81-0b91f31623af/WALs/jenkins-hbase4.apache.org,37711,1676055789944 2023-02-10 19:03:10,247 DEBUG [RS:1;jenkins-hbase4:39215] zookeeper.ZKUtil(162): regionserver:39215-0x1003f9daaf10002, quorum=127.0.0.1:52327, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,37711,1676055789944 2023-02-10 19:03:10,247 DEBUG [RS:0;jenkins-hbase4:37711] zookeeper.ZKUtil(162): regionserver:37711-0x1003f9daaf10001, quorum=127.0.0.1:52327, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,37711,1676055789944 2023-02-10 19:03:10,248 DEBUG [RS:1;jenkins-hbase4:39215] zookeeper.ZKUtil(162): regionserver:39215-0x1003f9daaf10002, quorum=127.0.0.1:52327, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,39215,1676055789974 2023-02-10 19:03:10,248 DEBUG [RS:0;jenkins-hbase4:37711] zookeeper.ZKUtil(162): regionserver:37711-0x1003f9daaf10001, quorum=127.0.0.1:52327, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,39215,1676055789974 2023-02-10 19:03:10,248 DEBUG [RS:1;jenkins-hbase4:39215] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-10 19:03:10,249 DEBUG [RS:0;jenkins-hbase4:37711] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-10 19:03:10,249 INFO [RS:1;jenkins-hbase4:39215] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-10 19:03:10,249 INFO [RS:0;jenkins-hbase4:37711] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-10 19:03:10,250 INFO [RS:1;jenkins-hbase4:39215] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-10 19:03:10,250 INFO [RS:1;jenkins-hbase4:39215] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-10 19:03:10,250 INFO [RS:1;jenkins-hbase4:39215] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-10 19:03:10,250 INFO [RS:1;jenkins-hbase4:39215] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-10 19:03:10,251 INFO [RS:0;jenkins-hbase4:37711] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-10 19:03:10,251 INFO [RS:0;jenkins-hbase4:37711] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-10 19:03:10,251 INFO [RS:0;jenkins-hbase4:37711] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-10 19:03:10,251 INFO [RS:1;jenkins-hbase4:39215] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-10 19:03:10,252 INFO [RS:0;jenkins-hbase4:37711] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-10 19:03:10,252 DEBUG [RS:1;jenkins-hbase4:39215] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-10 19:03:10,252 DEBUG [RS:1;jenkins-hbase4:39215] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-10 19:03:10,252 DEBUG [RS:1;jenkins-hbase4:39215] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-10 19:03:10,252 DEBUG [RS:1;jenkins-hbase4:39215] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-10 19:03:10,252 DEBUG [RS:1;jenkins-hbase4:39215] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-10 19:03:10,252 DEBUG [RS:1;jenkins-hbase4:39215] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-10 19:03:10,252 DEBUG [RS:1;jenkins-hbase4:39215] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-10 19:03:10,253 DEBUG [RS:1;jenkins-hbase4:39215] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-10 19:03:10,253 DEBUG [RS:1;jenkins-hbase4:39215] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-10 19:03:10,253 DEBUG [RS:1;jenkins-hbase4:39215] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-10 19:03:10,256 INFO [RS:0;jenkins-hbase4:37711] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-10 19:03:10,256 INFO [RS:1;jenkins-hbase4:39215] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-10 19:03:10,256 INFO [RS:1;jenkins-hbase4:39215] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-10 19:03:10,256 DEBUG [RS:0;jenkins-hbase4:37711] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-10 19:03:10,256 INFO [RS:1;jenkins-hbase4:39215] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-10 19:03:10,256 DEBUG [RS:0;jenkins-hbase4:37711] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-10 19:03:10,257 DEBUG [RS:0;jenkins-hbase4:37711] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-10 19:03:10,257 DEBUG [RS:0;jenkins-hbase4:37711] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-10 19:03:10,257 DEBUG [RS:0;jenkins-hbase4:37711] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-10 19:03:10,257 DEBUG [RS:0;jenkins-hbase4:37711] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-10 19:03:10,257 DEBUG [RS:0;jenkins-hbase4:37711] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-10 19:03:10,257 DEBUG [RS:0;jenkins-hbase4:37711] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-10 19:03:10,257 DEBUG [RS:0;jenkins-hbase4:37711] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-10 19:03:10,257 DEBUG [RS:0;jenkins-hbase4:37711] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-10 19:03:10,260 INFO [RS:0;jenkins-hbase4:37711] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-10 19:03:10,260 INFO [RS:0;jenkins-hbase4:37711] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-10 19:03:10,260 INFO [RS:0;jenkins-hbase4:37711] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-10 19:03:10,268 INFO [RS:1;jenkins-hbase4:39215] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-10 19:03:10,268 INFO [RS:1;jenkins-hbase4:39215] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,39215,1676055789974-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-10 19:03:10,272 INFO [RS:0;jenkins-hbase4:37711] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-10 19:03:10,272 INFO [RS:0;jenkins-hbase4:37711] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,37711,1676055789944-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-10 19:03:10,278 INFO [RS:1;jenkins-hbase4:39215] regionserver.Replication(203): jenkins-hbase4.apache.org,39215,1676055789974 started 2023-02-10 19:03:10,278 INFO [RS:1;jenkins-hbase4:39215] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,39215,1676055789974, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:39215, sessionid=0x1003f9daaf10002 2023-02-10 19:03:10,278 DEBUG [RS:1;jenkins-hbase4:39215] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-10 19:03:10,278 DEBUG [RS:1;jenkins-hbase4:39215] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,39215,1676055789974 2023-02-10 19:03:10,278 DEBUG [RS:1;jenkins-hbase4:39215] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,39215,1676055789974' 2023-02-10 19:03:10,278 DEBUG [RS:1;jenkins-hbase4:39215] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-10 19:03:10,278 DEBUG [RS:1;jenkins-hbase4:39215] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-10 19:03:10,279 DEBUG [RS:1;jenkins-hbase4:39215] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-10 19:03:10,279 DEBUG [RS:1;jenkins-hbase4:39215] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-10 19:03:10,279 DEBUG [RS:1;jenkins-hbase4:39215] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,39215,1676055789974 2023-02-10 19:03:10,279 DEBUG [RS:1;jenkins-hbase4:39215] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,39215,1676055789974' 2023-02-10 19:03:10,279 DEBUG [RS:1;jenkins-hbase4:39215] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-10 19:03:10,279 DEBUG [RS:1;jenkins-hbase4:39215] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-10 19:03:10,280 DEBUG [RS:1;jenkins-hbase4:39215] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-10 19:03:10,280 INFO [RS:1;jenkins-hbase4:39215] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-10 19:03:10,280 INFO [RS:1;jenkins-hbase4:39215] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-10 19:03:10,282 INFO [RS:0;jenkins-hbase4:37711] regionserver.Replication(203): jenkins-hbase4.apache.org,37711,1676055789944 started 2023-02-10 19:03:10,282 INFO [RS:0;jenkins-hbase4:37711] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,37711,1676055789944, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:37711, sessionid=0x1003f9daaf10001 2023-02-10 19:03:10,282 DEBUG [RS:0;jenkins-hbase4:37711] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-10 19:03:10,282 DEBUG [RS:0;jenkins-hbase4:37711] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,37711,1676055789944 2023-02-10 19:03:10,282 DEBUG [RS:0;jenkins-hbase4:37711] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,37711,1676055789944' 2023-02-10 19:03:10,282 DEBUG [RS:0;jenkins-hbase4:37711] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-10 19:03:10,282 DEBUG [RS:0;jenkins-hbase4:37711] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-10 19:03:10,283 DEBUG [RS:0;jenkins-hbase4:37711] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-10 19:03:10,283 DEBUG [RS:0;jenkins-hbase4:37711] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-10 19:03:10,283 DEBUG [RS:0;jenkins-hbase4:37711] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,37711,1676055789944 2023-02-10 19:03:10,283 DEBUG [RS:0;jenkins-hbase4:37711] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,37711,1676055789944' 2023-02-10 19:03:10,283 DEBUG [RS:0;jenkins-hbase4:37711] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-10 19:03:10,283 DEBUG [RS:0;jenkins-hbase4:37711] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-10 19:03:10,283 DEBUG [RS:0;jenkins-hbase4:37711] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-10 19:03:10,283 INFO [RS:0;jenkins-hbase4:37711] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-10 19:03:10,283 INFO [RS:0;jenkins-hbase4:37711] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-10 19:03:10,375 DEBUG [jenkins-hbase4:46421] assignment.AssignmentManager(2178): Processing assignQueue; systemServersCount=2, allServersCount=2 2023-02-10 19:03:10,375 DEBUG [jenkins-hbase4:46421] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-10 19:03:10,377 DEBUG [jenkins-hbase4:46421] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-10 19:03:10,377 DEBUG [jenkins-hbase4:46421] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-10 19:03:10,377 DEBUG [jenkins-hbase4:46421] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-10 19:03:10,378 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,39215,1676055789974, state=OPENING 2023-02-10 19:03:10,379 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-02-10 19:03:10,380 DEBUG [Listener at localhost/45079-EventThread] zookeeper.ZKWatcher(600): master:46421-0x1003f9daaf10000, quorum=127.0.0.1:52327, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-10 19:03:10,381 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-10 19:03:10,381 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,39215,1676055789974}] 2023-02-10 19:03:10,535 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,39215,1676055789974 2023-02-10 19:03:10,535 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-10 19:03:10,537 INFO [RS-EventLoopGroup-11-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40738, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-10 19:03:10,541 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:meta,,1.1588230740 2023-02-10 19:03:10,541 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-10 19:03:10,542 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C39215%2C1676055789974.meta, suffix=.meta, logDir=hdfs://localhost:33161/user/jenkins/test-data/6c75f688-f587-1f47-1e81-0b91f31623af/WALs/jenkins-hbase4.apache.org,39215,1676055789974, archiveDir=hdfs://localhost:33161/user/jenkins/test-data/6c75f688-f587-1f47-1e81-0b91f31623af/oldWALs, maxLogs=32 2023-02-10 19:03:10,561 DEBUG [RS-EventLoopGroup-11-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40603,DS-be45c795-6594-4f73-abcb-bd2441d5aef7,DISK] 2023-02-10 19:03:10,561 DEBUG [RS-EventLoopGroup-11-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39673,DS-8d00709e-eee8-4462-aefc-1a2c96b3d9a1,DISK] 2023-02-10 19:03:10,563 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/6c75f688-f587-1f47-1e81-0b91f31623af/WALs/jenkins-hbase4.apache.org,39215,1676055789974/jenkins-hbase4.apache.org%2C39215%2C1676055789974.meta.1676055790543.meta 2023-02-10 19:03:10,563 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:40603,DS-be45c795-6594-4f73-abcb-bd2441d5aef7,DISK], DatanodeInfoWithStorage[127.0.0.1:39673,DS-8d00709e-eee8-4462-aefc-1a2c96b3d9a1,DISK]] 2023-02-10 19:03:10,563 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-02-10 19:03:10,563 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-02-10 19:03:10,563 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8546): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-02-10 19:03:10,563 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-02-10 19:03:10,564 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-02-10 19:03:10,564 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-10 19:03:10,564 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 1588230740 2023-02-10 19:03:10,564 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 1588230740 2023-02-10 19:03:10,565 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-10 19:03:10,566 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33161/user/jenkins/test-data/6c75f688-f587-1f47-1e81-0b91f31623af/data/hbase/meta/1588230740/info 2023-02-10 19:03:10,566 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33161/user/jenkins/test-data/6c75f688-f587-1f47-1e81-0b91f31623af/data/hbase/meta/1588230740/info 2023-02-10 19:03:10,566 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-10 19:03:10,567 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-10 19:03:10,567 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-10 19:03:10,568 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33161/user/jenkins/test-data/6c75f688-f587-1f47-1e81-0b91f31623af/data/hbase/meta/1588230740/rep_barrier 2023-02-10 19:03:10,568 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33161/user/jenkins/test-data/6c75f688-f587-1f47-1e81-0b91f31623af/data/hbase/meta/1588230740/rep_barrier 2023-02-10 19:03:10,568 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-10 19:03:10,568 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-10 19:03:10,568 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-10 19:03:10,569 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33161/user/jenkins/test-data/6c75f688-f587-1f47-1e81-0b91f31623af/data/hbase/meta/1588230740/table 2023-02-10 19:03:10,569 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33161/user/jenkins/test-data/6c75f688-f587-1f47-1e81-0b91f31623af/data/hbase/meta/1588230740/table 2023-02-10 19:03:10,569 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-10 19:03:10,570 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-10 19:03:10,571 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33161/user/jenkins/test-data/6c75f688-f587-1f47-1e81-0b91f31623af/data/hbase/meta/1588230740 2023-02-10 19:03:10,572 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33161/user/jenkins/test-data/6c75f688-f587-1f47-1e81-0b91f31623af/data/hbase/meta/1588230740 2023-02-10 19:03:10,573 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-10 19:03:10,575 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-10 19:03:10,576 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60466421, jitterRate=-0.09898011386394501}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-10 19:03:10,576 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 1588230740: Running coprocessor pre-open hook at 1676055790564Writing region info on filesystem at 1676055790564Initializing all the Stores at 1676055790565 (+1 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676055790565Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676055790565Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676055790565Cleaning up temporary data from old regions at 1676055790572 (+7 ms)Cleaning up detritus from prior splits at 1676055790573 (+1 ms)Running coprocessor post-open hooks at 1676055790576 (+3 ms)Region opened successfully at 1676055790576 2023-02-10 19:03:10,577 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1676055790535 2023-02-10 19:03:10,580 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:meta,,1.1588230740 2023-02-10 19:03:10,581 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:meta,,1.1588230740 2023-02-10 19:03:10,582 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,39215,1676055789974, state=OPEN 2023-02-10 19:03:10,584 DEBUG [Listener at localhost/45079-EventThread] zookeeper.ZKWatcher(600): master:46421-0x1003f9daaf10000, quorum=127.0.0.1:52327, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-02-10 19:03:10,584 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-10 19:03:10,586 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-02-10 19:03:10,586 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,39215,1676055789974 in 203 msec 2023-02-10 19:03:10,587 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-02-10 19:03:10,587 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 366 msec 2023-02-10 19:03:10,589 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 419 msec 2023-02-10 19:03:10,589 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(946): Master startup: status=Wait for region servers to report in, state=RUNNING, startTime=1676055790003, completionTime=-1 2023-02-10 19:03:10,589 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=2; waited=0ms, expected min=2 server(s), max=2 server(s), master is running 2023-02-10 19:03:10,589 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1519): Joining cluster... 2023-02-10 19:03:10,593 DEBUG [hconnection-0x22c2d60e-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-10 19:03:10,595 INFO [RS-EventLoopGroup-11-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40750, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-10 19:03:10,596 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1531): Number of RegionServers=2 2023-02-10 19:03:10,596 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1676055850596 2023-02-10 19:03:10,596 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1676055910596 2023-02-10 19:03:10,596 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1538): Joined the cluster in 7 msec 2023-02-10 19:03:10,603 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,46421,1676055789889-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-10 19:03:10,603 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,46421,1676055789889-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-10 19:03:10,603 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,46421,1676055789889-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-10 19:03:10,603 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:46421, period=300000, unit=MILLISECONDS is enabled. 2023-02-10 19:03:10,604 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-02-10 19:03:10,604 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-02-10 19:03:10,604 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2138): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-10 19:03:10,605 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-02-10 19:03:10,606 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-02-10 19:03:10,607 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-02-10 19:03:10,607 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-10 19:03:10,609 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33161/user/jenkins/test-data/6c75f688-f587-1f47-1e81-0b91f31623af/.tmp/data/hbase/namespace/54460a74d8b5e3fb664f5f761fa75e69 2023-02-10 19:03:10,610 DEBUG [HFileArchiver-5] backup.HFileArchiver(153): Directory hdfs://localhost:33161/user/jenkins/test-data/6c75f688-f587-1f47-1e81-0b91f31623af/.tmp/data/hbase/namespace/54460a74d8b5e3fb664f5f761fa75e69 empty. 2023-02-10 19:03:10,610 DEBUG [HFileArchiver-5] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33161/user/jenkins/test-data/6c75f688-f587-1f47-1e81-0b91f31623af/.tmp/data/hbase/namespace/54460a74d8b5e3fb664f5f761fa75e69 2023-02-10 19:03:10,610 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-02-10 19:03:10,623 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:33161/user/jenkins/test-data/6c75f688-f587-1f47-1e81-0b91f31623af/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-02-10 19:03:10,624 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7671): creating {ENCODED => 54460a74d8b5e3fb664f5f761fa75e69, NAME => 'hbase:namespace,,1676055790604.54460a74d8b5e3fb664f5f761fa75e69.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33161/user/jenkins/test-data/6c75f688-f587-1f47-1e81-0b91f31623af/.tmp 2023-02-10 19:03:10,634 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676055790604.54460a74d8b5e3fb664f5f761fa75e69.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-10 19:03:10,635 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1603): Closing 54460a74d8b5e3fb664f5f761fa75e69, disabling compactions & flushes 2023-02-10 19:03:10,635 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676055790604.54460a74d8b5e3fb664f5f761fa75e69. 2023-02-10 19:03:10,635 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676055790604.54460a74d8b5e3fb664f5f761fa75e69. 2023-02-10 19:03:10,635 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676055790604.54460a74d8b5e3fb664f5f761fa75e69. after waiting 0 ms 2023-02-10 19:03:10,635 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676055790604.54460a74d8b5e3fb664f5f761fa75e69. 2023-02-10 19:03:10,635 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676055790604.54460a74d8b5e3fb664f5f761fa75e69. 2023-02-10 19:03:10,635 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1557): Region close journal for 54460a74d8b5e3fb664f5f761fa75e69: Waiting for close lock at 1676055790635Disabling compacts and flushes for region at 1676055790635Disabling writes for close at 1676055790635Writing region close event to WAL at 1676055790635Closed at 1676055790635 2023-02-10 19:03:10,637 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-02-10 19:03:10,638 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1676055790604.54460a74d8b5e3fb664f5f761fa75e69.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676055790638"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676055790638"}]},"ts":"1676055790638"} 2023-02-10 19:03:10,640 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-10 19:03:10,641 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-10 19:03:10,642 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676055790641"}]},"ts":"1676055790641"} 2023-02-10 19:03:10,643 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-02-10 19:03:10,647 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-10 19:03:10,648 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-10 19:03:10,648 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-10 19:03:10,648 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-10 19:03:10,648 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=54460a74d8b5e3fb664f5f761fa75e69, ASSIGN}] 2023-02-10 19:03:10,651 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=54460a74d8b5e3fb664f5f761fa75e69, ASSIGN 2023-02-10 19:03:10,651 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=54460a74d8b5e3fb664f5f761fa75e69, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39215,1676055789974; forceNewPlan=false, retain=false 2023-02-10 19:03:10,801 INFO [jenkins-hbase4:46421] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-10 19:03:10,803 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=54460a74d8b5e3fb664f5f761fa75e69, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39215,1676055789974 2023-02-10 19:03:10,803 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1676055790604.54460a74d8b5e3fb664f5f761fa75e69.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676055790802"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676055790802"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676055790802"}]},"ts":"1676055790802"} 2023-02-10 19:03:10,805 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 54460a74d8b5e3fb664f5f761fa75e69, server=jenkins-hbase4.apache.org,39215,1676055789974}] 2023-02-10 19:03:10,988 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:namespace,,1676055790604.54460a74d8b5e3fb664f5f761fa75e69. 2023-02-10 19:03:10,990 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C39215%2C1676055789974, suffix=, logDir=hdfs://localhost:33161/user/jenkins/test-data/6c75f688-f587-1f47-1e81-0b91f31623af/WALs/jenkins-hbase4.apache.org,39215,1676055789974, archiveDir=hdfs://localhost:33161/user/jenkins/test-data/6c75f688-f587-1f47-1e81-0b91f31623af/oldWALs, maxLogs=32 2023-02-10 19:03:11,015 DEBUG [RS-EventLoopGroup-11-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39673,DS-8d00709e-eee8-4462-aefc-1a2c96b3d9a1,DISK] 2023-02-10 19:03:11,016 DEBUG [RS-EventLoopGroup-11-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40603,DS-be45c795-6594-4f73-abcb-bd2441d5aef7,DISK] 2023-02-10 19:03:11,019 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/6c75f688-f587-1f47-1e81-0b91f31623af/WALs/jenkins-hbase4.apache.org,39215,1676055789974/jenkins-hbase4.apache.org%2C39215%2C1676055789974.1676055790991 2023-02-10 19:03:11,022 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:39673,DS-8d00709e-eee8-4462-aefc-1a2c96b3d9a1,DISK], DatanodeInfoWithStorage[127.0.0.1:40603,DS-be45c795-6594-4f73-abcb-bd2441d5aef7,DISK]] 2023-02-10 19:03:11,022 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 54460a74d8b5e3fb664f5f761fa75e69, NAME => 'hbase:namespace,,1676055790604.54460a74d8b5e3fb664f5f761fa75e69.', STARTKEY => '', ENDKEY => ''} 2023-02-10 19:03:11,023 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 54460a74d8b5e3fb664f5f761fa75e69 2023-02-10 19:03:11,023 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676055790604.54460a74d8b5e3fb664f5f761fa75e69.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-10 19:03:11,023 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 54460a74d8b5e3fb664f5f761fa75e69 2023-02-10 19:03:11,023 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 54460a74d8b5e3fb664f5f761fa75e69 2023-02-10 19:03:11,024 INFO [StoreOpener-54460a74d8b5e3fb664f5f761fa75e69-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 54460a74d8b5e3fb664f5f761fa75e69 2023-02-10 19:03:11,025 DEBUG [StoreOpener-54460a74d8b5e3fb664f5f761fa75e69-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33161/user/jenkins/test-data/6c75f688-f587-1f47-1e81-0b91f31623af/data/hbase/namespace/54460a74d8b5e3fb664f5f761fa75e69/info 2023-02-10 19:03:11,025 DEBUG [StoreOpener-54460a74d8b5e3fb664f5f761fa75e69-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33161/user/jenkins/test-data/6c75f688-f587-1f47-1e81-0b91f31623af/data/hbase/namespace/54460a74d8b5e3fb664f5f761fa75e69/info 2023-02-10 19:03:11,026 INFO [StoreOpener-54460a74d8b5e3fb664f5f761fa75e69-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 54460a74d8b5e3fb664f5f761fa75e69 columnFamilyName info 2023-02-10 19:03:11,026 INFO [StoreOpener-54460a74d8b5e3fb664f5f761fa75e69-1] regionserver.HStore(310): Store=54460a74d8b5e3fb664f5f761fa75e69/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-10 19:03:11,027 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33161/user/jenkins/test-data/6c75f688-f587-1f47-1e81-0b91f31623af/data/hbase/namespace/54460a74d8b5e3fb664f5f761fa75e69 2023-02-10 19:03:11,027 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33161/user/jenkins/test-data/6c75f688-f587-1f47-1e81-0b91f31623af/data/hbase/namespace/54460a74d8b5e3fb664f5f761fa75e69 2023-02-10 19:03:11,030 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 54460a74d8b5e3fb664f5f761fa75e69 2023-02-10 19:03:11,031 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33161/user/jenkins/test-data/6c75f688-f587-1f47-1e81-0b91f31623af/data/hbase/namespace/54460a74d8b5e3fb664f5f761fa75e69/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-10 19:03:11,032 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 54460a74d8b5e3fb664f5f761fa75e69; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62775224, jitterRate=-0.06457626819610596}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-10 19:03:11,032 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 54460a74d8b5e3fb664f5f761fa75e69: Running coprocessor pre-open hook at 1676055791023Writing region info on filesystem at 1676055791023Initializing all the Stores at 1676055791024 (+1 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676055791024Cleaning up temporary data from old regions at 1676055791028 (+4 ms)Cleaning up detritus from prior splits at 1676055791028Running coprocessor post-open hooks at 1676055791032 (+4 ms)Region opened successfully at 1676055791032 2023-02-10 19:03:11,033 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:namespace,,1676055790604.54460a74d8b5e3fb664f5f761fa75e69., pid=6, masterSystemTime=1676055790972 2023-02-10 19:03:11,034 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:namespace,,1676055790604.54460a74d8b5e3fb664f5f761fa75e69. 2023-02-10 19:03:11,035 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:namespace,,1676055790604.54460a74d8b5e3fb664f5f761fa75e69. 2023-02-10 19:03:11,035 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=54460a74d8b5e3fb664f5f761fa75e69, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39215,1676055789974 2023-02-10 19:03:11,035 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1676055790604.54460a74d8b5e3fb664f5f761fa75e69.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676055791035"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676055791035"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676055791035"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676055791035"}]},"ts":"1676055791035"} 2023-02-10 19:03:11,038 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-02-10 19:03:11,038 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 54460a74d8b5e3fb664f5f761fa75e69, server=jenkins-hbase4.apache.org,39215,1676055789974 in 232 msec 2023-02-10 19:03:11,039 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-02-10 19:03:11,040 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=54460a74d8b5e3fb664f5f761fa75e69, ASSIGN in 390 msec 2023-02-10 19:03:11,040 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-10 19:03:11,040 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676055791040"}]},"ts":"1676055791040"} 2023-02-10 19:03:11,042 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-02-10 19:03:11,044 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-02-10 19:03:11,046 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 440 msec 2023-02-10 19:03:11,106 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:46421-0x1003f9daaf10000, quorum=127.0.0.1:52327, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-02-10 19:03:11,108 DEBUG [Listener at localhost/45079-EventThread] zookeeper.ZKWatcher(600): master:46421-0x1003f9daaf10000, quorum=127.0.0.1:52327, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-02-10 19:03:11,108 DEBUG [Listener at localhost/45079-EventThread] zookeeper.ZKWatcher(600): master:46421-0x1003f9daaf10000, quorum=127.0.0.1:52327, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-10 19:03:11,111 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-02-10 19:03:11,119 DEBUG [Listener at localhost/45079-EventThread] zookeeper.ZKWatcher(600): master:46421-0x1003f9daaf10000, quorum=127.0.0.1:52327, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-10 19:03:11,123 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 11 msec 2023-02-10 19:03:11,133 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-02-10 19:03:11,142 DEBUG [Listener at localhost/45079-EventThread] zookeeper.ZKWatcher(600): master:46421-0x1003f9daaf10000, quorum=127.0.0.1:52327, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-10 19:03:11,152 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 10 msec 2023-02-10 19:03:11,159 DEBUG [Listener at localhost/45079-EventThread] zookeeper.ZKWatcher(600): master:46421-0x1003f9daaf10000, quorum=127.0.0.1:52327, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-02-10 19:03:11,161 DEBUG [Listener at localhost/45079-EventThread] zookeeper.ZKWatcher(600): master:46421-0x1003f9daaf10000, quorum=127.0.0.1:52327, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-02-10 19:03:11,161 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1077): Master has completed initialization 1.152sec 2023-02-10 19:03:11,161 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-02-10 19:03:11,161 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-02-10 19:03:11,161 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-02-10 19:03:11,161 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,46421,1676055789889-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-02-10 19:03:11,161 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,46421,1676055789889-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-02-10 19:03:11,162 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1166): Balancer post startup initialization complete, took 0 seconds 2023-02-10 19:03:11,204 DEBUG [Listener at localhost/45079] zookeeper.ReadOnlyZKClient(139): Connect 0x5f67a438 to 127.0.0.1:52327 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-10 19:03:11,209 DEBUG [Listener at localhost/45079] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7fa4d40a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-10 19:03:11,210 DEBUG [hconnection-0x321eb0a4-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-10 19:03:11,212 INFO [RS-EventLoopGroup-11-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40758, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-10 19:03:11,214 INFO [Listener at localhost/45079] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,46421,1676055789889 2023-02-10 19:03:11,214 DEBUG [Listener at localhost/45079] mapreduce.TableSnapshotInputFormatTestBase(193): Ensuring table doesn't exist. 2023-02-10 19:03:11,216 DEBUG [Listener at localhost/45079] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-10 19:03:11,218 INFO [RS-EventLoopGroup-9-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:57160, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-10 19:03:11,219 INFO [Listener at localhost/45079] client.HBaseAdmin$15(890): Started disable of testInitTableSnapshotMapperJobConfig 2023-02-10 19:03:11,219 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46421] master.HMaster$11(2405): Client=jenkins//172.31.14.131 disable testInitTableSnapshotMapperJobConfig 2023-02-10 19:03:11,219 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46421] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.TableNotFoundException: testInitTableSnapshotMapperJobConfig at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.checkTableModifiable(AbstractStateMachineTableProcedure.java:125) at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.preflightChecks(AbstractStateMachineTableProcedure.java:157) at org.apache.hadoop.hbase.master.procedure.DisableTableProcedure.(DisableTableProcedure.java:78) at org.apache.hadoop.hbase.master.HMaster$11.run(HMaster.java:2416) at org.apache.hadoop.hbase.master.procedure.MasterProcedureUtil.submitProcedure(MasterProcedureUtil.java:132) at org.apache.hadoop.hbase.master.HMaster.disableTable(HMaster.java:2400) at org.apache.hadoop.hbase.master.MasterRpcServices.disableTable(MasterRpcServices.java:784) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-02-10 19:03:11,220 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46421] ipc.CallRunner(144): callId: 2 service: MasterService methodName: DisableTable size: 95 connection: 172.31.14.131:57160 deadline: 1676055851219, exception=org.apache.hadoop.hbase.TableNotFoundException: testInitTableSnapshotMapperJobConfig 2023-02-10 19:03:11,220 INFO [Listener at localhost/45079] mapreduce.TableSnapshotInputFormatTestBase(199): creating table 'testInitTableSnapshotMapperJobConfig' 2023-02-10 19:03:11,223 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46421] master.HMaster$4(2102): Client=jenkins//172.31.14.131 create 'testInitTableSnapshotMapperJobConfig', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-10 19:03:11,224 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46421] procedure2.ProcedureExecutor(1029): Stored pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testInitTableSnapshotMapperJobConfig 2023-02-10 19:03:11,225 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testInitTableSnapshotMapperJobConfig execute state=CREATE_TABLE_PRE_OPERATION 2023-02-10 19:03:11,225 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46421] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testInitTableSnapshotMapperJobConfig" procId is: 10 2023-02-10 19:03:11,226 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testInitTableSnapshotMapperJobConfig execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-10 19:03:11,227 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46421] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-10 19:03:11,227 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33161/user/jenkins/test-data/6c75f688-f587-1f47-1e81-0b91f31623af/.tmp/data/default/testInitTableSnapshotMapperJobConfig/95f1e1dd88fe532437114fb5f675f5cc 2023-02-10 19:03:11,228 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:33161/user/jenkins/test-data/6c75f688-f587-1f47-1e81-0b91f31623af/.tmp/data/default/testInitTableSnapshotMapperJobConfig/95f1e1dd88fe532437114fb5f675f5cc empty. 2023-02-10 19:03:11,228 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33161/user/jenkins/test-data/6c75f688-f587-1f47-1e81-0b91f31623af/.tmp/data/default/testInitTableSnapshotMapperJobConfig/95f1e1dd88fe532437114fb5f675f5cc 2023-02-10 19:03:11,228 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testInitTableSnapshotMapperJobConfig regions 2023-02-10 19:03:11,239 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:33161/user/jenkins/test-data/6c75f688-f587-1f47-1e81-0b91f31623af/.tmp/data/default/testInitTableSnapshotMapperJobConfig/.tabledesc/.tableinfo.0000000001 2023-02-10 19:03:11,240 INFO [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(7671): creating {ENCODED => 95f1e1dd88fe532437114fb5f675f5cc, NAME => 'testInitTableSnapshotMapperJobConfig,,1676055791222.95f1e1dd88fe532437114fb5f675f5cc.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testInitTableSnapshotMapperJobConfig', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33161/user/jenkins/test-data/6c75f688-f587-1f47-1e81-0b91f31623af/.tmp 2023-02-10 19:03:11,250 DEBUG [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(865): Instantiated testInitTableSnapshotMapperJobConfig,,1676055791222.95f1e1dd88fe532437114fb5f675f5cc.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-10 19:03:11,250 DEBUG [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(1603): Closing 95f1e1dd88fe532437114fb5f675f5cc, disabling compactions & flushes 2023-02-10 19:03:11,250 INFO [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(1625): Closing region testInitTableSnapshotMapperJobConfig,,1676055791222.95f1e1dd88fe532437114fb5f675f5cc. 2023-02-10 19:03:11,250 DEBUG [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testInitTableSnapshotMapperJobConfig,,1676055791222.95f1e1dd88fe532437114fb5f675f5cc. 2023-02-10 19:03:11,250 DEBUG [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(1713): Acquired close lock on testInitTableSnapshotMapperJobConfig,,1676055791222.95f1e1dd88fe532437114fb5f675f5cc. after waiting 0 ms 2023-02-10 19:03:11,250 DEBUG [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(1723): Updates disabled for region testInitTableSnapshotMapperJobConfig,,1676055791222.95f1e1dd88fe532437114fb5f675f5cc. 2023-02-10 19:03:11,250 INFO [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(1837): Closed testInitTableSnapshotMapperJobConfig,,1676055791222.95f1e1dd88fe532437114fb5f675f5cc. 2023-02-10 19:03:11,250 DEBUG [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(1557): Region close journal for 95f1e1dd88fe532437114fb5f675f5cc: Waiting for close lock at 1676055791250Disabling compacts and flushes for region at 1676055791250Disabling writes for close at 1676055791250Writing region close event to WAL at 1676055791250Closed at 1676055791250 2023-02-10 19:03:11,252 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testInitTableSnapshotMapperJobConfig execute state=CREATE_TABLE_ADD_TO_META 2023-02-10 19:03:11,253 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testInitTableSnapshotMapperJobConfig,,1676055791222.95f1e1dd88fe532437114fb5f675f5cc.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1676055791253"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676055791253"}]},"ts":"1676055791253"} 2023-02-10 19:03:11,255 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-10 19:03:11,255 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testInitTableSnapshotMapperJobConfig execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-10 19:03:11,255 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testInitTableSnapshotMapperJobConfig","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676055791255"}]},"ts":"1676055791255"} 2023-02-10 19:03:11,257 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testInitTableSnapshotMapperJobConfig, state=ENABLING in hbase:meta 2023-02-10 19:03:11,261 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-10 19:03:11,262 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-10 19:03:11,262 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-10 19:03:11,262 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-10 19:03:11,262 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testInitTableSnapshotMapperJobConfig, region=95f1e1dd88fe532437114fb5f675f5cc, ASSIGN}] 2023-02-10 19:03:11,264 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testInitTableSnapshotMapperJobConfig, region=95f1e1dd88fe532437114fb5f675f5cc, ASSIGN 2023-02-10 19:03:11,265 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testInitTableSnapshotMapperJobConfig, region=95f1e1dd88fe532437114fb5f675f5cc, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,37711,1676055789944; forceNewPlan=false, retain=false 2023-02-10 19:03:11,285 INFO [RS:0;jenkins-hbase4:37711] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C37711%2C1676055789944, suffix=, logDir=hdfs://localhost:33161/user/jenkins/test-data/6c75f688-f587-1f47-1e81-0b91f31623af/WALs/jenkins-hbase4.apache.org,37711,1676055789944, archiveDir=hdfs://localhost:33161/user/jenkins/test-data/6c75f688-f587-1f47-1e81-0b91f31623af/oldWALs, maxLogs=32 2023-02-10 19:03:11,300 DEBUG [RS-EventLoopGroup-11-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40603,DS-be45c795-6594-4f73-abcb-bd2441d5aef7,DISK] 2023-02-10 19:03:11,301 DEBUG [RS-EventLoopGroup-11-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39673,DS-8d00709e-eee8-4462-aefc-1a2c96b3d9a1,DISK] 2023-02-10 19:03:11,302 INFO [RS:0;jenkins-hbase4:37711] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/6c75f688-f587-1f47-1e81-0b91f31623af/WALs/jenkins-hbase4.apache.org,37711,1676055789944/jenkins-hbase4.apache.org%2C37711%2C1676055789944.1676055791285 2023-02-10 19:03:11,303 DEBUG [RS:0;jenkins-hbase4:37711] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:40603,DS-be45c795-6594-4f73-abcb-bd2441d5aef7,DISK], DatanodeInfoWithStorage[127.0.0.1:39673,DS-8d00709e-eee8-4462-aefc-1a2c96b3d9a1,DISK]] 2023-02-10 19:03:11,328 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46421] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-10 19:03:11,415 INFO [jenkins-hbase4:46421] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-10 19:03:11,416 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=95f1e1dd88fe532437114fb5f675f5cc, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,37711,1676055789944 2023-02-10 19:03:11,417 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testInitTableSnapshotMapperJobConfig,,1676055791222.95f1e1dd88fe532437114fb5f675f5cc.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1676055791416"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676055791416"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676055791416"}]},"ts":"1676055791416"} 2023-02-10 19:03:11,419 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=12, ppid=11, state=RUNNABLE; OpenRegionProcedure 95f1e1dd88fe532437114fb5f675f5cc, server=jenkins-hbase4.apache.org,37711,1676055789944}] 2023-02-10 19:03:11,529 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46421] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-10 19:03:11,571 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,37711,1676055789944 2023-02-10 19:03:11,571 DEBUG [RSProcedureDispatcher-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-10 19:03:11,573 INFO [RS-EventLoopGroup-10-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48570, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-10 19:03:11,577 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testInitTableSnapshotMapperJobConfig,,1676055791222.95f1e1dd88fe532437114fb5f675f5cc. 2023-02-10 19:03:11,577 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 95f1e1dd88fe532437114fb5f675f5cc, NAME => 'testInitTableSnapshotMapperJobConfig,,1676055791222.95f1e1dd88fe532437114fb5f675f5cc.', STARTKEY => '', ENDKEY => ''} 2023-02-10 19:03:11,577 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testInitTableSnapshotMapperJobConfig 95f1e1dd88fe532437114fb5f675f5cc 2023-02-10 19:03:11,577 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testInitTableSnapshotMapperJobConfig,,1676055791222.95f1e1dd88fe532437114fb5f675f5cc.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-10 19:03:11,577 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 95f1e1dd88fe532437114fb5f675f5cc 2023-02-10 19:03:11,578 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 95f1e1dd88fe532437114fb5f675f5cc 2023-02-10 19:03:11,579 INFO [StoreOpener-95f1e1dd88fe532437114fb5f675f5cc-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 95f1e1dd88fe532437114fb5f675f5cc 2023-02-10 19:03:11,580 DEBUG [StoreOpener-95f1e1dd88fe532437114fb5f675f5cc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33161/user/jenkins/test-data/6c75f688-f587-1f47-1e81-0b91f31623af/data/default/testInitTableSnapshotMapperJobConfig/95f1e1dd88fe532437114fb5f675f5cc/f1 2023-02-10 19:03:11,580 DEBUG [StoreOpener-95f1e1dd88fe532437114fb5f675f5cc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33161/user/jenkins/test-data/6c75f688-f587-1f47-1e81-0b91f31623af/data/default/testInitTableSnapshotMapperJobConfig/95f1e1dd88fe532437114fb5f675f5cc/f1 2023-02-10 19:03:11,580 INFO [StoreOpener-95f1e1dd88fe532437114fb5f675f5cc-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 95f1e1dd88fe532437114fb5f675f5cc columnFamilyName f1 2023-02-10 19:03:11,581 INFO [StoreOpener-95f1e1dd88fe532437114fb5f675f5cc-1] regionserver.HStore(310): Store=95f1e1dd88fe532437114fb5f675f5cc/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-10 19:03:11,581 INFO [StoreOpener-95f1e1dd88fe532437114fb5f675f5cc-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 95f1e1dd88fe532437114fb5f675f5cc 2023-02-10 19:03:11,582 DEBUG [StoreOpener-95f1e1dd88fe532437114fb5f675f5cc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33161/user/jenkins/test-data/6c75f688-f587-1f47-1e81-0b91f31623af/data/default/testInitTableSnapshotMapperJobConfig/95f1e1dd88fe532437114fb5f675f5cc/f2 2023-02-10 19:03:11,582 DEBUG [StoreOpener-95f1e1dd88fe532437114fb5f675f5cc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33161/user/jenkins/test-data/6c75f688-f587-1f47-1e81-0b91f31623af/data/default/testInitTableSnapshotMapperJobConfig/95f1e1dd88fe532437114fb5f675f5cc/f2 2023-02-10 19:03:11,582 INFO [StoreOpener-95f1e1dd88fe532437114fb5f675f5cc-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 95f1e1dd88fe532437114fb5f675f5cc columnFamilyName f2 2023-02-10 19:03:11,583 INFO [StoreOpener-95f1e1dd88fe532437114fb5f675f5cc-1] regionserver.HStore(310): Store=95f1e1dd88fe532437114fb5f675f5cc/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-10 19:03:11,583 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33161/user/jenkins/test-data/6c75f688-f587-1f47-1e81-0b91f31623af/data/default/testInitTableSnapshotMapperJobConfig/95f1e1dd88fe532437114fb5f675f5cc 2023-02-10 19:03:11,583 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33161/user/jenkins/test-data/6c75f688-f587-1f47-1e81-0b91f31623af/data/default/testInitTableSnapshotMapperJobConfig/95f1e1dd88fe532437114fb5f675f5cc 2023-02-10 19:03:11,585 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testInitTableSnapshotMapperJobConfig descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-10 19:03:11,586 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 95f1e1dd88fe532437114fb5f675f5cc 2023-02-10 19:03:11,588 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33161/user/jenkins/test-data/6c75f688-f587-1f47-1e81-0b91f31623af/data/default/testInitTableSnapshotMapperJobConfig/95f1e1dd88fe532437114fb5f675f5cc/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-10 19:03:11,589 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 95f1e1dd88fe532437114fb5f675f5cc; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61125710, jitterRate=-0.08915594220161438}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-10 19:03:11,589 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 95f1e1dd88fe532437114fb5f675f5cc: Running coprocessor pre-open hook at 1676055791578Writing region info on filesystem at 1676055791578Initializing all the Stores at 1676055791578Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676055791578Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676055791578Cleaning up temporary data from old regions at 1676055791584 (+6 ms)Cleaning up detritus from prior splits at 1676055791584Running coprocessor post-open hooks at 1676055791589 (+5 ms)Region opened successfully at 1676055791589 2023-02-10 19:03:11,590 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testInitTableSnapshotMapperJobConfig,,1676055791222.95f1e1dd88fe532437114fb5f675f5cc., pid=12, masterSystemTime=1676055791571 2023-02-10 19:03:11,593 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testInitTableSnapshotMapperJobConfig,,1676055791222.95f1e1dd88fe532437114fb5f675f5cc. 2023-02-10 19:03:11,593 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testInitTableSnapshotMapperJobConfig,,1676055791222.95f1e1dd88fe532437114fb5f675f5cc. 2023-02-10 19:03:11,594 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=95f1e1dd88fe532437114fb5f675f5cc, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,37711,1676055789944 2023-02-10 19:03:11,594 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testInitTableSnapshotMapperJobConfig,,1676055791222.95f1e1dd88fe532437114fb5f675f5cc.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1676055791593"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676055791593"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676055791593"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676055791593"}]},"ts":"1676055791593"} 2023-02-10 19:03:11,596 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=12, resume processing ppid=11 2023-02-10 19:03:11,597 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=12, ppid=11, state=SUCCESS; OpenRegionProcedure 95f1e1dd88fe532437114fb5f675f5cc, server=jenkins-hbase4.apache.org,37711,1676055789944 in 177 msec 2023-02-10 19:03:11,598 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-02-10 19:03:11,598 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testInitTableSnapshotMapperJobConfig, region=95f1e1dd88fe532437114fb5f675f5cc, ASSIGN in 335 msec 2023-02-10 19:03:11,598 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testInitTableSnapshotMapperJobConfig execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-10 19:03:11,599 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testInitTableSnapshotMapperJobConfig","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676055791599"}]},"ts":"1676055791599"} 2023-02-10 19:03:11,600 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testInitTableSnapshotMapperJobConfig, state=ENABLED in hbase:meta 2023-02-10 19:03:11,602 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testInitTableSnapshotMapperJobConfig execute state=CREATE_TABLE_POST_OPERATION 2023-02-10 19:03:11,603 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=10, state=SUCCESS; CreateTableProcedure table=testInitTableSnapshotMapperJobConfig in 379 msec 2023-02-10 19:03:11,831 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46421] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-10 19:03:11,831 INFO [Listener at localhost/45079] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testInitTableSnapshotMapperJobConfig, procId: 10 completed 2023-02-10 19:03:11,832 DEBUG [Listener at localhost/45079] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testInitTableSnapshotMapperJobConfig get assigned. Timeout = 60000ms 2023-02-10 19:03:11,832 INFO [Listener at localhost/45079] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-10 19:03:11,834 INFO [Listener at localhost/45079] hbase.HBaseTestingUtility(3484): All regions for table testInitTableSnapshotMapperJobConfig assigned to meta. Checking AM states. 2023-02-10 19:03:11,834 INFO [Listener at localhost/45079] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-10 19:03:11,834 INFO [Listener at localhost/45079] hbase.HBaseTestingUtility(3504): All regions for table testInitTableSnapshotMapperJobConfig assigned. 2023-02-10 19:03:11,834 INFO [Listener at localhost/45079] mapreduce.TableSnapshotInputFormatTestBase(207): put some stuff in the table 2023-02-10 19:03:11,862 DEBUG [hconnection-0x321eb0a4-shared-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-10 19:03:11,878 INFO [RS-EventLoopGroup-10-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48572, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-10 19:03:11,887 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37711] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 17576 Client: jenkins//172.31.14.131 first region in multi=testInitTableSnapshotMapperJobConfig,,1676055791222.95f1e1dd88fe532437114fb5f675f5cc. 2023-02-10 19:03:11,996 INFO [Listener at localhost/45079] mapreduce.TableSnapshotInputFormatTestBase(214): snapshot 2023-02-10 19:03:11,996 INFO [Listener at localhost/45079] snapshot.SnapshotTestingUtils(396): taking snapshot. 2023-02-10 19:03:11,997 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46421] master.MasterRpcServices(1580): Client=jenkins//172.31.14.131 snapshot request for:{ ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 } 2023-02-10 19:03:11,997 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46421] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1676055791997 (current time:1676055791997). 2023-02-10 19:03:11,997 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46421] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-02-10 19:03:11,998 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46421] zookeeper.ReadOnlyZKClient(139): Connect 0x0b3965e1 to 127.0.0.1:52327 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-10 19:03:12,003 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46421] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2b9095bc, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-10 19:03:12,005 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46421] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-10 19:03:12,006 INFO [RS-EventLoopGroup-11-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40760, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-10 19:03:12,007 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46421] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0b3965e1 to 127.0.0.1:52327 2023-02-10 19:03:12,007 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46421] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-10 19:03:12,008 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46421] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-02-10 19:03:12,008 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46421] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 } 2023-02-10 19:03:12,010 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46421] procedure2.ProcedureExecutor(1029): Stored pid=13, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=EXCLUSIVE 2023-02-10 19:03:12,011 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=13, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=EXCLUSIVE 2023-02-10 19:03:12,012 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=13, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=EXCLUSIVE; timeout=600000, timestamp=1676056392012 2023-02-10 19:03:12,012 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46421] snapshot.SnapshotManager(653): Started snapshot: { ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 } 2023-02-10 19:03:12,012 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot foo C_M_SNAPSHOT_TABLE on table testInitTableSnapshotMapperJobConfig 2023-02-10 19:03:12,013 DEBUG [Listener at localhost/45079] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-02-10 19:03:12,013 DEBUG [Listener at localhost/45079] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-02-10 19:03:12,014 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=13, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=EXCLUSIVE 2023-02-10 19:03:12,014 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=14, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=SHARED 2023-02-10 19:03:12,015 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=13, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=EXCLUSIVE in 5 msec 2023-02-10 19:03:12,016 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=14, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=SHARED 2023-02-10 19:03:12,016 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=14, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=SHARED; timeout=600000, timestamp=1676056392016 2023-02-10 19:03:12,034 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure foo 2023-02-10 19:03:12,035 INFO [(jenkins-hbase4.apache.org,46421,1676055789889)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'foo' 2023-02-10 19:03:12,035 DEBUG [(jenkins-hbase4.apache.org,46421,1676055789889)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-10 19:03:12,036 DEBUG [(jenkins-hbase4.apache.org,46421,1676055789889)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'foo' starting 'acquire' 2023-02-10 19:03:12,036 DEBUG [(jenkins-hbase4.apache.org,46421,1676055789889)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'foo', kicking off acquire phase on members. 2023-02-10 19:03:12,037 DEBUG [(jenkins-hbase4.apache.org,46421,1676055789889)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46421-0x1003f9daaf10000, quorum=127.0.0.1:52327, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/foo 2023-02-10 19:03:12,037 DEBUG [(jenkins-hbase4.apache.org,46421,1676055789889)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/foo 2023-02-10 19:03:12,038 DEBUG [Listener at localhost/45079-EventThread] zookeeper.ZKWatcher(600): regionserver:37711-0x1003f9daaf10001, quorum=127.0.0.1:52327, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-10 19:03:12,038 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-10 19:03:12,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-10 19:03:12,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/foo 2023-02-10 19:03:12,039 DEBUG [Listener at localhost/45079-EventThread] zookeeper.ZKWatcher(600): regionserver:39215-0x1003f9daaf10002, quorum=127.0.0.1:52327, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-10 19:03:12,039 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-10 19:03:12,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-10 19:03:12,039 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37711-0x1003f9daaf10001, quorum=127.0.0.1:52327, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/foo 2023-02-10 19:03:12,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/foo 2023-02-10 19:03:12,040 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39215-0x1003f9daaf10002, quorum=127.0.0.1:52327, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/foo 2023-02-10 19:03:12,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 60 2023-02-10 19:03:12,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/foo 2023-02-10 19:03:12,040 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot foo from table testInitTableSnapshotMapperJobConfig type FLUSH 2023-02-10 19:03:12,040 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:foo 2023-02-10 19:03:12,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 60 2023-02-10 19:03:12,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/foo 2023-02-10 19:03:12,041 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot foo from table testInitTableSnapshotMapperJobConfig type FLUSH 2023-02-10 19:03:12,041 DEBUG [member: 'jenkins-hbase4.apache.org,37711,1676055789944' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'foo' with timeout 300000ms 2023-02-10 19:03:12,041 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:foo 2023-02-10 19:03:12,041 DEBUG [member: 'jenkins-hbase4.apache.org,37711,1676055789944' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-10 19:03:12,042 DEBUG [member: 'jenkins-hbase4.apache.org,37711,1676055789944' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'foo' starting 'acquire' stage 2023-02-10 19:03:12,042 DEBUG [member: 'jenkins-hbase4.apache.org,37711,1676055789944' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'foo' locally acquired 2023-02-10 19:03:12,042 DEBUG [member: 'jenkins-hbase4.apache.org,39215,1676055789974' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'foo' with timeout 300000ms 2023-02-10 19:03:12,042 DEBUG [member: 'jenkins-hbase4.apache.org,39215,1676055789974' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-10 19:03:12,042 DEBUG [member: 'jenkins-hbase4.apache.org,37711,1676055789944' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37711,1676055789944' joining acquired barrier for procedure (foo) in zk 2023-02-10 19:03:12,043 DEBUG [member: 'jenkins-hbase4.apache.org,39215,1676055789974' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'foo' starting 'acquire' stage 2023-02-10 19:03:12,043 DEBUG [member: 'jenkins-hbase4.apache.org,39215,1676055789974' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'foo' locally acquired 2023-02-10 19:03:12,043 DEBUG [member: 'jenkins-hbase4.apache.org,39215,1676055789974' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39215,1676055789974' joining acquired barrier for procedure (foo) in zk 2023-02-10 19:03:12,045 DEBUG [member: 'jenkins-hbase4.apache.org,37711,1676055789944' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/foo 2023-02-10 19:03:12,045 DEBUG [member: 'jenkins-hbase4.apache.org,39215,1676055789974' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/foo 2023-02-10 19:03:12,045 DEBUG [member: 'jenkins-hbase4.apache.org,37711,1676055789944' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37711-0x1003f9daaf10001, quorum=127.0.0.1:52327, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/foo 2023-02-10 19:03:12,045 DEBUG [member: 'jenkins-hbase4.apache.org,37711,1676055789944' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'foo' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-10 19:03:12,046 DEBUG [member: 'jenkins-hbase4.apache.org,39215,1676055789974' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39215-0x1003f9daaf10002, quorum=127.0.0.1:52327, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/foo 2023-02-10 19:03:12,046 DEBUG [member: 'jenkins-hbase4.apache.org,39215,1676055789974' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'foo' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-10 19:03:12,048 DEBUG [(jenkins-hbase4.apache.org,46421,1676055789889)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,37711,1676055789944 2023-02-10 19:03:12,048 DEBUG [(jenkins-hbase4.apache.org,46421,1676055789889)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46421-0x1003f9daaf10000, quorum=127.0.0.1:52327, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,37711,1676055789944 2023-02-10 19:03:12,048 DEBUG [(jenkins-hbase4.apache.org,46421,1676055789889)-proc-coordinator-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37711,1676055789944' joining acquired barrier for procedure 'foo' on coordinator 2023-02-10 19:03:12,048 DEBUG [(jenkins-hbase4.apache.org,46421,1676055789889)-proc-coordinator-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4626f00f[Count = 0] remaining members to acquire global barrier 2023-02-10 19:03:12,048 DEBUG [(jenkins-hbase4.apache.org,46421,1676055789889)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-10 19:03:12,048 DEBUG [(jenkins-hbase4.apache.org,46421,1676055789889)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'foo' starting 'in-barrier' execution. 2023-02-10 19:03:12,048 DEBUG [(jenkins-hbase4.apache.org,46421,1676055789889)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/foo 2023-02-10 19:03:12,050 DEBUG [Listener at localhost/45079-EventThread] zookeeper.ZKWatcher(600): regionserver:37711-0x1003f9daaf10001, quorum=127.0.0.1:52327, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/foo 2023-02-10 19:03:12,050 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/foo 2023-02-10 19:03:12,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/foo 2023-02-10 19:03:12,050 DEBUG [Listener at localhost/45079-EventThread] zookeeper.ZKWatcher(600): regionserver:39215-0x1003f9daaf10002, quorum=127.0.0.1:52327, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/foo 2023-02-10 19:03:12,050 DEBUG [member: 'jenkins-hbase4.apache.org,37711,1676055789944' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'foo' received 'reached' from coordinator. 2023-02-10 19:03:12,051 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/foo 2023-02-10 19:03:12,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/foo 2023-02-10 19:03:12,051 DEBUG [member: 'jenkins-hbase4.apache.org,39215,1676055789974' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'foo' received 'reached' from coordinator. 2023-02-10 19:03:12,051 DEBUG [member: 'jenkins-hbase4.apache.org,39215,1676055789974' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'foo' locally completed 2023-02-10 19:03:12,051 DEBUG [member: 'jenkins-hbase4.apache.org,39215,1676055789974' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'foo' completed for member 'jenkins-hbase4.apache.org,39215,1676055789974' in zk 2023-02-10 19:03:12,051 DEBUG [(jenkins-hbase4.apache.org,46421,1676055789889)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46421-0x1003f9daaf10000, quorum=127.0.0.1:52327, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,37711,1676055789944 2023-02-10 19:03:12,051 DEBUG [member: 'jenkins-hbase4.apache.org,37711,1676055789944' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-02-10 19:03:12,051 DEBUG [rs(jenkins-hbase4.apache.org,37711,1676055789944)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testInitTableSnapshotMapperJobConfig,,1676055791222.95f1e1dd88fe532437114fb5f675f5cc. 2023-02-10 19:03:12,051 DEBUG [member: 'jenkins-hbase4.apache.org,37711,1676055789944' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-10 19:03:12,051 DEBUG [rs(jenkins-hbase4.apache.org,37711,1676055789944)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testInitTableSnapshotMapperJobConfig,,1676055791222.95f1e1dd88fe532437114fb5f675f5cc. started... 2023-02-10 19:03:12,051 DEBUG [(jenkins-hbase4.apache.org,46421,1676055789889)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-10 19:03:12,052 INFO [rs(jenkins-hbase4.apache.org,37711,1676055789944)-snapshot-pool-0] regionserver.HRegion(2744): Flushing 95f1e1dd88fe532437114fb5f675f5cc 2/2 column families, dataSize=1.01 MB heapSize=3.49 MB 2023-02-10 19:03:12,053 DEBUG [member: 'jenkins-hbase4.apache.org,39215,1676055789974' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'foo' has notified controller of completion 2023-02-10 19:03:12,053 DEBUG [member: 'jenkins-hbase4.apache.org,39215,1676055789974' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-10 19:03:12,053 DEBUG [member: 'jenkins-hbase4.apache.org,39215,1676055789974' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'foo' completed. 2023-02-10 19:03:12,075 INFO [rs(jenkins-hbase4.apache.org,37711,1676055789944)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=514.92 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:33161/user/jenkins/test-data/6c75f688-f587-1f47-1e81-0b91f31623af/data/default/testInitTableSnapshotMapperJobConfig/95f1e1dd88fe532437114fb5f675f5cc/.tmp/f1/c97af859b46645c79b8a6c003fb18f3d 2023-02-10 19:03:12,093 INFO [rs(jenkins-hbase4.apache.org,37711,1676055789944)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=514.92 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:33161/user/jenkins/test-data/6c75f688-f587-1f47-1e81-0b91f31623af/data/default/testInitTableSnapshotMapperJobConfig/95f1e1dd88fe532437114fb5f675f5cc/.tmp/f2/49b5c95cca5d493d90b1c242d43a4160 2023-02-10 19:03:12,098 DEBUG [rs(jenkins-hbase4.apache.org,37711,1676055789944)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33161/user/jenkins/test-data/6c75f688-f587-1f47-1e81-0b91f31623af/data/default/testInitTableSnapshotMapperJobConfig/95f1e1dd88fe532437114fb5f675f5cc/.tmp/f1/c97af859b46645c79b8a6c003fb18f3d as hdfs://localhost:33161/user/jenkins/test-data/6c75f688-f587-1f47-1e81-0b91f31623af/data/default/testInitTableSnapshotMapperJobConfig/95f1e1dd88fe532437114fb5f675f5cc/f1/c97af859b46645c79b8a6c003fb18f3d 2023-02-10 19:03:12,102 INFO [rs(jenkins-hbase4.apache.org,37711,1676055789944)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33161/user/jenkins/test-data/6c75f688-f587-1f47-1e81-0b91f31623af/data/default/testInitTableSnapshotMapperJobConfig/95f1e1dd88fe532437114fb5f675f5cc/f1/c97af859b46645c79b8a6c003fb18f3d, entries=17576, sequenceid=5, filesize=537.3 K 2023-02-10 19:03:12,103 DEBUG [rs(jenkins-hbase4.apache.org,37711,1676055789944)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33161/user/jenkins/test-data/6c75f688-f587-1f47-1e81-0b91f31623af/data/default/testInitTableSnapshotMapperJobConfig/95f1e1dd88fe532437114fb5f675f5cc/.tmp/f2/49b5c95cca5d493d90b1c242d43a4160 as hdfs://localhost:33161/user/jenkins/test-data/6c75f688-f587-1f47-1e81-0b91f31623af/data/default/testInitTableSnapshotMapperJobConfig/95f1e1dd88fe532437114fb5f675f5cc/f2/49b5c95cca5d493d90b1c242d43a4160 2023-02-10 19:03:12,108 INFO [rs(jenkins-hbase4.apache.org,37711,1676055789944)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33161/user/jenkins/test-data/6c75f688-f587-1f47-1e81-0b91f31623af/data/default/testInitTableSnapshotMapperJobConfig/95f1e1dd88fe532437114fb5f675f5cc/f2/49b5c95cca5d493d90b1c242d43a4160, entries=17576, sequenceid=5, filesize=537.3 K 2023-02-10 19:03:12,109 INFO [rs(jenkins-hbase4.apache.org,37711,1676055789944)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~1.01 MB/1054560, heapSize ~3.49 MB/3656288, currentSize=0 B/0 for 95f1e1dd88fe532437114fb5f675f5cc in 57ms, sequenceid=5, compaction requested=false 2023-02-10 19:03:12,109 DEBUG [rs(jenkins-hbase4.apache.org,37711,1676055789944)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testInitTableSnapshotMapperJobConfig' 2023-02-10 19:03:12,110 DEBUG [rs(jenkins-hbase4.apache.org,37711,1676055789944)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 95f1e1dd88fe532437114fb5f675f5cc: 2023-02-10 19:03:12,111 DEBUG [rs(jenkins-hbase4.apache.org,37711,1676055789944)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testInitTableSnapshotMapperJobConfig,,1676055791222.95f1e1dd88fe532437114fb5f675f5cc.' region-info for snapshot=foo 2023-02-10 19:03:12,111 DEBUG [rs(jenkins-hbase4.apache.org,37711,1676055789944)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-10 19:03:12,111 DEBUG [rs(jenkins-hbase4.apache.org,37711,1676055789944)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33161/user/jenkins/test-data/6c75f688-f587-1f47-1e81-0b91f31623af/data/default/testInitTableSnapshotMapperJobConfig/95f1e1dd88fe532437114fb5f675f5cc/f1/c97af859b46645c79b8a6c003fb18f3d] hfiles 2023-02-10 19:03:12,111 DEBUG [rs(jenkins-hbase4.apache.org,37711,1676055789944)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:33161/user/jenkins/test-data/6c75f688-f587-1f47-1e81-0b91f31623af/data/default/testInitTableSnapshotMapperJobConfig/95f1e1dd88fe532437114fb5f675f5cc/f1/c97af859b46645c79b8a6c003fb18f3d for snapshot=foo 2023-02-10 19:03:12,111 DEBUG [rs(jenkins-hbase4.apache.org,37711,1676055789944)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33161/user/jenkins/test-data/6c75f688-f587-1f47-1e81-0b91f31623af/data/default/testInitTableSnapshotMapperJobConfig/95f1e1dd88fe532437114fb5f675f5cc/f2/49b5c95cca5d493d90b1c242d43a4160] hfiles 2023-02-10 19:03:12,111 DEBUG [rs(jenkins-hbase4.apache.org,37711,1676055789944)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:33161/user/jenkins/test-data/6c75f688-f587-1f47-1e81-0b91f31623af/data/default/testInitTableSnapshotMapperJobConfig/95f1e1dd88fe532437114fb5f675f5cc/f2/49b5c95cca5d493d90b1c242d43a4160 for snapshot=foo 2023-02-10 19:03:12,113 DEBUG [Listener at localhost/45079] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-10 19:03:12,115 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46421] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 } is done 2023-02-10 19:03:12,115 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46421] snapshot.SnapshotManager(404): Snapshoting '{ ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 }' is still in progress! 2023-02-10 19:03:12,115 DEBUG [Listener at localhost/45079] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-02-10 19:03:12,118 DEBUG [rs(jenkins-hbase4.apache.org,37711,1676055789944)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testInitTableSnapshotMapperJobConfig,,1676055791222.95f1e1dd88fe532437114fb5f675f5cc. completed. 2023-02-10 19:03:12,118 DEBUG [rs(jenkins-hbase4.apache.org,37711,1676055789944)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testInitTableSnapshotMapperJobConfig,,1676055791222.95f1e1dd88fe532437114fb5f675f5cc. 2023-02-10 19:03:12,118 DEBUG [member: 'jenkins-hbase4.apache.org,37711,1676055789944' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-02-10 19:03:12,118 DEBUG [member: 'jenkins-hbase4.apache.org,37711,1676055789944' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-02-10 19:03:12,118 DEBUG [member: 'jenkins-hbase4.apache.org,37711,1676055789944' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,37711,1676055789944 2023-02-10 19:03:12,118 DEBUG [member: 'jenkins-hbase4.apache.org,37711,1676055789944' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'foo' locally completed 2023-02-10 19:03:12,118 DEBUG [member: 'jenkins-hbase4.apache.org,37711,1676055789944' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'foo' completed for member 'jenkins-hbase4.apache.org,37711,1676055789944' in zk 2023-02-10 19:03:12,120 DEBUG [Listener at localhost/45079-EventThread] zookeeper.ZKWatcher(600): master:46421-0x1003f9daaf10000, quorum=127.0.0.1:52327, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,37711,1676055789944 2023-02-10 19:03:12,120 DEBUG [member: 'jenkins-hbase4.apache.org,37711,1676055789944' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'foo' has notified controller of completion 2023-02-10 19:03:12,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,37711,1676055789944 2023-02-10 19:03:12,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-10 19:03:12,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-10 19:03:12,120 DEBUG [member: 'jenkins-hbase4.apache.org,37711,1676055789944' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-10 19:03:12,120 DEBUG [member: 'jenkins-hbase4.apache.org,37711,1676055789944' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'foo' completed. 2023-02-10 19:03:12,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-10 19:03:12,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-10 19:03:12,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-10 19:03:12,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37711,1676055789944 2023-02-10 19:03:12,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39215,1676055789974 2023-02-10 19:03:12,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-10 19:03:12,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-10 19:03:12,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37711,1676055789944 2023-02-10 19:03:12,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39215,1676055789974 2023-02-10 19:03:12,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'foo' member 'jenkins-hbase4.apache.org,37711,1676055789944': 2023-02-10 19:03:12,124 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37711,1676055789944' released barrier for procedure'foo', counting down latch. Waiting for 0 more 2023-02-10 19:03:12,124 INFO [(jenkins-hbase4.apache.org,46421,1676055789889)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'foo' execution completed 2023-02-10 19:03:12,124 DEBUG [(jenkins-hbase4.apache.org,46421,1676055789889)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-10 19:03:12,124 DEBUG [(jenkins-hbase4.apache.org,46421,1676055789889)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-10 19:03:12,124 DEBUG [(jenkins-hbase4.apache.org,46421,1676055789889)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:foo 2023-02-10 19:03:12,124 INFO [(jenkins-hbase4.apache.org,46421,1676055789889)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure fooincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-02-10 19:03:12,126 DEBUG [Listener at localhost/45079-EventThread] zookeeper.ZKWatcher(600): regionserver:37711-0x1003f9daaf10001, quorum=127.0.0.1:52327, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/foo 2023-02-10 19:03:12,126 DEBUG [Listener at localhost/45079-EventThread] zookeeper.ZKWatcher(600): regionserver:39215-0x1003f9daaf10002, quorum=127.0.0.1:52327, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/foo 2023-02-10 19:03:12,126 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/foo 2023-02-10 19:03:12,126 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/foo 2023-02-10 19:03:12,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/foo 2023-02-10 19:03:12,126 DEBUG [Listener at localhost/45079-EventThread] zookeeper.ZKWatcher(600): regionserver:39215-0x1003f9daaf10002, quorum=127.0.0.1:52327, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-10 19:03:12,126 DEBUG [Listener at localhost/45079-EventThread] zookeeper.ZKWatcher(600): master:46421-0x1003f9daaf10000, quorum=127.0.0.1:52327, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/foo 2023-02-10 19:03:12,126 DEBUG [Listener at localhost/45079-EventThread] zookeeper.ZKWatcher(600): regionserver:37711-0x1003f9daaf10001, quorum=127.0.0.1:52327, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-10 19:03:12,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/foo 2023-02-10 19:03:12,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-10 19:03:12,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-10 19:03:12,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/foo 2023-02-10 19:03:12,127 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-10 19:03:12,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-10 19:03:12,127 DEBUG [(jenkins-hbase4.apache.org,46421,1676055789889)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46421-0x1003f9daaf10000, quorum=127.0.0.1:52327, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,37711,1676055789944 2023-02-10 19:03:12,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-10 19:03:12,127 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-10 19:03:12,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-10 19:03:12,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/foo 2023-02-10 19:03:12,127 DEBUG [(jenkins-hbase4.apache.org,46421,1676055789889)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46421-0x1003f9daaf10000, quorum=127.0.0.1:52327, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,39215,1676055789974 2023-02-10 19:03:12,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-10 19:03:12,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/foo 2023-02-10 19:03:12,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-10 19:03:12,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-10 19:03:12,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37711,1676055789944 2023-02-10 19:03:12,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39215,1676055789974 2023-02-10 19:03:12,129 DEBUG [(jenkins-hbase4.apache.org,46421,1676055789889)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46421-0x1003f9daaf10000, quorum=127.0.0.1:52327, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,37711,1676055789944 2023-02-10 19:03:12,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-10 19:03:12,129 DEBUG [(jenkins-hbase4.apache.org,46421,1676055789889)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46421-0x1003f9daaf10000, quorum=127.0.0.1:52327, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,39215,1676055789974 2023-02-10 19:03:12,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-10 19:03:12,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37711,1676055789944 2023-02-10 19:03:12,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39215,1676055789974 2023-02-10 19:03:12,135 DEBUG [Listener at localhost/45079-EventThread] zookeeper.ZKWatcher(600): master:46421-0x1003f9daaf10000, quorum=127.0.0.1:52327, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,39215,1676055789974 2023-02-10 19:03:12,135 DEBUG [Listener at localhost/45079-EventThread] zookeeper.ZKWatcher(600): regionserver:39215-0x1003f9daaf10002, quorum=127.0.0.1:52327, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-10 19:03:12,135 DEBUG [Listener at localhost/45079-EventThread] zookeeper.ZKWatcher(600): regionserver:37711-0x1003f9daaf10001, quorum=127.0.0.1:52327, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-10 19:03:12,135 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-10 19:03:12,135 DEBUG [Listener at localhost/45079-EventThread] zookeeper.ZKWatcher(600): master:46421-0x1003f9daaf10000, quorum=127.0.0.1:52327, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo 2023-02-10 19:03:12,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-10 19:03:12,135 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-10 19:03:12,135 DEBUG [(jenkins-hbase4.apache.org,46421,1676055789889)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-10 19:03:12,135 DEBUG [Listener at localhost/45079-EventThread] zookeeper.ZKWatcher(600): regionserver:37711-0x1003f9daaf10001, quorum=127.0.0.1:52327, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-10 19:03:12,135 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for foo 2023-02-10 19:03:12,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-10 19:03:12,135 DEBUG [Listener at localhost/45079-EventThread] zookeeper.ZKWatcher(600): regionserver:39215-0x1003f9daaf10002, quorum=127.0.0.1:52327, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-10 19:03:12,135 DEBUG [Listener at localhost/45079-EventThread] zookeeper.ZKWatcher(600): master:46421-0x1003f9daaf10000, quorum=127.0.0.1:52327, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,37711,1676055789944 2023-02-10 19:03:12,136 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-10 19:03:12,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-10 19:03:12,136 DEBUG [Listener at localhost/45079-EventThread] zookeeper.ZKWatcher(600): master:46421-0x1003f9daaf10000, quorum=127.0.0.1:52327, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo 2023-02-10 19:03:12,137 DEBUG [Listener at localhost/45079-EventThread] zookeeper.ZKWatcher(600): master:46421-0x1003f9daaf10000, quorum=127.0.0.1:52327, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,39215,1676055789974 2023-02-10 19:03:12,137 DEBUG [Listener at localhost/45079-EventThread] zookeeper.ZKWatcher(600): master:46421-0x1003f9daaf10000, quorum=127.0.0.1:52327, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/foo 2023-02-10 19:03:12,137 DEBUG [Listener at localhost/45079-EventThread] zookeeper.ZKWatcher(600): master:46421-0x1003f9daaf10000, quorum=127.0.0.1:52327, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,37711,1676055789944 2023-02-10 19:03:12,137 DEBUG [Listener at localhost/45079-EventThread] zookeeper.ZKWatcher(600): master:46421-0x1003f9daaf10000, quorum=127.0.0.1:52327, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/foo 2023-02-10 19:03:12,137 DEBUG [Listener at localhost/45079-EventThread] zookeeper.ZKWatcher(600): master:46421-0x1003f9daaf10000, quorum=127.0.0.1:52327, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/foo 2023-02-10 19:03:12,136 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for foo 2023-02-10 19:03:12,137 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-10 19:03:12,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-10 19:03:12,138 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:33161/user/jenkins/test-data/6c75f688-f587-1f47-1e81-0b91f31623af/.hbase-snapshot/.tmp/foo 2023-02-10 19:03:12,160 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:33161/user/jenkins/test-data/6c75f688-f587-1f47-1e81-0b91f31623af/.hbase-snapshot/.tmp/foo to hdfs://localhost:33161/user/jenkins/test-data/6c75f688-f587-1f47-1e81-0b91f31623af/.hbase-snapshot/foo 2023-02-10 19:03:12,180 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot foo of table testInitTableSnapshotMapperJobConfig completed 2023-02-10 19:03:12,180 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:33161/user/jenkins/test-data/6c75f688-f587-1f47-1e81-0b91f31623af/.hbase-snapshot/.tmp/foo 2023-02-10 19:03:12,181 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:33161/user/jenkins/test-data/6c75f688-f587-1f47-1e81-0b91f31623af/.hbase-snapshot/.tmp/foo 2023-02-10 19:03:12,181 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot foo C_M_SNAPSHOT_TABLE on table testInitTableSnapshotMapperJobConfig at 1676055792012Consolidate snapshot: foo at 1676055792136 (+124 ms)Loading Region manifests for foo at 1676055792137 (+1 ms)Writing data manifest for foo at 1676055792141 (+4 ms)Verifying snapshot: foo at 1676055792154 (+13 ms)Snapshot foo of table testInitTableSnapshotMapperJobConfig completed at 1676055792180 (+26 ms) 2023-02-10 19:03:12,182 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=14, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=SHARED 2023-02-10 19:03:12,184 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=14, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=SHARED in 169 msec 2023-02-10 19:03:12,315 DEBUG [Listener at localhost/45079] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-10 19:03:12,316 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46421] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 } is done 2023-02-10 19:03:12,316 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46421] snapshot.SnapshotManager(401): Snapshot '{ ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 }' has completed, notifying client. 2023-02-10 19:03:12,317 INFO [Listener at localhost/45079] snapshot.SnapshotTestingUtils(399): Confirming snapshot exists. 2023-02-10 19:03:12,321 INFO [Listener at localhost/45079] snapshot.SnapshotTestingUtils(406): validating snapshot. 2023-02-10 19:03:12,326 INFO [Listener at localhost/45079] mapreduce.TableSnapshotInputFormatTestBase(218): load different values 2023-02-10 19:03:12,373 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37711] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 17576 Client: jenkins//172.31.14.131 first region in multi=testInitTableSnapshotMapperJobConfig,,1676055791222.95f1e1dd88fe532437114fb5f675f5cc. 2023-02-10 19:03:12,469 INFO [Listener at localhost/45079] mapreduce.TableSnapshotInputFormatTestBase(222): cause flush to create new files in the region 2023-02-10 19:03:12,475 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46421] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-10 19:03:12,476 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46421] procedure.ProcedureCoordinator(165): Submitting procedure testInitTableSnapshotMapperJobConfig 2023-02-10 19:03:12,477 INFO [(jenkins-hbase4.apache.org,46421,1676055789889)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testInitTableSnapshotMapperJobConfig' 2023-02-10 19:03:12,477 DEBUG [(jenkins-hbase4.apache.org,46421,1676055789889)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-10 19:03:12,478 DEBUG [(jenkins-hbase4.apache.org,46421,1676055789889)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testInitTableSnapshotMapperJobConfig' starting 'acquire' 2023-02-10 19:03:12,478 DEBUG [(jenkins-hbase4.apache.org,46421,1676055789889)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testInitTableSnapshotMapperJobConfig', kicking off acquire phase on members. 2023-02-10 19:03:12,478 DEBUG [(jenkins-hbase4.apache.org,46421,1676055789889)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46421-0x1003f9daaf10000, quorum=127.0.0.1:52327, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-10 19:03:12,478 DEBUG [(jenkins-hbase4.apache.org,46421,1676055789889)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig 2023-02-10 19:03:12,480 DEBUG [Listener at localhost/45079-EventThread] zookeeper.ZKWatcher(600): regionserver:39215-0x1003f9daaf10002, quorum=127.0.0.1:52327, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-10 19:03:12,480 DEBUG [(jenkins-hbase4.apache.org,46421,1676055789889)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,37711,1676055789944 2023-02-10 19:03:12,480 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-10 19:03:12,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-10 19:03:12,480 DEBUG [Listener at localhost/45079-EventThread] zookeeper.ZKWatcher(600): regionserver:37711-0x1003f9daaf10001, quorum=127.0.0.1:52327, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-10 19:03:12,480 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-10 19:03:12,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-10 19:03:12,480 DEBUG [(jenkins-hbase4.apache.org,46421,1676055789889)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46421-0x1003f9daaf10000, quorum=127.0.0.1:52327, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,37711,1676055789944 2023-02-10 19:03:12,480 DEBUG [(jenkins-hbase4.apache.org,46421,1676055789889)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-10 19:03:12,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig 2023-02-10 19:03:12,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig 2023-02-10 19:03:12,483 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39215-0x1003f9daaf10002, quorum=127.0.0.1:52327, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-10 19:03:12,484 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37711-0x1003f9daaf10001, quorum=127.0.0.1:52327, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-10 19:03:12,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-10 19:03:12,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-10 19:03:12,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig 2023-02-10 19:03:12,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig 2023-02-10 19:03:12,484 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testInitTableSnapshotMapperJobConfig 2023-02-10 19:03:12,484 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testInitTableSnapshotMapperJobConfig 2023-02-10 19:03:12,484 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testInitTableSnapshotMapperJobConfig 2023-02-10 19:03:12,484 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testInitTableSnapshotMapperJobConfig 2023-02-10 19:03:12,485 DEBUG [member: 'jenkins-hbase4.apache.org,37711,1676055789944' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testInitTableSnapshotMapperJobConfig' with timeout 60000ms 2023-02-10 19:03:12,485 DEBUG [member: 'jenkins-hbase4.apache.org,37711,1676055789944' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-10 19:03:12,486 DEBUG [member: 'jenkins-hbase4.apache.org,37711,1676055789944' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testInitTableSnapshotMapperJobConfig' starting 'acquire' stage 2023-02-10 19:03:12,486 DEBUG [member: 'jenkins-hbase4.apache.org,39215,1676055789974' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testInitTableSnapshotMapperJobConfig' with timeout 60000ms 2023-02-10 19:03:12,486 DEBUG [member: 'jenkins-hbase4.apache.org,39215,1676055789974' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-10 19:03:12,486 DEBUG [member: 'jenkins-hbase4.apache.org,37711,1676055789944' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-10 19:03:12,486 DEBUG [member: 'jenkins-hbase4.apache.org,37711,1676055789944' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-10 19:03:12,486 DEBUG [rs(jenkins-hbase4.apache.org,37711,1676055789944)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testInitTableSnapshotMapperJobConfig,,1676055791222.95f1e1dd88fe532437114fb5f675f5cc. 2023-02-10 19:03:12,486 DEBUG [member: 'jenkins-hbase4.apache.org,39215,1676055789974' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testInitTableSnapshotMapperJobConfig' starting 'acquire' stage 2023-02-10 19:03:12,487 DEBUG [member: 'jenkins-hbase4.apache.org,39215,1676055789974' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testInitTableSnapshotMapperJobConfig' locally acquired 2023-02-10 19:03:12,486 DEBUG [rs(jenkins-hbase4.apache.org,37711,1676055789944)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testInitTableSnapshotMapperJobConfig,,1676055791222.95f1e1dd88fe532437114fb5f675f5cc. started... 2023-02-10 19:03:12,487 DEBUG [member: 'jenkins-hbase4.apache.org,39215,1676055789974' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39215,1676055789974' joining acquired barrier for procedure (testInitTableSnapshotMapperJobConfig) in zk 2023-02-10 19:03:12,487 INFO [rs(jenkins-hbase4.apache.org,37711,1676055789944)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 95f1e1dd88fe532437114fb5f675f5cc 2/2 column families, dataSize=1.58 MB heapSize=4.02 MB 2023-02-10 19:03:12,488 DEBUG [member: 'jenkins-hbase4.apache.org,39215,1676055789974' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-10 19:03:12,489 DEBUG [member: 'jenkins-hbase4.apache.org,39215,1676055789974' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39215-0x1003f9daaf10002, quorum=127.0.0.1:52327, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-10 19:03:12,489 DEBUG [member: 'jenkins-hbase4.apache.org,39215,1676055789974' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testInitTableSnapshotMapperJobConfig' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-10 19:03:12,507 INFO [rs(jenkins-hbase4.apache.org,37711,1676055789944)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=806.71 KB at sequenceid=9 (bloomFilter=false), to=hdfs://localhost:33161/user/jenkins/test-data/6c75f688-f587-1f47-1e81-0b91f31623af/data/default/testInitTableSnapshotMapperJobConfig/95f1e1dd88fe532437114fb5f675f5cc/.tmp/f1/30a39d39294743eebb91b2d9c3207fd5 2023-02-10 19:03:12,527 INFO [rs(jenkins-hbase4.apache.org,37711,1676055789944)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=806.71 KB at sequenceid=9 (bloomFilter=false), to=hdfs://localhost:33161/user/jenkins/test-data/6c75f688-f587-1f47-1e81-0b91f31623af/data/default/testInitTableSnapshotMapperJobConfig/95f1e1dd88fe532437114fb5f675f5cc/.tmp/f2/5ffc664be37c479f80f2b11396748d68 2023-02-10 19:03:12,531 DEBUG [rs(jenkins-hbase4.apache.org,37711,1676055789944)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33161/user/jenkins/test-data/6c75f688-f587-1f47-1e81-0b91f31623af/data/default/testInitTableSnapshotMapperJobConfig/95f1e1dd88fe532437114fb5f675f5cc/.tmp/f1/30a39d39294743eebb91b2d9c3207fd5 as hdfs://localhost:33161/user/jenkins/test-data/6c75f688-f587-1f47-1e81-0b91f31623af/data/default/testInitTableSnapshotMapperJobConfig/95f1e1dd88fe532437114fb5f675f5cc/f1/30a39d39294743eebb91b2d9c3207fd5 2023-02-10 19:03:12,535 INFO [rs(jenkins-hbase4.apache.org,37711,1676055789944)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33161/user/jenkins/test-data/6c75f688-f587-1f47-1e81-0b91f31623af/data/default/testInitTableSnapshotMapperJobConfig/95f1e1dd88fe532437114fb5f675f5cc/f1/30a39d39294743eebb91b2d9c3207fd5, entries=17576, sequenceid=9, filesize=829.4 K 2023-02-10 19:03:12,536 DEBUG [rs(jenkins-hbase4.apache.org,37711,1676055789944)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33161/user/jenkins/test-data/6c75f688-f587-1f47-1e81-0b91f31623af/data/default/testInitTableSnapshotMapperJobConfig/95f1e1dd88fe532437114fb5f675f5cc/.tmp/f2/5ffc664be37c479f80f2b11396748d68 as hdfs://localhost:33161/user/jenkins/test-data/6c75f688-f587-1f47-1e81-0b91f31623af/data/default/testInitTableSnapshotMapperJobConfig/95f1e1dd88fe532437114fb5f675f5cc/f2/5ffc664be37c479f80f2b11396748d68 2023-02-10 19:03:12,541 INFO [rs(jenkins-hbase4.apache.org,37711,1676055789944)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33161/user/jenkins/test-data/6c75f688-f587-1f47-1e81-0b91f31623af/data/default/testInitTableSnapshotMapperJobConfig/95f1e1dd88fe532437114fb5f675f5cc/f2/5ffc664be37c479f80f2b11396748d68, entries=17576, sequenceid=9, filesize=829.4 K 2023-02-10 19:03:12,542 INFO [rs(jenkins-hbase4.apache.org,37711,1676055789944)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~1.58 MB/1652144, heapSize ~4.02 MB/4218720, currentSize=0 B/0 for 95f1e1dd88fe532437114fb5f675f5cc in 55ms, sequenceid=9, compaction requested=false 2023-02-10 19:03:12,543 DEBUG [rs(jenkins-hbase4.apache.org,37711,1676055789944)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 95f1e1dd88fe532437114fb5f675f5cc: 2023-02-10 19:03:12,543 DEBUG [rs(jenkins-hbase4.apache.org,37711,1676055789944)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testInitTableSnapshotMapperJobConfig,,1676055791222.95f1e1dd88fe532437114fb5f675f5cc. 2023-02-10 19:03:12,543 DEBUG [member: 'jenkins-hbase4.apache.org,37711,1676055789944' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-10 19:03:12,543 DEBUG [member: 'jenkins-hbase4.apache.org,37711,1676055789944' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-10 19:03:12,543 DEBUG [member: 'jenkins-hbase4.apache.org,37711,1676055789944' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,37711,1676055789944 2023-02-10 19:03:12,543 DEBUG [member: 'jenkins-hbase4.apache.org,37711,1676055789944' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testInitTableSnapshotMapperJobConfig' locally acquired 2023-02-10 19:03:12,543 DEBUG [member: 'jenkins-hbase4.apache.org,37711,1676055789944' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37711,1676055789944' joining acquired barrier for procedure (testInitTableSnapshotMapperJobConfig) in zk 2023-02-10 19:03:12,545 DEBUG [member: 'jenkins-hbase4.apache.org,37711,1676055789944' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-10 19:03:12,545 DEBUG [Listener at localhost/45079-EventThread] zookeeper.ZKWatcher(600): master:46421-0x1003f9daaf10000, quorum=127.0.0.1:52327, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,37711,1676055789944 2023-02-10 19:03:12,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,37711,1676055789944 2023-02-10 19:03:12,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-10 19:03:12,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-10 19:03:12,546 DEBUG [member: 'jenkins-hbase4.apache.org,37711,1676055789944' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37711-0x1003f9daaf10001, quorum=127.0.0.1:52327, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-10 19:03:12,546 DEBUG [member: 'jenkins-hbase4.apache.org,37711,1676055789944' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testInitTableSnapshotMapperJobConfig' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-10 19:03:12,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-10 19:03:12,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-10 19:03:12,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testInitTableSnapshotMapperJobConfig 2023-02-10 19:03:12,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37711,1676055789944 2023-02-10 19:03:12,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39215,1676055789974 2023-02-10 19:03:12,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-10 19:03:12,548 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37711,1676055789944' joining acquired barrier for procedure 'testInitTableSnapshotMapperJobConfig' on coordinator 2023-02-10 19:03:12,548 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4dff7eaa[Count = 0] remaining members to acquire global barrier 2023-02-10 19:03:12,548 DEBUG [(jenkins-hbase4.apache.org,46421,1676055789889)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testInitTableSnapshotMapperJobConfig' starting 'in-barrier' execution. 2023-02-10 19:03:12,548 DEBUG [(jenkins-hbase4.apache.org,46421,1676055789889)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-10 19:03:12,549 DEBUG [Listener at localhost/45079-EventThread] zookeeper.ZKWatcher(600): regionserver:39215-0x1003f9daaf10002, quorum=127.0.0.1:52327, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-10 19:03:12,549 DEBUG [Listener at localhost/45079-EventThread] zookeeper.ZKWatcher(600): regionserver:37711-0x1003f9daaf10001, quorum=127.0.0.1:52327, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-10 19:03:12,549 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-10 19:03:12,549 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-10 19:03:12,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-10 19:03:12,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-10 19:03:12,549 DEBUG [member: 'jenkins-hbase4.apache.org,37711,1676055789944' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testInitTableSnapshotMapperJobConfig' received 'reached' from coordinator. 2023-02-10 19:03:12,549 DEBUG [member: 'jenkins-hbase4.apache.org,39215,1676055789974' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testInitTableSnapshotMapperJobConfig' received 'reached' from coordinator. 2023-02-10 19:03:12,549 DEBUG [member: 'jenkins-hbase4.apache.org,39215,1676055789974' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testInitTableSnapshotMapperJobConfig' locally completed 2023-02-10 19:03:12,549 DEBUG [(jenkins-hbase4.apache.org,46421,1676055789889)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46421-0x1003f9daaf10000, quorum=127.0.0.1:52327, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,37711,1676055789944 2023-02-10 19:03:12,549 DEBUG [(jenkins-hbase4.apache.org,46421,1676055789889)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-10 19:03:12,549 DEBUG [member: 'jenkins-hbase4.apache.org,37711,1676055789944' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testInitTableSnapshotMapperJobConfig' locally completed 2023-02-10 19:03:12,549 DEBUG [member: 'jenkins-hbase4.apache.org,39215,1676055789974' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testInitTableSnapshotMapperJobConfig' completed for member 'jenkins-hbase4.apache.org,39215,1676055789974' in zk 2023-02-10 19:03:12,549 DEBUG [member: 'jenkins-hbase4.apache.org,37711,1676055789944' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testInitTableSnapshotMapperJobConfig' completed for member 'jenkins-hbase4.apache.org,37711,1676055789944' in zk 2023-02-10 19:03:12,551 DEBUG [member: 'jenkins-hbase4.apache.org,39215,1676055789974' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testInitTableSnapshotMapperJobConfig' has notified controller of completion 2023-02-10 19:03:12,551 DEBUG [member: 'jenkins-hbase4.apache.org,39215,1676055789974' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-10 19:03:12,551 DEBUG [member: 'jenkins-hbase4.apache.org,39215,1676055789974' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testInitTableSnapshotMapperJobConfig' completed. 2023-02-10 19:03:12,552 DEBUG [member: 'jenkins-hbase4.apache.org,37711,1676055789944' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testInitTableSnapshotMapperJobConfig' has notified controller of completion 2023-02-10 19:03:12,552 DEBUG [Listener at localhost/45079-EventThread] zookeeper.ZKWatcher(600): master:46421-0x1003f9daaf10000, quorum=127.0.0.1:52327, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,37711,1676055789944 2023-02-10 19:03:12,552 DEBUG [member: 'jenkins-hbase4.apache.org,37711,1676055789944' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-10 19:03:12,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,37711,1676055789944 2023-02-10 19:03:12,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-10 19:03:12,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-10 19:03:12,552 DEBUG [member: 'jenkins-hbase4.apache.org,37711,1676055789944' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testInitTableSnapshotMapperJobConfig' completed. 2023-02-10 19:03:12,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-10 19:03:12,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-10 19:03:12,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testInitTableSnapshotMapperJobConfig 2023-02-10 19:03:12,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37711,1676055789944 2023-02-10 19:03:12,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39215,1676055789974 2023-02-10 19:03:12,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-10 19:03:12,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testInitTableSnapshotMapperJobConfig 2023-02-10 19:03:12,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37711,1676055789944 2023-02-10 19:03:12,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39215,1676055789974 2023-02-10 19:03:12,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testInitTableSnapshotMapperJobConfig' member 'jenkins-hbase4.apache.org,37711,1676055789944': 2023-02-10 19:03:12,555 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37711,1676055789944' released barrier for procedure'testInitTableSnapshotMapperJobConfig', counting down latch. Waiting for 0 more 2023-02-10 19:03:12,555 INFO [(jenkins-hbase4.apache.org,46421,1676055789889)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testInitTableSnapshotMapperJobConfig' execution completed 2023-02-10 19:03:12,556 DEBUG [(jenkins-hbase4.apache.org,46421,1676055789889)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-10 19:03:12,556 DEBUG [(jenkins-hbase4.apache.org,46421,1676055789889)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-10 19:03:12,556 DEBUG [(jenkins-hbase4.apache.org,46421,1676055789889)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testInitTableSnapshotMapperJobConfig 2023-02-10 19:03:12,556 INFO [(jenkins-hbase4.apache.org,46421,1676055789889)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testInitTableSnapshotMapperJobConfigincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-10 19:03:12,558 DEBUG [Listener at localhost/45079-EventThread] zookeeper.ZKWatcher(600): regionserver:37711-0x1003f9daaf10001, quorum=127.0.0.1:52327, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-10 19:03:12,558 DEBUG [Listener at localhost/45079-EventThread] zookeeper.ZKWatcher(600): master:46421-0x1003f9daaf10000, quorum=127.0.0.1:52327, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-10 19:03:12,558 DEBUG [Listener at localhost/45079-EventThread] zookeeper.ZKWatcher(600): regionserver:37711-0x1003f9daaf10001, quorum=127.0.0.1:52327, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-10 19:03:12,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-10 19:03:12,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-10 19:03:12,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-10 19:03:12,558 DEBUG [Listener at localhost/45079-EventThread] zookeeper.ZKWatcher(600): regionserver:39215-0x1003f9daaf10002, quorum=127.0.0.1:52327, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-10 19:03:12,558 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-10 19:03:12,558 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-10 19:03:12,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-10 19:03:12,558 DEBUG [Listener at localhost/45079-EventThread] zookeeper.ZKWatcher(600): regionserver:39215-0x1003f9daaf10002, quorum=127.0.0.1:52327, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-10 19:03:12,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-10 19:03:12,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-10 19:03:12,559 DEBUG [(jenkins-hbase4.apache.org,46421,1676055789889)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46421-0x1003f9daaf10000, quorum=127.0.0.1:52327, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,37711,1676055789944 2023-02-10 19:03:12,559 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-10 19:03:12,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-10 19:03:12,559 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-10 19:03:12,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-10 19:03:12,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testInitTableSnapshotMapperJobConfig 2023-02-10 19:03:12,559 DEBUG [(jenkins-hbase4.apache.org,46421,1676055789889)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46421-0x1003f9daaf10000, quorum=127.0.0.1:52327, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,39215,1676055789974 2023-02-10 19:03:12,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-10 19:03:12,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-10 19:03:12,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-10 19:03:12,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testInitTableSnapshotMapperJobConfig 2023-02-10 19:03:12,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37711,1676055789944 2023-02-10 19:03:12,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39215,1676055789974 2023-02-10 19:03:12,561 DEBUG [(jenkins-hbase4.apache.org,46421,1676055789889)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46421-0x1003f9daaf10000, quorum=127.0.0.1:52327, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,37711,1676055789944 2023-02-10 19:03:12,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-10 19:03:12,561 DEBUG [(jenkins-hbase4.apache.org,46421,1676055789889)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46421-0x1003f9daaf10000, quorum=127.0.0.1:52327, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,39215,1676055789974 2023-02-10 19:03:12,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testInitTableSnapshotMapperJobConfig 2023-02-10 19:03:12,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37711,1676055789944 2023-02-10 19:03:12,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39215,1676055789974 2023-02-10 19:03:12,563 DEBUG [Listener at localhost/45079-EventThread] zookeeper.ZKWatcher(600): regionserver:37711-0x1003f9daaf10001, quorum=127.0.0.1:52327, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-10 19:03:12,563 DEBUG [Listener at localhost/45079-EventThread] zookeeper.ZKWatcher(600): master:46421-0x1003f9daaf10000, quorum=127.0.0.1:52327, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,39215,1676055789974 2023-02-10 19:03:12,563 DEBUG [Listener at localhost/45079-EventThread] zookeeper.ZKWatcher(600): regionserver:37711-0x1003f9daaf10001, quorum=127.0.0.1:52327, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-10 19:03:12,563 DEBUG [Listener at localhost/45079-EventThread] zookeeper.ZKWatcher(600): master:46421-0x1003f9daaf10000, quorum=127.0.0.1:52327, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig 2023-02-10 19:03:12,563 DEBUG [(jenkins-hbase4.apache.org,46421,1676055789889)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-10 19:03:12,563 DEBUG [Listener at localhost/45079-EventThread] zookeeper.ZKWatcher(600): regionserver:39215-0x1003f9daaf10002, quorum=127.0.0.1:52327, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-10 19:03:12,563 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46421] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testInitTableSnapshotMapperJobConfig' 2023-02-10 19:03:12,564 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46421] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-10 19:03:12,563 DEBUG [Listener at localhost/45079-EventThread] zookeeper.ZKWatcher(600): master:46421-0x1003f9daaf10000, quorum=127.0.0.1:52327, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,37711,1676055789944 2023-02-10 19:03:12,563 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-10 19:03:12,564 DEBUG [Listener at localhost/45079-EventThread] zookeeper.ZKWatcher(600): master:46421-0x1003f9daaf10000, quorum=127.0.0.1:52327, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig 2023-02-10 19:03:12,564 DEBUG [Listener at localhost/45079-EventThread] zookeeper.ZKWatcher(600): regionserver:39215-0x1003f9daaf10002, quorum=127.0.0.1:52327, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-10 19:03:12,564 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-10 19:03:12,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-10 19:03:12,565 DEBUG [Listener at localhost/45079-EventThread] zookeeper.ZKWatcher(600): master:46421-0x1003f9daaf10000, quorum=127.0.0.1:52327, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,39215,1676055789974 2023-02-10 19:03:12,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-10 19:03:12,565 DEBUG [Listener at localhost/45079-EventThread] zookeeper.ZKWatcher(600): master:46421-0x1003f9daaf10000, quorum=127.0.0.1:52327, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-10 19:03:12,565 DEBUG [Listener at localhost/45079-EventThread] zookeeper.ZKWatcher(600): master:46421-0x1003f9daaf10000, quorum=127.0.0.1:52327, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,37711,1676055789944 2023-02-10 19:03:12,565 DEBUG [Listener at localhost/45079] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testInitTableSnapshotMapperJobConfig'' to complete. (max 20000 ms per retry) 2023-02-10 19:03:12,565 DEBUG [Listener at localhost/45079-EventThread] zookeeper.ZKWatcher(600): master:46421-0x1003f9daaf10000, quorum=127.0.0.1:52327, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-10 19:03:12,565 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-10 19:03:12,565 DEBUG [Listener at localhost/45079] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-10 19:03:12,565 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-10 19:03:12,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-10 19:03:12,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-10 19:03:12,565 DEBUG [Listener at localhost/45079-EventThread] zookeeper.ZKWatcher(600): master:46421-0x1003f9daaf10000, quorum=127.0.0.1:52327, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-10 19:03:12,665 DEBUG [Listener at localhost/45079] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-10 19:03:12,667 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46421] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-10 19:03:12,671 INFO [Listener at localhost/45079] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "foo" table: "testInitTableSnapshotMapperJobConfig" creation_time: 1676055791997 type: FLUSH version: 2 ttl: 0 2023-02-10 19:03:12,671 DEBUG [Listener at localhost/45079] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost:33161/user/jenkins/test-data/9cb1bb7f-01ef-8444-0230-c92db88a1e31/foo/b1f42037-0775-4a1a-8c77-920199be7db2/data/default/testInitTableSnapshotMapperJobConfig 2023-02-10 19:03:12,672 INFO [Listener at localhost/45079] snapshot.RestoreSnapshotHelper(239): region to add: 95f1e1dd88fe532437114fb5f675f5cc 2023-02-10 19:03:12,672 INFO [Listener at localhost/45079] snapshot.RestoreSnapshotHelper(585): clone region=95f1e1dd88fe532437114fb5f675f5cc as 95f1e1dd88fe532437114fb5f675f5cc in snapshot foo 2023-02-10 19:03:12,673 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(7671): creating {ENCODED => 95f1e1dd88fe532437114fb5f675f5cc, NAME => 'testInitTableSnapshotMapperJobConfig,,1676055791222.95f1e1dd88fe532437114fb5f675f5cc.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testInitTableSnapshotMapperJobConfig', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33161/user/jenkins/test-data/9cb1bb7f-01ef-8444-0230-c92db88a1e31/foo/b1f42037-0775-4a1a-8c77-920199be7db2 2023-02-10 19:03:12,686 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(865): Instantiated testInitTableSnapshotMapperJobConfig,,1676055791222.95f1e1dd88fe532437114fb5f675f5cc.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-10 19:03:12,686 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink c97af859b46645c79b8a6c003fb18f3d from cloned region in snapshot foo to table=testInitTableSnapshotMapperJobConfig 2023-02-10 19:03:12,688 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 49b5c95cca5d493d90b1c242d43a4160 from cloned region in snapshot foo to table=testInitTableSnapshotMapperJobConfig 2023-02-10 19:03:12,690 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1603): Closing 95f1e1dd88fe532437114fb5f675f5cc, disabling compactions & flushes 2023-02-10 19:03:12,690 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1625): Closing region testInitTableSnapshotMapperJobConfig,,1676055791222.95f1e1dd88fe532437114fb5f675f5cc. 2023-02-10 19:03:12,690 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testInitTableSnapshotMapperJobConfig,,1676055791222.95f1e1dd88fe532437114fb5f675f5cc. 2023-02-10 19:03:12,690 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1713): Acquired close lock on testInitTableSnapshotMapperJobConfig,,1676055791222.95f1e1dd88fe532437114fb5f675f5cc. after waiting 0 ms 2023-02-10 19:03:12,690 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1723): Updates disabled for region testInitTableSnapshotMapperJobConfig,,1676055791222.95f1e1dd88fe532437114fb5f675f5cc. 2023-02-10 19:03:12,690 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1837): Closed testInitTableSnapshotMapperJobConfig,,1676055791222.95f1e1dd88fe532437114fb5f675f5cc. 2023-02-10 19:03:12,690 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1557): Region close journal for 95f1e1dd88fe532437114fb5f675f5cc: Waiting for close lock at 1676055792690Disabling compacts and flushes for region at 1676055792690Disabling writes for close at 1676055792690Writing region close event to WAL at 1676055792690Closed at 1676055792690 2023-02-10 19:03:12,690 INFO [Listener at localhost/45079] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "foo" table: "testInitTableSnapshotMapperJobConfig" creation_time: 1676055791997 type: FLUSH version: 2 ttl: 0 2023-02-10 19:03:12,691 DEBUG [Listener at localhost/45079] snapshot.RestoreSnapshotHelper(832): Restored table dir:hdfs://localhost:33161/user/jenkins/test-data/9cb1bb7f-01ef-8444-0230-c92db88a1e31/foo/b1f42037-0775-4a1a-8c77-920199be7db2 2023-02-10 19:03:12,691 DEBUG [Listener at localhost/45079] util.CommonFSUtils(682): File system contents for path hdfs://localhost:33161/user/jenkins/test-data/9cb1bb7f-01ef-8444-0230-c92db88a1e31/foo/b1f42037-0775-4a1a-8c77-920199be7db2 2023-02-10 19:03:12,691 DEBUG [Listener at localhost/45079] util.CommonFSUtils(699): |-data/ 2023-02-10 19:03:12,692 DEBUG [Listener at localhost/45079] util.CommonFSUtils(699): |----default/ 2023-02-10 19:03:12,692 DEBUG [Listener at localhost/45079] util.CommonFSUtils(699): |-------testInitTableSnapshotMapperJobConfig/ 2023-02-10 19:03:12,692 DEBUG [Listener at localhost/45079] util.CommonFSUtils(699): |----------95f1e1dd88fe532437114fb5f675f5cc/ 2023-02-10 19:03:12,693 DEBUG [Listener at localhost/45079] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-10 19:03:12,693 DEBUG [Listener at localhost/45079] util.CommonFSUtils(699): |-------------f1/ 2023-02-10 19:03:12,693 DEBUG [Listener at localhost/45079] util.CommonFSUtils(702): |----------------testInitTableSnapshotMapperJobConfig=95f1e1dd88fe532437114fb5f675f5cc-c97af859b46645c79b8a6c003fb18f3d 2023-02-10 19:03:12,693 DEBUG [Listener at localhost/45079] util.CommonFSUtils(699): |-------------f2/ 2023-02-10 19:03:12,694 DEBUG [Listener at localhost/45079] util.CommonFSUtils(702): |----------------testInitTableSnapshotMapperJobConfig=95f1e1dd88fe532437114fb5f675f5cc-49b5c95cca5d493d90b1c242d43a4160 2023-02-10 19:03:12,695 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46421] master.MasterRpcServices(748): Client=jenkins//172.31.14.131 delete name: "foo" 2023-02-10 19:03:12,697 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46421] snapshot.SnapshotManager(333): Deleting snapshot: foo 2023-02-10 19:03:12,698 INFO [Listener at localhost/45079] client.HBaseAdmin$15(890): Started disable of testInitTableSnapshotMapperJobConfig 2023-02-10 19:03:12,698 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46421] master.HMaster$11(2405): Client=jenkins//172.31.14.131 disable testInitTableSnapshotMapperJobConfig 2023-02-10 19:03:12,699 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46421] procedure2.ProcedureExecutor(1029): Stored pid=15, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testInitTableSnapshotMapperJobConfig 2023-02-10 19:03:12,702 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testInitTableSnapshotMapperJobConfig","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676055792702"}]},"ts":"1676055792702"} 2023-02-10 19:03:12,702 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46421] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-10 19:03:12,703 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testInitTableSnapshotMapperJobConfig, state=DISABLING in hbase:meta 2023-02-10 19:03:12,705 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testInitTableSnapshotMapperJobConfig to state=DISABLING 2023-02-10 19:03:12,706 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testInitTableSnapshotMapperJobConfig, region=95f1e1dd88fe532437114fb5f675f5cc, UNASSIGN}] 2023-02-10 19:03:12,707 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testInitTableSnapshotMapperJobConfig, region=95f1e1dd88fe532437114fb5f675f5cc, UNASSIGN 2023-02-10 19:03:12,708 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=95f1e1dd88fe532437114fb5f675f5cc, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,37711,1676055789944 2023-02-10 19:03:12,708 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testInitTableSnapshotMapperJobConfig,,1676055791222.95f1e1dd88fe532437114fb5f675f5cc.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1676055792708"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676055792708"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676055792708"}]},"ts":"1676055792708"} 2023-02-10 19:03:12,710 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=17, ppid=16, state=RUNNABLE; CloseRegionProcedure 95f1e1dd88fe532437114fb5f675f5cc, server=jenkins-hbase4.apache.org,37711,1676055789944}] 2023-02-10 19:03:12,804 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46421] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-10 19:03:12,862 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 95f1e1dd88fe532437114fb5f675f5cc 2023-02-10 19:03:12,862 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 95f1e1dd88fe532437114fb5f675f5cc, disabling compactions & flushes 2023-02-10 19:03:12,862 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testInitTableSnapshotMapperJobConfig,,1676055791222.95f1e1dd88fe532437114fb5f675f5cc. 2023-02-10 19:03:12,862 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testInitTableSnapshotMapperJobConfig,,1676055791222.95f1e1dd88fe532437114fb5f675f5cc. 2023-02-10 19:03:12,862 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testInitTableSnapshotMapperJobConfig,,1676055791222.95f1e1dd88fe532437114fb5f675f5cc. after waiting 0 ms 2023-02-10 19:03:12,862 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testInitTableSnapshotMapperJobConfig,,1676055791222.95f1e1dd88fe532437114fb5f675f5cc. 2023-02-10 19:03:12,866 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33161/user/jenkins/test-data/6c75f688-f587-1f47-1e81-0b91f31623af/data/default/testInitTableSnapshotMapperJobConfig/95f1e1dd88fe532437114fb5f675f5cc/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-10 19:03:12,867 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testInitTableSnapshotMapperJobConfig,,1676055791222.95f1e1dd88fe532437114fb5f675f5cc. 2023-02-10 19:03:12,867 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 95f1e1dd88fe532437114fb5f675f5cc: Waiting for close lock at 1676055792862Running coprocessor pre-close hooks at 1676055792862Disabling compacts and flushes for region at 1676055792862Disabling writes for close at 1676055792862Writing region close event to WAL at 1676055792863 (+1 ms)Running coprocessor post-close hooks at 1676055792867 (+4 ms)Closed at 1676055792867 2023-02-10 19:03:12,868 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 95f1e1dd88fe532437114fb5f675f5cc 2023-02-10 19:03:12,869 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=95f1e1dd88fe532437114fb5f675f5cc, regionState=CLOSED 2023-02-10 19:03:12,869 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testInitTableSnapshotMapperJobConfig,,1676055791222.95f1e1dd88fe532437114fb5f675f5cc.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1676055792869"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676055792869"}]},"ts":"1676055792869"} 2023-02-10 19:03:12,871 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=17, resume processing ppid=16 2023-02-10 19:03:12,871 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=16, state=SUCCESS; CloseRegionProcedure 95f1e1dd88fe532437114fb5f675f5cc, server=jenkins-hbase4.apache.org,37711,1676055789944 in 160 msec 2023-02-10 19:03:12,873 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=16, resume processing ppid=15 2023-02-10 19:03:12,873 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=15, state=SUCCESS; TransitRegionStateProcedure table=testInitTableSnapshotMapperJobConfig, region=95f1e1dd88fe532437114fb5f675f5cc, UNASSIGN in 165 msec 2023-02-10 19:03:12,873 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testInitTableSnapshotMapperJobConfig","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676055792873"}]},"ts":"1676055792873"} 2023-02-10 19:03:12,874 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testInitTableSnapshotMapperJobConfig, state=DISABLED in hbase:meta 2023-02-10 19:03:12,876 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testInitTableSnapshotMapperJobConfig to state=DISABLED 2023-02-10 19:03:12,877 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=15, state=SUCCESS; DisableTableProcedure table=testInitTableSnapshotMapperJobConfig in 178 msec 2023-02-10 19:03:13,005 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46421] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-10 19:03:13,006 INFO [Listener at localhost/45079] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testInitTableSnapshotMapperJobConfig, procId: 15 completed 2023-02-10 19:03:13,007 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46421] master.HMaster$5(2215): Client=jenkins//172.31.14.131 delete testInitTableSnapshotMapperJobConfig 2023-02-10 19:03:13,008 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46421] procedure2.ProcedureExecutor(1029): Stored pid=18, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testInitTableSnapshotMapperJobConfig 2023-02-10 19:03:13,009 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=18, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testInitTableSnapshotMapperJobConfig 2023-02-10 19:03:13,010 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=18, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testInitTableSnapshotMapperJobConfig 2023-02-10 19:03:13,010 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46421] master.MasterRpcServices(1227): Checking to see if procedure is done pid=18 2023-02-10 19:03:13,013 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33161/user/jenkins/test-data/6c75f688-f587-1f47-1e81-0b91f31623af/.tmp/data/default/testInitTableSnapshotMapperJobConfig/95f1e1dd88fe532437114fb5f675f5cc 2023-02-10 19:03:13,015 DEBUG [HFileArchiver-3] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33161/user/jenkins/test-data/6c75f688-f587-1f47-1e81-0b91f31623af/.tmp/data/default/testInitTableSnapshotMapperJobConfig/95f1e1dd88fe532437114fb5f675f5cc/f1, FileablePath, hdfs://localhost:33161/user/jenkins/test-data/6c75f688-f587-1f47-1e81-0b91f31623af/.tmp/data/default/testInitTableSnapshotMapperJobConfig/95f1e1dd88fe532437114fb5f675f5cc/f2, FileablePath, hdfs://localhost:33161/user/jenkins/test-data/6c75f688-f587-1f47-1e81-0b91f31623af/.tmp/data/default/testInitTableSnapshotMapperJobConfig/95f1e1dd88fe532437114fb5f675f5cc/recovered.edits] 2023-02-10 19:03:13,018 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33161/user/jenkins/test-data/6c75f688-f587-1f47-1e81-0b91f31623af/.tmp/data/default/testInitTableSnapshotMapperJobConfig/95f1e1dd88fe532437114fb5f675f5cc/f1/30a39d39294743eebb91b2d9c3207fd5 to hdfs://localhost:33161/user/jenkins/test-data/6c75f688-f587-1f47-1e81-0b91f31623af/archive/data/default/testInitTableSnapshotMapperJobConfig/95f1e1dd88fe532437114fb5f675f5cc/f1/30a39d39294743eebb91b2d9c3207fd5 2023-02-10 19:03:13,019 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33161/user/jenkins/test-data/6c75f688-f587-1f47-1e81-0b91f31623af/.tmp/data/default/testInitTableSnapshotMapperJobConfig/95f1e1dd88fe532437114fb5f675f5cc/f1/c97af859b46645c79b8a6c003fb18f3d to hdfs://localhost:33161/user/jenkins/test-data/6c75f688-f587-1f47-1e81-0b91f31623af/archive/data/default/testInitTableSnapshotMapperJobConfig/95f1e1dd88fe532437114fb5f675f5cc/f1/c97af859b46645c79b8a6c003fb18f3d 2023-02-10 19:03:13,022 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33161/user/jenkins/test-data/6c75f688-f587-1f47-1e81-0b91f31623af/.tmp/data/default/testInitTableSnapshotMapperJobConfig/95f1e1dd88fe532437114fb5f675f5cc/f2/49b5c95cca5d493d90b1c242d43a4160 to hdfs://localhost:33161/user/jenkins/test-data/6c75f688-f587-1f47-1e81-0b91f31623af/archive/data/default/testInitTableSnapshotMapperJobConfig/95f1e1dd88fe532437114fb5f675f5cc/f2/49b5c95cca5d493d90b1c242d43a4160 2023-02-10 19:03:13,023 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33161/user/jenkins/test-data/6c75f688-f587-1f47-1e81-0b91f31623af/.tmp/data/default/testInitTableSnapshotMapperJobConfig/95f1e1dd88fe532437114fb5f675f5cc/f2/5ffc664be37c479f80f2b11396748d68 to hdfs://localhost:33161/user/jenkins/test-data/6c75f688-f587-1f47-1e81-0b91f31623af/archive/data/default/testInitTableSnapshotMapperJobConfig/95f1e1dd88fe532437114fb5f675f5cc/f2/5ffc664be37c479f80f2b11396748d68 2023-02-10 19:03:13,025 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33161/user/jenkins/test-data/6c75f688-f587-1f47-1e81-0b91f31623af/.tmp/data/default/testInitTableSnapshotMapperJobConfig/95f1e1dd88fe532437114fb5f675f5cc/recovered.edits/12.seqid to hdfs://localhost:33161/user/jenkins/test-data/6c75f688-f587-1f47-1e81-0b91f31623af/archive/data/default/testInitTableSnapshotMapperJobConfig/95f1e1dd88fe532437114fb5f675f5cc/recovered.edits/12.seqid 2023-02-10 19:03:13,026 DEBUG [HFileArchiver-3] backup.HFileArchiver(596): Deleted hdfs://localhost:33161/user/jenkins/test-data/6c75f688-f587-1f47-1e81-0b91f31623af/.tmp/data/default/testInitTableSnapshotMapperJobConfig/95f1e1dd88fe532437114fb5f675f5cc 2023-02-10 19:03:13,026 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testInitTableSnapshotMapperJobConfig regions 2023-02-10 19:03:13,028 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=18, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testInitTableSnapshotMapperJobConfig 2023-02-10 19:03:13,030 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testInitTableSnapshotMapperJobConfig from hbase:meta 2023-02-10 19:03:13,032 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testInitTableSnapshotMapperJobConfig' descriptor. 2023-02-10 19:03:13,033 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=18, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testInitTableSnapshotMapperJobConfig 2023-02-10 19:03:13,033 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testInitTableSnapshotMapperJobConfig' from region states. 2023-02-10 19:03:13,033 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testInitTableSnapshotMapperJobConfig,,1676055791222.95f1e1dd88fe532437114fb5f675f5cc.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676055793033"}]},"ts":"9223372036854775807"} 2023-02-10 19:03:13,034 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-02-10 19:03:13,034 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 95f1e1dd88fe532437114fb5f675f5cc, NAME => 'testInitTableSnapshotMapperJobConfig,,1676055791222.95f1e1dd88fe532437114fb5f675f5cc.', STARTKEY => '', ENDKEY => ''}] 2023-02-10 19:03:13,034 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testInitTableSnapshotMapperJobConfig' as deleted. 2023-02-10 19:03:13,034 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testInitTableSnapshotMapperJobConfig","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1676055793034"}]},"ts":"9223372036854775807"} 2023-02-10 19:03:13,038 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testInitTableSnapshotMapperJobConfig state from META 2023-02-10 19:03:13,041 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=18, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testInitTableSnapshotMapperJobConfig 2023-02-10 19:03:13,042 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=18, state=SUCCESS; DeleteTableProcedure table=testInitTableSnapshotMapperJobConfig in 34 msec 2023-02-10 19:03:13,112 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46421] master.MasterRpcServices(1227): Checking to see if procedure is done pid=18 2023-02-10 19:03:13,112 INFO [Listener at localhost/45079] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testInitTableSnapshotMapperJobConfig, procId: 18 completed 2023-02-10 19:03:13,112 INFO [Listener at localhost/45079] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-02-10 19:03:13,112 INFO [Listener at localhost/45079] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-10 19:03:13,113 DEBUG [Listener at localhost/45079] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5f67a438 to 127.0.0.1:52327 2023-02-10 19:03:13,113 DEBUG [Listener at localhost/45079] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-10 19:03:13,113 DEBUG [Listener at localhost/45079] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-02-10 19:03:13,113 DEBUG [Listener at localhost/45079] util.JVMClusterUtil(257): Found active master hash=1606893182, stopped=false 2023-02-10 19:03:13,113 INFO [Listener at localhost/45079] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,46421,1676055789889 2023-02-10 19:03:13,115 DEBUG [Listener at localhost/45079-EventThread] zookeeper.ZKWatcher(600): regionserver:37711-0x1003f9daaf10001, quorum=127.0.0.1:52327, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-10 19:03:13,115 DEBUG [Listener at localhost/45079-EventThread] zookeeper.ZKWatcher(600): master:46421-0x1003f9daaf10000, quorum=127.0.0.1:52327, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-10 19:03:13,115 INFO [Listener at localhost/45079] procedure2.ProcedureExecutor(629): Stopping 2023-02-10 19:03:13,115 DEBUG [Listener at localhost/45079-EventThread] zookeeper.ZKWatcher(600): master:46421-0x1003f9daaf10000, quorum=127.0.0.1:52327, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-10 19:03:13,115 DEBUG [Listener at localhost/45079-EventThread] zookeeper.ZKWatcher(600): regionserver:39215-0x1003f9daaf10002, quorum=127.0.0.1:52327, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-10 19:03:13,117 DEBUG [Listener at localhost/45079] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3313bcff to 127.0.0.1:52327 2023-02-10 19:03:13,117 DEBUG [Listener at localhost/45079] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-10 19:03:13,117 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37711-0x1003f9daaf10001, quorum=127.0.0.1:52327, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-10 19:03:13,117 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39215-0x1003f9daaf10002, quorum=127.0.0.1:52327, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-10 19:03:13,117 INFO [Listener at localhost/45079] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,37711,1676055789944' ***** 2023-02-10 19:03:13,117 INFO [Listener at localhost/45079] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-10 19:03:13,117 INFO [Listener at localhost/45079] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,39215,1676055789974' ***** 2023-02-10 19:03:13,117 INFO [Listener at localhost/45079] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-10 19:03:13,117 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:46421-0x1003f9daaf10000, quorum=127.0.0.1:52327, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-10 19:03:13,117 INFO [RS:1;jenkins-hbase4:39215] regionserver.HeapMemoryManager(220): Stopping 2023-02-10 19:03:13,118 INFO [RS:0;jenkins-hbase4:37711] regionserver.HeapMemoryManager(220): Stopping 2023-02-10 19:03:13,118 INFO [RS:1;jenkins-hbase4:39215] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-10 19:03:13,118 INFO [RS:0;jenkins-hbase4:37711] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-10 19:03:13,119 INFO [RS:0;jenkins-hbase4:37711] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-10 19:03:13,119 INFO [RS:0;jenkins-hbase4:37711] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,37711,1676055789944 2023-02-10 19:03:13,118 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-10 19:03:13,119 DEBUG [RS:0;jenkins-hbase4:37711] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x11033117 to 127.0.0.1:52327 2023-02-10 19:03:13,120 DEBUG [RS:0;jenkins-hbase4:37711] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-10 19:03:13,118 INFO [RS:1;jenkins-hbase4:39215] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-10 19:03:13,118 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-10 19:03:13,120 INFO [RS:1;jenkins-hbase4:39215] regionserver.HRegionServer(3304): Received CLOSE for 54460a74d8b5e3fb664f5f761fa75e69 2023-02-10 19:03:13,120 INFO [RS:0;jenkins-hbase4:37711] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,37711,1676055789944; all regions closed. 2023-02-10 19:03:13,121 INFO [RS:1;jenkins-hbase4:39215] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,39215,1676055789974 2023-02-10 19:03:13,121 DEBUG [RS:1;jenkins-hbase4:39215] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x55b4ddde to 127.0.0.1:52327 2023-02-10 19:03:13,122 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 54460a74d8b5e3fb664f5f761fa75e69, disabling compactions & flushes 2023-02-10 19:03:13,122 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676055790604.54460a74d8b5e3fb664f5f761fa75e69. 2023-02-10 19:03:13,122 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676055790604.54460a74d8b5e3fb664f5f761fa75e69. 2023-02-10 19:03:13,122 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676055790604.54460a74d8b5e3fb664f5f761fa75e69. after waiting 0 ms 2023-02-10 19:03:13,122 DEBUG [RS:1;jenkins-hbase4:39215] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-10 19:03:13,122 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676055790604.54460a74d8b5e3fb664f5f761fa75e69. 2023-02-10 19:03:13,122 INFO [RS:1;jenkins-hbase4:39215] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-10 19:03:13,122 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 54460a74d8b5e3fb664f5f761fa75e69 1/1 column families, dataSize=78 B heapSize=488 B 2023-02-10 19:03:13,122 INFO [RS:1;jenkins-hbase4:39215] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-10 19:03:13,122 INFO [RS:1;jenkins-hbase4:39215] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-10 19:03:13,122 INFO [RS:1;jenkins-hbase4:39215] regionserver.HRegionServer(3304): Received CLOSE for 1588230740 2023-02-10 19:03:13,124 INFO [RS:1;jenkins-hbase4:39215] regionserver.HRegionServer(1475): Waiting on 2 regions to close 2023-02-10 19:03:13,124 DEBUG [RS:1;jenkins-hbase4:39215] regionserver.HRegionServer(1479): Online Regions={54460a74d8b5e3fb664f5f761fa75e69=hbase:namespace,,1676055790604.54460a74d8b5e3fb664f5f761fa75e69., 1588230740=hbase:meta,,1.1588230740} 2023-02-10 19:03:13,128 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-10 19:03:13,128 DEBUG [RS:1;jenkins-hbase4:39215] regionserver.HRegionServer(1505): Waiting on 1588230740, 54460a74d8b5e3fb664f5f761fa75e69 2023-02-10 19:03:13,128 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-10 19:03:13,129 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-10 19:03:13,129 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-10 19:03:13,129 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-10 19:03:13,130 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 1588230740 3/3 column families, dataSize=4.24 KB heapSize=7.64 KB 2023-02-10 19:03:13,139 DEBUG [RS:0;jenkins-hbase4:37711] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/6c75f688-f587-1f47-1e81-0b91f31623af/oldWALs 2023-02-10 19:03:13,139 INFO [RS:0;jenkins-hbase4:37711] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C37711%2C1676055789944:(num 1676055791285) 2023-02-10 19:03:13,139 DEBUG [RS:0;jenkins-hbase4:37711] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-10 19:03:13,139 INFO [RS:0;jenkins-hbase4:37711] regionserver.LeaseManager(133): Closed leases 2023-02-10 19:03:13,141 INFO [RS:0;jenkins-hbase4:37711] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-02-10 19:03:13,141 INFO [RS:0;jenkins-hbase4:37711] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-10 19:03:13,141 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-10 19:03:13,141 INFO [RS:0;jenkins-hbase4:37711] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-10 19:03:13,141 INFO [RS:0;jenkins-hbase4:37711] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-10 19:03:13,142 INFO [RS:0;jenkins-hbase4:37711] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:37711 2023-02-10 19:03:13,143 DEBUG [Listener at localhost/45079-EventThread] zookeeper.ZKWatcher(600): regionserver:39215-0x1003f9daaf10002, quorum=127.0.0.1:52327, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,37711,1676055789944 2023-02-10 19:03:13,143 DEBUG [Listener at localhost/45079-EventThread] zookeeper.ZKWatcher(600): master:46421-0x1003f9daaf10000, quorum=127.0.0.1:52327, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-10 19:03:13,143 DEBUG [Listener at localhost/45079-EventThread] zookeeper.ZKWatcher(600): regionserver:37711-0x1003f9daaf10001, quorum=127.0.0.1:52327, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,37711,1676055789944 2023-02-10 19:03:13,143 DEBUG [Listener at localhost/45079-EventThread] zookeeper.ZKWatcher(600): regionserver:39215-0x1003f9daaf10002, quorum=127.0.0.1:52327, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-10 19:03:13,144 ERROR [Listener at localhost/45079-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@58045c90 rejected from java.util.concurrent.ThreadPoolExecutor@5c3bc348[Shutting down, pool size = 1, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-10 19:03:13,144 DEBUG [Listener at localhost/45079-EventThread] zookeeper.ZKWatcher(600): regionserver:37711-0x1003f9daaf10001, quorum=127.0.0.1:52327, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-10 19:03:13,144 ERROR [Listener at localhost/45079-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@52f0afdc rejected from java.util.concurrent.ThreadPoolExecutor@5c3bc348[Shutting down, pool size = 1, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-10 19:03:13,145 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,37711,1676055789944] 2023-02-10 19:03:13,145 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,37711,1676055789944; numProcessing=1 2023-02-10 19:03:13,147 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,37711,1676055789944 already deleted, retry=false 2023-02-10 19:03:13,147 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,37711,1676055789944 expired; onlineServers=1 2023-02-10 19:03:13,148 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:33161/user/jenkins/test-data/6c75f688-f587-1f47-1e81-0b91f31623af/data/hbase/namespace/54460a74d8b5e3fb664f5f761fa75e69/.tmp/info/fb705650de6445608767df99b497eb94 2023-02-10 19:03:13,154 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33161/user/jenkins/test-data/6c75f688-f587-1f47-1e81-0b91f31623af/data/hbase/namespace/54460a74d8b5e3fb664f5f761fa75e69/.tmp/info/fb705650de6445608767df99b497eb94 as hdfs://localhost:33161/user/jenkins/test-data/6c75f688-f587-1f47-1e81-0b91f31623af/data/hbase/namespace/54460a74d8b5e3fb664f5f761fa75e69/info/fb705650de6445608767df99b497eb94 2023-02-10 19:03:13,159 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-10 19:03:13,162 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:33161/user/jenkins/test-data/6c75f688-f587-1f47-1e81-0b91f31623af/data/hbase/namespace/54460a74d8b5e3fb664f5f761fa75e69/info/fb705650de6445608767df99b497eb94, entries=2, sequenceid=6, filesize=4.8 K 2023-02-10 19:03:13,163 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 54460a74d8b5e3fb664f5f761fa75e69 in 41ms, sequenceid=6, compaction requested=false 2023-02-10 19:03:13,165 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-10 19:03:13,167 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33161/user/jenkins/test-data/6c75f688-f587-1f47-1e81-0b91f31623af/data/hbase/namespace/54460a74d8b5e3fb664f5f761fa75e69/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-02-10 19:03:13,167 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676055790604.54460a74d8b5e3fb664f5f761fa75e69. 2023-02-10 19:03:13,167 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 54460a74d8b5e3fb664f5f761fa75e69: Waiting for close lock at 1676055793121Running coprocessor pre-close hooks at 1676055793121Disabling compacts and flushes for region at 1676055793121Disabling writes for close at 1676055793122 (+1 ms)Obtaining lock to block concurrent updates at 1676055793122Preparing flush snapshotting stores in 54460a74d8b5e3fb664f5f761fa75e69 at 1676055793122Finished memstore snapshotting hbase:namespace,,1676055790604.54460a74d8b5e3fb664f5f761fa75e69., syncing WAL and waiting on mvcc, flushsize=dataSize=78, getHeapSize=472, getOffHeapSize=0, getCellsCount=2 at 1676055793122Flushing stores of hbase:namespace,,1676055790604.54460a74d8b5e3fb664f5f761fa75e69. at 1676055793124 (+2 ms)Flushing 54460a74d8b5e3fb664f5f761fa75e69/info: creating writer at 1676055793124Flushing 54460a74d8b5e3fb664f5f761fa75e69/info: appending metadata at 1676055793136 (+12 ms)Flushing 54460a74d8b5e3fb664f5f761fa75e69/info: closing flushed file at 1676055793136Flushing 54460a74d8b5e3fb664f5f761fa75e69/info: reopening flushed file at 1676055793154 (+18 ms)Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 54460a74d8b5e3fb664f5f761fa75e69 in 41ms, sequenceid=6, compaction requested=false at 1676055793163 (+9 ms)Writing region close event to WAL at 1676055793163Running coprocessor post-close hooks at 1676055793167 (+4 ms)Closed at 1676055793167 2023-02-10 19:03:13,167 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1676055790604.54460a74d8b5e3fb664f5f761fa75e69. 2023-02-10 19:03:13,314 DEBUG [Listener at localhost/45079-EventThread] zookeeper.ZKWatcher(600): regionserver:37711-0x1003f9daaf10001, quorum=127.0.0.1:52327, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-10 19:03:13,314 INFO [RS:0;jenkins-hbase4:37711] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,37711,1676055789944; zookeeper connection closed. 2023-02-10 19:03:13,315 ERROR [Listener at localhost/45079-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@2ac92e18 rejected from java.util.concurrent.ThreadPoolExecutor@5c3bc348[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-10 19:03:13,315 DEBUG [Listener at localhost/45079-EventThread] zookeeper.ZKWatcher(600): regionserver:37711-0x1003f9daaf10001, quorum=127.0.0.1:52327, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-10 19:03:13,315 ERROR [Listener at localhost/45079-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@2ecf6755 rejected from java.util.concurrent.ThreadPoolExecutor@5c3bc348[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-10 19:03:13,315 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@5a73ed0b] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@5a73ed0b 2023-02-10 19:03:13,324 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-02-10 19:03:13,324 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-02-10 19:03:13,329 DEBUG [RS:1;jenkins-hbase4:39215] regionserver.HRegionServer(1505): Waiting on 1588230740 2023-02-10 19:03:13,529 DEBUG [RS:1;jenkins-hbase4:39215] regionserver.HRegionServer(1505): Waiting on 1588230740 2023-02-10 19:03:13,558 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.60 KB at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:33161/user/jenkins/test-data/6c75f688-f587-1f47-1e81-0b91f31623af/data/hbase/meta/1588230740/.tmp/info/8eb62d808c0945a0b14eff08c4e1c4ed 2023-02-10 19:03:13,564 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 8eb62d808c0945a0b14eff08c4e1c4ed 2023-02-10 19:03:13,574 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=116 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:33161/user/jenkins/test-data/6c75f688-f587-1f47-1e81-0b91f31623af/data/hbase/meta/1588230740/.tmp/rep_barrier/3bc3196b7a974d288dba3a17aa83353c 2023-02-10 19:03:13,579 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 3bc3196b7a974d288dba3a17aa83353c 2023-02-10 19:03:13,588 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=542 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:33161/user/jenkins/test-data/6c75f688-f587-1f47-1e81-0b91f31623af/data/hbase/meta/1588230740/.tmp/table/eccce08691944e0389e40f44fc7c7876 2023-02-10 19:03:13,593 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for eccce08691944e0389e40f44fc7c7876 2023-02-10 19:03:13,593 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33161/user/jenkins/test-data/6c75f688-f587-1f47-1e81-0b91f31623af/data/hbase/meta/1588230740/.tmp/info/8eb62d808c0945a0b14eff08c4e1c4ed as hdfs://localhost:33161/user/jenkins/test-data/6c75f688-f587-1f47-1e81-0b91f31623af/data/hbase/meta/1588230740/info/8eb62d808c0945a0b14eff08c4e1c4ed 2023-02-10 19:03:13,598 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 8eb62d808c0945a0b14eff08c4e1c4ed 2023-02-10 19:03:13,599 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:33161/user/jenkins/test-data/6c75f688-f587-1f47-1e81-0b91f31623af/data/hbase/meta/1588230740/info/8eb62d808c0945a0b14eff08c4e1c4ed, entries=12, sequenceid=21, filesize=6.3 K 2023-02-10 19:03:13,600 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33161/user/jenkins/test-data/6c75f688-f587-1f47-1e81-0b91f31623af/data/hbase/meta/1588230740/.tmp/rep_barrier/3bc3196b7a974d288dba3a17aa83353c as hdfs://localhost:33161/user/jenkins/test-data/6c75f688-f587-1f47-1e81-0b91f31623af/data/hbase/meta/1588230740/rep_barrier/3bc3196b7a974d288dba3a17aa83353c 2023-02-10 19:03:13,605 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 3bc3196b7a974d288dba3a17aa83353c 2023-02-10 19:03:13,605 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:33161/user/jenkins/test-data/6c75f688-f587-1f47-1e81-0b91f31623af/data/hbase/meta/1588230740/rep_barrier/3bc3196b7a974d288dba3a17aa83353c, entries=1, sequenceid=21, filesize=5.0 K 2023-02-10 19:03:13,606 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33161/user/jenkins/test-data/6c75f688-f587-1f47-1e81-0b91f31623af/data/hbase/meta/1588230740/.tmp/table/eccce08691944e0389e40f44fc7c7876 as hdfs://localhost:33161/user/jenkins/test-data/6c75f688-f587-1f47-1e81-0b91f31623af/data/hbase/meta/1588230740/table/eccce08691944e0389e40f44fc7c7876 2023-02-10 19:03:13,610 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for eccce08691944e0389e40f44fc7c7876 2023-02-10 19:03:13,610 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:33161/user/jenkins/test-data/6c75f688-f587-1f47-1e81-0b91f31623af/data/hbase/meta/1588230740/table/eccce08691944e0389e40f44fc7c7876, entries=4, sequenceid=21, filesize=5.1 K 2023-02-10 19:03:13,611 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~4.24 KB/4340, heapSize ~7.59 KB/7776, currentSize=0 B/0 for 1588230740 in 482ms, sequenceid=21, compaction requested=false 2023-02-10 19:03:13,614 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33161/user/jenkins/test-data/6c75f688-f587-1f47-1e81-0b91f31623af/data/hbase/meta/1588230740/recovered.edits/24.seqid, newMaxSeqId=24, maxSeqId=1 2023-02-10 19:03:13,615 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-10 19:03:13,615 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-10 19:03:13,615 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1676055793124Running coprocessor pre-close hooks at 1676055793124Disabling compacts and flushes for region at 1676055793124Disabling writes for close at 1676055793129 (+5 ms)Obtaining lock to block concurrent updates at 1676055793130 (+1 ms)Preparing flush snapshotting stores in 1588230740 at 1676055793130Finished memstore snapshotting hbase:meta,,1.1588230740, syncing WAL and waiting on mvcc, flushsize=dataSize=4340, getHeapSize=7776, getOffHeapSize=0, getCellsCount=36 at 1676055793131 (+1 ms)Flushing stores of hbase:meta,,1.1588230740 at 1676055793132 (+1 ms)Flushing 1588230740/info: creating writer at 1676055793132Flushing 1588230740/info: appending metadata at 1676055793137 (+5 ms)Flushing 1588230740/info: closing flushed file at 1676055793137Flushing 1588230740/rep_barrier: creating writer at 1676055793564 (+427 ms)Flushing 1588230740/rep_barrier: appending metadata at 1676055793566 (+2 ms)Flushing 1588230740/rep_barrier: closing flushed file at 1676055793566Flushing 1588230740/table: creating writer at 1676055793579 (+13 ms)Flushing 1588230740/table: appending metadata at 1676055793582 (+3 ms)Flushing 1588230740/table: closing flushed file at 1676055793582Flushing 1588230740/info: reopening flushed file at 1676055793594 (+12 ms)Flushing 1588230740/rep_barrier: reopening flushed file at 1676055793600 (+6 ms)Flushing 1588230740/table: reopening flushed file at 1676055793606 (+6 ms)Finished flush of dataSize ~4.24 KB/4340, heapSize ~7.59 KB/7776, currentSize=0 B/0 for 1588230740 in 482ms, sequenceid=21, compaction requested=false at 1676055793611 (+5 ms)Writing region close event to WAL at 1676055793612 (+1 ms)Running coprocessor post-close hooks at 1676055793615 (+3 ms)Closed at 1676055793615 2023-02-10 19:03:13,615 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-02-10 19:03:13,729 INFO [RS:1;jenkins-hbase4:39215] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,39215,1676055789974; all regions closed. 2023-02-10 19:03:13,735 DEBUG [RS:1;jenkins-hbase4:39215] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/6c75f688-f587-1f47-1e81-0b91f31623af/oldWALs 2023-02-10 19:03:13,735 INFO [RS:1;jenkins-hbase4:39215] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C39215%2C1676055789974.meta:.meta(num 1676055790543) 2023-02-10 19:03:13,739 DEBUG [RS:1;jenkins-hbase4:39215] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/6c75f688-f587-1f47-1e81-0b91f31623af/oldWALs 2023-02-10 19:03:13,739 INFO [RS:1;jenkins-hbase4:39215] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C39215%2C1676055789974:(num 1676055790991) 2023-02-10 19:03:13,739 DEBUG [RS:1;jenkins-hbase4:39215] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-10 19:03:13,739 INFO [RS:1;jenkins-hbase4:39215] regionserver.LeaseManager(133): Closed leases 2023-02-10 19:03:13,740 INFO [RS:1;jenkins-hbase4:39215] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-02-10 19:03:13,740 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-10 19:03:13,740 INFO [RS:1;jenkins-hbase4:39215] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:39215 2023-02-10 19:03:13,742 DEBUG [Listener at localhost/45079-EventThread] zookeeper.ZKWatcher(600): master:46421-0x1003f9daaf10000, quorum=127.0.0.1:52327, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-10 19:03:13,742 DEBUG [Listener at localhost/45079-EventThread] zookeeper.ZKWatcher(600): regionserver:39215-0x1003f9daaf10002, quorum=127.0.0.1:52327, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,39215,1676055789974 2023-02-10 19:03:13,742 ERROR [Listener at localhost/45079-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@65fef09e rejected from java.util.concurrent.ThreadPoolExecutor@61c168f9[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-10 19:03:13,744 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,39215,1676055789974] 2023-02-10 19:03:13,744 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,39215,1676055789974; numProcessing=2 2023-02-10 19:03:13,745 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,39215,1676055789974 already deleted, retry=false 2023-02-10 19:03:13,745 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,39215,1676055789974 expired; onlineServers=0 2023-02-10 19:03:13,745 INFO [RegionServerTracker-0] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,46421,1676055789889' ***** 2023-02-10 19:03:13,745 INFO [RegionServerTracker-0] regionserver.HRegionServer(2310): STOPPED: Cluster shutdown set; onlineServer=0 2023-02-10 19:03:13,746 DEBUG [M:0;jenkins-hbase4:46421] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5bf8b15e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-10 19:03:13,746 INFO [M:0;jenkins-hbase4:46421] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,46421,1676055789889 2023-02-10 19:03:13,746 INFO [M:0;jenkins-hbase4:46421] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,46421,1676055789889; all regions closed. 2023-02-10 19:03:13,746 DEBUG [M:0;jenkins-hbase4:46421] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-10 19:03:13,746 DEBUG [M:0;jenkins-hbase4:46421] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-02-10 19:03:13,746 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-02-10 19:03:13,746 DEBUG [M:0;jenkins-hbase4:46421] cleaner.HFileCleaner(317): Stopping file delete threads 2023-02-10 19:03:13,746 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676055790180] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676055790180,5,FailOnTimeoutGroup] 2023-02-10 19:03:13,746 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676055790180] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676055790180,5,FailOnTimeoutGroup] 2023-02-10 19:03:13,746 INFO [M:0;jenkins-hbase4:46421] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-02-10 19:03:13,748 INFO [M:0;jenkins-hbase4:46421] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-02-10 19:03:13,748 INFO [M:0;jenkins-hbase4:46421] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-02-10 19:03:13,748 DEBUG [M:0;jenkins-hbase4:46421] master.HMaster(1502): Stopping service threads 2023-02-10 19:03:13,748 INFO [M:0;jenkins-hbase4:46421] procedure2.RemoteProcedureDispatcher(118): Stopping procedure remote dispatcher 2023-02-10 19:03:13,748 ERROR [M:0;jenkins-hbase4:46421] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-02-10 19:03:13,748 INFO [M:0;jenkins-hbase4:46421] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-02-10 19:03:13,749 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-02-10 19:03:13,750 DEBUG [Listener at localhost/45079-EventThread] zookeeper.ZKWatcher(600): master:46421-0x1003f9daaf10000, quorum=127.0.0.1:52327, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-02-10 19:03:13,750 DEBUG [Listener at localhost/45079-EventThread] zookeeper.ZKWatcher(600): master:46421-0x1003f9daaf10000, quorum=127.0.0.1:52327, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-10 19:03:13,750 DEBUG [M:0;jenkins-hbase4:46421] zookeeper.ZKUtil(398): master:46421-0x1003f9daaf10000, quorum=127.0.0.1:52327, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-02-10 19:03:13,750 WARN [M:0;jenkins-hbase4:46421] master.ActiveMasterManager(323): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-02-10 19:03:13,750 INFO [M:0;jenkins-hbase4:46421] assignment.AssignmentManager(315): Stopping assignment manager 2023-02-10 19:03:13,750 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:46421-0x1003f9daaf10000, quorum=127.0.0.1:52327, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-10 19:03:13,750 INFO [M:0;jenkins-hbase4:46421] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-02-10 19:03:13,751 DEBUG [M:0;jenkins-hbase4:46421] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-10 19:03:13,751 INFO [M:0;jenkins-hbase4:46421] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-10 19:03:13,751 DEBUG [M:0;jenkins-hbase4:46421] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-10 19:03:13,751 DEBUG [M:0;jenkins-hbase4:46421] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-10 19:03:13,751 DEBUG [M:0;jenkins-hbase4:46421] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-10 19:03:13,751 INFO [M:0;jenkins-hbase4:46421] regionserver.HRegion(2744): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=55.89 KB heapSize=66.83 KB 2023-02-10 19:03:13,760 INFO [M:0;jenkins-hbase4:46421] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=55.89 KB at sequenceid=132 (bloomFilter=true), to=hdfs://localhost:33161/user/jenkins/test-data/6c75f688-f587-1f47-1e81-0b91f31623af/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/c15ac9bc2051442f82ea63c3ffb26f32 2023-02-10 19:03:13,765 DEBUG [M:0;jenkins-hbase4:46421] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33161/user/jenkins/test-data/6c75f688-f587-1f47-1e81-0b91f31623af/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/c15ac9bc2051442f82ea63c3ffb26f32 as hdfs://localhost:33161/user/jenkins/test-data/6c75f688-f587-1f47-1e81-0b91f31623af/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/c15ac9bc2051442f82ea63c3ffb26f32 2023-02-10 19:03:13,769 INFO [M:0;jenkins-hbase4:46421] regionserver.HStore(1080): Added hdfs://localhost:33161/user/jenkins/test-data/6c75f688-f587-1f47-1e81-0b91f31623af/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/c15ac9bc2051442f82ea63c3ffb26f32, entries=17, sequenceid=132, filesize=8.7 K 2023-02-10 19:03:13,770 INFO [M:0;jenkins-hbase4:46421] regionserver.HRegion(2947): Finished flush of dataSize ~55.89 KB/57229, heapSize ~66.81 KB/68416, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 19ms, sequenceid=132, compaction requested=false 2023-02-10 19:03:13,770 INFO [M:0;jenkins-hbase4:46421] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-10 19:03:13,770 DEBUG [M:0;jenkins-hbase4:46421] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1676055793751Disabling compacts and flushes for region at 1676055793751Disabling writes for close at 1676055793751Obtaining lock to block concurrent updates at 1676055793751Preparing flush snapshotting stores in 1595e783b53d99cd5eef43b6debb2682 at 1676055793751Finished memstore snapshotting master:store,,1.1595e783b53d99cd5eef43b6debb2682., syncing WAL and waiting on mvcc, flushsize=dataSize=57229, getHeapSize=68416, getOffHeapSize=0, getCellsCount=145 at 1676055793751Flushing stores of master:store,,1.1595e783b53d99cd5eef43b6debb2682. at 1676055793752 (+1 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: creating writer at 1676055793752Flushing 1595e783b53d99cd5eef43b6debb2682/proc: appending metadata at 1676055793755 (+3 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: closing flushed file at 1676055793755Flushing 1595e783b53d99cd5eef43b6debb2682/proc: reopening flushed file at 1676055793766 (+11 ms)Finished flush of dataSize ~55.89 KB/57229, heapSize ~66.81 KB/68416, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 19ms, sequenceid=132, compaction requested=false at 1676055793770 (+4 ms)Writing region close event to WAL at 1676055793770Closed at 1676055793770 2023-02-10 19:03:13,773 INFO [M:0;jenkins-hbase4:46421] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-02-10 19:03:13,773 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-10 19:03:13,773 INFO [M:0;jenkins-hbase4:46421] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:46421 2023-02-10 19:03:13,775 DEBUG [M:0;jenkins-hbase4:46421] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,46421,1676055789889 already deleted, retry=false 2023-02-10 19:03:13,819 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(152): Removing adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-10 19:03:13,844 DEBUG [Listener at localhost/45079-EventThread] zookeeper.ZKWatcher(600): regionserver:39215-0x1003f9daaf10002, quorum=127.0.0.1:52327, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-10 19:03:13,844 INFO [RS:1;jenkins-hbase4:39215] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,39215,1676055789974; zookeeper connection closed. 2023-02-10 19:03:13,845 ERROR [Listener at localhost/45079-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@74580ff rejected from java.util.concurrent.ThreadPoolExecutor@61c168f9[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-10 19:03:13,845 DEBUG [Listener at localhost/45079-EventThread] zookeeper.ZKWatcher(600): regionserver:39215-0x1003f9daaf10002, quorum=127.0.0.1:52327, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-10 19:03:13,845 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@293d683c] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@293d683c 2023-02-10 19:03:13,845 ERROR [Listener at localhost/45079-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@7f41de75 rejected from java.util.concurrent.ThreadPoolExecutor@61c168f9[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-10 19:03:13,845 INFO [Listener at localhost/45079] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 2 regionserver(s) complete 2023-02-10 19:03:13,945 DEBUG [Listener at localhost/45079-EventThread] zookeeper.ZKWatcher(600): master:46421-0x1003f9daaf10000, quorum=127.0.0.1:52327, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-10 19:03:13,945 INFO [M:0;jenkins-hbase4:46421] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,46421,1676055789889; zookeeper connection closed. 2023-02-10 19:03:13,945 ERROR [Listener at localhost/45079-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@13be2252 rejected from java.util.concurrent.ThreadPoolExecutor@1781b4fd[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 50] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-10 19:03:13,946 DEBUG [Listener at localhost/45079-EventThread] zookeeper.ZKWatcher(600): master:46421-0x1003f9daaf10000, quorum=127.0.0.1:52327, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-10 19:03:13,946 ERROR [Listener at localhost/45079-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@1d50003 rejected from java.util.concurrent.ThreadPoolExecutor@1781b4fd[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 50] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-10 19:03:13,946 WARN [Listener at localhost/45079] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-10 19:03:13,950 INFO [Listener at localhost/45079] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-10 19:03:14,054 WARN [BP-327675525-172.31.14.131-1676055788978 heartbeating to localhost/127.0.0.1:33161] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-10 19:03:14,055 WARN [BP-327675525-172.31.14.131-1676055788978 heartbeating to localhost/127.0.0.1:33161] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-327675525-172.31.14.131-1676055788978 (Datanode Uuid 4f55802e-a8a6-4645-8a5b-fff778355560) service to localhost/127.0.0.1:33161 2023-02-10 19:03:14,055 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3bb8cb07-c3f3-574d-cc77-c22264857571/cluster_e6b355cb-f938-a09e-4337-e00c222fe318/dfs/data/data3/current/BP-327675525-172.31.14.131-1676055788978] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-10 19:03:14,055 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3bb8cb07-c3f3-574d-cc77-c22264857571/cluster_e6b355cb-f938-a09e-4337-e00c222fe318/dfs/data/data4/current/BP-327675525-172.31.14.131-1676055788978] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-10 19:03:14,057 WARN [Listener at localhost/45079] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-10 19:03:14,060 INFO [Listener at localhost/45079] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-10 19:03:14,166 WARN [BP-327675525-172.31.14.131-1676055788978 heartbeating to localhost/127.0.0.1:33161] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-10 19:03:14,166 WARN [BP-327675525-172.31.14.131-1676055788978 heartbeating to localhost/127.0.0.1:33161] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-327675525-172.31.14.131-1676055788978 (Datanode Uuid 02736bdf-6fa0-49e5-a732-415ab3a895a1) service to localhost/127.0.0.1:33161 2023-02-10 19:03:14,166 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3bb8cb07-c3f3-574d-cc77-c22264857571/cluster_e6b355cb-f938-a09e-4337-e00c222fe318/dfs/data/data1/current/BP-327675525-172.31.14.131-1676055788978] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-10 19:03:14,166 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3bb8cb07-c3f3-574d-cc77-c22264857571/cluster_e6b355cb-f938-a09e-4337-e00c222fe318/dfs/data/data2/current/BP-327675525-172.31.14.131-1676055788978] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-10 19:03:14,176 INFO [Listener at localhost/45079] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-10 19:03:14,309 INFO [Listener at localhost/45079] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-02-10 19:03:14,341 INFO [Listener at localhost/45079] hbase.HBaseTestingUtility(1293): Minicluster is down 2023-02-10 19:03:14,354 INFO [Listener at localhost/45079] hbase.ResourceChecker(175): after: mapred.TestTableSnapshotInputFormat#testInitTableSnapshotMapperJobConfig Thread=178 (was 152) Potentially hanging thread: nioEventLoopGroup-10-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-12-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-12-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-13-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-9 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-10-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-9-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-11-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/45079 java.lang.Thread.dumpThreads(Native Method) java.lang.Thread.getAllStackTraces(Thread.java:1615) org.apache.hadoop.hbase.ResourceCheckerJUnitListener$ThreadResourceAnalyzer.getVal(ResourceCheckerJUnitListener.java:49) org.apache.hadoop.hbase.ResourceChecker.fill(ResourceChecker.java:110) org.apache.hadoop.hbase.ResourceChecker.fillEndings(ResourceChecker.java:104) org.apache.hadoop.hbase.ResourceChecker.end(ResourceChecker.java:206) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.end(ResourceCheckerJUnitListener.java:165) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.testFinished(ResourceCheckerJUnitListener.java:185) org.junit.runner.notification.SynchronizedRunListener.testFinished(SynchronizedRunListener.java:87) org.junit.runner.notification.RunNotifier$9.notifyListener(RunNotifier.java:225) org.junit.runner.notification.RunNotifier$SafeNotifier.run(RunNotifier.java:72) org.junit.runner.notification.RunNotifier.fireTestFinished(RunNotifier.java:222) org.junit.internal.runners.model.EachTestNotifier.fireTestFinished(EachTestNotifier.java:38) org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:372) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) org.apache.hadoop.hbase.SystemExitRule$1.evaluate(SystemExitRule.java:39) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1688088802) connection to localhost/127.0.0.1:33161 from jenkins.hfs.4 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS-EventLoopGroup-9-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-11-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1688088802) connection to localhost/127.0.0.1:33161 from jenkins.hfs.5 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-7 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-11-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1688088802) connection to localhost/127.0.0.1:33161 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS-EventLoopGroup-10-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-13-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-10-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-12-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1688088802) connection to localhost/127.0.0.1:33161 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: (jenkins-hbase4.apache.org,46421,1676055789889)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-11-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-8 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-10-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.5@localhost:33161 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-9-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-11-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-13-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-10-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ForkJoinPool-2-worker-7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.ForkJoinPool.awaitWork(ForkJoinPool.java:1824) java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1693) java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175) Potentially hanging thread: LeaseRenewer:jenkins@localhost:33161 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-11-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.4@localhost:33161 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=567 (was 534) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=371 (was 394), ProcessCount=167 (was 167), AvailableMemoryMB=3484 (was 3536) 2023-02-10 19:03:14,365 INFO [Listener at localhost/45079] hbase.ResourceChecker(147): before: mapred.TestTableSnapshotInputFormat#testWithMockedMapReduceMultiRegion Thread=177, OpenFileDescriptor=567, MaxFileDescriptor=60000, SystemLoadAverage=371, ProcessCount=167, AvailableMemoryMB=3484 2023-02-10 19:03:14,380 INFO [Listener at localhost/45079] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.log.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3bb8cb07-c3f3-574d-cc77-c22264857571/hadoop.log.dir so I do NOT create it in target/test-data/757a71d1-7690-509e-0487-fb796263e86c 2023-02-10 19:03:14,380 WARN [Listener at localhost/45079] hbase.HBaseTestingUtility(449): hadoop.log.dir property value differs in configuration and system: Configuration=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/../logs while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3bb8cb07-c3f3-574d-cc77-c22264857571/hadoop.log.dir Erasing configuration value by system value. 2023-02-10 19:03:14,380 INFO [Listener at localhost/45079] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.tmp.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3bb8cb07-c3f3-574d-cc77-c22264857571/hadoop.tmp.dir so I do NOT create it in target/test-data/757a71d1-7690-509e-0487-fb796263e86c 2023-02-10 19:03:14,381 WARN [Listener at localhost/45079] hbase.HBaseTestingUtility(449): hadoop.tmp.dir property value differs in configuration and system: Configuration=/tmp/hadoop-jenkins while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3bb8cb07-c3f3-574d-cc77-c22264857571/hadoop.tmp.dir Erasing configuration value by system value. 2023-02-10 19:03:14,381 DEBUG [Listener at localhost/45079] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/757a71d1-7690-509e-0487-fb796263e86c 2023-02-10 19:03:14,381 INFO [Listener at localhost/45079] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=2, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=true, createWALDir=false} 2023-02-10 19:03:14,381 INFO [Listener at localhost/45079] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/757a71d1-7690-509e-0487-fb796263e86c/cluster_58a94646-bb78-d4e4-4033-d6cf027883fb, deleteOnExit=true 2023-02-10 19:03:14,381 INFO [Listener at localhost/45079] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-02-10 19:03:14,381 INFO [Listener at localhost/45079] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/757a71d1-7690-509e-0487-fb796263e86c/test.cache.data in system properties and HBase conf 2023-02-10 19:03:14,381 INFO [Listener at localhost/45079] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/757a71d1-7690-509e-0487-fb796263e86c/hadoop.tmp.dir in system properties and HBase conf 2023-02-10 19:03:14,382 INFO [Listener at localhost/45079] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/757a71d1-7690-509e-0487-fb796263e86c/hadoop.log.dir in system properties and HBase conf 2023-02-10 19:03:14,382 INFO [Listener at localhost/45079] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/757a71d1-7690-509e-0487-fb796263e86c/mapreduce.cluster.local.dir in system properties and HBase conf 2023-02-10 19:03:14,382 INFO [Listener at localhost/45079] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/757a71d1-7690-509e-0487-fb796263e86c/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-02-10 19:03:14,382 INFO [Listener at localhost/45079] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-02-10 19:03:14,382 DEBUG [Listener at localhost/45079] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-02-10 19:03:14,382 INFO [Listener at localhost/45079] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/757a71d1-7690-509e-0487-fb796263e86c/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-02-10 19:03:14,383 INFO [Listener at localhost/45079] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/757a71d1-7690-509e-0487-fb796263e86c/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-02-10 19:03:14,383 INFO [Listener at localhost/45079] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/757a71d1-7690-509e-0487-fb796263e86c/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-02-10 19:03:14,383 INFO [Listener at localhost/45079] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/757a71d1-7690-509e-0487-fb796263e86c/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-10 19:03:14,383 INFO [Listener at localhost/45079] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/757a71d1-7690-509e-0487-fb796263e86c/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-02-10 19:03:14,383 INFO [Listener at localhost/45079] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/757a71d1-7690-509e-0487-fb796263e86c/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-02-10 19:03:14,383 INFO [Listener at localhost/45079] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/757a71d1-7690-509e-0487-fb796263e86c/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-10 19:03:14,384 INFO [Listener at localhost/45079] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/757a71d1-7690-509e-0487-fb796263e86c/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-10 19:03:14,384 INFO [Listener at localhost/45079] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/757a71d1-7690-509e-0487-fb796263e86c/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-02-10 19:03:14,384 INFO [Listener at localhost/45079] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/757a71d1-7690-509e-0487-fb796263e86c/nfs.dump.dir in system properties and HBase conf 2023-02-10 19:03:14,384 INFO [Listener at localhost/45079] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/757a71d1-7690-509e-0487-fb796263e86c/java.io.tmpdir in system properties and HBase conf 2023-02-10 19:03:14,384 INFO [Listener at localhost/45079] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/757a71d1-7690-509e-0487-fb796263e86c/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-10 19:03:14,384 INFO [Listener at localhost/45079] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/757a71d1-7690-509e-0487-fb796263e86c/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-02-10 19:03:14,385 INFO [Listener at localhost/45079] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/757a71d1-7690-509e-0487-fb796263e86c/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-02-10 19:03:14,389 WARN [Listener at localhost/45079] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-10 19:03:14,389 WARN [Listener at localhost/45079] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-10 19:03:14,428 WARN [Listener at localhost/45079] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-10 19:03:14,431 INFO [Listener at localhost/45079] log.Slf4jLog(67): jetty-6.1.26 2023-02-10 19:03:14,437 INFO [Listener at localhost/45079] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/757a71d1-7690-509e-0487-fb796263e86c/java.io.tmpdir/Jetty_localhost_34397_hdfs____ef5i62/webapp 2023-02-10 19:03:14,532 INFO [Listener at localhost/45079] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:34397 2023-02-10 19:03:14,536 WARN [Listener at localhost/45079] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-10 19:03:14,536 WARN [Listener at localhost/45079] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-10 19:03:14,579 WARN [Listener at localhost/44513] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-10 19:03:14,591 WARN [Listener at localhost/44513] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-10 19:03:14,596 WARN [Listener at localhost/44513] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-10 19:03:14,597 INFO [Listener at localhost/44513] log.Slf4jLog(67): jetty-6.1.26 2023-02-10 19:03:14,603 INFO [Listener at localhost/44513] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/757a71d1-7690-509e-0487-fb796263e86c/java.io.tmpdir/Jetty_localhost_33577_datanode____.2ek17o/webapp 2023-02-10 19:03:14,695 INFO [Listener at localhost/44513] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:33577 2023-02-10 19:03:14,708 WARN [Listener at localhost/41001] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-10 19:03:14,722 WARN [Listener at localhost/41001] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-10 19:03:14,724 WARN [Listener at localhost/41001] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-10 19:03:14,725 INFO [Listener at localhost/41001] log.Slf4jLog(67): jetty-6.1.26 2023-02-10 19:03:14,729 INFO [Listener at localhost/41001] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/757a71d1-7690-509e-0487-fb796263e86c/java.io.tmpdir/Jetty_localhost_39399_datanode____cpfs9g/webapp 2023-02-10 19:03:14,821 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x406f21d7812eec65: Processing first storage report for DS-0c5b02b1-7b11-44ff-b8de-d8dea6849c5a from datanode 4775a56b-ef25-4b7a-8ab9-9355b3e4fdd3 2023-02-10 19:03:14,821 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x406f21d7812eec65: from storage DS-0c5b02b1-7b11-44ff-b8de-d8dea6849c5a node DatanodeRegistration(127.0.0.1:46583, datanodeUuid=4775a56b-ef25-4b7a-8ab9-9355b3e4fdd3, infoPort=36357, infoSecurePort=0, ipcPort=41001, storageInfo=lv=-57;cid=testClusterID;nsid=1171832943;c=1676055794392), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-10 19:03:14,821 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x406f21d7812eec65: Processing first storage report for DS-e2a36795-6fec-4cbc-82a7-2165477fbc38 from datanode 4775a56b-ef25-4b7a-8ab9-9355b3e4fdd3 2023-02-10 19:03:14,821 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x406f21d7812eec65: from storage DS-e2a36795-6fec-4cbc-82a7-2165477fbc38 node DatanodeRegistration(127.0.0.1:46583, datanodeUuid=4775a56b-ef25-4b7a-8ab9-9355b3e4fdd3, infoPort=36357, infoSecurePort=0, ipcPort=41001, storageInfo=lv=-57;cid=testClusterID;nsid=1171832943;c=1676055794392), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-10 19:03:14,836 INFO [Listener at localhost/41001] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:39399 2023-02-10 19:03:14,844 WARN [Listener at localhost/37107] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-10 19:03:14,941 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xe7a87eaac72d818a: Processing first storage report for DS-37d8094c-4575-44d0-b4c4-ce71f3293d18 from datanode 332eb48f-611f-4828-a940-8d74a207dbb0 2023-02-10 19:03:14,941 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xe7a87eaac72d818a: from storage DS-37d8094c-4575-44d0-b4c4-ce71f3293d18 node DatanodeRegistration(127.0.0.1:39007, datanodeUuid=332eb48f-611f-4828-a940-8d74a207dbb0, infoPort=45541, infoSecurePort=0, ipcPort=37107, storageInfo=lv=-57;cid=testClusterID;nsid=1171832943;c=1676055794392), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-10 19:03:14,941 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xe7a87eaac72d818a: Processing first storage report for DS-36c2efd7-3280-48a2-804f-81aca9227c3b from datanode 332eb48f-611f-4828-a940-8d74a207dbb0 2023-02-10 19:03:14,941 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xe7a87eaac72d818a: from storage DS-36c2efd7-3280-48a2-804f-81aca9227c3b node DatanodeRegistration(127.0.0.1:39007, datanodeUuid=332eb48f-611f-4828-a940-8d74a207dbb0, infoPort=45541, infoSecurePort=0, ipcPort=37107, storageInfo=lv=-57;cid=testClusterID;nsid=1171832943;c=1676055794392), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-10 19:03:14,955 DEBUG [Listener at localhost/37107] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/757a71d1-7690-509e-0487-fb796263e86c 2023-02-10 19:03:14,957 INFO [Listener at localhost/37107] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/757a71d1-7690-509e-0487-fb796263e86c/cluster_58a94646-bb78-d4e4-4033-d6cf027883fb/zookeeper_0, clientPort=52230, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/757a71d1-7690-509e-0487-fb796263e86c/cluster_58a94646-bb78-d4e4-4033-d6cf027883fb/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/757a71d1-7690-509e-0487-fb796263e86c/cluster_58a94646-bb78-d4e4-4033-d6cf027883fb/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-02-10 19:03:14,958 INFO [Listener at localhost/37107] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=52230 2023-02-10 19:03:14,958 INFO [Listener at localhost/37107] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-10 19:03:14,959 INFO [Listener at localhost/37107] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-10 19:03:14,971 INFO [Listener at localhost/37107] util.FSUtils(479): Created version file at hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c with version=8 2023-02-10 19:03:14,972 INFO [Listener at localhost/37107] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-10 19:03:14,972 INFO [Listener at localhost/37107] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-10 19:03:14,973 INFO [Listener at localhost/37107] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:44513/user/jenkins/test-data/171bfff3-7974-3283-60d4-30ee0b6875b1/hbase-staging 2023-02-10 19:03:14,975 INFO [Listener at localhost/37107] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-02-10 19:03:14,975 INFO [Listener at localhost/37107] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-10 19:03:14,975 INFO [Listener at localhost/37107] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-10 19:03:14,975 INFO [Listener at localhost/37107] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-10 19:03:14,975 INFO [Listener at localhost/37107] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-10 19:03:14,975 INFO [Listener at localhost/37107] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-10 19:03:14,976 INFO [Listener at localhost/37107] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-02-10 19:03:14,976 INFO [Listener at localhost/37107] ipc.NettyRpcServer(120): Bind to /172.31.14.131:33383 2023-02-10 19:03:14,977 INFO [Listener at localhost/37107] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-10 19:03:14,977 INFO [Listener at localhost/37107] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-10 19:03:14,978 INFO [Listener at localhost/37107] zookeeper.RecoverableZooKeeper(93): Process identifier=master:33383 connecting to ZooKeeper ensemble=127.0.0.1:52230 2023-02-10 19:03:14,985 DEBUG [Listener at localhost/37107-EventThread] zookeeper.ZKWatcher(600): master:333830x0, quorum=127.0.0.1:52230, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-10 19:03:14,986 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): master:33383-0x1003f9dbed10000 connected 2023-02-10 19:03:15,000 DEBUG [Listener at localhost/37107] zookeeper.ZKUtil(164): master:33383-0x1003f9dbed10000, quorum=127.0.0.1:52230, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-10 19:03:15,001 DEBUG [Listener at localhost/37107] zookeeper.ZKUtil(164): master:33383-0x1003f9dbed10000, quorum=127.0.0.1:52230, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-10 19:03:15,001 DEBUG [Listener at localhost/37107] zookeeper.ZKUtil(164): master:33383-0x1003f9dbed10000, quorum=127.0.0.1:52230, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-10 19:03:15,004 DEBUG [Listener at localhost/37107] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=33383 2023-02-10 19:03:15,004 DEBUG [Listener at localhost/37107] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=33383 2023-02-10 19:03:15,008 DEBUG [Listener at localhost/37107] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=33383 2023-02-10 19:03:15,008 DEBUG [Listener at localhost/37107] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=33383 2023-02-10 19:03:15,008 DEBUG [Listener at localhost/37107] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=33383 2023-02-10 19:03:15,008 INFO [Listener at localhost/37107] master.HMaster(439): hbase.rootdir=hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c, hbase.cluster.distributed=false 2023-02-10 19:03:15,020 INFO [Listener at localhost/37107] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-10 19:03:15,020 INFO [Listener at localhost/37107] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-10 19:03:15,020 INFO [Listener at localhost/37107] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-10 19:03:15,020 INFO [Listener at localhost/37107] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-10 19:03:15,021 INFO [Listener at localhost/37107] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-10 19:03:15,021 INFO [Listener at localhost/37107] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-10 19:03:15,021 INFO [Listener at localhost/37107] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-10 19:03:15,021 INFO [Listener at localhost/37107] ipc.NettyRpcServer(120): Bind to /172.31.14.131:35891 2023-02-10 19:03:15,022 INFO [Listener at localhost/37107] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-10 19:03:15,024 DEBUG [Listener at localhost/37107] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-10 19:03:15,024 INFO [Listener at localhost/37107] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-10 19:03:15,025 INFO [Listener at localhost/37107] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-10 19:03:15,026 INFO [Listener at localhost/37107] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:35891 connecting to ZooKeeper ensemble=127.0.0.1:52230 2023-02-10 19:03:15,029 DEBUG [Listener at localhost/37107-EventThread] zookeeper.ZKWatcher(600): regionserver:358910x0, quorum=127.0.0.1:52230, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-10 19:03:15,032 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:35891-0x1003f9dbed10001 connected 2023-02-10 19:03:15,032 DEBUG [Listener at localhost/37107] zookeeper.ZKUtil(164): regionserver:35891-0x1003f9dbed10001, quorum=127.0.0.1:52230, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-10 19:03:15,033 DEBUG [Listener at localhost/37107] zookeeper.ZKUtil(164): regionserver:35891-0x1003f9dbed10001, quorum=127.0.0.1:52230, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-10 19:03:15,033 DEBUG [Listener at localhost/37107] zookeeper.ZKUtil(164): regionserver:35891-0x1003f9dbed10001, quorum=127.0.0.1:52230, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-10 19:03:15,036 DEBUG [Listener at localhost/37107] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=35891 2023-02-10 19:03:15,036 DEBUG [Listener at localhost/37107] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=35891 2023-02-10 19:03:15,036 DEBUG [Listener at localhost/37107] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=35891 2023-02-10 19:03:15,040 DEBUG [Listener at localhost/37107] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=35891 2023-02-10 19:03:15,040 DEBUG [Listener at localhost/37107] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=35891 2023-02-10 19:03:15,051 INFO [Listener at localhost/37107] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-10 19:03:15,051 INFO [Listener at localhost/37107] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-10 19:03:15,051 INFO [Listener at localhost/37107] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-10 19:03:15,051 INFO [Listener at localhost/37107] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-10 19:03:15,051 INFO [Listener at localhost/37107] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-10 19:03:15,051 INFO [Listener at localhost/37107] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-10 19:03:15,051 INFO [Listener at localhost/37107] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-10 19:03:15,052 INFO [Listener at localhost/37107] ipc.NettyRpcServer(120): Bind to /172.31.14.131:44697 2023-02-10 19:03:15,052 INFO [Listener at localhost/37107] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-10 19:03:15,053 DEBUG [Listener at localhost/37107] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-10 19:03:15,054 INFO [Listener at localhost/37107] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-10 19:03:15,054 INFO [Listener at localhost/37107] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-10 19:03:15,055 INFO [Listener at localhost/37107] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:44697 connecting to ZooKeeper ensemble=127.0.0.1:52230 2023-02-10 19:03:15,058 DEBUG [Listener at localhost/37107-EventThread] zookeeper.ZKWatcher(600): regionserver:446970x0, quorum=127.0.0.1:52230, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-10 19:03:15,060 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:44697-0x1003f9dbed10002 connected 2023-02-10 19:03:15,060 DEBUG [Listener at localhost/37107] zookeeper.ZKUtil(164): regionserver:44697-0x1003f9dbed10002, quorum=127.0.0.1:52230, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-10 19:03:15,060 DEBUG [Listener at localhost/37107] zookeeper.ZKUtil(164): regionserver:44697-0x1003f9dbed10002, quorum=127.0.0.1:52230, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-10 19:03:15,061 DEBUG [Listener at localhost/37107] zookeeper.ZKUtil(164): regionserver:44697-0x1003f9dbed10002, quorum=127.0.0.1:52230, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-10 19:03:15,064 DEBUG [Listener at localhost/37107] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=44697 2023-02-10 19:03:15,064 DEBUG [Listener at localhost/37107] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=44697 2023-02-10 19:03:15,064 DEBUG [Listener at localhost/37107] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=44697 2023-02-10 19:03:15,065 DEBUG [Listener at localhost/37107] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=44697 2023-02-10 19:03:15,065 DEBUG [Listener at localhost/37107] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=44697 2023-02-10 19:03:15,071 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2158): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,33383,1676055794975 2023-02-10 19:03:15,072 DEBUG [Listener at localhost/37107-EventThread] zookeeper.ZKWatcher(600): master:33383-0x1003f9dbed10000, quorum=127.0.0.1:52230, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-10 19:03:15,073 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:33383-0x1003f9dbed10000, quorum=127.0.0.1:52230, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,33383,1676055794975 2023-02-10 19:03:15,075 DEBUG [Listener at localhost/37107-EventThread] zookeeper.ZKWatcher(600): regionserver:35891-0x1003f9dbed10001, quorum=127.0.0.1:52230, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-10 19:03:15,075 DEBUG [Listener at localhost/37107-EventThread] zookeeper.ZKWatcher(600): master:33383-0x1003f9dbed10000, quorum=127.0.0.1:52230, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-10 19:03:15,075 DEBUG [Listener at localhost/37107-EventThread] zookeeper.ZKWatcher(600): regionserver:44697-0x1003f9dbed10002, quorum=127.0.0.1:52230, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-10 19:03:15,075 DEBUG [Listener at localhost/37107-EventThread] zookeeper.ZKWatcher(600): master:33383-0x1003f9dbed10000, quorum=127.0.0.1:52230, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-10 19:03:15,076 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:33383-0x1003f9dbed10000, quorum=127.0.0.1:52230, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-10 19:03:15,077 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(224): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,33383,1676055794975 from backup master directory 2023-02-10 19:03:15,077 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:33383-0x1003f9dbed10000, quorum=127.0.0.1:52230, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-10 19:03:15,078 DEBUG [Listener at localhost/37107-EventThread] zookeeper.ZKWatcher(600): master:33383-0x1003f9dbed10000, quorum=127.0.0.1:52230, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,33383,1676055794975 2023-02-10 19:03:15,078 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-10 19:03:15,079 DEBUG [Listener at localhost/37107-EventThread] zookeeper.ZKWatcher(600): master:33383-0x1003f9dbed10000, quorum=127.0.0.1:52230, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-10 19:03:15,079 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(234): Registered as active master=jenkins-hbase4.apache.org,33383,1676055794975 2023-02-10 19:03:15,090 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(628): Created cluster ID file at hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/hbase.id with ID: cc826ab9-b192-4f19-8c35-035902ce2d20 2023-02-10 19:03:15,100 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-10 19:03:15,102 DEBUG [Listener at localhost/37107-EventThread] zookeeper.ZKWatcher(600): master:33383-0x1003f9dbed10000, quorum=127.0.0.1:52230, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-10 19:03:15,110 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x712afd87 to 127.0.0.1:52230 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-10 19:03:15,115 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@110b5bb2, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-10 19:03:15,115 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-10 19:03:15,115 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-02-10 19:03:15,116 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-10 19:03:15,117 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7689): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/MasterData/data/master/store-tmp 2023-02-10 19:03:15,126 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-10 19:03:15,126 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-10 19:03:15,126 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-10 19:03:15,126 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-10 19:03:15,126 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-10 19:03:15,126 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-10 19:03:15,126 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-10 19:03:15,126 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1676055795126Disabling compacts and flushes for region at 1676055795126Disabling writes for close at 1676055795126Writing region close event to WAL at 1676055795126Closed at 1676055795126 2023-02-10 19:03:15,127 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/MasterData/WALs/jenkins-hbase4.apache.org,33383,1676055794975 2023-02-10 19:03:15,129 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C33383%2C1676055794975, suffix=, logDir=hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/MasterData/WALs/jenkins-hbase4.apache.org,33383,1676055794975, archiveDir=hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/MasterData/oldWALs, maxLogs=10 2023-02-10 19:03:15,149 DEBUG [RS-EventLoopGroup-14-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39007,DS-37d8094c-4575-44d0-b4c4-ce71f3293d18,DISK] 2023-02-10 19:03:15,153 DEBUG [RS-EventLoopGroup-14-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46583,DS-0c5b02b1-7b11-44ff-b8de-d8dea6849c5a,DISK] 2023-02-10 19:03:15,156 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/MasterData/WALs/jenkins-hbase4.apache.org,33383,1676055794975/jenkins-hbase4.apache.org%2C33383%2C1676055794975.1676055795130 2023-02-10 19:03:15,156 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:39007,DS-37d8094c-4575-44d0-b4c4-ce71f3293d18,DISK], DatanodeInfoWithStorage[127.0.0.1:46583,DS-0c5b02b1-7b11-44ff-b8de-d8dea6849c5a,DISK]] 2023-02-10 19:03:15,156 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7850): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-02-10 19:03:15,156 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-10 19:03:15,157 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7890): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-02-10 19:03:15,157 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7893): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-02-10 19:03:15,159 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-02-10 19:03:15,161 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-02-10 19:03:15,161 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-02-10 19:03:15,162 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-10 19:03:15,163 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-10 19:03:15,163 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-10 19:03:15,166 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1054): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-02-10 19:03:15,168 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-10 19:03:15,168 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1071): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66023888, jitterRate=-0.016167402267456055}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-10 19:03:15,168 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(964): Region open journal for 1595e783b53d99cd5eef43b6debb2682: Writing region info on filesystem at 1676055795157Initializing all the Stores at 1676055795158 (+1 ms)Instantiating store for column family {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676055795158Cleaning up temporary data from old regions at 1676055795164 (+6 ms)Cleaning up detritus from prior splits at 1676055795164Region opened successfully at 1676055795168 (+4 ms) 2023-02-10 19:03:15,176 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-02-10 19:03:15,177 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-02-10 19:03:15,177 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-02-10 19:03:15,177 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-02-10 19:03:15,178 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 0 msec 2023-02-10 19:03:15,178 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 0 msec 2023-02-10 19:03:15,178 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(95): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-02-10 19:03:15,179 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-02-10 19:03:15,180 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-02-10 19:03:15,190 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-02-10 19:03:15,190 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-02-10 19:03:15,190 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:33383-0x1003f9dbed10000, quorum=127.0.0.1:52230, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-02-10 19:03:15,190 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-02-10 19:03:15,191 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:33383-0x1003f9dbed10000, quorum=127.0.0.1:52230, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-02-10 19:03:15,193 DEBUG [Listener at localhost/37107-EventThread] zookeeper.ZKWatcher(600): master:33383-0x1003f9dbed10000, quorum=127.0.0.1:52230, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-10 19:03:15,194 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:33383-0x1003f9dbed10000, quorum=127.0.0.1:52230, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-02-10 19:03:15,194 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:33383-0x1003f9dbed10000, quorum=127.0.0.1:52230, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-02-10 19:03:15,195 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:33383-0x1003f9dbed10000, quorum=127.0.0.1:52230, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-02-10 19:03:15,196 DEBUG [Listener at localhost/37107-EventThread] zookeeper.ZKWatcher(600): master:33383-0x1003f9dbed10000, quorum=127.0.0.1:52230, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-10 19:03:15,196 DEBUG [Listener at localhost/37107-EventThread] zookeeper.ZKWatcher(600): regionserver:44697-0x1003f9dbed10002, quorum=127.0.0.1:52230, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-10 19:03:15,196 DEBUG [Listener at localhost/37107-EventThread] zookeeper.ZKWatcher(600): master:33383-0x1003f9dbed10000, quorum=127.0.0.1:52230, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-10 19:03:15,196 DEBUG [Listener at localhost/37107-EventThread] zookeeper.ZKWatcher(600): regionserver:35891-0x1003f9dbed10001, quorum=127.0.0.1:52230, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-10 19:03:15,196 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(739): Active/primary master=jenkins-hbase4.apache.org,33383,1676055794975, sessionid=0x1003f9dbed10000, setting cluster-up flag (Was=false) 2023-02-10 19:03:15,200 DEBUG [Listener at localhost/37107-EventThread] zookeeper.ZKWatcher(600): master:33383-0x1003f9dbed10000, quorum=127.0.0.1:52230, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-10 19:03:15,205 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-02-10 19:03:15,206 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,33383,1676055794975 2023-02-10 19:03:15,209 DEBUG [Listener at localhost/37107-EventThread] zookeeper.ZKWatcher(600): master:33383-0x1003f9dbed10000, quorum=127.0.0.1:52230, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-10 19:03:15,212 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-02-10 19:03:15,213 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,33383,1676055794975 2023-02-10 19:03:15,213 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/.hbase-snapshot/.tmp 2023-02-10 19:03:15,215 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-02-10 19:03:15,215 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-10 19:03:15,215 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-10 19:03:15,215 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-10 19:03:15,215 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-10 19:03:15,215 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-02-10 19:03:15,216 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-10 19:03:15,216 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-10 19:03:15,216 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-10 19:03:15,224 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1676055825224 2023-02-10 19:03:15,225 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-02-10 19:03:15,225 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-02-10 19:03:15,225 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-02-10 19:03:15,225 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-02-10 19:03:15,225 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-02-10 19:03:15,225 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-02-10 19:03:15,225 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-02-10 19:03:15,225 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-10 19:03:15,225 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-02-10 19:03:15,226 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-02-10 19:03:15,227 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-02-10 19:03:15,227 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-02-10 19:03:15,227 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-02-10 19:03:15,227 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-02-10 19:03:15,228 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676055795227,5,FailOnTimeoutGroup] 2023-02-10 19:03:15,228 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-10 19:03:15,231 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676055795228,5,FailOnTimeoutGroup] 2023-02-10 19:03:15,231 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-10 19:03:15,231 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1451): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-02-10 19:03:15,232 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-02-10 19:03:15,232 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-02-10 19:03:15,243 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-10 19:03:15,243 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-10 19:03:15,243 INFO [PEWorker-1] regionserver.HRegion(7671): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c 2023-02-10 19:03:15,251 DEBUG [PEWorker-1] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-10 19:03:15,252 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-10 19:03:15,254 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/data/hbase/meta/1588230740/info 2023-02-10 19:03:15,254 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-10 19:03:15,255 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-10 19:03:15,255 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-10 19:03:15,256 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/data/hbase/meta/1588230740/rep_barrier 2023-02-10 19:03:15,256 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-10 19:03:15,257 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-10 19:03:15,257 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-10 19:03:15,258 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/data/hbase/meta/1588230740/table 2023-02-10 19:03:15,258 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-10 19:03:15,258 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-10 19:03:15,259 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/data/hbase/meta/1588230740 2023-02-10 19:03:15,259 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/data/hbase/meta/1588230740 2023-02-10 19:03:15,261 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-10 19:03:15,262 DEBUG [PEWorker-1] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-10 19:03:15,264 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-10 19:03:15,264 INFO [PEWorker-1] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68042887, jitterRate=0.01391802728176117}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-10 19:03:15,264 DEBUG [PEWorker-1] regionserver.HRegion(964): Region open journal for 1588230740: Writing region info on filesystem at 1676055795251Initializing all the Stores at 1676055795252 (+1 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676055795252Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676055795252Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676055795252Cleaning up temporary data from old regions at 1676055795260 (+8 ms)Cleaning up detritus from prior splits at 1676055795261 (+1 ms)Region opened successfully at 1676055795264 (+3 ms) 2023-02-10 19:03:15,264 DEBUG [PEWorker-1] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-10 19:03:15,264 INFO [PEWorker-1] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-10 19:03:15,264 DEBUG [PEWorker-1] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-10 19:03:15,264 DEBUG [PEWorker-1] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-10 19:03:15,264 DEBUG [PEWorker-1] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-10 19:03:15,265 INFO [PEWorker-1] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-10 19:03:15,265 DEBUG [PEWorker-1] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1676055795264Disabling compacts and flushes for region at 1676055795264Disabling writes for close at 1676055795264Writing region close event to WAL at 1676055795265 (+1 ms)Closed at 1676055795265 2023-02-10 19:03:15,265 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-02-10 19:03:15,265 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-02-10 19:03:15,265 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-02-10 19:03:15,267 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-02-10 19:03:15,269 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-02-10 19:03:15,269 INFO [RS:0;jenkins-hbase4:35891] regionserver.HRegionServer(952): ClusterId : cc826ab9-b192-4f19-8c35-035902ce2d20 2023-02-10 19:03:15,269 INFO [RS:1;jenkins-hbase4:44697] regionserver.HRegionServer(952): ClusterId : cc826ab9-b192-4f19-8c35-035902ce2d20 2023-02-10 19:03:15,270 DEBUG [RS:0;jenkins-hbase4:35891] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-10 19:03:15,270 DEBUG [RS:1;jenkins-hbase4:44697] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-10 19:03:15,273 DEBUG [RS:0;jenkins-hbase4:35891] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-10 19:03:15,273 DEBUG [RS:0;jenkins-hbase4:35891] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-10 19:03:15,273 DEBUG [RS:1;jenkins-hbase4:44697] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-10 19:03:15,273 DEBUG [RS:1;jenkins-hbase4:44697] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-10 19:03:15,275 DEBUG [RS:0;jenkins-hbase4:35891] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-10 19:03:15,276 DEBUG [RS:1;jenkins-hbase4:44697] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-10 19:03:15,277 DEBUG [RS:0;jenkins-hbase4:35891] zookeeper.ReadOnlyZKClient(139): Connect 0x09d87452 to 127.0.0.1:52230 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-10 19:03:15,277 DEBUG [RS:1;jenkins-hbase4:44697] zookeeper.ReadOnlyZKClient(139): Connect 0x16d440e4 to 127.0.0.1:52230 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-10 19:03:15,286 DEBUG [RS:0;jenkins-hbase4:35891] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@71f8b19, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-10 19:03:15,286 DEBUG [RS:1;jenkins-hbase4:44697] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1813bc4e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-10 19:03:15,286 DEBUG [RS:0;jenkins-hbase4:35891] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3201f22, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-10 19:03:15,287 DEBUG [RS:1;jenkins-hbase4:44697] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1c2c2b94, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-10 19:03:15,295 DEBUG [RS:0;jenkins-hbase4:35891] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:35891 2023-02-10 19:03:15,295 INFO [RS:0;jenkins-hbase4:35891] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-10 19:03:15,295 INFO [RS:0;jenkins-hbase4:35891] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-10 19:03:15,295 DEBUG [RS:0;jenkins-hbase4:35891] regionserver.HRegionServer(1023): About to register with Master. 2023-02-10 19:03:15,295 INFO [RS:0;jenkins-hbase4:35891] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,33383,1676055794975 with isa=jenkins-hbase4.apache.org/172.31.14.131:35891, startcode=1676055795020 2023-02-10 19:03:15,296 DEBUG [RS:0;jenkins-hbase4:35891] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-10 19:03:15,297 INFO [RS-EventLoopGroup-12-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55593, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.6 (auth:SIMPLE), service=RegionServerStatusService 2023-02-10 19:03:15,299 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33383] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,35891,1676055795020 2023-02-10 19:03:15,299 DEBUG [RS:0;jenkins-hbase4:35891] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c 2023-02-10 19:03:15,299 DEBUG [RS:0;jenkins-hbase4:35891] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:44513 2023-02-10 19:03:15,299 DEBUG [RS:0;jenkins-hbase4:35891] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-10 19:03:15,299 DEBUG [RS:1;jenkins-hbase4:44697] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:44697 2023-02-10 19:03:15,299 INFO [RS:1;jenkins-hbase4:44697] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-10 19:03:15,299 INFO [RS:1;jenkins-hbase4:44697] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-10 19:03:15,299 DEBUG [RS:1;jenkins-hbase4:44697] regionserver.HRegionServer(1023): About to register with Master. 2023-02-10 19:03:15,301 DEBUG [Listener at localhost/37107-EventThread] zookeeper.ZKWatcher(600): master:33383-0x1003f9dbed10000, quorum=127.0.0.1:52230, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-10 19:03:15,301 INFO [RS:1;jenkins-hbase4:44697] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,33383,1676055794975 with isa=jenkins-hbase4.apache.org/172.31.14.131:44697, startcode=1676055795050 2023-02-10 19:03:15,301 DEBUG [RS:1;jenkins-hbase4:44697] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-10 19:03:15,301 DEBUG [RS:0;jenkins-hbase4:35891] zookeeper.ZKUtil(162): regionserver:35891-0x1003f9dbed10001, quorum=127.0.0.1:52230, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,35891,1676055795020 2023-02-10 19:03:15,301 WARN [RS:0;jenkins-hbase4:35891] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-10 19:03:15,301 INFO [RS:0;jenkins-hbase4:35891] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-10 19:03:15,302 DEBUG [RS:0;jenkins-hbase4:35891] regionserver.HRegionServer(1947): logDir=hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/WALs/jenkins-hbase4.apache.org,35891,1676055795020 2023-02-10 19:03:15,302 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,35891,1676055795020] 2023-02-10 19:03:15,304 INFO [RS-EventLoopGroup-12-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55123, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.7 (auth:SIMPLE), service=RegionServerStatusService 2023-02-10 19:03:15,305 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33383] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,44697,1676055795050 2023-02-10 19:03:15,306 DEBUG [RS:1;jenkins-hbase4:44697] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c 2023-02-10 19:03:15,306 DEBUG [RS:1;jenkins-hbase4:44697] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:44513 2023-02-10 19:03:15,306 DEBUG [RS:1;jenkins-hbase4:44697] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-10 19:03:15,309 DEBUG [Listener at localhost/37107-EventThread] zookeeper.ZKWatcher(600): regionserver:35891-0x1003f9dbed10001, quorum=127.0.0.1:52230, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-10 19:03:15,309 DEBUG [RS:0;jenkins-hbase4:35891] zookeeper.ZKUtil(162): regionserver:35891-0x1003f9dbed10001, quorum=127.0.0.1:52230, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,35891,1676055795020 2023-02-10 19:03:15,309 DEBUG [Listener at localhost/37107-EventThread] zookeeper.ZKWatcher(600): master:33383-0x1003f9dbed10000, quorum=127.0.0.1:52230, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-10 19:03:15,310 DEBUG [RS:1;jenkins-hbase4:44697] zookeeper.ZKUtil(162): regionserver:44697-0x1003f9dbed10002, quorum=127.0.0.1:52230, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,44697,1676055795050 2023-02-10 19:03:15,310 WARN [RS:1;jenkins-hbase4:44697] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-10 19:03:15,310 INFO [RS:1;jenkins-hbase4:44697] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-10 19:03:15,310 DEBUG [RS:1;jenkins-hbase4:44697] regionserver.HRegionServer(1947): logDir=hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/WALs/jenkins-hbase4.apache.org,44697,1676055795050 2023-02-10 19:03:15,310 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,44697,1676055795050] 2023-02-10 19:03:15,310 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): regionserver:35891-0x1003f9dbed10001, quorum=127.0.0.1:52230, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,44697,1676055795050 2023-02-10 19:03:15,311 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): regionserver:35891-0x1003f9dbed10001, quorum=127.0.0.1:52230, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,35891,1676055795020 2023-02-10 19:03:15,311 DEBUG [RS:0;jenkins-hbase4:35891] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-10 19:03:15,311 INFO [RS:0;jenkins-hbase4:35891] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-10 19:03:15,313 INFO [RS:0;jenkins-hbase4:35891] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-10 19:03:15,314 INFO [RS:0;jenkins-hbase4:35891] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-10 19:03:15,314 INFO [RS:0;jenkins-hbase4:35891] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-10 19:03:15,315 INFO [RS:0;jenkins-hbase4:35891] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-10 19:03:15,316 INFO [RS:0;jenkins-hbase4:35891] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-10 19:03:15,316 DEBUG [RS:0;jenkins-hbase4:35891] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-10 19:03:15,316 DEBUG [RS:0;jenkins-hbase4:35891] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-10 19:03:15,316 DEBUG [RS:0;jenkins-hbase4:35891] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-10 19:03:15,316 DEBUG [RS:0;jenkins-hbase4:35891] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-10 19:03:15,316 DEBUG [RS:0;jenkins-hbase4:35891] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-10 19:03:15,317 DEBUG [RS:0;jenkins-hbase4:35891] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-10 19:03:15,317 DEBUG [RS:0;jenkins-hbase4:35891] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-10 19:03:15,317 DEBUG [RS:0;jenkins-hbase4:35891] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-10 19:03:15,317 DEBUG [RS:1;jenkins-hbase4:44697] zookeeper.ZKUtil(162): regionserver:44697-0x1003f9dbed10002, quorum=127.0.0.1:52230, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,44697,1676055795050 2023-02-10 19:03:15,317 DEBUG [RS:0;jenkins-hbase4:35891] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-10 19:03:15,317 DEBUG [RS:0;jenkins-hbase4:35891] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-10 19:03:15,317 DEBUG [RS:1;jenkins-hbase4:44697] zookeeper.ZKUtil(162): regionserver:44697-0x1003f9dbed10002, quorum=127.0.0.1:52230, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,35891,1676055795020 2023-02-10 19:03:15,318 INFO [RS:0;jenkins-hbase4:35891] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-10 19:03:15,318 INFO [RS:0;jenkins-hbase4:35891] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-10 19:03:15,318 INFO [RS:0;jenkins-hbase4:35891] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-10 19:03:15,318 DEBUG [RS:1;jenkins-hbase4:44697] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-10 19:03:15,318 INFO [RS:1;jenkins-hbase4:44697] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-10 19:03:15,324 INFO [RS:1;jenkins-hbase4:44697] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-10 19:03:15,324 INFO [RS:1;jenkins-hbase4:44697] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-10 19:03:15,324 INFO [RS:1;jenkins-hbase4:44697] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-10 19:03:15,324 INFO [RS:1;jenkins-hbase4:44697] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-10 19:03:15,326 INFO [RS:1;jenkins-hbase4:44697] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-10 19:03:15,326 DEBUG [RS:1;jenkins-hbase4:44697] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-10 19:03:15,326 DEBUG [RS:1;jenkins-hbase4:44697] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-10 19:03:15,326 DEBUG [RS:1;jenkins-hbase4:44697] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-10 19:03:15,326 DEBUG [RS:1;jenkins-hbase4:44697] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-10 19:03:15,326 DEBUG [RS:1;jenkins-hbase4:44697] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-10 19:03:15,326 DEBUG [RS:1;jenkins-hbase4:44697] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-10 19:03:15,326 DEBUG [RS:1;jenkins-hbase4:44697] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-10 19:03:15,326 DEBUG [RS:1;jenkins-hbase4:44697] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-10 19:03:15,326 DEBUG [RS:1;jenkins-hbase4:44697] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-10 19:03:15,326 DEBUG [RS:1;jenkins-hbase4:44697] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-10 19:03:15,328 INFO [RS:1;jenkins-hbase4:44697] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-10 19:03:15,328 INFO [RS:1;jenkins-hbase4:44697] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-10 19:03:15,328 INFO [RS:1;jenkins-hbase4:44697] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-10 19:03:15,330 INFO [RS:0;jenkins-hbase4:35891] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-10 19:03:15,331 INFO [RS:0;jenkins-hbase4:35891] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,35891,1676055795020-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-10 19:03:15,341 INFO [RS:1;jenkins-hbase4:44697] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-10 19:03:15,341 INFO [RS:1;jenkins-hbase4:44697] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,44697,1676055795050-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-10 19:03:15,341 INFO [RS:0;jenkins-hbase4:35891] regionserver.Replication(203): jenkins-hbase4.apache.org,35891,1676055795020 started 2023-02-10 19:03:15,341 INFO [RS:0;jenkins-hbase4:35891] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,35891,1676055795020, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:35891, sessionid=0x1003f9dbed10001 2023-02-10 19:03:15,341 DEBUG [RS:0;jenkins-hbase4:35891] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-10 19:03:15,341 DEBUG [RS:0;jenkins-hbase4:35891] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,35891,1676055795020 2023-02-10 19:03:15,341 DEBUG [RS:0;jenkins-hbase4:35891] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,35891,1676055795020' 2023-02-10 19:03:15,341 DEBUG [RS:0;jenkins-hbase4:35891] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-10 19:03:15,341 DEBUG [RS:0;jenkins-hbase4:35891] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-10 19:03:15,342 DEBUG [RS:0;jenkins-hbase4:35891] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-10 19:03:15,342 DEBUG [RS:0;jenkins-hbase4:35891] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-10 19:03:15,342 DEBUG [RS:0;jenkins-hbase4:35891] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,35891,1676055795020 2023-02-10 19:03:15,342 DEBUG [RS:0;jenkins-hbase4:35891] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,35891,1676055795020' 2023-02-10 19:03:15,342 DEBUG [RS:0;jenkins-hbase4:35891] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-10 19:03:15,342 DEBUG [RS:0;jenkins-hbase4:35891] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-10 19:03:15,342 DEBUG [RS:0;jenkins-hbase4:35891] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-10 19:03:15,342 INFO [RS:0;jenkins-hbase4:35891] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-10 19:03:15,342 INFO [RS:0;jenkins-hbase4:35891] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-10 19:03:15,351 INFO [RS:1;jenkins-hbase4:44697] regionserver.Replication(203): jenkins-hbase4.apache.org,44697,1676055795050 started 2023-02-10 19:03:15,351 INFO [RS:1;jenkins-hbase4:44697] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,44697,1676055795050, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:44697, sessionid=0x1003f9dbed10002 2023-02-10 19:03:15,351 DEBUG [RS:1;jenkins-hbase4:44697] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-10 19:03:15,351 DEBUG [RS:1;jenkins-hbase4:44697] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,44697,1676055795050 2023-02-10 19:03:15,351 DEBUG [RS:1;jenkins-hbase4:44697] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,44697,1676055795050' 2023-02-10 19:03:15,351 DEBUG [RS:1;jenkins-hbase4:44697] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-10 19:03:15,351 DEBUG [RS:1;jenkins-hbase4:44697] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-10 19:03:15,351 DEBUG [RS:1;jenkins-hbase4:44697] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-10 19:03:15,352 DEBUG [RS:1;jenkins-hbase4:44697] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-10 19:03:15,352 DEBUG [RS:1;jenkins-hbase4:44697] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,44697,1676055795050 2023-02-10 19:03:15,352 DEBUG [RS:1;jenkins-hbase4:44697] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,44697,1676055795050' 2023-02-10 19:03:15,352 DEBUG [RS:1;jenkins-hbase4:44697] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-10 19:03:15,352 DEBUG [RS:1;jenkins-hbase4:44697] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-10 19:03:15,352 DEBUG [RS:1;jenkins-hbase4:44697] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-10 19:03:15,352 INFO [RS:1;jenkins-hbase4:44697] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-10 19:03:15,352 INFO [RS:1;jenkins-hbase4:44697] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-10 19:03:15,419 DEBUG [jenkins-hbase4:33383] assignment.AssignmentManager(2178): Processing assignQueue; systemServersCount=2, allServersCount=2 2023-02-10 19:03:15,419 DEBUG [jenkins-hbase4:33383] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-10 19:03:15,421 DEBUG [jenkins-hbase4:33383] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-10 19:03:15,421 DEBUG [jenkins-hbase4:33383] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-10 19:03:15,421 DEBUG [jenkins-hbase4:33383] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-10 19:03:15,422 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,35891,1676055795020, state=OPENING 2023-02-10 19:03:15,423 DEBUG [PEWorker-5] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-02-10 19:03:15,424 DEBUG [Listener at localhost/37107-EventThread] zookeeper.ZKWatcher(600): master:33383-0x1003f9dbed10000, quorum=127.0.0.1:52230, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-10 19:03:15,425 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,35891,1676055795020}] 2023-02-10 19:03:15,425 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-10 19:03:15,578 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,35891,1676055795020 2023-02-10 19:03:15,578 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-10 19:03:15,580 INFO [RS-EventLoopGroup-13-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36812, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-10 19:03:15,583 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:meta,,1.1588230740 2023-02-10 19:03:15,584 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-10 19:03:15,585 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C35891%2C1676055795020.meta, suffix=.meta, logDir=hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/WALs/jenkins-hbase4.apache.org,35891,1676055795020, archiveDir=hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/oldWALs, maxLogs=32 2023-02-10 19:03:15,601 DEBUG [RS-EventLoopGroup-14-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39007,DS-37d8094c-4575-44d0-b4c4-ce71f3293d18,DISK] 2023-02-10 19:03:15,601 DEBUG [RS-EventLoopGroup-14-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46583,DS-0c5b02b1-7b11-44ff-b8de-d8dea6849c5a,DISK] 2023-02-10 19:03:15,603 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/WALs/jenkins-hbase4.apache.org,35891,1676055795020/jenkins-hbase4.apache.org%2C35891%2C1676055795020.meta.1676055795586.meta 2023-02-10 19:03:15,603 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:39007,DS-37d8094c-4575-44d0-b4c4-ce71f3293d18,DISK], DatanodeInfoWithStorage[127.0.0.1:46583,DS-0c5b02b1-7b11-44ff-b8de-d8dea6849c5a,DISK]] 2023-02-10 19:03:15,603 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-02-10 19:03:15,604 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-02-10 19:03:15,604 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8546): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-02-10 19:03:15,604 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-02-10 19:03:15,604 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-02-10 19:03:15,604 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-10 19:03:15,604 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 1588230740 2023-02-10 19:03:15,604 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 1588230740 2023-02-10 19:03:15,605 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-10 19:03:15,606 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/data/hbase/meta/1588230740/info 2023-02-10 19:03:15,606 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/data/hbase/meta/1588230740/info 2023-02-10 19:03:15,606 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-10 19:03:15,607 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-10 19:03:15,607 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-10 19:03:15,608 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/data/hbase/meta/1588230740/rep_barrier 2023-02-10 19:03:15,608 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/data/hbase/meta/1588230740/rep_barrier 2023-02-10 19:03:15,608 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-10 19:03:15,609 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-10 19:03:15,609 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-10 19:03:15,610 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/data/hbase/meta/1588230740/table 2023-02-10 19:03:15,610 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/data/hbase/meta/1588230740/table 2023-02-10 19:03:15,610 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-10 19:03:15,610 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-10 19:03:15,611 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/data/hbase/meta/1588230740 2023-02-10 19:03:15,612 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/data/hbase/meta/1588230740 2023-02-10 19:03:15,614 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-10 19:03:15,615 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-10 19:03:15,616 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61972425, jitterRate=-0.07653890550136566}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-10 19:03:15,616 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 1588230740: Running coprocessor pre-open hook at 1676055795604Writing region info on filesystem at 1676055795604Initializing all the Stores at 1676055795605 (+1 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676055795605Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676055795605Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676055795605Cleaning up temporary data from old regions at 1676055795613 (+8 ms)Cleaning up detritus from prior splits at 1676055795614 (+1 ms)Running coprocessor post-open hooks at 1676055795616 (+2 ms)Region opened successfully at 1676055795616 2023-02-10 19:03:15,617 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1676055795578 2023-02-10 19:03:15,621 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:meta,,1.1588230740 2023-02-10 19:03:15,622 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:meta,,1.1588230740 2023-02-10 19:03:15,622 INFO [PEWorker-2] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,35891,1676055795020, state=OPEN 2023-02-10 19:03:15,624 DEBUG [Listener at localhost/37107-EventThread] zookeeper.ZKWatcher(600): master:33383-0x1003f9dbed10000, quorum=127.0.0.1:52230, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-02-10 19:03:15,624 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-10 19:03:15,626 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-02-10 19:03:15,626 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,35891,1676055795020 in 199 msec 2023-02-10 19:03:15,627 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-02-10 19:03:15,627 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 361 msec 2023-02-10 19:03:15,629 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 414 msec 2023-02-10 19:03:15,629 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(946): Master startup: status=Wait for region servers to report in, state=RUNNING, startTime=1676055795073, completionTime=-1 2023-02-10 19:03:15,629 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=2; waited=0ms, expected min=2 server(s), max=2 server(s), master is running 2023-02-10 19:03:15,629 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1519): Joining cluster... 2023-02-10 19:03:15,633 DEBUG [hconnection-0x5eb65e9d-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-10 19:03:15,635 INFO [RS-EventLoopGroup-13-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36818, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-10 19:03:15,636 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1531): Number of RegionServers=2 2023-02-10 19:03:15,636 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1676055855636 2023-02-10 19:03:15,636 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1676055915636 2023-02-10 19:03:15,636 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1538): Joined the cluster in 7 msec 2023-02-10 19:03:15,642 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,33383,1676055794975-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-10 19:03:15,642 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,33383,1676055794975-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-10 19:03:15,642 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,33383,1676055794975-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-10 19:03:15,643 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:33383, period=300000, unit=MILLISECONDS is enabled. 2023-02-10 19:03:15,643 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-02-10 19:03:15,643 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-02-10 19:03:15,643 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2138): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-10 19:03:15,644 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-02-10 19:03:15,645 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-02-10 19:03:15,646 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-10 19:03:15,646 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-02-10 19:03:15,648 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/.tmp/data/hbase/namespace/c14f5740dcaa778d9823206a6b1ca0eb 2023-02-10 19:03:15,648 DEBUG [HFileArchiver-6] backup.HFileArchiver(153): Directory hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/.tmp/data/hbase/namespace/c14f5740dcaa778d9823206a6b1ca0eb empty. 2023-02-10 19:03:15,649 DEBUG [HFileArchiver-6] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/.tmp/data/hbase/namespace/c14f5740dcaa778d9823206a6b1ca0eb 2023-02-10 19:03:15,649 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-02-10 19:03:15,665 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-02-10 19:03:15,666 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7671): creating {ENCODED => c14f5740dcaa778d9823206a6b1ca0eb, NAME => 'hbase:namespace,,1676055795643.c14f5740dcaa778d9823206a6b1ca0eb.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/.tmp 2023-02-10 19:03:15,679 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676055795643.c14f5740dcaa778d9823206a6b1ca0eb.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-10 19:03:15,679 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1603): Closing c14f5740dcaa778d9823206a6b1ca0eb, disabling compactions & flushes 2023-02-10 19:03:15,679 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676055795643.c14f5740dcaa778d9823206a6b1ca0eb. 2023-02-10 19:03:15,679 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676055795643.c14f5740dcaa778d9823206a6b1ca0eb. 2023-02-10 19:03:15,679 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676055795643.c14f5740dcaa778d9823206a6b1ca0eb. after waiting 0 ms 2023-02-10 19:03:15,679 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676055795643.c14f5740dcaa778d9823206a6b1ca0eb. 2023-02-10 19:03:15,679 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676055795643.c14f5740dcaa778d9823206a6b1ca0eb. 2023-02-10 19:03:15,679 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1557): Region close journal for c14f5740dcaa778d9823206a6b1ca0eb: Waiting for close lock at 1676055795679Disabling compacts and flushes for region at 1676055795679Disabling writes for close at 1676055795679Writing region close event to WAL at 1676055795679Closed at 1676055795679 2023-02-10 19:03:15,682 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-02-10 19:03:15,683 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1676055795643.c14f5740dcaa778d9823206a6b1ca0eb.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676055795683"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676055795683"}]},"ts":"1676055795683"} 2023-02-10 19:03:15,687 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-10 19:03:15,688 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-10 19:03:15,689 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676055795688"}]},"ts":"1676055795688"} 2023-02-10 19:03:15,690 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-02-10 19:03:15,694 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-10 19:03:15,695 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-10 19:03:15,695 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-10 19:03:15,695 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-10 19:03:15,698 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=c14f5740dcaa778d9823206a6b1ca0eb, ASSIGN}] 2023-02-10 19:03:15,700 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=c14f5740dcaa778d9823206a6b1ca0eb, ASSIGN 2023-02-10 19:03:15,701 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=c14f5740dcaa778d9823206a6b1ca0eb, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,44697,1676055795050; forceNewPlan=false, retain=false 2023-02-10 19:03:15,851 INFO [jenkins-hbase4:33383] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-10 19:03:15,853 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=c14f5740dcaa778d9823206a6b1ca0eb, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,44697,1676055795050 2023-02-10 19:03:15,853 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1676055795643.c14f5740dcaa778d9823206a6b1ca0eb.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676055795853"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676055795853"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676055795853"}]},"ts":"1676055795853"} 2023-02-10 19:03:15,855 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure c14f5740dcaa778d9823206a6b1ca0eb, server=jenkins-hbase4.apache.org,44697,1676055795050}] 2023-02-10 19:03:16,007 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,44697,1676055795050 2023-02-10 19:03:16,008 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-10 19:03:16,009 INFO [RS-EventLoopGroup-14-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42346, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-10 19:03:16,014 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:namespace,,1676055795643.c14f5740dcaa778d9823206a6b1ca0eb. 2023-02-10 19:03:16,016 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C44697%2C1676055795050, suffix=, logDir=hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/WALs/jenkins-hbase4.apache.org,44697,1676055795050, archiveDir=hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/oldWALs, maxLogs=32 2023-02-10 19:03:16,029 DEBUG [RS-EventLoopGroup-14-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39007,DS-37d8094c-4575-44d0-b4c4-ce71f3293d18,DISK] 2023-02-10 19:03:16,029 DEBUG [RS-EventLoopGroup-14-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46583,DS-0c5b02b1-7b11-44ff-b8de-d8dea6849c5a,DISK] 2023-02-10 19:03:16,034 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/WALs/jenkins-hbase4.apache.org,44697,1676055795050/jenkins-hbase4.apache.org%2C44697%2C1676055795050.1676055796016 2023-02-10 19:03:16,035 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:39007,DS-37d8094c-4575-44d0-b4c4-ce71f3293d18,DISK], DatanodeInfoWithStorage[127.0.0.1:46583,DS-0c5b02b1-7b11-44ff-b8de-d8dea6849c5a,DISK]] 2023-02-10 19:03:16,035 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => c14f5740dcaa778d9823206a6b1ca0eb, NAME => 'hbase:namespace,,1676055795643.c14f5740dcaa778d9823206a6b1ca0eb.', STARTKEY => '', ENDKEY => ''} 2023-02-10 19:03:16,035 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace c14f5740dcaa778d9823206a6b1ca0eb 2023-02-10 19:03:16,036 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676055795643.c14f5740dcaa778d9823206a6b1ca0eb.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-10 19:03:16,036 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for c14f5740dcaa778d9823206a6b1ca0eb 2023-02-10 19:03:16,036 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for c14f5740dcaa778d9823206a6b1ca0eb 2023-02-10 19:03:16,037 INFO [StoreOpener-c14f5740dcaa778d9823206a6b1ca0eb-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region c14f5740dcaa778d9823206a6b1ca0eb 2023-02-10 19:03:16,038 DEBUG [StoreOpener-c14f5740dcaa778d9823206a6b1ca0eb-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/data/hbase/namespace/c14f5740dcaa778d9823206a6b1ca0eb/info 2023-02-10 19:03:16,038 DEBUG [StoreOpener-c14f5740dcaa778d9823206a6b1ca0eb-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/data/hbase/namespace/c14f5740dcaa778d9823206a6b1ca0eb/info 2023-02-10 19:03:16,038 INFO [StoreOpener-c14f5740dcaa778d9823206a6b1ca0eb-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c14f5740dcaa778d9823206a6b1ca0eb columnFamilyName info 2023-02-10 19:03:16,039 INFO [StoreOpener-c14f5740dcaa778d9823206a6b1ca0eb-1] regionserver.HStore(310): Store=c14f5740dcaa778d9823206a6b1ca0eb/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-10 19:03:16,039 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/data/hbase/namespace/c14f5740dcaa778d9823206a6b1ca0eb 2023-02-10 19:03:16,040 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/data/hbase/namespace/c14f5740dcaa778d9823206a6b1ca0eb 2023-02-10 19:03:16,043 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for c14f5740dcaa778d9823206a6b1ca0eb 2023-02-10 19:03:16,045 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/data/hbase/namespace/c14f5740dcaa778d9823206a6b1ca0eb/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-10 19:03:16,045 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened c14f5740dcaa778d9823206a6b1ca0eb; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69533898, jitterRate=0.03613582253456116}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-10 19:03:16,045 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for c14f5740dcaa778d9823206a6b1ca0eb: Running coprocessor pre-open hook at 1676055796036Writing region info on filesystem at 1676055796036Initializing all the Stores at 1676055796036Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676055796036Cleaning up temporary data from old regions at 1676055796040 (+4 ms)Cleaning up detritus from prior splits at 1676055796041 (+1 ms)Running coprocessor post-open hooks at 1676055796045 (+4 ms)Region opened successfully at 1676055796045 2023-02-10 19:03:16,046 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:namespace,,1676055795643.c14f5740dcaa778d9823206a6b1ca0eb., pid=6, masterSystemTime=1676055796007 2023-02-10 19:03:16,050 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:namespace,,1676055795643.c14f5740dcaa778d9823206a6b1ca0eb. 2023-02-10 19:03:16,050 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:namespace,,1676055795643.c14f5740dcaa778d9823206a6b1ca0eb. 2023-02-10 19:03:16,051 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=c14f5740dcaa778d9823206a6b1ca0eb, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,44697,1676055795050 2023-02-10 19:03:16,051 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1676055795643.c14f5740dcaa778d9823206a6b1ca0eb.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676055796051"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676055796051"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676055796051"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676055796051"}]},"ts":"1676055796051"} 2023-02-10 19:03:16,054 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-02-10 19:03:16,054 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure c14f5740dcaa778d9823206a6b1ca0eb, server=jenkins-hbase4.apache.org,44697,1676055795050 in 197 msec 2023-02-10 19:03:16,055 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-02-10 19:03:16,056 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=c14f5740dcaa778d9823206a6b1ca0eb, ASSIGN in 359 msec 2023-02-10 19:03:16,056 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-10 19:03:16,056 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676055796056"}]},"ts":"1676055796056"} 2023-02-10 19:03:16,058 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-02-10 19:03:16,060 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-02-10 19:03:16,064 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 417 msec 2023-02-10 19:03:16,066 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-datanode.properties,hadoop-metrics2.properties 2023-02-10 19:03:16,145 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:33383-0x1003f9dbed10000, quorum=127.0.0.1:52230, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-02-10 19:03:16,146 DEBUG [Listener at localhost/37107-EventThread] zookeeper.ZKWatcher(600): master:33383-0x1003f9dbed10000, quorum=127.0.0.1:52230, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-02-10 19:03:16,146 DEBUG [Listener at localhost/37107-EventThread] zookeeper.ZKWatcher(600): master:33383-0x1003f9dbed10000, quorum=127.0.0.1:52230, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-10 19:03:16,149 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-10 19:03:16,150 INFO [RS-EventLoopGroup-14-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42352, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-10 19:03:16,152 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-02-10 19:03:16,161 DEBUG [Listener at localhost/37107-EventThread] zookeeper.ZKWatcher(600): master:33383-0x1003f9dbed10000, quorum=127.0.0.1:52230, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-10 19:03:16,166 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 13 msec 2023-02-10 19:03:16,174 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-02-10 19:03:16,180 DEBUG [Listener at localhost/37107-EventThread] zookeeper.ZKWatcher(600): master:33383-0x1003f9dbed10000, quorum=127.0.0.1:52230, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-10 19:03:16,182 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 7 msec 2023-02-10 19:03:16,193 DEBUG [Listener at localhost/37107-EventThread] zookeeper.ZKWatcher(600): master:33383-0x1003f9dbed10000, quorum=127.0.0.1:52230, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-02-10 19:03:16,195 DEBUG [Listener at localhost/37107-EventThread] zookeeper.ZKWatcher(600): master:33383-0x1003f9dbed10000, quorum=127.0.0.1:52230, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-02-10 19:03:16,195 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1077): Master has completed initialization 1.116sec 2023-02-10 19:03:16,195 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-02-10 19:03:16,195 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-02-10 19:03:16,195 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-02-10 19:03:16,195 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,33383,1676055794975-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-02-10 19:03:16,195 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,33383,1676055794975-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-02-10 19:03:16,197 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1166): Balancer post startup initialization complete, took 0 seconds 2023-02-10 19:03:16,270 DEBUG [Listener at localhost/37107] zookeeper.ReadOnlyZKClient(139): Connect 0x62935b5a to 127.0.0.1:52230 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-10 19:03:16,275 DEBUG [Listener at localhost/37107] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6a8375cd, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-10 19:03:16,277 DEBUG [hconnection-0xab71b16-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-10 19:03:16,279 INFO [RS-EventLoopGroup-13-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36820, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-10 19:03:16,280 INFO [Listener at localhost/37107] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,33383,1676055794975 2023-02-10 19:03:16,280 DEBUG [Listener at localhost/37107] mapreduce.TableSnapshotInputFormatTestBase(193): Ensuring table doesn't exist. 2023-02-10 19:03:16,282 DEBUG [Listener at localhost/37107] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-10 19:03:16,284 INFO [RS-EventLoopGroup-12-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35104, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-10 19:03:16,284 INFO [Listener at localhost/37107] client.HBaseAdmin$15(890): Started disable of testWithMockedMapReduceMultiRegion 2023-02-10 19:03:16,285 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33383] master.HMaster$11(2405): Client=jenkins//172.31.14.131 disable testWithMockedMapReduceMultiRegion 2023-02-10 19:03:16,285 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33383] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.TableNotFoundException: testWithMockedMapReduceMultiRegion at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.checkTableModifiable(AbstractStateMachineTableProcedure.java:125) at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.preflightChecks(AbstractStateMachineTableProcedure.java:157) at org.apache.hadoop.hbase.master.procedure.DisableTableProcedure.(DisableTableProcedure.java:78) at org.apache.hadoop.hbase.master.HMaster$11.run(HMaster.java:2416) at org.apache.hadoop.hbase.master.procedure.MasterProcedureUtil.submitProcedure(MasterProcedureUtil.java:132) at org.apache.hadoop.hbase.master.HMaster.disableTable(HMaster.java:2400) at org.apache.hadoop.hbase.master.MasterRpcServices.disableTable(MasterRpcServices.java:784) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-02-10 19:03:16,285 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33383] ipc.CallRunner(144): callId: 2 service: MasterService methodName: DisableTable size: 94 connection: 172.31.14.131:35104 deadline: 1676055856285, exception=org.apache.hadoop.hbase.TableNotFoundException: testWithMockedMapReduceMultiRegion 2023-02-10 19:03:16,286 INFO [Listener at localhost/37107] mapreduce.TableSnapshotInputFormatTestBase(199): creating table 'testWithMockedMapReduceMultiRegion' 2023-02-10 19:03:16,288 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33383] master.HMaster$4(2102): Client=jenkins//172.31.14.131 create 'testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-10 19:03:16,289 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33383] procedure2.ProcedureExecutor(1029): Stored pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testWithMockedMapReduceMultiRegion 2023-02-10 19:03:16,291 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testWithMockedMapReduceMultiRegion execute state=CREATE_TABLE_PRE_OPERATION 2023-02-10 19:03:16,291 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33383] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testWithMockedMapReduceMultiRegion" procId is: 10 2023-02-10 19:03:16,291 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testWithMockedMapReduceMultiRegion execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-10 19:03:16,292 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33383] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-10 19:03:16,299 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/.tmp/data/default/testWithMockedMapReduceMultiRegion/2fd40e0179a0e968c4672055c041d740 2023-02-10 19:03:16,299 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/.tmp/data/default/testWithMockedMapReduceMultiRegion/f8e2703c94874a9a6d0d1541b43c1eb3 2023-02-10 19:03:16,299 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/.tmp/data/default/testWithMockedMapReduceMultiRegion/54239cd4e87d877b10bac35ba4d2a8c8 2023-02-10 19:03:16,299 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/.tmp/data/default/testWithMockedMapReduceMultiRegion/4539b623282fa7d2beb504c373ad6181 2023-02-10 19:03:16,299 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/.tmp/data/default/testWithMockedMapReduceMultiRegion/b324410564271f3c81fcd7c2326d0435 2023-02-10 19:03:16,299 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/.tmp/data/default/testWithMockedMapReduceMultiRegion/08e6594f21fdd814bfb7b05ba0f4191b 2023-02-10 19:03:16,299 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/.tmp/data/default/testWithMockedMapReduceMultiRegion/6b4a925bbaa3b95421bfaa80da606099 2023-02-10 19:03:16,299 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/.tmp/data/default/testWithMockedMapReduceMultiRegion/eca90e03b313fba8b7a1d6571ea05502 2023-02-10 19:03:16,300 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/.tmp/data/default/testWithMockedMapReduceMultiRegion/2fd40e0179a0e968c4672055c041d740 empty. 2023-02-10 19:03:16,300 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/.tmp/data/default/testWithMockedMapReduceMultiRegion/eca90e03b313fba8b7a1d6571ea05502 empty. 2023-02-10 19:03:16,300 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/.tmp/data/default/testWithMockedMapReduceMultiRegion/6b4a925bbaa3b95421bfaa80da606099 empty. 2023-02-10 19:03:16,300 DEBUG [HFileArchiver-5] backup.HFileArchiver(153): Directory hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/.tmp/data/default/testWithMockedMapReduceMultiRegion/08e6594f21fdd814bfb7b05ba0f4191b empty. 2023-02-10 19:03:16,300 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/.tmp/data/default/testWithMockedMapReduceMultiRegion/b324410564271f3c81fcd7c2326d0435 empty. 2023-02-10 19:03:16,301 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/.tmp/data/default/testWithMockedMapReduceMultiRegion/4539b623282fa7d2beb504c373ad6181 empty. 2023-02-10 19:03:16,301 DEBUG [HFileArchiver-5] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/.tmp/data/default/testWithMockedMapReduceMultiRegion/08e6594f21fdd814bfb7b05ba0f4191b 2023-02-10 19:03:16,301 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/.tmp/data/default/testWithMockedMapReduceMultiRegion/bc3dafb6d0db6c740ff9583526924864 2023-02-10 19:03:16,301 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/.tmp/data/default/testWithMockedMapReduceMultiRegion/b324410564271f3c81fcd7c2326d0435 2023-02-10 19:03:16,301 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/.tmp/data/default/testWithMockedMapReduceMultiRegion/ca626b09070f3e18c31fb632b018370f 2023-02-10 19:03:16,301 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/.tmp/data/default/testWithMockedMapReduceMultiRegion/f8e2703c94874a9a6d0d1541b43c1eb3 empty. 2023-02-10 19:03:16,301 DEBUG [HFileArchiver-6] backup.HFileArchiver(153): Directory hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/.tmp/data/default/testWithMockedMapReduceMultiRegion/54239cd4e87d877b10bac35ba4d2a8c8 empty. 2023-02-10 19:03:16,301 DEBUG [HFileArchiver-5] backup.HFileArchiver(153): Directory hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/.tmp/data/default/testWithMockedMapReduceMultiRegion/bc3dafb6d0db6c740ff9583526924864 empty. 2023-02-10 19:03:16,301 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/.tmp/data/default/testWithMockedMapReduceMultiRegion/4539b623282fa7d2beb504c373ad6181 2023-02-10 19:03:16,302 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/.tmp/data/default/testWithMockedMapReduceMultiRegion/2fd40e0179a0e968c4672055c041d740 2023-02-10 19:03:16,302 DEBUG [HFileArchiver-5] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/.tmp/data/default/testWithMockedMapReduceMultiRegion/bc3dafb6d0db6c740ff9583526924864 2023-02-10 19:03:16,302 DEBUG [HFileArchiver-6] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/.tmp/data/default/testWithMockedMapReduceMultiRegion/54239cd4e87d877b10bac35ba4d2a8c8 2023-02-10 19:03:16,302 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/.tmp/data/default/testWithMockedMapReduceMultiRegion/f8e2703c94874a9a6d0d1541b43c1eb3 2023-02-10 19:03:16,302 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/.tmp/data/default/testWithMockedMapReduceMultiRegion/eca90e03b313fba8b7a1d6571ea05502 2023-02-10 19:03:16,302 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/.tmp/data/default/testWithMockedMapReduceMultiRegion/ca626b09070f3e18c31fb632b018370f empty. 2023-02-10 19:03:16,302 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/.tmp/data/default/testWithMockedMapReduceMultiRegion/6b4a925bbaa3b95421bfaa80da606099 2023-02-10 19:03:16,302 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/.tmp/data/default/testWithMockedMapReduceMultiRegion/ca626b09070f3e18c31fb632b018370f 2023-02-10 19:03:16,302 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testWithMockedMapReduceMultiRegion regions 2023-02-10 19:03:16,312 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/.tmp/data/default/testWithMockedMapReduceMultiRegion/.tabledesc/.tableinfo.0000000001 2023-02-10 19:03:16,313 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(7671): creating {ENCODED => 2fd40e0179a0e968c4672055c041d740, NAME => 'testWithMockedMapReduceMultiRegion,,1676055796287.2fd40e0179a0e968c4672055c041d740.', STARTKEY => '', ENDKEY => 'aaa'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/.tmp 2023-02-10 19:03:16,314 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(7671): creating {ENCODED => f8e2703c94874a9a6d0d1541b43c1eb3, NAME => 'testWithMockedMapReduceMultiRegion,d\x84\x84,1676055796287.f8e2703c94874a9a6d0d1541b43c1eb3.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/.tmp 2023-02-10 19:03:16,314 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(7671): creating {ENCODED => eca90e03b313fba8b7a1d6571ea05502, NAME => 'testWithMockedMapReduceMultiRegion,aaa,1676055796287.eca90e03b313fba8b7a1d6571ea05502.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/.tmp 2023-02-10 19:03:16,325 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,,1676055796287.2fd40e0179a0e968c4672055c041d740.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-10 19:03:16,326 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1603): Closing 2fd40e0179a0e968c4672055c041d740, disabling compactions & flushes 2023-02-10 19:03:16,326 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,,1676055796287.2fd40e0179a0e968c4672055c041d740. 2023-02-10 19:03:16,326 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,,1676055796287.2fd40e0179a0e968c4672055c041d740. 2023-02-10 19:03:16,326 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,,1676055796287.2fd40e0179a0e968c4672055c041d740. after waiting 0 ms 2023-02-10 19:03:16,326 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,,1676055796287.2fd40e0179a0e968c4672055c041d740. 2023-02-10 19:03:16,326 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,,1676055796287.2fd40e0179a0e968c4672055c041d740. 2023-02-10 19:03:16,326 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1557): Region close journal for 2fd40e0179a0e968c4672055c041d740: Waiting for close lock at 1676055796325Disabling compacts and flushes for region at 1676055796326 (+1 ms)Disabling writes for close at 1676055796326Writing region close event to WAL at 1676055796326Closed at 1676055796326 2023-02-10 19:03:16,326 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,aaa,1676055796287.eca90e03b313fba8b7a1d6571ea05502.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-10 19:03:16,326 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1603): Closing eca90e03b313fba8b7a1d6571ea05502, disabling compactions & flushes 2023-02-10 19:03:16,326 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(7671): creating {ENCODED => 6b4a925bbaa3b95421bfaa80da606099, NAME => 'testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676055796287.6b4a925bbaa3b95421bfaa80da606099.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/.tmp 2023-02-10 19:03:16,326 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,aaa,1676055796287.eca90e03b313fba8b7a1d6571ea05502. 2023-02-10 19:03:16,326 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,aaa,1676055796287.eca90e03b313fba8b7a1d6571ea05502. 2023-02-10 19:03:16,326 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,aaa,1676055796287.eca90e03b313fba8b7a1d6571ea05502. after waiting 0 ms 2023-02-10 19:03:16,326 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,aaa,1676055796287.eca90e03b313fba8b7a1d6571ea05502. 2023-02-10 19:03:16,326 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,aaa,1676055796287.eca90e03b313fba8b7a1d6571ea05502. 2023-02-10 19:03:16,326 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1557): Region close journal for eca90e03b313fba8b7a1d6571ea05502: Waiting for close lock at 1676055796326Disabling compacts and flushes for region at 1676055796326Disabling writes for close at 1676055796326Writing region close event to WAL at 1676055796326Closed at 1676055796326 2023-02-10 19:03:16,327 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(7671): creating {ENCODED => 08e6594f21fdd814bfb7b05ba0f4191b, NAME => 'testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676055796287.08e6594f21fdd814bfb7b05ba0f4191b.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/.tmp 2023-02-10 19:03:16,335 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676055796287.6b4a925bbaa3b95421bfaa80da606099.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-10 19:03:16,335 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676055796287.08e6594f21fdd814bfb7b05ba0f4191b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-10 19:03:16,335 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1603): Closing 6b4a925bbaa3b95421bfaa80da606099, disabling compactions & flushes 2023-02-10 19:03:16,335 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1603): Closing 08e6594f21fdd814bfb7b05ba0f4191b, disabling compactions & flushes 2023-02-10 19:03:16,335 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676055796287.6b4a925bbaa3b95421bfaa80da606099. 2023-02-10 19:03:16,335 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676055796287.08e6594f21fdd814bfb7b05ba0f4191b. 2023-02-10 19:03:16,335 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676055796287.6b4a925bbaa3b95421bfaa80da606099. 2023-02-10 19:03:16,335 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676055796287.08e6594f21fdd814bfb7b05ba0f4191b. 2023-02-10 19:03:16,335 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676055796287.6b4a925bbaa3b95421bfaa80da606099. after waiting 0 ms 2023-02-10 19:03:16,335 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676055796287.6b4a925bbaa3b95421bfaa80da606099. 2023-02-10 19:03:16,335 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676055796287.08e6594f21fdd814bfb7b05ba0f4191b. after waiting 0 ms 2023-02-10 19:03:16,335 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676055796287.08e6594f21fdd814bfb7b05ba0f4191b. 2023-02-10 19:03:16,335 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676055796287.6b4a925bbaa3b95421bfaa80da606099. 2023-02-10 19:03:16,335 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676055796287.08e6594f21fdd814bfb7b05ba0f4191b. 2023-02-10 19:03:16,335 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1557): Region close journal for 6b4a925bbaa3b95421bfaa80da606099: Waiting for close lock at 1676055796335Disabling compacts and flushes for region at 1676055796335Disabling writes for close at 1676055796335Writing region close event to WAL at 1676055796335Closed at 1676055796335 2023-02-10 19:03:16,335 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1557): Region close journal for 08e6594f21fdd814bfb7b05ba0f4191b: Waiting for close lock at 1676055796335Disabling compacts and flushes for region at 1676055796335Disabling writes for close at 1676055796335Writing region close event to WAL at 1676055796335Closed at 1676055796335 2023-02-10 19:03:16,336 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(7671): creating {ENCODED => 4539b623282fa7d2beb504c373ad6181, NAME => 'testWithMockedMapReduceMultiRegion,q\x11\x10,1676055796287.4539b623282fa7d2beb504c373ad6181.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/.tmp 2023-02-10 19:03:16,336 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(7671): creating {ENCODED => b324410564271f3c81fcd7c2326d0435, NAME => 'testWithMockedMapReduceMultiRegion,m\xED\xED,1676055796287.b324410564271f3c81fcd7c2326d0435.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/.tmp 2023-02-10 19:03:16,344 INFO [RS:0;jenkins-hbase4:35891] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C35891%2C1676055795020, suffix=, logDir=hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/WALs/jenkins-hbase4.apache.org,35891,1676055795020, archiveDir=hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/oldWALs, maxLogs=32 2023-02-10 19:03:16,345 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,m\xED\xED,1676055796287.b324410564271f3c81fcd7c2326d0435.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-10 19:03:16,345 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1603): Closing b324410564271f3c81fcd7c2326d0435, disabling compactions & flushes 2023-02-10 19:03:16,345 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,m\xED\xED,1676055796287.b324410564271f3c81fcd7c2326d0435. 2023-02-10 19:03:16,345 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,m\xED\xED,1676055796287.b324410564271f3c81fcd7c2326d0435. 2023-02-10 19:03:16,345 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,m\xED\xED,1676055796287.b324410564271f3c81fcd7c2326d0435. after waiting 0 ms 2023-02-10 19:03:16,345 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,m\xED\xED,1676055796287.b324410564271f3c81fcd7c2326d0435. 2023-02-10 19:03:16,345 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,m\xED\xED,1676055796287.b324410564271f3c81fcd7c2326d0435. 2023-02-10 19:03:16,345 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1557): Region close journal for b324410564271f3c81fcd7c2326d0435: Waiting for close lock at 1676055796345Disabling compacts and flushes for region at 1676055796345Disabling writes for close at 1676055796345Writing region close event to WAL at 1676055796345Closed at 1676055796345 2023-02-10 19:03:16,346 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(7671): creating {ENCODED => 54239cd4e87d877b10bac35ba4d2a8c8, NAME => 'testWithMockedMapReduceMultiRegion,t43,1676055796287.54239cd4e87d877b10bac35ba4d2a8c8.', STARTKEY => 't43', ENDKEY => 'wWV'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/.tmp 2023-02-10 19:03:16,348 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,q\x11\x10,1676055796287.4539b623282fa7d2beb504c373ad6181.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-10 19:03:16,348 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1603): Closing 4539b623282fa7d2beb504c373ad6181, disabling compactions & flushes 2023-02-10 19:03:16,348 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,q\x11\x10,1676055796287.4539b623282fa7d2beb504c373ad6181. 2023-02-10 19:03:16,348 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,q\x11\x10,1676055796287.4539b623282fa7d2beb504c373ad6181. 2023-02-10 19:03:16,348 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,q\x11\x10,1676055796287.4539b623282fa7d2beb504c373ad6181. after waiting 0 ms 2023-02-10 19:03:16,348 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,q\x11\x10,1676055796287.4539b623282fa7d2beb504c373ad6181. 2023-02-10 19:03:16,348 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,q\x11\x10,1676055796287.4539b623282fa7d2beb504c373ad6181. 2023-02-10 19:03:16,348 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1557): Region close journal for 4539b623282fa7d2beb504c373ad6181: Waiting for close lock at 1676055796348Disabling compacts and flushes for region at 1676055796348Disabling writes for close at 1676055796348Writing region close event to WAL at 1676055796348Closed at 1676055796348 2023-02-10 19:03:16,349 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(7671): creating {ENCODED => bc3dafb6d0db6c740ff9583526924864, NAME => 'testWithMockedMapReduceMultiRegion,wWV,1676055796287.bc3dafb6d0db6c740ff9583526924864.', STARTKEY => 'wWV', ENDKEY => 'zz{'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/.tmp 2023-02-10 19:03:16,358 DEBUG [RS-EventLoopGroup-14-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39007,DS-37d8094c-4575-44d0-b4c4-ce71f3293d18,DISK] 2023-02-10 19:03:16,358 DEBUG [RS-EventLoopGroup-14-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46583,DS-0c5b02b1-7b11-44ff-b8de-d8dea6849c5a,DISK] 2023-02-10 19:03:16,363 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,t43,1676055796287.54239cd4e87d877b10bac35ba4d2a8c8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-10 19:03:16,363 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1603): Closing 54239cd4e87d877b10bac35ba4d2a8c8, disabling compactions & flushes 2023-02-10 19:03:16,363 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,t43,1676055796287.54239cd4e87d877b10bac35ba4d2a8c8. 2023-02-10 19:03:16,363 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,t43,1676055796287.54239cd4e87d877b10bac35ba4d2a8c8. 2023-02-10 19:03:16,363 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,t43,1676055796287.54239cd4e87d877b10bac35ba4d2a8c8. after waiting 0 ms 2023-02-10 19:03:16,363 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,t43,1676055796287.54239cd4e87d877b10bac35ba4d2a8c8. 2023-02-10 19:03:16,363 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,t43,1676055796287.54239cd4e87d877b10bac35ba4d2a8c8. 2023-02-10 19:03:16,363 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1557): Region close journal for 54239cd4e87d877b10bac35ba4d2a8c8: Waiting for close lock at 1676055796363Disabling compacts and flushes for region at 1676055796363Disabling writes for close at 1676055796363Writing region close event to WAL at 1676055796363Closed at 1676055796363 2023-02-10 19:03:16,363 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(7671): creating {ENCODED => ca626b09070f3e18c31fb632b018370f, NAME => 'testWithMockedMapReduceMultiRegion,zz{,1676055796287.ca626b09070f3e18c31fb632b018370f.', STARTKEY => 'zz{', ENDKEY => ''}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/.tmp 2023-02-10 19:03:16,365 INFO [RS:0;jenkins-hbase4:35891] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/WALs/jenkins-hbase4.apache.org,35891,1676055795020/jenkins-hbase4.apache.org%2C35891%2C1676055795020.1676055796344 2023-02-10 19:03:16,365 DEBUG [RS:0;jenkins-hbase4:35891] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:39007,DS-37d8094c-4575-44d0-b4c4-ce71f3293d18,DISK], DatanodeInfoWithStorage[127.0.0.1:46583,DS-0c5b02b1-7b11-44ff-b8de-d8dea6849c5a,DISK]] 2023-02-10 19:03:16,365 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,wWV,1676055796287.bc3dafb6d0db6c740ff9583526924864.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-10 19:03:16,365 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1603): Closing bc3dafb6d0db6c740ff9583526924864, disabling compactions & flushes 2023-02-10 19:03:16,365 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,wWV,1676055796287.bc3dafb6d0db6c740ff9583526924864. 2023-02-10 19:03:16,365 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,wWV,1676055796287.bc3dafb6d0db6c740ff9583526924864. 2023-02-10 19:03:16,365 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,wWV,1676055796287.bc3dafb6d0db6c740ff9583526924864. after waiting 0 ms 2023-02-10 19:03:16,365 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,wWV,1676055796287.bc3dafb6d0db6c740ff9583526924864. 2023-02-10 19:03:16,365 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,wWV,1676055796287.bc3dafb6d0db6c740ff9583526924864. 2023-02-10 19:03:16,365 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1557): Region close journal for bc3dafb6d0db6c740ff9583526924864: Waiting for close lock at 1676055796365Disabling compacts and flushes for region at 1676055796365Disabling writes for close at 1676055796365Writing region close event to WAL at 1676055796365Closed at 1676055796365 2023-02-10 19:03:16,372 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,zz{,1676055796287.ca626b09070f3e18c31fb632b018370f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-10 19:03:16,372 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1603): Closing ca626b09070f3e18c31fb632b018370f, disabling compactions & flushes 2023-02-10 19:03:16,372 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,zz{,1676055796287.ca626b09070f3e18c31fb632b018370f. 2023-02-10 19:03:16,373 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,zz{,1676055796287.ca626b09070f3e18c31fb632b018370f. 2023-02-10 19:03:16,373 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,zz{,1676055796287.ca626b09070f3e18c31fb632b018370f. after waiting 0 ms 2023-02-10 19:03:16,373 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,zz{,1676055796287.ca626b09070f3e18c31fb632b018370f. 2023-02-10 19:03:16,373 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,zz{,1676055796287.ca626b09070f3e18c31fb632b018370f. 2023-02-10 19:03:16,373 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1557): Region close journal for ca626b09070f3e18c31fb632b018370f: Waiting for close lock at 1676055796372Disabling compacts and flushes for region at 1676055796372Disabling writes for close at 1676055796373 (+1 ms)Writing region close event to WAL at 1676055796373Closed at 1676055796373 2023-02-10 19:03:16,393 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33383] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-10 19:03:16,595 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33383] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-10 19:03:16,726 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,d\x84\x84,1676055796287.f8e2703c94874a9a6d0d1541b43c1eb3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-10 19:03:16,727 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1603): Closing f8e2703c94874a9a6d0d1541b43c1eb3, disabling compactions & flushes 2023-02-10 19:03:16,727 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,d\x84\x84,1676055796287.f8e2703c94874a9a6d0d1541b43c1eb3. 2023-02-10 19:03:16,727 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,d\x84\x84,1676055796287.f8e2703c94874a9a6d0d1541b43c1eb3. 2023-02-10 19:03:16,727 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,d\x84\x84,1676055796287.f8e2703c94874a9a6d0d1541b43c1eb3. after waiting 0 ms 2023-02-10 19:03:16,727 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,d\x84\x84,1676055796287.f8e2703c94874a9a6d0d1541b43c1eb3. 2023-02-10 19:03:16,727 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,d\x84\x84,1676055796287.f8e2703c94874a9a6d0d1541b43c1eb3. 2023-02-10 19:03:16,727 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1557): Region close journal for f8e2703c94874a9a6d0d1541b43c1eb3: Waiting for close lock at 1676055796727Disabling compacts and flushes for region at 1676055796727Disabling writes for close at 1676055796727Writing region close event to WAL at 1676055796727Closed at 1676055796727 2023-02-10 19:03:16,729 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testWithMockedMapReduceMultiRegion execute state=CREATE_TABLE_ADD_TO_META 2023-02-10 19:03:16,730 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,,1676055796287.2fd40e0179a0e968c4672055c041d740.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1676055796730"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676055796730"}]},"ts":"1676055796730"} 2023-02-10 19:03:16,730 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,aaa,1676055796287.eca90e03b313fba8b7a1d6571ea05502.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676055796730"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676055796730"}]},"ts":"1676055796730"} 2023-02-10 19:03:16,730 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,g\\xA7\\xA7,1676055796287.6b4a925bbaa3b95421bfaa80da606099.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676055796730"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676055796730"}]},"ts":"1676055796730"} 2023-02-10 19:03:16,730 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,j\\xCA\\xCA,1676055796287.08e6594f21fdd814bfb7b05ba0f4191b.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676055796730"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676055796730"}]},"ts":"1676055796730"} 2023-02-10 19:03:16,730 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,m\\xED\\xED,1676055796287.b324410564271f3c81fcd7c2326d0435.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676055796730"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676055796730"}]},"ts":"1676055796730"} 2023-02-10 19:03:16,730 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,q\\x11\\x10,1676055796287.4539b623282fa7d2beb504c373ad6181.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676055796730"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676055796730"}]},"ts":"1676055796730"} 2023-02-10 19:03:16,730 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,t43,1676055796287.54239cd4e87d877b10bac35ba4d2a8c8.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676055796730"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676055796730"}]},"ts":"1676055796730"} 2023-02-10 19:03:16,730 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,wWV,1676055796287.bc3dafb6d0db6c740ff9583526924864.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676055796730"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676055796730"}]},"ts":"1676055796730"} 2023-02-10 19:03:16,730 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,zz{,1676055796287.ca626b09070f3e18c31fb632b018370f.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1676055796730"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676055796730"}]},"ts":"1676055796730"} 2023-02-10 19:03:16,730 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,d\\x84\\x84,1676055796287.f8e2703c94874a9a6d0d1541b43c1eb3.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676055796730"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676055796730"}]},"ts":"1676055796730"} 2023-02-10 19:03:16,733 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 10 regions to meta. 2023-02-10 19:03:16,733 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testWithMockedMapReduceMultiRegion execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-10 19:03:16,733 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676055796733"}]},"ts":"1676055796733"} 2023-02-10 19:03:16,734 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testWithMockedMapReduceMultiRegion, state=ENABLING in hbase:meta 2023-02-10 19:03:16,738 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-10 19:03:16,745 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-10 19:03:16,745 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-10 19:03:16,745 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-10 19:03:16,745 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=2fd40e0179a0e968c4672055c041d740, ASSIGN}, {pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=eca90e03b313fba8b7a1d6571ea05502, ASSIGN}, {pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=f8e2703c94874a9a6d0d1541b43c1eb3, ASSIGN}, {pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=6b4a925bbaa3b95421bfaa80da606099, ASSIGN}, {pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=08e6594f21fdd814bfb7b05ba0f4191b, ASSIGN}, {pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=b324410564271f3c81fcd7c2326d0435, ASSIGN}, {pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=4539b623282fa7d2beb504c373ad6181, ASSIGN}, {pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=54239cd4e87d877b10bac35ba4d2a8c8, ASSIGN}, {pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=bc3dafb6d0db6c740ff9583526924864, ASSIGN}, {pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=ca626b09070f3e18c31fb632b018370f, ASSIGN}] 2023-02-10 19:03:16,748 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=f8e2703c94874a9a6d0d1541b43c1eb3, ASSIGN 2023-02-10 19:03:16,749 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=bc3dafb6d0db6c740ff9583526924864, ASSIGN 2023-02-10 19:03:16,749 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=54239cd4e87d877b10bac35ba4d2a8c8, ASSIGN 2023-02-10 19:03:16,749 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=4539b623282fa7d2beb504c373ad6181, ASSIGN 2023-02-10 19:03:16,750 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=f8e2703c94874a9a6d0d1541b43c1eb3, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,35891,1676055795020; forceNewPlan=false, retain=false 2023-02-10 19:03:16,750 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=bc3dafb6d0db6c740ff9583526924864, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,35891,1676055795020; forceNewPlan=false, retain=false 2023-02-10 19:03:16,750 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=4539b623282fa7d2beb504c373ad6181, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,35891,1676055795020; forceNewPlan=false, retain=false 2023-02-10 19:03:16,750 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=ca626b09070f3e18c31fb632b018370f, ASSIGN 2023-02-10 19:03:16,750 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=54239cd4e87d877b10bac35ba4d2a8c8, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,44697,1676055795050; forceNewPlan=false, retain=false 2023-02-10 19:03:16,751 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=b324410564271f3c81fcd7c2326d0435, ASSIGN 2023-02-10 19:03:16,751 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=08e6594f21fdd814bfb7b05ba0f4191b, ASSIGN 2023-02-10 19:03:16,751 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=6b4a925bbaa3b95421bfaa80da606099, ASSIGN 2023-02-10 19:03:16,751 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=ca626b09070f3e18c31fb632b018370f, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,44697,1676055795050; forceNewPlan=false, retain=false 2023-02-10 19:03:16,751 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=eca90e03b313fba8b7a1d6571ea05502, ASSIGN 2023-02-10 19:03:16,752 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=b324410564271f3c81fcd7c2326d0435, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,44697,1676055795050; forceNewPlan=false, retain=false 2023-02-10 19:03:16,752 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=08e6594f21fdd814bfb7b05ba0f4191b, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,35891,1676055795020; forceNewPlan=false, retain=false 2023-02-10 19:03:16,752 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=6b4a925bbaa3b95421bfaa80da606099, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,44697,1676055795050; forceNewPlan=false, retain=false 2023-02-10 19:03:16,752 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=2fd40e0179a0e968c4672055c041d740, ASSIGN 2023-02-10 19:03:16,754 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=eca90e03b313fba8b7a1d6571ea05502, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,35891,1676055795020; forceNewPlan=false, retain=false 2023-02-10 19:03:16,754 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=2fd40e0179a0e968c4672055c041d740, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,44697,1676055795050; forceNewPlan=false, retain=false 2023-02-10 19:03:16,896 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33383] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-10 19:03:16,900 INFO [jenkins-hbase4:33383] balancer.BaseLoadBalancer(1545): Reassigned 10 regions. 10 retained the pre-restart assignment. 2023-02-10 19:03:16,906 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=b324410564271f3c81fcd7c2326d0435, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,44697,1676055795050 2023-02-10 19:03:16,906 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=6b4a925bbaa3b95421bfaa80da606099, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,44697,1676055795050 2023-02-10 19:03:16,906 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,m\\xED\\xED,1676055796287.b324410564271f3c81fcd7c2326d0435.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676055796906"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676055796906"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676055796906"}]},"ts":"1676055796906"} 2023-02-10 19:03:16,906 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=2fd40e0179a0e968c4672055c041d740, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,44697,1676055795050 2023-02-10 19:03:16,906 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,g\\xA7\\xA7,1676055796287.6b4a925bbaa3b95421bfaa80da606099.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676055796906"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676055796906"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676055796906"}]},"ts":"1676055796906"} 2023-02-10 19:03:16,906 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,,1676055796287.2fd40e0179a0e968c4672055c041d740.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1676055796906"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676055796906"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676055796906"}]},"ts":"1676055796906"} 2023-02-10 19:03:16,906 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=ca626b09070f3e18c31fb632b018370f, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,44697,1676055795050 2023-02-10 19:03:16,906 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=18 updating hbase:meta row=54239cd4e87d877b10bac35ba4d2a8c8, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,44697,1676055795050 2023-02-10 19:03:16,906 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,zz{,1676055796287.ca626b09070f3e18c31fb632b018370f.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1676055796906"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676055796906"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676055796906"}]},"ts":"1676055796906"} 2023-02-10 19:03:16,907 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,t43,1676055796287.54239cd4e87d877b10bac35ba4d2a8c8.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676055796906"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676055796906"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676055796906"}]},"ts":"1676055796906"} 2023-02-10 19:03:16,908 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=21, ppid=16, state=RUNNABLE; OpenRegionProcedure b324410564271f3c81fcd7c2326d0435, server=jenkins-hbase4.apache.org,44697,1676055795050}] 2023-02-10 19:03:16,909 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=22, ppid=14, state=RUNNABLE; OpenRegionProcedure 6b4a925bbaa3b95421bfaa80da606099, server=jenkins-hbase4.apache.org,44697,1676055795050}] 2023-02-10 19:03:16,910 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=23, ppid=11, state=RUNNABLE; OpenRegionProcedure 2fd40e0179a0e968c4672055c041d740, server=jenkins-hbase4.apache.org,44697,1676055795050}] 2023-02-10 19:03:16,911 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=24, ppid=20, state=RUNNABLE; OpenRegionProcedure ca626b09070f3e18c31fb632b018370f, server=jenkins-hbase4.apache.org,44697,1676055795050}] 2023-02-10 19:03:16,911 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=17 updating hbase:meta row=4539b623282fa7d2beb504c373ad6181, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,35891,1676055795020 2023-02-10 19:03:16,911 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=25, ppid=18, state=RUNNABLE; OpenRegionProcedure 54239cd4e87d877b10bac35ba4d2a8c8, server=jenkins-hbase4.apache.org,44697,1676055795050}] 2023-02-10 19:03:16,911 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,q\\x11\\x10,1676055796287.4539b623282fa7d2beb504c373ad6181.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676055796911"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676055796911"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676055796911"}]},"ts":"1676055796911"} 2023-02-10 19:03:16,913 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=12 updating hbase:meta row=eca90e03b313fba8b7a1d6571ea05502, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,35891,1676055795020 2023-02-10 19:03:16,913 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,aaa,1676055796287.eca90e03b313fba8b7a1d6571ea05502.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676055796912"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676055796912"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676055796912"}]},"ts":"1676055796912"} 2023-02-10 19:03:16,913 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=26, ppid=17, state=RUNNABLE; OpenRegionProcedure 4539b623282fa7d2beb504c373ad6181, server=jenkins-hbase4.apache.org,35891,1676055795020}] 2023-02-10 19:03:16,914 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=27, ppid=12, state=RUNNABLE; OpenRegionProcedure eca90e03b313fba8b7a1d6571ea05502, server=jenkins-hbase4.apache.org,35891,1676055795020}] 2023-02-10 19:03:16,914 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=f8e2703c94874a9a6d0d1541b43c1eb3, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,35891,1676055795020 2023-02-10 19:03:16,915 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=19 updating hbase:meta row=bc3dafb6d0db6c740ff9583526924864, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,35891,1676055795020 2023-02-10 19:03:16,915 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,d\\x84\\x84,1676055796287.f8e2703c94874a9a6d0d1541b43c1eb3.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676055796914"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676055796914"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676055796914"}]},"ts":"1676055796914"} 2023-02-10 19:03:16,915 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,wWV,1676055796287.bc3dafb6d0db6c740ff9583526924864.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676055796915"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676055796915"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676055796915"}]},"ts":"1676055796915"} 2023-02-10 19:03:16,915 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=08e6594f21fdd814bfb7b05ba0f4191b, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,35891,1676055795020 2023-02-10 19:03:16,915 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,j\\xCA\\xCA,1676055796287.08e6594f21fdd814bfb7b05ba0f4191b.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676055796915"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676055796915"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676055796915"}]},"ts":"1676055796915"} 2023-02-10 19:03:16,916 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=28, ppid=13, state=RUNNABLE; OpenRegionProcedure f8e2703c94874a9a6d0d1541b43c1eb3, server=jenkins-hbase4.apache.org,35891,1676055795020}] 2023-02-10 19:03:16,917 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=29, ppid=19, state=RUNNABLE; OpenRegionProcedure bc3dafb6d0db6c740ff9583526924864, server=jenkins-hbase4.apache.org,35891,1676055795020}] 2023-02-10 19:03:16,917 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=30, ppid=15, state=RUNNABLE; OpenRegionProcedure 08e6594f21fdd814bfb7b05ba0f4191b, server=jenkins-hbase4.apache.org,35891,1676055795020}] 2023-02-10 19:03:17,064 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,zz{,1676055796287.ca626b09070f3e18c31fb632b018370f. 2023-02-10 19:03:17,064 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => ca626b09070f3e18c31fb632b018370f, NAME => 'testWithMockedMapReduceMultiRegion,zz{,1676055796287.ca626b09070f3e18c31fb632b018370f.', STARTKEY => 'zz{', ENDKEY => ''} 2023-02-10 19:03:17,064 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion ca626b09070f3e18c31fb632b018370f 2023-02-10 19:03:17,064 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,zz{,1676055796287.ca626b09070f3e18c31fb632b018370f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-10 19:03:17,064 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for ca626b09070f3e18c31fb632b018370f 2023-02-10 19:03:17,064 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for ca626b09070f3e18c31fb632b018370f 2023-02-10 19:03:17,065 INFO [StoreOpener-ca626b09070f3e18c31fb632b018370f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region ca626b09070f3e18c31fb632b018370f 2023-02-10 19:03:17,066 DEBUG [StoreOpener-ca626b09070f3e18c31fb632b018370f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/data/default/testWithMockedMapReduceMultiRegion/ca626b09070f3e18c31fb632b018370f/f1 2023-02-10 19:03:17,066 DEBUG [StoreOpener-ca626b09070f3e18c31fb632b018370f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/data/default/testWithMockedMapReduceMultiRegion/ca626b09070f3e18c31fb632b018370f/f1 2023-02-10 19:03:17,067 INFO [StoreOpener-ca626b09070f3e18c31fb632b018370f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ca626b09070f3e18c31fb632b018370f columnFamilyName f1 2023-02-10 19:03:17,067 INFO [StoreOpener-ca626b09070f3e18c31fb632b018370f-1] regionserver.HStore(310): Store=ca626b09070f3e18c31fb632b018370f/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-10 19:03:17,067 INFO [StoreOpener-ca626b09070f3e18c31fb632b018370f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region ca626b09070f3e18c31fb632b018370f 2023-02-10 19:03:17,068 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,q\x11\x10,1676055796287.4539b623282fa7d2beb504c373ad6181. 2023-02-10 19:03:17,068 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 4539b623282fa7d2beb504c373ad6181, NAME => 'testWithMockedMapReduceMultiRegion,q\x11\x10,1676055796287.4539b623282fa7d2beb504c373ad6181.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'} 2023-02-10 19:03:17,068 DEBUG [StoreOpener-ca626b09070f3e18c31fb632b018370f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/data/default/testWithMockedMapReduceMultiRegion/ca626b09070f3e18c31fb632b018370f/f2 2023-02-10 19:03:17,068 DEBUG [StoreOpener-ca626b09070f3e18c31fb632b018370f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/data/default/testWithMockedMapReduceMultiRegion/ca626b09070f3e18c31fb632b018370f/f2 2023-02-10 19:03:17,068 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion 4539b623282fa7d2beb504c373ad6181 2023-02-10 19:03:17,069 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,q\x11\x10,1676055796287.4539b623282fa7d2beb504c373ad6181.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-10 19:03:17,069 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 4539b623282fa7d2beb504c373ad6181 2023-02-10 19:03:17,069 INFO [StoreOpener-ca626b09070f3e18c31fb632b018370f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ca626b09070f3e18c31fb632b018370f columnFamilyName f2 2023-02-10 19:03:17,069 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 4539b623282fa7d2beb504c373ad6181 2023-02-10 19:03:17,069 INFO [StoreOpener-ca626b09070f3e18c31fb632b018370f-1] regionserver.HStore(310): Store=ca626b09070f3e18c31fb632b018370f/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-10 19:03:17,070 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/data/default/testWithMockedMapReduceMultiRegion/ca626b09070f3e18c31fb632b018370f 2023-02-10 19:03:17,070 INFO [StoreOpener-4539b623282fa7d2beb504c373ad6181-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 4539b623282fa7d2beb504c373ad6181 2023-02-10 19:03:17,070 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/data/default/testWithMockedMapReduceMultiRegion/ca626b09070f3e18c31fb632b018370f 2023-02-10 19:03:17,071 DEBUG [StoreOpener-4539b623282fa7d2beb504c373ad6181-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/data/default/testWithMockedMapReduceMultiRegion/4539b623282fa7d2beb504c373ad6181/f1 2023-02-10 19:03:17,071 DEBUG [StoreOpener-4539b623282fa7d2beb504c373ad6181-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/data/default/testWithMockedMapReduceMultiRegion/4539b623282fa7d2beb504c373ad6181/f1 2023-02-10 19:03:17,071 INFO [StoreOpener-4539b623282fa7d2beb504c373ad6181-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4539b623282fa7d2beb504c373ad6181 columnFamilyName f1 2023-02-10 19:03:17,071 INFO [StoreOpener-4539b623282fa7d2beb504c373ad6181-1] regionserver.HStore(310): Store=4539b623282fa7d2beb504c373ad6181/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-10 19:03:17,072 INFO [StoreOpener-4539b623282fa7d2beb504c373ad6181-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 4539b623282fa7d2beb504c373ad6181 2023-02-10 19:03:17,072 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-10 19:03:17,073 DEBUG [StoreOpener-4539b623282fa7d2beb504c373ad6181-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/data/default/testWithMockedMapReduceMultiRegion/4539b623282fa7d2beb504c373ad6181/f2 2023-02-10 19:03:17,073 DEBUG [StoreOpener-4539b623282fa7d2beb504c373ad6181-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/data/default/testWithMockedMapReduceMultiRegion/4539b623282fa7d2beb504c373ad6181/f2 2023-02-10 19:03:17,073 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for ca626b09070f3e18c31fb632b018370f 2023-02-10 19:03:17,073 INFO [StoreOpener-4539b623282fa7d2beb504c373ad6181-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4539b623282fa7d2beb504c373ad6181 columnFamilyName f2 2023-02-10 19:03:17,074 INFO [StoreOpener-4539b623282fa7d2beb504c373ad6181-1] regionserver.HStore(310): Store=4539b623282fa7d2beb504c373ad6181/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-10 19:03:17,074 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/data/default/testWithMockedMapReduceMultiRegion/4539b623282fa7d2beb504c373ad6181 2023-02-10 19:03:17,075 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/data/default/testWithMockedMapReduceMultiRegion/4539b623282fa7d2beb504c373ad6181 2023-02-10 19:03:17,076 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-10 19:03:17,076 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/data/default/testWithMockedMapReduceMultiRegion/ca626b09070f3e18c31fb632b018370f/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-10 19:03:17,077 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened ca626b09070f3e18c31fb632b018370f; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66355992, jitterRate=-0.011218667030334473}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-10 19:03:17,077 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for ca626b09070f3e18c31fb632b018370f: Running coprocessor pre-open hook at 1676055797064Writing region info on filesystem at 1676055797064Initializing all the Stores at 1676055797065 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676055797065Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676055797065Cleaning up temporary data from old regions at 1676055797071 (+6 ms)Cleaning up detritus from prior splits at 1676055797071Running coprocessor post-open hooks at 1676055797077 (+6 ms)Region opened successfully at 1676055797077 2023-02-10 19:03:17,077 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 4539b623282fa7d2beb504c373ad6181 2023-02-10 19:03:17,077 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,zz{,1676055796287.ca626b09070f3e18c31fb632b018370f., pid=24, masterSystemTime=1676055797060 2023-02-10 19:03:17,079 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,zz{,1676055796287.ca626b09070f3e18c31fb632b018370f. 2023-02-10 19:03:17,079 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,zz{,1676055796287.ca626b09070f3e18c31fb632b018370f. 2023-02-10 19:03:17,079 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,,1676055796287.2fd40e0179a0e968c4672055c041d740. 2023-02-10 19:03:17,079 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/data/default/testWithMockedMapReduceMultiRegion/4539b623282fa7d2beb504c373ad6181/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-10 19:03:17,079 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 2fd40e0179a0e968c4672055c041d740, NAME => 'testWithMockedMapReduceMultiRegion,,1676055796287.2fd40e0179a0e968c4672055c041d740.', STARTKEY => '', ENDKEY => 'aaa'} 2023-02-10 19:03:17,079 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=ca626b09070f3e18c31fb632b018370f, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,44697,1676055795050 2023-02-10 19:03:17,079 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion 2fd40e0179a0e968c4672055c041d740 2023-02-10 19:03:17,079 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,zz{,1676055796287.ca626b09070f3e18c31fb632b018370f.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1676055797079"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676055797079"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676055797079"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676055797079"}]},"ts":"1676055797079"} 2023-02-10 19:03:17,080 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 4539b623282fa7d2beb504c373ad6181; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65347330, jitterRate=-0.026248902082443237}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-10 19:03:17,079 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,,1676055796287.2fd40e0179a0e968c4672055c041d740.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-10 19:03:17,080 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 4539b623282fa7d2beb504c373ad6181: Running coprocessor pre-open hook at 1676055797069Writing region info on filesystem at 1676055797069Initializing all the Stores at 1676055797069Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676055797070 (+1 ms)Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676055797070Cleaning up temporary data from old regions at 1676055797075 (+5 ms)Cleaning up detritus from prior splits at 1676055797075Running coprocessor post-open hooks at 1676055797080 (+5 ms)Region opened successfully at 1676055797080 2023-02-10 19:03:17,080 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 2fd40e0179a0e968c4672055c041d740 2023-02-10 19:03:17,080 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 2fd40e0179a0e968c4672055c041d740 2023-02-10 19:03:17,080 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,q\x11\x10,1676055796287.4539b623282fa7d2beb504c373ad6181., pid=26, masterSystemTime=1676055797065 2023-02-10 19:03:17,081 INFO [StoreOpener-2fd40e0179a0e968c4672055c041d740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 2fd40e0179a0e968c4672055c041d740 2023-02-10 19:03:17,082 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,q\x11\x10,1676055796287.4539b623282fa7d2beb504c373ad6181. 2023-02-10 19:03:17,082 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,q\x11\x10,1676055796287.4539b623282fa7d2beb504c373ad6181. 2023-02-10 19:03:17,082 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,aaa,1676055796287.eca90e03b313fba8b7a1d6571ea05502. 2023-02-10 19:03:17,082 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => eca90e03b313fba8b7a1d6571ea05502, NAME => 'testWithMockedMapReduceMultiRegion,aaa,1676055796287.eca90e03b313fba8b7a1d6571ea05502.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'} 2023-02-10 19:03:17,082 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=17 updating hbase:meta row=4539b623282fa7d2beb504c373ad6181, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,35891,1676055795020 2023-02-10 19:03:17,082 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion eca90e03b313fba8b7a1d6571ea05502 2023-02-10 19:03:17,082 DEBUG [StoreOpener-2fd40e0179a0e968c4672055c041d740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/data/default/testWithMockedMapReduceMultiRegion/2fd40e0179a0e968c4672055c041d740/f1 2023-02-10 19:03:17,082 DEBUG [StoreOpener-2fd40e0179a0e968c4672055c041d740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/data/default/testWithMockedMapReduceMultiRegion/2fd40e0179a0e968c4672055c041d740/f1 2023-02-10 19:03:17,082 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,aaa,1676055796287.eca90e03b313fba8b7a1d6571ea05502.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-10 19:03:17,082 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,q\\x11\\x10,1676055796287.4539b623282fa7d2beb504c373ad6181.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676055797082"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676055797082"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676055797082"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676055797082"}]},"ts":"1676055797082"} 2023-02-10 19:03:17,082 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for eca90e03b313fba8b7a1d6571ea05502 2023-02-10 19:03:17,082 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=24, resume processing ppid=20 2023-02-10 19:03:17,082 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for eca90e03b313fba8b7a1d6571ea05502 2023-02-10 19:03:17,082 INFO [StoreOpener-2fd40e0179a0e968c4672055c041d740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2fd40e0179a0e968c4672055c041d740 columnFamilyName f1 2023-02-10 19:03:17,082 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=24, ppid=20, state=SUCCESS; OpenRegionProcedure ca626b09070f3e18c31fb632b018370f, server=jenkins-hbase4.apache.org,44697,1676055795050 in 170 msec 2023-02-10 19:03:17,083 INFO [StoreOpener-2fd40e0179a0e968c4672055c041d740-1] regionserver.HStore(310): Store=2fd40e0179a0e968c4672055c041d740/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-10 19:03:17,083 INFO [StoreOpener-2fd40e0179a0e968c4672055c041d740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 2fd40e0179a0e968c4672055c041d740 2023-02-10 19:03:17,084 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=20, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=ca626b09070f3e18c31fb632b018370f, ASSIGN in 337 msec 2023-02-10 19:03:17,084 INFO [StoreOpener-eca90e03b313fba8b7a1d6571ea05502-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region eca90e03b313fba8b7a1d6571ea05502 2023-02-10 19:03:17,084 DEBUG [StoreOpener-2fd40e0179a0e968c4672055c041d740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/data/default/testWithMockedMapReduceMultiRegion/2fd40e0179a0e968c4672055c041d740/f2 2023-02-10 19:03:17,084 DEBUG [StoreOpener-2fd40e0179a0e968c4672055c041d740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/data/default/testWithMockedMapReduceMultiRegion/2fd40e0179a0e968c4672055c041d740/f2 2023-02-10 19:03:17,084 INFO [StoreOpener-2fd40e0179a0e968c4672055c041d740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2fd40e0179a0e968c4672055c041d740 columnFamilyName f2 2023-02-10 19:03:17,085 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=26, resume processing ppid=17 2023-02-10 19:03:17,085 INFO [StoreOpener-2fd40e0179a0e968c4672055c041d740-1] regionserver.HStore(310): Store=2fd40e0179a0e968c4672055c041d740/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-10 19:03:17,085 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=26, ppid=17, state=SUCCESS; OpenRegionProcedure 4539b623282fa7d2beb504c373ad6181, server=jenkins-hbase4.apache.org,35891,1676055795020 in 171 msec 2023-02-10 19:03:17,085 DEBUG [StoreOpener-eca90e03b313fba8b7a1d6571ea05502-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/data/default/testWithMockedMapReduceMultiRegion/eca90e03b313fba8b7a1d6571ea05502/f1 2023-02-10 19:03:17,085 DEBUG [StoreOpener-eca90e03b313fba8b7a1d6571ea05502-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/data/default/testWithMockedMapReduceMultiRegion/eca90e03b313fba8b7a1d6571ea05502/f1 2023-02-10 19:03:17,085 INFO [StoreOpener-eca90e03b313fba8b7a1d6571ea05502-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region eca90e03b313fba8b7a1d6571ea05502 columnFamilyName f1 2023-02-10 19:03:17,086 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/data/default/testWithMockedMapReduceMultiRegion/2fd40e0179a0e968c4672055c041d740 2023-02-10 19:03:17,086 INFO [StoreOpener-eca90e03b313fba8b7a1d6571ea05502-1] regionserver.HStore(310): Store=eca90e03b313fba8b7a1d6571ea05502/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-10 19:03:17,086 INFO [StoreOpener-eca90e03b313fba8b7a1d6571ea05502-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region eca90e03b313fba8b7a1d6571ea05502 2023-02-10 19:03:17,086 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/data/default/testWithMockedMapReduceMultiRegion/2fd40e0179a0e968c4672055c041d740 2023-02-10 19:03:17,087 DEBUG [StoreOpener-eca90e03b313fba8b7a1d6571ea05502-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/data/default/testWithMockedMapReduceMultiRegion/eca90e03b313fba8b7a1d6571ea05502/f2 2023-02-10 19:03:17,087 DEBUG [StoreOpener-eca90e03b313fba8b7a1d6571ea05502-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/data/default/testWithMockedMapReduceMultiRegion/eca90e03b313fba8b7a1d6571ea05502/f2 2023-02-10 19:03:17,087 INFO [StoreOpener-eca90e03b313fba8b7a1d6571ea05502-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region eca90e03b313fba8b7a1d6571ea05502 columnFamilyName f2 2023-02-10 19:03:17,088 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=4539b623282fa7d2beb504c373ad6181, ASSIGN in 340 msec 2023-02-10 19:03:17,088 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-10 19:03:17,088 INFO [StoreOpener-eca90e03b313fba8b7a1d6571ea05502-1] regionserver.HStore(310): Store=eca90e03b313fba8b7a1d6571ea05502/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-10 19:03:17,088 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/data/default/testWithMockedMapReduceMultiRegion/eca90e03b313fba8b7a1d6571ea05502 2023-02-10 19:03:17,089 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/data/default/testWithMockedMapReduceMultiRegion/eca90e03b313fba8b7a1d6571ea05502 2023-02-10 19:03:17,089 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 2fd40e0179a0e968c4672055c041d740 2023-02-10 19:03:17,090 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-10 19:03:17,090 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/data/default/testWithMockedMapReduceMultiRegion/2fd40e0179a0e968c4672055c041d740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-10 19:03:17,091 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 2fd40e0179a0e968c4672055c041d740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73225236, jitterRate=0.09114104509353638}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-10 19:03:17,091 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 2fd40e0179a0e968c4672055c041d740: Running coprocessor pre-open hook at 1676055797080Writing region info on filesystem at 1676055797080Initializing all the Stores at 1676055797081 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676055797081Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676055797081Cleaning up temporary data from old regions at 1676055797087 (+6 ms)Cleaning up detritus from prior splits at 1676055797087Running coprocessor post-open hooks at 1676055797091 (+4 ms)Region opened successfully at 1676055797091 2023-02-10 19:03:17,091 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for eca90e03b313fba8b7a1d6571ea05502 2023-02-10 19:03:17,091 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,,1676055796287.2fd40e0179a0e968c4672055c041d740., pid=23, masterSystemTime=1676055797060 2023-02-10 19:03:17,093 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,,1676055796287.2fd40e0179a0e968c4672055c041d740. 2023-02-10 19:03:17,093 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,,1676055796287.2fd40e0179a0e968c4672055c041d740. 2023-02-10 19:03:17,093 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,m\xED\xED,1676055796287.b324410564271f3c81fcd7c2326d0435. 2023-02-10 19:03:17,093 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=2fd40e0179a0e968c4672055c041d740, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,44697,1676055795050 2023-02-10 19:03:17,093 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => b324410564271f3c81fcd7c2326d0435, NAME => 'testWithMockedMapReduceMultiRegion,m\xED\xED,1676055796287.b324410564271f3c81fcd7c2326d0435.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'} 2023-02-10 19:03:17,093 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,,1676055796287.2fd40e0179a0e968c4672055c041d740.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1676055797093"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676055797093"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676055797093"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676055797093"}]},"ts":"1676055797093"} 2023-02-10 19:03:17,093 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/data/default/testWithMockedMapReduceMultiRegion/eca90e03b313fba8b7a1d6571ea05502/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-10 19:03:17,093 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion b324410564271f3c81fcd7c2326d0435 2023-02-10 19:03:17,093 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,m\xED\xED,1676055796287.b324410564271f3c81fcd7c2326d0435.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-10 19:03:17,093 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for b324410564271f3c81fcd7c2326d0435 2023-02-10 19:03:17,093 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for b324410564271f3c81fcd7c2326d0435 2023-02-10 19:03:17,094 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened eca90e03b313fba8b7a1d6571ea05502; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61396313, jitterRate=-0.08512364327907562}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-10 19:03:17,094 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for eca90e03b313fba8b7a1d6571ea05502: Running coprocessor pre-open hook at 1676055797083Writing region info on filesystem at 1676055797083Initializing all the Stores at 1676055797083Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676055797083Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676055797084 (+1 ms)Cleaning up temporary data from old regions at 1676055797089 (+5 ms)Cleaning up detritus from prior splits at 1676055797090 (+1 ms)Running coprocessor post-open hooks at 1676055797094 (+4 ms)Region opened successfully at 1676055797094 2023-02-10 19:03:17,094 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,aaa,1676055796287.eca90e03b313fba8b7a1d6571ea05502., pid=27, masterSystemTime=1676055797065 2023-02-10 19:03:17,094 INFO [StoreOpener-b324410564271f3c81fcd7c2326d0435-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region b324410564271f3c81fcd7c2326d0435 2023-02-10 19:03:17,095 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,aaa,1676055796287.eca90e03b313fba8b7a1d6571ea05502. 2023-02-10 19:03:17,096 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,aaa,1676055796287.eca90e03b313fba8b7a1d6571ea05502. 2023-02-10 19:03:17,096 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,wWV,1676055796287.bc3dafb6d0db6c740ff9583526924864. 2023-02-10 19:03:17,096 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => bc3dafb6d0db6c740ff9583526924864, NAME => 'testWithMockedMapReduceMultiRegion,wWV,1676055796287.bc3dafb6d0db6c740ff9583526924864.', STARTKEY => 'wWV', ENDKEY => 'zz{'} 2023-02-10 19:03:17,096 DEBUG [StoreOpener-b324410564271f3c81fcd7c2326d0435-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/data/default/testWithMockedMapReduceMultiRegion/b324410564271f3c81fcd7c2326d0435/f1 2023-02-10 19:03:17,096 DEBUG [StoreOpener-b324410564271f3c81fcd7c2326d0435-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/data/default/testWithMockedMapReduceMultiRegion/b324410564271f3c81fcd7c2326d0435/f1 2023-02-10 19:03:17,096 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion bc3dafb6d0db6c740ff9583526924864 2023-02-10 19:03:17,096 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,wWV,1676055796287.bc3dafb6d0db6c740ff9583526924864.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-10 19:03:17,096 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for bc3dafb6d0db6c740ff9583526924864 2023-02-10 19:03:17,096 INFO [StoreOpener-b324410564271f3c81fcd7c2326d0435-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b324410564271f3c81fcd7c2326d0435 columnFamilyName f1 2023-02-10 19:03:17,096 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for bc3dafb6d0db6c740ff9583526924864 2023-02-10 19:03:17,097 INFO [StoreOpener-b324410564271f3c81fcd7c2326d0435-1] regionserver.HStore(310): Store=b324410564271f3c81fcd7c2326d0435/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-10 19:03:17,097 INFO [StoreOpener-b324410564271f3c81fcd7c2326d0435-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region b324410564271f3c81fcd7c2326d0435 2023-02-10 19:03:17,097 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=12 updating hbase:meta row=eca90e03b313fba8b7a1d6571ea05502, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,35891,1676055795020 2023-02-10 19:03:17,097 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=23, resume processing ppid=11 2023-02-10 19:03:17,097 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,aaa,1676055796287.eca90e03b313fba8b7a1d6571ea05502.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676055797097"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676055797097"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676055797097"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676055797097"}]},"ts":"1676055797097"} 2023-02-10 19:03:17,097 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=23, ppid=11, state=SUCCESS; OpenRegionProcedure 2fd40e0179a0e968c4672055c041d740, server=jenkins-hbase4.apache.org,44697,1676055795050 in 184 msec 2023-02-10 19:03:17,097 INFO [StoreOpener-bc3dafb6d0db6c740ff9583526924864-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region bc3dafb6d0db6c740ff9583526924864 2023-02-10 19:03:17,098 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=2fd40e0179a0e968c4672055c041d740, ASSIGN in 352 msec 2023-02-10 19:03:17,098 DEBUG [StoreOpener-b324410564271f3c81fcd7c2326d0435-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/data/default/testWithMockedMapReduceMultiRegion/b324410564271f3c81fcd7c2326d0435/f2 2023-02-10 19:03:17,098 DEBUG [StoreOpener-b324410564271f3c81fcd7c2326d0435-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/data/default/testWithMockedMapReduceMultiRegion/b324410564271f3c81fcd7c2326d0435/f2 2023-02-10 19:03:17,098 INFO [StoreOpener-b324410564271f3c81fcd7c2326d0435-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b324410564271f3c81fcd7c2326d0435 columnFamilyName f2 2023-02-10 19:03:17,099 DEBUG [StoreOpener-bc3dafb6d0db6c740ff9583526924864-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/data/default/testWithMockedMapReduceMultiRegion/bc3dafb6d0db6c740ff9583526924864/f1 2023-02-10 19:03:17,099 DEBUG [StoreOpener-bc3dafb6d0db6c740ff9583526924864-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/data/default/testWithMockedMapReduceMultiRegion/bc3dafb6d0db6c740ff9583526924864/f1 2023-02-10 19:03:17,099 INFO [StoreOpener-bc3dafb6d0db6c740ff9583526924864-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region bc3dafb6d0db6c740ff9583526924864 columnFamilyName f1 2023-02-10 19:03:17,099 INFO [StoreOpener-b324410564271f3c81fcd7c2326d0435-1] regionserver.HStore(310): Store=b324410564271f3c81fcd7c2326d0435/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-10 19:03:17,099 INFO [StoreOpener-bc3dafb6d0db6c740ff9583526924864-1] regionserver.HStore(310): Store=bc3dafb6d0db6c740ff9583526924864/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-10 19:03:17,099 INFO [StoreOpener-bc3dafb6d0db6c740ff9583526924864-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region bc3dafb6d0db6c740ff9583526924864 2023-02-10 19:03:17,100 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/data/default/testWithMockedMapReduceMultiRegion/b324410564271f3c81fcd7c2326d0435 2023-02-10 19:03:17,100 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/data/default/testWithMockedMapReduceMultiRegion/b324410564271f3c81fcd7c2326d0435 2023-02-10 19:03:17,100 DEBUG [StoreOpener-bc3dafb6d0db6c740ff9583526924864-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/data/default/testWithMockedMapReduceMultiRegion/bc3dafb6d0db6c740ff9583526924864/f2 2023-02-10 19:03:17,101 DEBUG [StoreOpener-bc3dafb6d0db6c740ff9583526924864-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/data/default/testWithMockedMapReduceMultiRegion/bc3dafb6d0db6c740ff9583526924864/f2 2023-02-10 19:03:17,101 INFO [StoreOpener-bc3dafb6d0db6c740ff9583526924864-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region bc3dafb6d0db6c740ff9583526924864 columnFamilyName f2 2023-02-10 19:03:17,101 INFO [StoreOpener-bc3dafb6d0db6c740ff9583526924864-1] regionserver.HStore(310): Store=bc3dafb6d0db6c740ff9583526924864/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-10 19:03:17,101 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=27, resume processing ppid=12 2023-02-10 19:03:17,101 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=27, ppid=12, state=SUCCESS; OpenRegionProcedure eca90e03b313fba8b7a1d6571ea05502, server=jenkins-hbase4.apache.org,35891,1676055795020 in 186 msec 2023-02-10 19:03:17,102 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-10 19:03:17,102 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/data/default/testWithMockedMapReduceMultiRegion/bc3dafb6d0db6c740ff9583526924864 2023-02-10 19:03:17,102 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=12, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=eca90e03b313fba8b7a1d6571ea05502, ASSIGN in 356 msec 2023-02-10 19:03:17,102 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/data/default/testWithMockedMapReduceMultiRegion/bc3dafb6d0db6c740ff9583526924864 2023-02-10 19:03:17,104 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-10 19:03:17,104 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for b324410564271f3c81fcd7c2326d0435 2023-02-10 19:03:17,105 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for bc3dafb6d0db6c740ff9583526924864 2023-02-10 19:03:17,106 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/data/default/testWithMockedMapReduceMultiRegion/b324410564271f3c81fcd7c2326d0435/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-10 19:03:17,106 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened b324410564271f3c81fcd7c2326d0435; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72813849, jitterRate=0.08501090109348297}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-10 19:03:17,106 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for b324410564271f3c81fcd7c2326d0435: Running coprocessor pre-open hook at 1676055797093Writing region info on filesystem at 1676055797093Initializing all the Stores at 1676055797094 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676055797094Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676055797094Cleaning up temporary data from old regions at 1676055797100 (+6 ms)Cleaning up detritus from prior splits at 1676055797101 (+1 ms)Running coprocessor post-open hooks at 1676055797106 (+5 ms)Region opened successfully at 1676055797106 2023-02-10 19:03:17,107 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/data/default/testWithMockedMapReduceMultiRegion/bc3dafb6d0db6c740ff9583526924864/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-10 19:03:17,107 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,m\xED\xED,1676055796287.b324410564271f3c81fcd7c2326d0435., pid=21, masterSystemTime=1676055797060 2023-02-10 19:03:17,107 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened bc3dafb6d0db6c740ff9583526924864; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74777296, jitterRate=0.11426854133605957}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-10 19:03:17,107 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for bc3dafb6d0db6c740ff9583526924864: Running coprocessor pre-open hook at 1676055797096Writing region info on filesystem at 1676055797096Initializing all the Stores at 1676055797097 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676055797097Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676055797097Cleaning up temporary data from old regions at 1676055797103 (+6 ms)Cleaning up detritus from prior splits at 1676055797103Running coprocessor post-open hooks at 1676055797107 (+4 ms)Region opened successfully at 1676055797107 2023-02-10 19:03:17,108 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,wWV,1676055796287.bc3dafb6d0db6c740ff9583526924864., pid=29, masterSystemTime=1676055797065 2023-02-10 19:03:17,108 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,m\xED\xED,1676055796287.b324410564271f3c81fcd7c2326d0435. 2023-02-10 19:03:17,108 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,m\xED\xED,1676055796287.b324410564271f3c81fcd7c2326d0435. 2023-02-10 19:03:17,108 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676055796287.6b4a925bbaa3b95421bfaa80da606099. 2023-02-10 19:03:17,108 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 6b4a925bbaa3b95421bfaa80da606099, NAME => 'testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676055796287.6b4a925bbaa3b95421bfaa80da606099.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'} 2023-02-10 19:03:17,108 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=b324410564271f3c81fcd7c2326d0435, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,44697,1676055795050 2023-02-10 19:03:17,109 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,m\\xED\\xED,1676055796287.b324410564271f3c81fcd7c2326d0435.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676055797108"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676055797108"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676055797108"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676055797108"}]},"ts":"1676055797108"} 2023-02-10 19:03:17,109 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion 6b4a925bbaa3b95421bfaa80da606099 2023-02-10 19:03:17,109 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676055796287.6b4a925bbaa3b95421bfaa80da606099.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-10 19:03:17,109 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 6b4a925bbaa3b95421bfaa80da606099 2023-02-10 19:03:17,109 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 6b4a925bbaa3b95421bfaa80da606099 2023-02-10 19:03:17,109 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,wWV,1676055796287.bc3dafb6d0db6c740ff9583526924864. 2023-02-10 19:03:17,109 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,wWV,1676055796287.bc3dafb6d0db6c740ff9583526924864. 2023-02-10 19:03:17,110 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,d\x84\x84,1676055796287.f8e2703c94874a9a6d0d1541b43c1eb3. 2023-02-10 19:03:17,110 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => f8e2703c94874a9a6d0d1541b43c1eb3, NAME => 'testWithMockedMapReduceMultiRegion,d\x84\x84,1676055796287.f8e2703c94874a9a6d0d1541b43c1eb3.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'} 2023-02-10 19:03:17,110 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=19 updating hbase:meta row=bc3dafb6d0db6c740ff9583526924864, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,35891,1676055795020 2023-02-10 19:03:17,110 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion f8e2703c94874a9a6d0d1541b43c1eb3 2023-02-10 19:03:17,110 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,wWV,1676055796287.bc3dafb6d0db6c740ff9583526924864.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676055797110"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676055797110"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676055797110"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676055797110"}]},"ts":"1676055797110"} 2023-02-10 19:03:17,110 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,d\x84\x84,1676055796287.f8e2703c94874a9a6d0d1541b43c1eb3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-10 19:03:17,110 INFO [StoreOpener-6b4a925bbaa3b95421bfaa80da606099-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 6b4a925bbaa3b95421bfaa80da606099 2023-02-10 19:03:17,110 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for f8e2703c94874a9a6d0d1541b43c1eb3 2023-02-10 19:03:17,110 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for f8e2703c94874a9a6d0d1541b43c1eb3 2023-02-10 19:03:17,112 DEBUG [StoreOpener-6b4a925bbaa3b95421bfaa80da606099-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/data/default/testWithMockedMapReduceMultiRegion/6b4a925bbaa3b95421bfaa80da606099/f1 2023-02-10 19:03:17,112 DEBUG [StoreOpener-6b4a925bbaa3b95421bfaa80da606099-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/data/default/testWithMockedMapReduceMultiRegion/6b4a925bbaa3b95421bfaa80da606099/f1 2023-02-10 19:03:17,112 INFO [StoreOpener-f8e2703c94874a9a6d0d1541b43c1eb3-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region f8e2703c94874a9a6d0d1541b43c1eb3 2023-02-10 19:03:17,112 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=21, resume processing ppid=16 2023-02-10 19:03:17,112 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=21, ppid=16, state=SUCCESS; OpenRegionProcedure b324410564271f3c81fcd7c2326d0435, server=jenkins-hbase4.apache.org,44697,1676055795050 in 202 msec 2023-02-10 19:03:17,112 INFO [StoreOpener-6b4a925bbaa3b95421bfaa80da606099-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6b4a925bbaa3b95421bfaa80da606099 columnFamilyName f1 2023-02-10 19:03:17,113 INFO [StoreOpener-6b4a925bbaa3b95421bfaa80da606099-1] regionserver.HStore(310): Store=6b4a925bbaa3b95421bfaa80da606099/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-10 19:03:17,113 INFO [StoreOpener-6b4a925bbaa3b95421bfaa80da606099-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 6b4a925bbaa3b95421bfaa80da606099 2023-02-10 19:03:17,113 DEBUG [StoreOpener-f8e2703c94874a9a6d0d1541b43c1eb3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/data/default/testWithMockedMapReduceMultiRegion/f8e2703c94874a9a6d0d1541b43c1eb3/f1 2023-02-10 19:03:17,113 DEBUG [StoreOpener-f8e2703c94874a9a6d0d1541b43c1eb3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/data/default/testWithMockedMapReduceMultiRegion/f8e2703c94874a9a6d0d1541b43c1eb3/f1 2023-02-10 19:03:17,114 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=29, resume processing ppid=19 2023-02-10 19:03:17,114 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=b324410564271f3c81fcd7c2326d0435, ASSIGN in 367 msec 2023-02-10 19:03:17,114 DEBUG [StoreOpener-6b4a925bbaa3b95421bfaa80da606099-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/data/default/testWithMockedMapReduceMultiRegion/6b4a925bbaa3b95421bfaa80da606099/f2 2023-02-10 19:03:17,114 DEBUG [StoreOpener-6b4a925bbaa3b95421bfaa80da606099-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/data/default/testWithMockedMapReduceMultiRegion/6b4a925bbaa3b95421bfaa80da606099/f2 2023-02-10 19:03:17,114 INFO [StoreOpener-f8e2703c94874a9a6d0d1541b43c1eb3-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f8e2703c94874a9a6d0d1541b43c1eb3 columnFamilyName f1 2023-02-10 19:03:17,114 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=29, ppid=19, state=SUCCESS; OpenRegionProcedure bc3dafb6d0db6c740ff9583526924864, server=jenkins-hbase4.apache.org,35891,1676055795020 in 194 msec 2023-02-10 19:03:17,115 INFO [StoreOpener-6b4a925bbaa3b95421bfaa80da606099-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6b4a925bbaa3b95421bfaa80da606099 columnFamilyName f2 2023-02-10 19:03:17,115 INFO [StoreOpener-f8e2703c94874a9a6d0d1541b43c1eb3-1] regionserver.HStore(310): Store=f8e2703c94874a9a6d0d1541b43c1eb3/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-10 19:03:17,115 INFO [StoreOpener-6b4a925bbaa3b95421bfaa80da606099-1] regionserver.HStore(310): Store=6b4a925bbaa3b95421bfaa80da606099/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-10 19:03:17,115 INFO [StoreOpener-f8e2703c94874a9a6d0d1541b43c1eb3-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region f8e2703c94874a9a6d0d1541b43c1eb3 2023-02-10 19:03:17,115 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=19, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=bc3dafb6d0db6c740ff9583526924864, ASSIGN in 369 msec 2023-02-10 19:03:17,116 DEBUG [StoreOpener-f8e2703c94874a9a6d0d1541b43c1eb3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/data/default/testWithMockedMapReduceMultiRegion/f8e2703c94874a9a6d0d1541b43c1eb3/f2 2023-02-10 19:03:17,116 DEBUG [StoreOpener-f8e2703c94874a9a6d0d1541b43c1eb3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/data/default/testWithMockedMapReduceMultiRegion/f8e2703c94874a9a6d0d1541b43c1eb3/f2 2023-02-10 19:03:17,117 INFO [StoreOpener-f8e2703c94874a9a6d0d1541b43c1eb3-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f8e2703c94874a9a6d0d1541b43c1eb3 columnFamilyName f2 2023-02-10 19:03:17,117 INFO [StoreOpener-f8e2703c94874a9a6d0d1541b43c1eb3-1] regionserver.HStore(310): Store=f8e2703c94874a9a6d0d1541b43c1eb3/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-10 19:03:17,118 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/data/default/testWithMockedMapReduceMultiRegion/f8e2703c94874a9a6d0d1541b43c1eb3 2023-02-10 19:03:17,118 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/data/default/testWithMockedMapReduceMultiRegion/f8e2703c94874a9a6d0d1541b43c1eb3 2023-02-10 19:03:17,120 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-10 19:03:17,121 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for f8e2703c94874a9a6d0d1541b43c1eb3 2023-02-10 19:03:17,122 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/data/default/testWithMockedMapReduceMultiRegion/f8e2703c94874a9a6d0d1541b43c1eb3/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-10 19:03:17,123 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened f8e2703c94874a9a6d0d1541b43c1eb3; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60308073, jitterRate=-0.1013396829366684}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-10 19:03:17,123 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for f8e2703c94874a9a6d0d1541b43c1eb3: Running coprocessor pre-open hook at 1676055797110Writing region info on filesystem at 1676055797110Initializing all the Stores at 1676055797111 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676055797111Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676055797112 (+1 ms)Cleaning up temporary data from old regions at 1676055797119 (+7 ms)Cleaning up detritus from prior splits at 1676055797119Running coprocessor post-open hooks at 1676055797123 (+4 ms)Region opened successfully at 1676055797123 2023-02-10 19:03:17,123 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,d\x84\x84,1676055796287.f8e2703c94874a9a6d0d1541b43c1eb3., pid=28, masterSystemTime=1676055797065 2023-02-10 19:03:17,123 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/data/default/testWithMockedMapReduceMultiRegion/6b4a925bbaa3b95421bfaa80da606099 2023-02-10 19:03:17,124 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/data/default/testWithMockedMapReduceMultiRegion/6b4a925bbaa3b95421bfaa80da606099 2023-02-10 19:03:17,125 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,d\x84\x84,1676055796287.f8e2703c94874a9a6d0d1541b43c1eb3. 2023-02-10 19:03:17,125 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,d\x84\x84,1676055796287.f8e2703c94874a9a6d0d1541b43c1eb3. 2023-02-10 19:03:17,125 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676055796287.08e6594f21fdd814bfb7b05ba0f4191b. 2023-02-10 19:03:17,125 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 08e6594f21fdd814bfb7b05ba0f4191b, NAME => 'testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676055796287.08e6594f21fdd814bfb7b05ba0f4191b.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'} 2023-02-10 19:03:17,125 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=f8e2703c94874a9a6d0d1541b43c1eb3, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,35891,1676055795020 2023-02-10 19:03:17,126 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-10 19:03:17,126 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,d\\x84\\x84,1676055796287.f8e2703c94874a9a6d0d1541b43c1eb3.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676055797125"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676055797125"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676055797125"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676055797125"}]},"ts":"1676055797125"} 2023-02-10 19:03:17,126 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion 08e6594f21fdd814bfb7b05ba0f4191b 2023-02-10 19:03:17,126 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676055796287.08e6594f21fdd814bfb7b05ba0f4191b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-10 19:03:17,126 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 08e6594f21fdd814bfb7b05ba0f4191b 2023-02-10 19:03:17,126 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 08e6594f21fdd814bfb7b05ba0f4191b 2023-02-10 19:03:17,127 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 6b4a925bbaa3b95421bfaa80da606099 2023-02-10 19:03:17,128 INFO [StoreOpener-08e6594f21fdd814bfb7b05ba0f4191b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 08e6594f21fdd814bfb7b05ba0f4191b 2023-02-10 19:03:17,129 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=28, resume processing ppid=13 2023-02-10 19:03:17,129 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=28, ppid=13, state=SUCCESS; OpenRegionProcedure f8e2703c94874a9a6d0d1541b43c1eb3, server=jenkins-hbase4.apache.org,35891,1676055795020 in 211 msec 2023-02-10 19:03:17,130 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/data/default/testWithMockedMapReduceMultiRegion/6b4a925bbaa3b95421bfaa80da606099/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-10 19:03:17,130 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=13, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=f8e2703c94874a9a6d0d1541b43c1eb3, ASSIGN in 384 msec 2023-02-10 19:03:17,130 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 6b4a925bbaa3b95421bfaa80da606099; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67388316, jitterRate=0.004164159297943115}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-10 19:03:17,130 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 6b4a925bbaa3b95421bfaa80da606099: Running coprocessor pre-open hook at 1676055797109Writing region info on filesystem at 1676055797109Initializing all the Stores at 1676055797110 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676055797110Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676055797110Cleaning up temporary data from old regions at 1676055797125 (+15 ms)Cleaning up detritus from prior splits at 1676055797125Running coprocessor post-open hooks at 1676055797130 (+5 ms)Region opened successfully at 1676055797130 2023-02-10 19:03:17,132 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676055796287.6b4a925bbaa3b95421bfaa80da606099., pid=22, masterSystemTime=1676055797060 2023-02-10 19:03:17,133 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676055796287.6b4a925bbaa3b95421bfaa80da606099. 2023-02-10 19:03:17,133 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676055796287.6b4a925bbaa3b95421bfaa80da606099. 2023-02-10 19:03:17,134 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,t43,1676055796287.54239cd4e87d877b10bac35ba4d2a8c8. 2023-02-10 19:03:17,134 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 54239cd4e87d877b10bac35ba4d2a8c8, NAME => 'testWithMockedMapReduceMultiRegion,t43,1676055796287.54239cd4e87d877b10bac35ba4d2a8c8.', STARTKEY => 't43', ENDKEY => 'wWV'} 2023-02-10 19:03:17,134 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=6b4a925bbaa3b95421bfaa80da606099, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,44697,1676055795050 2023-02-10 19:03:17,134 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion 54239cd4e87d877b10bac35ba4d2a8c8 2023-02-10 19:03:17,134 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,g\\xA7\\xA7,1676055796287.6b4a925bbaa3b95421bfaa80da606099.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676055797134"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676055797134"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676055797134"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676055797134"}]},"ts":"1676055797134"} 2023-02-10 19:03:17,134 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,t43,1676055796287.54239cd4e87d877b10bac35ba4d2a8c8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-10 19:03:17,134 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 54239cd4e87d877b10bac35ba4d2a8c8 2023-02-10 19:03:17,134 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 54239cd4e87d877b10bac35ba4d2a8c8 2023-02-10 19:03:17,135 INFO [StoreOpener-54239cd4e87d877b10bac35ba4d2a8c8-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 54239cd4e87d877b10bac35ba4d2a8c8 2023-02-10 19:03:17,136 DEBUG [StoreOpener-54239cd4e87d877b10bac35ba4d2a8c8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/data/default/testWithMockedMapReduceMultiRegion/54239cd4e87d877b10bac35ba4d2a8c8/f1 2023-02-10 19:03:17,136 DEBUG [StoreOpener-54239cd4e87d877b10bac35ba4d2a8c8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/data/default/testWithMockedMapReduceMultiRegion/54239cd4e87d877b10bac35ba4d2a8c8/f1 2023-02-10 19:03:17,137 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=22, resume processing ppid=14 2023-02-10 19:03:17,137 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=22, ppid=14, state=SUCCESS; OpenRegionProcedure 6b4a925bbaa3b95421bfaa80da606099, server=jenkins-hbase4.apache.org,44697,1676055795050 in 226 msec 2023-02-10 19:03:17,137 INFO [StoreOpener-54239cd4e87d877b10bac35ba4d2a8c8-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 54239cd4e87d877b10bac35ba4d2a8c8 columnFamilyName f1 2023-02-10 19:03:17,137 INFO [StoreOpener-54239cd4e87d877b10bac35ba4d2a8c8-1] regionserver.HStore(310): Store=54239cd4e87d877b10bac35ba4d2a8c8/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-10 19:03:17,137 INFO [StoreOpener-54239cd4e87d877b10bac35ba4d2a8c8-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 54239cd4e87d877b10bac35ba4d2a8c8 2023-02-10 19:03:17,137 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=14, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=6b4a925bbaa3b95421bfaa80da606099, ASSIGN in 392 msec 2023-02-10 19:03:17,138 DEBUG [StoreOpener-54239cd4e87d877b10bac35ba4d2a8c8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/data/default/testWithMockedMapReduceMultiRegion/54239cd4e87d877b10bac35ba4d2a8c8/f2 2023-02-10 19:03:17,138 DEBUG [StoreOpener-54239cd4e87d877b10bac35ba4d2a8c8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/data/default/testWithMockedMapReduceMultiRegion/54239cd4e87d877b10bac35ba4d2a8c8/f2 2023-02-10 19:03:17,139 INFO [StoreOpener-54239cd4e87d877b10bac35ba4d2a8c8-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 54239cd4e87d877b10bac35ba4d2a8c8 columnFamilyName f2 2023-02-10 19:03:17,139 INFO [StoreOpener-54239cd4e87d877b10bac35ba4d2a8c8-1] regionserver.HStore(310): Store=54239cd4e87d877b10bac35ba4d2a8c8/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-10 19:03:17,140 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/data/default/testWithMockedMapReduceMultiRegion/54239cd4e87d877b10bac35ba4d2a8c8 2023-02-10 19:03:17,140 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/data/default/testWithMockedMapReduceMultiRegion/54239cd4e87d877b10bac35ba4d2a8c8 2023-02-10 19:03:17,140 DEBUG [StoreOpener-08e6594f21fdd814bfb7b05ba0f4191b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/data/default/testWithMockedMapReduceMultiRegion/08e6594f21fdd814bfb7b05ba0f4191b/f1 2023-02-10 19:03:17,140 DEBUG [StoreOpener-08e6594f21fdd814bfb7b05ba0f4191b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/data/default/testWithMockedMapReduceMultiRegion/08e6594f21fdd814bfb7b05ba0f4191b/f1 2023-02-10 19:03:17,141 INFO [StoreOpener-08e6594f21fdd814bfb7b05ba0f4191b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 08e6594f21fdd814bfb7b05ba0f4191b columnFamilyName f1 2023-02-10 19:03:17,141 INFO [StoreOpener-08e6594f21fdd814bfb7b05ba0f4191b-1] regionserver.HStore(310): Store=08e6594f21fdd814bfb7b05ba0f4191b/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-10 19:03:17,141 INFO [StoreOpener-08e6594f21fdd814bfb7b05ba0f4191b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 08e6594f21fdd814bfb7b05ba0f4191b 2023-02-10 19:03:17,142 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-10 19:03:17,142 DEBUG [StoreOpener-08e6594f21fdd814bfb7b05ba0f4191b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/data/default/testWithMockedMapReduceMultiRegion/08e6594f21fdd814bfb7b05ba0f4191b/f2 2023-02-10 19:03:17,142 DEBUG [StoreOpener-08e6594f21fdd814bfb7b05ba0f4191b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/data/default/testWithMockedMapReduceMultiRegion/08e6594f21fdd814bfb7b05ba0f4191b/f2 2023-02-10 19:03:17,143 INFO [StoreOpener-08e6594f21fdd814bfb7b05ba0f4191b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 08e6594f21fdd814bfb7b05ba0f4191b columnFamilyName f2 2023-02-10 19:03:17,143 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 54239cd4e87d877b10bac35ba4d2a8c8 2023-02-10 19:03:17,143 INFO [StoreOpener-08e6594f21fdd814bfb7b05ba0f4191b-1] regionserver.HStore(310): Store=08e6594f21fdd814bfb7b05ba0f4191b/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-10 19:03:17,144 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/data/default/testWithMockedMapReduceMultiRegion/08e6594f21fdd814bfb7b05ba0f4191b 2023-02-10 19:03:17,144 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/data/default/testWithMockedMapReduceMultiRegion/08e6594f21fdd814bfb7b05ba0f4191b 2023-02-10 19:03:17,144 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/data/default/testWithMockedMapReduceMultiRegion/54239cd4e87d877b10bac35ba4d2a8c8/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-10 19:03:17,145 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 54239cd4e87d877b10bac35ba4d2a8c8; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63879012, jitterRate=-0.04812854528427124}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-10 19:03:17,145 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 54239cd4e87d877b10bac35ba4d2a8c8: Running coprocessor pre-open hook at 1676055797134Writing region info on filesystem at 1676055797134Initializing all the Stores at 1676055797135 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676055797135Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676055797135Cleaning up temporary data from old regions at 1676055797141 (+6 ms)Cleaning up detritus from prior splits at 1676055797141Running coprocessor post-open hooks at 1676055797145 (+4 ms)Region opened successfully at 1676055797145 2023-02-10 19:03:17,145 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-10 19:03:17,146 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,t43,1676055796287.54239cd4e87d877b10bac35ba4d2a8c8., pid=25, masterSystemTime=1676055797060 2023-02-10 19:03:17,147 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 08e6594f21fdd814bfb7b05ba0f4191b 2023-02-10 19:03:17,147 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,t43,1676055796287.54239cd4e87d877b10bac35ba4d2a8c8. 2023-02-10 19:03:17,147 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,t43,1676055796287.54239cd4e87d877b10bac35ba4d2a8c8. 2023-02-10 19:03:17,148 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=18 updating hbase:meta row=54239cd4e87d877b10bac35ba4d2a8c8, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,44697,1676055795050 2023-02-10 19:03:17,148 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,t43,1676055796287.54239cd4e87d877b10bac35ba4d2a8c8.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676055797148"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676055797148"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676055797148"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676055797148"}]},"ts":"1676055797148"} 2023-02-10 19:03:17,149 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/data/default/testWithMockedMapReduceMultiRegion/08e6594f21fdd814bfb7b05ba0f4191b/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-10 19:03:17,149 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 08e6594f21fdd814bfb7b05ba0f4191b; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68508045, jitterRate=0.020849421620368958}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-10 19:03:17,149 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 08e6594f21fdd814bfb7b05ba0f4191b: Running coprocessor pre-open hook at 1676055797126Writing region info on filesystem at 1676055797126Initializing all the Stores at 1676055797127 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676055797127Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676055797127Cleaning up temporary data from old regions at 1676055797144 (+17 ms)Cleaning up detritus from prior splits at 1676055797145 (+1 ms)Running coprocessor post-open hooks at 1676055797149 (+4 ms)Region opened successfully at 1676055797149 2023-02-10 19:03:17,150 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676055796287.08e6594f21fdd814bfb7b05ba0f4191b., pid=30, masterSystemTime=1676055797065 2023-02-10 19:03:17,151 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=25, resume processing ppid=18 2023-02-10 19:03:17,151 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=25, ppid=18, state=SUCCESS; OpenRegionProcedure 54239cd4e87d877b10bac35ba4d2a8c8, server=jenkins-hbase4.apache.org,44697,1676055795050 in 238 msec 2023-02-10 19:03:17,151 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676055796287.08e6594f21fdd814bfb7b05ba0f4191b. 2023-02-10 19:03:17,151 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676055796287.08e6594f21fdd814bfb7b05ba0f4191b. 2023-02-10 19:03:17,152 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=08e6594f21fdd814bfb7b05ba0f4191b, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,35891,1676055795020 2023-02-10 19:03:17,152 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,j\\xCA\\xCA,1676055796287.08e6594f21fdd814bfb7b05ba0f4191b.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676055797152"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676055797152"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676055797152"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676055797152"}]},"ts":"1676055797152"} 2023-02-10 19:03:17,152 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=18, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=54239cd4e87d877b10bac35ba4d2a8c8, ASSIGN in 406 msec 2023-02-10 19:03:17,154 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=30, resume processing ppid=15 2023-02-10 19:03:17,154 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=30, ppid=15, state=SUCCESS; OpenRegionProcedure 08e6594f21fdd814bfb7b05ba0f4191b, server=jenkins-hbase4.apache.org,35891,1676055795020 in 236 msec 2023-02-10 19:03:17,155 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=15, resume processing ppid=10 2023-02-10 19:03:17,155 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=15, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=08e6594f21fdd814bfb7b05ba0f4191b, ASSIGN in 409 msec 2023-02-10 19:03:17,156 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testWithMockedMapReduceMultiRegion execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-10 19:03:17,156 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676055797156"}]},"ts":"1676055797156"} 2023-02-10 19:03:17,157 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testWithMockedMapReduceMultiRegion, state=ENABLED in hbase:meta 2023-02-10 19:03:17,159 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testWithMockedMapReduceMultiRegion execute state=CREATE_TABLE_POST_OPERATION 2023-02-10 19:03:17,160 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=10, state=SUCCESS; CreateTableProcedure table=testWithMockedMapReduceMultiRegion in 871 msec 2023-02-10 19:03:17,398 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33383] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-10 19:03:17,398 INFO [Listener at localhost/37107] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testWithMockedMapReduceMultiRegion, procId: 10 completed 2023-02-10 19:03:17,398 DEBUG [Listener at localhost/37107] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testWithMockedMapReduceMultiRegion get assigned. Timeout = 60000ms 2023-02-10 19:03:17,399 INFO [Listener at localhost/37107] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-10 19:03:17,401 INFO [Listener at localhost/37107] hbase.HBaseTestingUtility(3484): All regions for table testWithMockedMapReduceMultiRegion assigned to meta. Checking AM states. 2023-02-10 19:03:17,402 INFO [Listener at localhost/37107] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-10 19:03:17,402 INFO [Listener at localhost/37107] hbase.HBaseTestingUtility(3504): All regions for table testWithMockedMapReduceMultiRegion assigned. 2023-02-10 19:03:17,402 INFO [Listener at localhost/37107] mapreduce.TableSnapshotInputFormatTestBase(207): put some stuff in the table 2023-02-10 19:03:17,431 DEBUG [hconnection-0xab71b16-shared-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-10 19:03:17,437 INFO [RS-EventLoopGroup-14-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42364, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-10 19:03:17,440 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44697] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 6084 Client: jenkins//172.31.14.131 first region in multi=testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676055796287.6b4a925bbaa3b95421bfaa80da606099. 2023-02-10 19:03:17,488 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35891] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 11492 Client: jenkins//172.31.14.131 first region in multi=testWithMockedMapReduceMultiRegion,aaa,1676055796287.eca90e03b313fba8b7a1d6571ea05502. 2023-02-10 19:03:17,546 INFO [Listener at localhost/37107] mapreduce.TableSnapshotInputFormatTestBase(214): snapshot 2023-02-10 19:03:17,546 INFO [Listener at localhost/37107] snapshot.SnapshotTestingUtils(396): taking snapshot. 2023-02-10 19:03:17,547 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33383] master.MasterRpcServices(1580): Client=jenkins//172.31.14.131 snapshot request for:{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 } 2023-02-10 19:03:17,547 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33383] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1676055797547 (current time:1676055797547). 2023-02-10 19:03:17,548 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33383] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-02-10 19:03:17,548 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33383] zookeeper.ReadOnlyZKClient(139): Connect 0x4d32a5d8 to 127.0.0.1:52230 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-10 19:03:17,554 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33383] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@45a57001, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-10 19:03:17,555 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33383] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-10 19:03:17,556 INFO [RS-EventLoopGroup-13-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36830, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-10 19:03:17,557 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33383] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4d32a5d8 to 127.0.0.1:52230 2023-02-10 19:03:17,557 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33383] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-10 19:03:17,558 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33383] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-02-10 19:03:17,558 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33383] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 } 2023-02-10 19:03:17,560 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33383] procedure2.ProcedureExecutor(1029): Stored pid=31, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=EXCLUSIVE 2023-02-10 19:03:17,561 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=31, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=EXCLUSIVE 2023-02-10 19:03:17,561 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=31, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=EXCLUSIVE; timeout=600000, timestamp=1676056397561 2023-02-10 19:03:17,562 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33383] snapshot.SnapshotManager(653): Started snapshot: { ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 } 2023-02-10 19:03:17,562 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot testWithMockedMapReduceMultiRegion C_M_SNAPSHOT_TABLE on table testWithMockedMapReduceMultiRegion 2023-02-10 19:03:17,564 DEBUG [Listener at localhost/37107] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-02-10 19:03:17,565 DEBUG [Listener at localhost/37107] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-02-10 19:03:17,565 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=31, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=EXCLUSIVE 2023-02-10 19:03:17,565 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=SHARED 2023-02-10 19:03:17,566 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=31, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=EXCLUSIVE in 6 msec 2023-02-10 19:03:17,567 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=SHARED 2023-02-10 19:03:17,567 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=32, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=SHARED; timeout=600000, timestamp=1676056397567 2023-02-10 19:03:17,582 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure testWithMockedMapReduceMultiRegion 2023-02-10 19:03:17,582 INFO [(jenkins-hbase4.apache.org,33383,1676055794975)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMockedMapReduceMultiRegion' 2023-02-10 19:03:17,582 DEBUG [(jenkins-hbase4.apache.org,33383,1676055794975)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-10 19:03:17,583 DEBUG [(jenkins-hbase4.apache.org,33383,1676055794975)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMockedMapReduceMultiRegion' starting 'acquire' 2023-02-10 19:03:17,583 DEBUG [(jenkins-hbase4.apache.org,33383,1676055794975)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMockedMapReduceMultiRegion', kicking off acquire phase on members. 2023-02-10 19:03:17,583 DEBUG [(jenkins-hbase4.apache.org,33383,1676055794975)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33383-0x1003f9dbed10000, quorum=127.0.0.1:52230, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-10 19:03:17,583 DEBUG [(jenkins-hbase4.apache.org,33383,1676055794975)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion 2023-02-10 19:03:17,585 DEBUG [Listener at localhost/37107-EventThread] zookeeper.ZKWatcher(600): regionserver:35891-0x1003f9dbed10001, quorum=127.0.0.1:52230, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-10 19:03:17,585 DEBUG [(jenkins-hbase4.apache.org,33383,1676055794975)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,44697,1676055795050 2023-02-10 19:03:17,585 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-10 19:03:17,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-10 19:03:17,585 DEBUG [Listener at localhost/37107-EventThread] zookeeper.ZKWatcher(600): regionserver:44697-0x1003f9dbed10002, quorum=127.0.0.1:52230, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-10 19:03:17,585 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-10 19:03:17,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-10 19:03:17,585 DEBUG [(jenkins-hbase4.apache.org,33383,1676055794975)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33383-0x1003f9dbed10000, quorum=127.0.0.1:52230, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,44697,1676055795050 2023-02-10 19:03:17,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion 2023-02-10 19:03:17,585 DEBUG [(jenkins-hbase4.apache.org,33383,1676055794975)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,35891,1676055795020 2023-02-10 19:03:17,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion 2023-02-10 19:03:17,585 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35891-0x1003f9dbed10001, quorum=127.0.0.1:52230, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-10 19:03:17,586 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44697-0x1003f9dbed10002, quorum=127.0.0.1:52230, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-10 19:03:17,586 DEBUG [(jenkins-hbase4.apache.org,33383,1676055794975)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33383-0x1003f9dbed10000, quorum=127.0.0.1:52230, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,35891,1676055795020 2023-02-10 19:03:17,586 DEBUG [(jenkins-hbase4.apache.org,33383,1676055794975)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-10 19:03:17,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 89 2023-02-10 19:03:17,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion 2023-02-10 19:03:17,586 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMockedMapReduceMultiRegion from table testWithMockedMapReduceMultiRegion type FLUSH 2023-02-10 19:03:17,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 89 2023-02-10 19:03:17,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion 2023-02-10 19:03:17,586 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMockedMapReduceMultiRegion from table testWithMockedMapReduceMultiRegion type FLUSH 2023-02-10 19:03:17,586 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMockedMapReduceMultiRegion 2023-02-10 19:03:17,586 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMockedMapReduceMultiRegion 2023-02-10 19:03:17,588 DEBUG [member: 'jenkins-hbase4.apache.org,35891,1676055795020' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMockedMapReduceMultiRegion' with timeout 300000ms 2023-02-10 19:03:17,588 DEBUG [member: 'jenkins-hbase4.apache.org,35891,1676055795020' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-10 19:03:17,588 DEBUG [member: 'jenkins-hbase4.apache.org,44697,1676055795050' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMockedMapReduceMultiRegion' with timeout 300000ms 2023-02-10 19:03:17,588 DEBUG [member: 'jenkins-hbase4.apache.org,44697,1676055795050' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-10 19:03:17,590 DEBUG [member: 'jenkins-hbase4.apache.org,35891,1676055795020' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMockedMapReduceMultiRegion' starting 'acquire' stage 2023-02-10 19:03:17,590 DEBUG [member: 'jenkins-hbase4.apache.org,35891,1676055795020' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMockedMapReduceMultiRegion' locally acquired 2023-02-10 19:03:17,590 DEBUG [member: 'jenkins-hbase4.apache.org,44697,1676055795050' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMockedMapReduceMultiRegion' starting 'acquire' stage 2023-02-10 19:03:17,590 DEBUG [member: 'jenkins-hbase4.apache.org,44697,1676055795050' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMockedMapReduceMultiRegion' locally acquired 2023-02-10 19:03:17,590 DEBUG [member: 'jenkins-hbase4.apache.org,35891,1676055795020' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35891,1676055795020' joining acquired barrier for procedure (testWithMockedMapReduceMultiRegion) in zk 2023-02-10 19:03:17,590 DEBUG [member: 'jenkins-hbase4.apache.org,44697,1676055795050' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44697,1676055795050' joining acquired barrier for procedure (testWithMockedMapReduceMultiRegion) in zk 2023-02-10 19:03:17,592 DEBUG [Listener at localhost/37107-EventThread] zookeeper.ZKWatcher(600): master:33383-0x1003f9dbed10000, quorum=127.0.0.1:52230, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,35891,1676055795020 2023-02-10 19:03:17,592 DEBUG [member: 'jenkins-hbase4.apache.org,44697,1676055795050' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-10 19:03:17,592 DEBUG [Listener at localhost/37107-EventThread] zookeeper.ZKWatcher(600): master:33383-0x1003f9dbed10000, quorum=127.0.0.1:52230, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,44697,1676055795050 2023-02-10 19:03:17,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,35891,1676055795020 2023-02-10 19:03:17,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-10 19:03:17,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-10 19:03:17,592 DEBUG [member: 'jenkins-hbase4.apache.org,35891,1676055795020' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-10 19:03:17,592 DEBUG [member: 'jenkins-hbase4.apache.org,44697,1676055795050' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44697-0x1003f9dbed10002, quorum=127.0.0.1:52230, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-10 19:03:17,592 DEBUG [member: 'jenkins-hbase4.apache.org,44697,1676055795050' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMockedMapReduceMultiRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-10 19:03:17,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-10 19:03:17,592 DEBUG [member: 'jenkins-hbase4.apache.org,35891,1676055795020' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35891-0x1003f9dbed10001, quorum=127.0.0.1:52230, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-10 19:03:17,592 DEBUG [member: 'jenkins-hbase4.apache.org,35891,1676055795020' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMockedMapReduceMultiRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-10 19:03:17,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-10 19:03:17,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-10 19:03:17,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44697,1676055795050 2023-02-10 19:03:17,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35891,1676055795020 2023-02-10 19:03:17,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-10 19:03:17,594 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35891,1676055795020' joining acquired barrier for procedure 'testWithMockedMapReduceMultiRegion' on coordinator 2023-02-10 19:03:17,594 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@69fe9e4b[Count = 1] remaining members to acquire global barrier 2023-02-10 19:03:17,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,44697,1676055795050 2023-02-10 19:03:17,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-10 19:03:17,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-10 19:03:17,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-10 19:03:17,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-10 19:03:17,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-10 19:03:17,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44697,1676055795050 2023-02-10 19:03:17,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35891,1676055795020 2023-02-10 19:03:17,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-10 19:03:17,596 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44697,1676055795050' joining acquired barrier for procedure 'testWithMockedMapReduceMultiRegion' on coordinator 2023-02-10 19:03:17,596 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@69fe9e4b[Count = 0] remaining members to acquire global barrier 2023-02-10 19:03:17,596 DEBUG [(jenkins-hbase4.apache.org,33383,1676055794975)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMockedMapReduceMultiRegion' starting 'in-barrier' execution. 2023-02-10 19:03:17,596 DEBUG [(jenkins-hbase4.apache.org,33383,1676055794975)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-10 19:03:17,597 DEBUG [Listener at localhost/37107-EventThread] zookeeper.ZKWatcher(600): regionserver:35891-0x1003f9dbed10001, quorum=127.0.0.1:52230, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-10 19:03:17,597 DEBUG [Listener at localhost/37107-EventThread] zookeeper.ZKWatcher(600): regionserver:44697-0x1003f9dbed10002, quorum=127.0.0.1:52230, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-10 19:03:17,597 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-10 19:03:17,597 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-10 19:03:17,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-10 19:03:17,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-10 19:03:17,597 DEBUG [member: 'jenkins-hbase4.apache.org,44697,1676055795050' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMockedMapReduceMultiRegion' received 'reached' from coordinator. 2023-02-10 19:03:17,597 DEBUG [member: 'jenkins-hbase4.apache.org,35891,1676055795020' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMockedMapReduceMultiRegion' received 'reached' from coordinator. 2023-02-10 19:03:17,597 DEBUG [(jenkins-hbase4.apache.org,33383,1676055794975)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33383-0x1003f9dbed10000, quorum=127.0.0.1:52230, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,35891,1676055795020 2023-02-10 19:03:17,597 DEBUG [rs(jenkins-hbase4.apache.org,44697,1676055795050)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,,1676055796287.2fd40e0179a0e968c4672055c041d740. 2023-02-10 19:03:17,597 DEBUG [rs(jenkins-hbase4.apache.org,44697,1676055795050)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,,1676055796287.2fd40e0179a0e968c4672055c041d740. started... 2023-02-10 19:03:17,597 DEBUG [rs(jenkins-hbase4.apache.org,35891,1676055795020)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,q\x11\x10,1676055796287.4539b623282fa7d2beb504c373ad6181. 2023-02-10 19:03:17,597 DEBUG [rs(jenkins-hbase4.apache.org,35891,1676055795020)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,q\x11\x10,1676055796287.4539b623282fa7d2beb504c373ad6181. started... 2023-02-10 19:03:17,598 DEBUG [rs(jenkins-hbase4.apache.org,44697,1676055795050)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 2fd40e0179a0e968c4672055c041d740: 2023-02-10 19:03:17,598 DEBUG [(jenkins-hbase4.apache.org,33383,1676055794975)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33383-0x1003f9dbed10000, quorum=127.0.0.1:52230, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,44697,1676055795050 2023-02-10 19:03:17,598 DEBUG [(jenkins-hbase4.apache.org,33383,1676055794975)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-10 19:03:17,598 DEBUG [rs(jenkins-hbase4.apache.org,35891,1676055795020)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,aaa,1676055796287.eca90e03b313fba8b7a1d6571ea05502. 2023-02-10 19:03:17,598 DEBUG [rs(jenkins-hbase4.apache.org,44697,1676055795050)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,,1676055796287.2fd40e0179a0e968c4672055c041d740.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-10 19:03:17,598 DEBUG [rs(jenkins-hbase4.apache.org,44697,1676055795050)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676055796287.6b4a925bbaa3b95421bfaa80da606099. 2023-02-10 19:03:17,598 DEBUG [rs(jenkins-hbase4.apache.org,35891,1676055795020)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,aaa,1676055796287.eca90e03b313fba8b7a1d6571ea05502. started... 2023-02-10 19:03:17,599 DEBUG [rs(jenkins-hbase4.apache.org,44697,1676055795050)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676055796287.6b4a925bbaa3b95421bfaa80da606099. started... 2023-02-10 19:03:17,600 DEBUG [member: 'jenkins-hbase4.apache.org,35891,1676055795020' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 5 regions 2023-02-10 19:03:17,600 DEBUG [member: 'jenkins-hbase4.apache.org,35891,1676055795020' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-10 19:03:17,600 DEBUG [rs(jenkins-hbase4.apache.org,44697,1676055795050)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-10 19:03:17,600 INFO [rs(jenkins-hbase4.apache.org,44697,1676055795050)-snapshot-pool-1] regionserver.HRegion(2744): Flushing 6b4a925bbaa3b95421bfaa80da606099 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-10 19:03:17,600 DEBUG [rs(jenkins-hbase4.apache.org,35891,1676055795020)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,d\x84\x84,1676055796287.f8e2703c94874a9a6d0d1541b43c1eb3. 2023-02-10 19:03:17,600 INFO [rs(jenkins-hbase4.apache.org,35891,1676055795020)-snapshot-pool-1] regionserver.HRegion(2744): Flushing eca90e03b313fba8b7a1d6571ea05502 2/2 column families, dataSize=158.44 KB heapSize=549.75 KB 2023-02-10 19:03:17,600 INFO [rs(jenkins-hbase4.apache.org,35891,1676055795020)-snapshot-pool-0] regionserver.HRegion(2744): Flushing 4539b623282fa7d2beb504c373ad6181 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-10 19:03:17,601 DEBUG [rs(jenkins-hbase4.apache.org,35891,1676055795020)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,d\x84\x84,1676055796287.f8e2703c94874a9a6d0d1541b43c1eb3. started... 2023-02-10 19:03:17,601 DEBUG [rs(jenkins-hbase4.apache.org,44697,1676055795050)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-10 19:03:17,601 DEBUG [rs(jenkins-hbase4.apache.org,44697,1676055795050)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-10 19:03:17,604 DEBUG [member: 'jenkins-hbase4.apache.org,44697,1676055795050' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 5 regions 2023-02-10 19:03:17,605 DEBUG [member: 'jenkins-hbase4.apache.org,44697,1676055795050' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-10 19:03:17,605 DEBUG [rs(jenkins-hbase4.apache.org,44697,1676055795050)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,zz{,1676055796287.ca626b09070f3e18c31fb632b018370f. 2023-02-10 19:03:17,604 INFO [rs(jenkins-hbase4.apache.org,35891,1676055795020)-snapshot-pool-2] regionserver.HRegion(2744): Flushing f8e2703c94874a9a6d0d1541b43c1eb3 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-10 19:03:17,605 DEBUG [rs(jenkins-hbase4.apache.org,44697,1676055795050)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,zz{,1676055796287.ca626b09070f3e18c31fb632b018370f. started... 2023-02-10 19:03:17,605 DEBUG [rs(jenkins-hbase4.apache.org,44697,1676055795050)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for ca626b09070f3e18c31fb632b018370f: 2023-02-10 19:03:17,606 DEBUG [rs(jenkins-hbase4.apache.org,44697,1676055795050)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,zz{,1676055796287.ca626b09070f3e18c31fb632b018370f.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-10 19:03:17,606 DEBUG [rs(jenkins-hbase4.apache.org,44697,1676055795050)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-10 19:03:17,606 DEBUG [rs(jenkins-hbase4.apache.org,44697,1676055795050)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-10 19:03:17,606 DEBUG [rs(jenkins-hbase4.apache.org,44697,1676055795050)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-10 19:03:17,632 DEBUG [rs(jenkins-hbase4.apache.org,44697,1676055795050)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,,1676055796287.2fd40e0179a0e968c4672055c041d740. completed. 2023-02-10 19:03:17,632 DEBUG [rs(jenkins-hbase4.apache.org,44697,1676055795050)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,,1676055796287.2fd40e0179a0e968c4672055c041d740. 2023-02-10 19:03:17,632 DEBUG [rs(jenkins-hbase4.apache.org,44697,1676055795050)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,m\xED\xED,1676055796287.b324410564271f3c81fcd7c2326d0435. 2023-02-10 19:03:17,632 DEBUG [rs(jenkins-hbase4.apache.org,44697,1676055795050)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,zz{,1676055796287.ca626b09070f3e18c31fb632b018370f. completed. 2023-02-10 19:03:17,632 DEBUG [member: 'jenkins-hbase4.apache.org,44697,1676055795050' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/5 local region snapshots. 2023-02-10 19:03:17,632 DEBUG [rs(jenkins-hbase4.apache.org,44697,1676055795050)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,m\xED\xED,1676055796287.b324410564271f3c81fcd7c2326d0435. started... 2023-02-10 19:03:17,632 DEBUG [rs(jenkins-hbase4.apache.org,44697,1676055795050)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,zz{,1676055796287.ca626b09070f3e18c31fb632b018370f. 2023-02-10 19:03:17,632 DEBUG [rs(jenkins-hbase4.apache.org,44697,1676055795050)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,t43,1676055796287.54239cd4e87d877b10bac35ba4d2a8c8. 2023-02-10 19:03:17,637 DEBUG [member: 'jenkins-hbase4.apache.org,44697,1676055795050' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 2/5 local region snapshots. 2023-02-10 19:03:17,637 INFO [rs(jenkins-hbase4.apache.org,44697,1676055795050)-snapshot-pool-0] regionserver.HRegion(2744): Flushing b324410564271f3c81fcd7c2326d0435 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-10 19:03:17,637 DEBUG [rs(jenkins-hbase4.apache.org,44697,1676055795050)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,t43,1676055796287.54239cd4e87d877b10bac35ba4d2a8c8. started... 2023-02-10 19:03:17,641 INFO [rs(jenkins-hbase4.apache.org,44697,1676055795050)-snapshot-pool-2] regionserver.HRegion(2744): Flushing 54239cd4e87d877b10bac35ba4d2a8c8 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-10 19:03:17,651 INFO [rs(jenkins-hbase4.apache.org,35891,1676055795020)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/data/default/testWithMockedMapReduceMultiRegion/f8e2703c94874a9a6d0d1541b43c1eb3/.tmp/f1/d9cb9fdd72484ad5887d21abdea99fc6 2023-02-10 19:03:17,655 INFO [rs(jenkins-hbase4.apache.org,35891,1676055795020)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/data/default/testWithMockedMapReduceMultiRegion/4539b623282fa7d2beb504c373ad6181/.tmp/f1/162a7696e02a4a4c9611ac886893cd7e 2023-02-10 19:03:17,655 INFO [rs(jenkins-hbase4.apache.org,44697,1676055795050)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/data/default/testWithMockedMapReduceMultiRegion/6b4a925bbaa3b95421bfaa80da606099/.tmp/f1/b40c4c188cf84850af2e9f8cc89239b7 2023-02-10 19:03:17,657 INFO [rs(jenkins-hbase4.apache.org,35891,1676055795020)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/data/default/testWithMockedMapReduceMultiRegion/eca90e03b313fba8b7a1d6571ea05502/.tmp/f1/d3fc07d8a2dc437cbc5b0d6449b82ce5 2023-02-10 19:03:17,664 INFO [rs(jenkins-hbase4.apache.org,44697,1676055795050)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/data/default/testWithMockedMapReduceMultiRegion/b324410564271f3c81fcd7c2326d0435/.tmp/f1/109ffb49435d4f9d8b2303143ce8c190 2023-02-10 19:03:17,665 DEBUG [Listener at localhost/37107] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-10 19:03:17,669 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33383] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 } is done 2023-02-10 19:03:17,669 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33383] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 }' is still in progress! 2023-02-10 19:03:17,670 DEBUG [Listener at localhost/37107] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-02-10 19:03:17,680 WARN [DataStreamer for file /user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/data/default/testWithMockedMapReduceMultiRegion/54239cd4e87d877b10bac35ba4d2a8c8/.tmp/f1/998ea972b9ba48cbbbdfc4c5644202c7] hdfs.DataStreamer(982): Caught exception java.lang.InterruptedException at java.lang.Object.wait(Native Method) at java.lang.Thread.join(Thread.java:1257) at java.lang.Thread.join(Thread.java:1331) at org.apache.hadoop.hdfs.DataStreamer.closeResponder(DataStreamer.java:980) at org.apache.hadoop.hdfs.DataStreamer.endBlock(DataStreamer.java:630) at org.apache.hadoop.hdfs.DataStreamer.run(DataStreamer.java:807) 2023-02-10 19:03:17,681 INFO [rs(jenkins-hbase4.apache.org,44697,1676055795050)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/data/default/testWithMockedMapReduceMultiRegion/54239cd4e87d877b10bac35ba4d2a8c8/.tmp/f1/998ea972b9ba48cbbbdfc4c5644202c7 2023-02-10 19:03:17,704 INFO [rs(jenkins-hbase4.apache.org,44697,1676055795050)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/data/default/testWithMockedMapReduceMultiRegion/6b4a925bbaa3b95421bfaa80da606099/.tmp/f2/5784d0007aae4b6587c2605c3982f3e5 2023-02-10 19:03:17,716 INFO [rs(jenkins-hbase4.apache.org,44697,1676055795050)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/data/default/testWithMockedMapReduceMultiRegion/b324410564271f3c81fcd7c2326d0435/.tmp/f2/e3751b81f34246ada74148861c841aea 2023-02-10 19:03:17,719 INFO [rs(jenkins-hbase4.apache.org,35891,1676055795020)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/data/default/testWithMockedMapReduceMultiRegion/f8e2703c94874a9a6d0d1541b43c1eb3/.tmp/f2/fa18b005bdb24003bc90c081e4bc0826 2023-02-10 19:03:17,721 INFO [rs(jenkins-hbase4.apache.org,35891,1676055795020)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/data/default/testWithMockedMapReduceMultiRegion/4539b623282fa7d2beb504c373ad6181/.tmp/f2/16a960ab437341ac939f98660d7ed9b5 2023-02-10 19:03:17,721 INFO [rs(jenkins-hbase4.apache.org,44697,1676055795050)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/data/default/testWithMockedMapReduceMultiRegion/54239cd4e87d877b10bac35ba4d2a8c8/.tmp/f2/d23712496aef458b97ec335b1481382e 2023-02-10 19:03:17,721 INFO [rs(jenkins-hbase4.apache.org,35891,1676055795020)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/data/default/testWithMockedMapReduceMultiRegion/eca90e03b313fba8b7a1d6571ea05502/.tmp/f2/0750363b3f3243a587dec443702e524a 2023-02-10 19:03:17,724 DEBUG [rs(jenkins-hbase4.apache.org,44697,1676055795050)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/data/default/testWithMockedMapReduceMultiRegion/6b4a925bbaa3b95421bfaa80da606099/.tmp/f1/b40c4c188cf84850af2e9f8cc89239b7 as hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/data/default/testWithMockedMapReduceMultiRegion/6b4a925bbaa3b95421bfaa80da606099/f1/b40c4c188cf84850af2e9f8cc89239b7 2023-02-10 19:03:17,724 DEBUG [rs(jenkins-hbase4.apache.org,44697,1676055795050)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/data/default/testWithMockedMapReduceMultiRegion/b324410564271f3c81fcd7c2326d0435/.tmp/f1/109ffb49435d4f9d8b2303143ce8c190 as hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/data/default/testWithMockedMapReduceMultiRegion/b324410564271f3c81fcd7c2326d0435/f1/109ffb49435d4f9d8b2303143ce8c190 2023-02-10 19:03:17,726 DEBUG [rs(jenkins-hbase4.apache.org,35891,1676055795020)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/data/default/testWithMockedMapReduceMultiRegion/f8e2703c94874a9a6d0d1541b43c1eb3/.tmp/f1/d9cb9fdd72484ad5887d21abdea99fc6 as hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/data/default/testWithMockedMapReduceMultiRegion/f8e2703c94874a9a6d0d1541b43c1eb3/f1/d9cb9fdd72484ad5887d21abdea99fc6 2023-02-10 19:03:17,728 DEBUG [rs(jenkins-hbase4.apache.org,35891,1676055795020)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/data/default/testWithMockedMapReduceMultiRegion/4539b623282fa7d2beb504c373ad6181/.tmp/f1/162a7696e02a4a4c9611ac886893cd7e as hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/data/default/testWithMockedMapReduceMultiRegion/4539b623282fa7d2beb504c373ad6181/f1/162a7696e02a4a4c9611ac886893cd7e 2023-02-10 19:03:17,729 DEBUG [rs(jenkins-hbase4.apache.org,35891,1676055795020)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/data/default/testWithMockedMapReduceMultiRegion/eca90e03b313fba8b7a1d6571ea05502/.tmp/f1/d3fc07d8a2dc437cbc5b0d6449b82ce5 as hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/data/default/testWithMockedMapReduceMultiRegion/eca90e03b313fba8b7a1d6571ea05502/f1/d3fc07d8a2dc437cbc5b0d6449b82ce5 2023-02-10 19:03:17,730 INFO [rs(jenkins-hbase4.apache.org,44697,1676055795050)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/data/default/testWithMockedMapReduceMultiRegion/b324410564271f3c81fcd7c2326d0435/f1/109ffb49435d4f9d8b2303143ce8c190, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-10 19:03:17,730 INFO [rs(jenkins-hbase4.apache.org,44697,1676055795050)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/data/default/testWithMockedMapReduceMultiRegion/6b4a925bbaa3b95421bfaa80da606099/f1/b40c4c188cf84850af2e9f8cc89239b7, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-10 19:03:17,731 DEBUG [rs(jenkins-hbase4.apache.org,44697,1676055795050)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/data/default/testWithMockedMapReduceMultiRegion/b324410564271f3c81fcd7c2326d0435/.tmp/f2/e3751b81f34246ada74148861c841aea as hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/data/default/testWithMockedMapReduceMultiRegion/b324410564271f3c81fcd7c2326d0435/f2/e3751b81f34246ada74148861c841aea 2023-02-10 19:03:17,731 DEBUG [rs(jenkins-hbase4.apache.org,44697,1676055795050)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/data/default/testWithMockedMapReduceMultiRegion/6b4a925bbaa3b95421bfaa80da606099/.tmp/f2/5784d0007aae4b6587c2605c3982f3e5 as hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/data/default/testWithMockedMapReduceMultiRegion/6b4a925bbaa3b95421bfaa80da606099/f2/5784d0007aae4b6587c2605c3982f3e5 2023-02-10 19:03:17,732 INFO [rs(jenkins-hbase4.apache.org,35891,1676055795020)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/data/default/testWithMockedMapReduceMultiRegion/f8e2703c94874a9a6d0d1541b43c1eb3/f1/d9cb9fdd72484ad5887d21abdea99fc6, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-10 19:03:17,733 DEBUG [rs(jenkins-hbase4.apache.org,35891,1676055795020)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/data/default/testWithMockedMapReduceMultiRegion/f8e2703c94874a9a6d0d1541b43c1eb3/.tmp/f2/fa18b005bdb24003bc90c081e4bc0826 as hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/data/default/testWithMockedMapReduceMultiRegion/f8e2703c94874a9a6d0d1541b43c1eb3/f2/fa18b005bdb24003bc90c081e4bc0826 2023-02-10 19:03:17,736 INFO [rs(jenkins-hbase4.apache.org,35891,1676055795020)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/data/default/testWithMockedMapReduceMultiRegion/eca90e03b313fba8b7a1d6571ea05502/f1/d3fc07d8a2dc437cbc5b0d6449b82ce5, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-10 19:03:17,737 INFO [rs(jenkins-hbase4.apache.org,35891,1676055795020)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/data/default/testWithMockedMapReduceMultiRegion/4539b623282fa7d2beb504c373ad6181/f1/162a7696e02a4a4c9611ac886893cd7e, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-10 19:03:17,738 DEBUG [rs(jenkins-hbase4.apache.org,35891,1676055795020)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/data/default/testWithMockedMapReduceMultiRegion/eca90e03b313fba8b7a1d6571ea05502/.tmp/f2/0750363b3f3243a587dec443702e524a as hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/data/default/testWithMockedMapReduceMultiRegion/eca90e03b313fba8b7a1d6571ea05502/f2/0750363b3f3243a587dec443702e524a 2023-02-10 19:03:17,738 DEBUG [rs(jenkins-hbase4.apache.org,44697,1676055795050)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/data/default/testWithMockedMapReduceMultiRegion/54239cd4e87d877b10bac35ba4d2a8c8/.tmp/f1/998ea972b9ba48cbbbdfc4c5644202c7 as hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/data/default/testWithMockedMapReduceMultiRegion/54239cd4e87d877b10bac35ba4d2a8c8/f1/998ea972b9ba48cbbbdfc4c5644202c7 2023-02-10 19:03:17,738 INFO [rs(jenkins-hbase4.apache.org,44697,1676055795050)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/data/default/testWithMockedMapReduceMultiRegion/b324410564271f3c81fcd7c2326d0435/f2/e3751b81f34246ada74148861c841aea, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-10 19:03:17,739 INFO [rs(jenkins-hbase4.apache.org,44697,1676055795050)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for b324410564271f3c81fcd7c2326d0435 in 102ms, sequenceid=5, compaction requested=false 2023-02-10 19:03:17,739 DEBUG [rs(jenkins-hbase4.apache.org,44697,1676055795050)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testWithMockedMapReduceMultiRegion' 2023-02-10 19:03:17,739 DEBUG [rs(jenkins-hbase4.apache.org,35891,1676055795020)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/data/default/testWithMockedMapReduceMultiRegion/4539b623282fa7d2beb504c373ad6181/.tmp/f2/16a960ab437341ac939f98660d7ed9b5 as hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/data/default/testWithMockedMapReduceMultiRegion/4539b623282fa7d2beb504c373ad6181/f2/16a960ab437341ac939f98660d7ed9b5 2023-02-10 19:03:17,740 INFO [rs(jenkins-hbase4.apache.org,44697,1676055795050)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/data/default/testWithMockedMapReduceMultiRegion/6b4a925bbaa3b95421bfaa80da606099/f2/5784d0007aae4b6587c2605c3982f3e5, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-10 19:03:17,740 DEBUG [rs(jenkins-hbase4.apache.org,44697,1676055795050)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for b324410564271f3c81fcd7c2326d0435: 2023-02-10 19:03:17,740 DEBUG [rs(jenkins-hbase4.apache.org,44697,1676055795050)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,m\xED\xED,1676055796287.b324410564271f3c81fcd7c2326d0435.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-10 19:03:17,740 DEBUG [rs(jenkins-hbase4.apache.org,44697,1676055795050)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-10 19:03:17,741 DEBUG [rs(jenkins-hbase4.apache.org,44697,1676055795050)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/data/default/testWithMockedMapReduceMultiRegion/b324410564271f3c81fcd7c2326d0435/f1/109ffb49435d4f9d8b2303143ce8c190] hfiles 2023-02-10 19:03:17,741 DEBUG [rs(jenkins-hbase4.apache.org,44697,1676055795050)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/data/default/testWithMockedMapReduceMultiRegion/b324410564271f3c81fcd7c2326d0435/f1/109ffb49435d4f9d8b2303143ce8c190 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-10 19:03:17,741 DEBUG [rs(jenkins-hbase4.apache.org,44697,1676055795050)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/data/default/testWithMockedMapReduceMultiRegion/b324410564271f3c81fcd7c2326d0435/f2/e3751b81f34246ada74148861c841aea] hfiles 2023-02-10 19:03:17,741 DEBUG [rs(jenkins-hbase4.apache.org,44697,1676055795050)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/data/default/testWithMockedMapReduceMultiRegion/b324410564271f3c81fcd7c2326d0435/f2/e3751b81f34246ada74148861c841aea for snapshot=testWithMockedMapReduceMultiRegion 2023-02-10 19:03:17,741 INFO [rs(jenkins-hbase4.apache.org,44697,1676055795050)-snapshot-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 6b4a925bbaa3b95421bfaa80da606099 in 141ms, sequenceid=5, compaction requested=false 2023-02-10 19:03:17,742 DEBUG [rs(jenkins-hbase4.apache.org,44697,1676055795050)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for 6b4a925bbaa3b95421bfaa80da606099: 2023-02-10 19:03:17,742 DEBUG [rs(jenkins-hbase4.apache.org,44697,1676055795050)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676055796287.6b4a925bbaa3b95421bfaa80da606099.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-10 19:03:17,742 DEBUG [rs(jenkins-hbase4.apache.org,44697,1676055795050)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-10 19:03:17,742 DEBUG [rs(jenkins-hbase4.apache.org,44697,1676055795050)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/data/default/testWithMockedMapReduceMultiRegion/6b4a925bbaa3b95421bfaa80da606099/f1/b40c4c188cf84850af2e9f8cc89239b7] hfiles 2023-02-10 19:03:17,742 DEBUG [rs(jenkins-hbase4.apache.org,44697,1676055795050)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/data/default/testWithMockedMapReduceMultiRegion/6b4a925bbaa3b95421bfaa80da606099/f1/b40c4c188cf84850af2e9f8cc89239b7 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-10 19:03:17,743 DEBUG [rs(jenkins-hbase4.apache.org,44697,1676055795050)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/data/default/testWithMockedMapReduceMultiRegion/6b4a925bbaa3b95421bfaa80da606099/f2/5784d0007aae4b6587c2605c3982f3e5] hfiles 2023-02-10 19:03:17,743 DEBUG [rs(jenkins-hbase4.apache.org,44697,1676055795050)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/data/default/testWithMockedMapReduceMultiRegion/6b4a925bbaa3b95421bfaa80da606099/f2/5784d0007aae4b6587c2605c3982f3e5 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-10 19:03:17,744 INFO [rs(jenkins-hbase4.apache.org,35891,1676055795020)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/data/default/testWithMockedMapReduceMultiRegion/f8e2703c94874a9a6d0d1541b43c1eb3/f2/fa18b005bdb24003bc90c081e4bc0826, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-10 19:03:17,745 INFO [rs(jenkins-hbase4.apache.org,35891,1676055795020)-snapshot-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for f8e2703c94874a9a6d0d1541b43c1eb3 in 141ms, sequenceid=5, compaction requested=false 2023-02-10 19:03:17,745 DEBUG [rs(jenkins-hbase4.apache.org,35891,1676055795020)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for f8e2703c94874a9a6d0d1541b43c1eb3: 2023-02-10 19:03:17,745 DEBUG [rs(jenkins-hbase4.apache.org,35891,1676055795020)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,d\x84\x84,1676055796287.f8e2703c94874a9a6d0d1541b43c1eb3.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-10 19:03:17,749 DEBUG [rs(jenkins-hbase4.apache.org,35891,1676055795020)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-10 19:03:17,749 DEBUG [rs(jenkins-hbase4.apache.org,35891,1676055795020)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/data/default/testWithMockedMapReduceMultiRegion/f8e2703c94874a9a6d0d1541b43c1eb3/f1/d9cb9fdd72484ad5887d21abdea99fc6] hfiles 2023-02-10 19:03:17,749 DEBUG [rs(jenkins-hbase4.apache.org,35891,1676055795020)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/data/default/testWithMockedMapReduceMultiRegion/f8e2703c94874a9a6d0d1541b43c1eb3/f1/d9cb9fdd72484ad5887d21abdea99fc6 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-10 19:03:17,749 DEBUG [rs(jenkins-hbase4.apache.org,35891,1676055795020)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/data/default/testWithMockedMapReduceMultiRegion/f8e2703c94874a9a6d0d1541b43c1eb3/f2/fa18b005bdb24003bc90c081e4bc0826] hfiles 2023-02-10 19:03:17,749 DEBUG [rs(jenkins-hbase4.apache.org,35891,1676055795020)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/data/default/testWithMockedMapReduceMultiRegion/f8e2703c94874a9a6d0d1541b43c1eb3/f2/fa18b005bdb24003bc90c081e4bc0826 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-10 19:03:17,751 INFO [rs(jenkins-hbase4.apache.org,35891,1676055795020)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/data/default/testWithMockedMapReduceMultiRegion/eca90e03b313fba8b7a1d6571ea05502/f2/0750363b3f3243a587dec443702e524a, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-10 19:03:17,751 INFO [rs(jenkins-hbase4.apache.org,35891,1676055795020)-snapshot-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~158.44 KB/162240, heapSize ~549.72 KB/562912, currentSize=0 B/0 for eca90e03b313fba8b7a1d6571ea05502 in 151ms, sequenceid=5, compaction requested=false 2023-02-10 19:03:17,752 DEBUG [rs(jenkins-hbase4.apache.org,35891,1676055795020)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for eca90e03b313fba8b7a1d6571ea05502: 2023-02-10 19:03:17,752 DEBUG [rs(jenkins-hbase4.apache.org,35891,1676055795020)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,aaa,1676055796287.eca90e03b313fba8b7a1d6571ea05502.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-10 19:03:17,752 DEBUG [rs(jenkins-hbase4.apache.org,35891,1676055795020)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-10 19:03:17,752 DEBUG [rs(jenkins-hbase4.apache.org,35891,1676055795020)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/data/default/testWithMockedMapReduceMultiRegion/eca90e03b313fba8b7a1d6571ea05502/f1/d3fc07d8a2dc437cbc5b0d6449b82ce5] hfiles 2023-02-10 19:03:17,752 DEBUG [rs(jenkins-hbase4.apache.org,35891,1676055795020)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/data/default/testWithMockedMapReduceMultiRegion/eca90e03b313fba8b7a1d6571ea05502/f1/d3fc07d8a2dc437cbc5b0d6449b82ce5 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-10 19:03:17,752 DEBUG [rs(jenkins-hbase4.apache.org,35891,1676055795020)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/data/default/testWithMockedMapReduceMultiRegion/eca90e03b313fba8b7a1d6571ea05502/f2/0750363b3f3243a587dec443702e524a] hfiles 2023-02-10 19:03:17,752 DEBUG [rs(jenkins-hbase4.apache.org,35891,1676055795020)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/data/default/testWithMockedMapReduceMultiRegion/eca90e03b313fba8b7a1d6571ea05502/f2/0750363b3f3243a587dec443702e524a for snapshot=testWithMockedMapReduceMultiRegion 2023-02-10 19:03:17,753 INFO [rs(jenkins-hbase4.apache.org,35891,1676055795020)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/data/default/testWithMockedMapReduceMultiRegion/4539b623282fa7d2beb504c373ad6181/f2/16a960ab437341ac939f98660d7ed9b5, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-10 19:03:17,753 INFO [rs(jenkins-hbase4.apache.org,35891,1676055795020)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 4539b623282fa7d2beb504c373ad6181 in 153ms, sequenceid=5, compaction requested=false 2023-02-10 19:03:17,753 INFO [rs(jenkins-hbase4.apache.org,44697,1676055795050)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/data/default/testWithMockedMapReduceMultiRegion/54239cd4e87d877b10bac35ba4d2a8c8/f1/998ea972b9ba48cbbbdfc4c5644202c7, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-10 19:03:17,753 DEBUG [rs(jenkins-hbase4.apache.org,35891,1676055795020)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 4539b623282fa7d2beb504c373ad6181: 2023-02-10 19:03:17,754 DEBUG [rs(jenkins-hbase4.apache.org,35891,1676055795020)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,q\x11\x10,1676055796287.4539b623282fa7d2beb504c373ad6181.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-10 19:03:17,754 DEBUG [rs(jenkins-hbase4.apache.org,35891,1676055795020)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-10 19:03:17,754 DEBUG [rs(jenkins-hbase4.apache.org,35891,1676055795020)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/data/default/testWithMockedMapReduceMultiRegion/4539b623282fa7d2beb504c373ad6181/f1/162a7696e02a4a4c9611ac886893cd7e] hfiles 2023-02-10 19:03:17,754 DEBUG [rs(jenkins-hbase4.apache.org,35891,1676055795020)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/data/default/testWithMockedMapReduceMultiRegion/4539b623282fa7d2beb504c373ad6181/f1/162a7696e02a4a4c9611ac886893cd7e for snapshot=testWithMockedMapReduceMultiRegion 2023-02-10 19:03:17,754 DEBUG [rs(jenkins-hbase4.apache.org,35891,1676055795020)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/data/default/testWithMockedMapReduceMultiRegion/4539b623282fa7d2beb504c373ad6181/f2/16a960ab437341ac939f98660d7ed9b5] hfiles 2023-02-10 19:03:17,754 DEBUG [rs(jenkins-hbase4.apache.org,35891,1676055795020)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/data/default/testWithMockedMapReduceMultiRegion/4539b623282fa7d2beb504c373ad6181/f2/16a960ab437341ac939f98660d7ed9b5 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-10 19:03:17,754 DEBUG [rs(jenkins-hbase4.apache.org,44697,1676055795050)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/data/default/testWithMockedMapReduceMultiRegion/54239cd4e87d877b10bac35ba4d2a8c8/.tmp/f2/d23712496aef458b97ec335b1481382e as hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/data/default/testWithMockedMapReduceMultiRegion/54239cd4e87d877b10bac35ba4d2a8c8/f2/d23712496aef458b97ec335b1481382e 2023-02-10 19:03:17,759 INFO [rs(jenkins-hbase4.apache.org,44697,1676055795050)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/data/default/testWithMockedMapReduceMultiRegion/54239cd4e87d877b10bac35ba4d2a8c8/f2/d23712496aef458b97ec335b1481382e, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-10 19:03:17,759 INFO [rs(jenkins-hbase4.apache.org,44697,1676055795050)-snapshot-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 54239cd4e87d877b10bac35ba4d2a8c8 in 118ms, sequenceid=5, compaction requested=false 2023-02-10 19:03:17,759 DEBUG [rs(jenkins-hbase4.apache.org,44697,1676055795050)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for 54239cd4e87d877b10bac35ba4d2a8c8: 2023-02-10 19:03:17,759 DEBUG [rs(jenkins-hbase4.apache.org,44697,1676055795050)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,t43,1676055796287.54239cd4e87d877b10bac35ba4d2a8c8.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-10 19:03:17,759 DEBUG [rs(jenkins-hbase4.apache.org,44697,1676055795050)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-10 19:03:17,760 DEBUG [rs(jenkins-hbase4.apache.org,44697,1676055795050)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/data/default/testWithMockedMapReduceMultiRegion/54239cd4e87d877b10bac35ba4d2a8c8/f1/998ea972b9ba48cbbbdfc4c5644202c7] hfiles 2023-02-10 19:03:17,760 DEBUG [rs(jenkins-hbase4.apache.org,44697,1676055795050)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/data/default/testWithMockedMapReduceMultiRegion/54239cd4e87d877b10bac35ba4d2a8c8/f1/998ea972b9ba48cbbbdfc4c5644202c7 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-10 19:03:17,760 DEBUG [rs(jenkins-hbase4.apache.org,44697,1676055795050)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/data/default/testWithMockedMapReduceMultiRegion/54239cd4e87d877b10bac35ba4d2a8c8/f2/d23712496aef458b97ec335b1481382e] hfiles 2023-02-10 19:03:17,760 DEBUG [rs(jenkins-hbase4.apache.org,44697,1676055795050)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/data/default/testWithMockedMapReduceMultiRegion/54239cd4e87d877b10bac35ba4d2a8c8/f2/d23712496aef458b97ec335b1481382e for snapshot=testWithMockedMapReduceMultiRegion 2023-02-10 19:03:17,768 DEBUG [rs(jenkins-hbase4.apache.org,44697,1676055795050)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676055796287.6b4a925bbaa3b95421bfaa80da606099. completed. 2023-02-10 19:03:17,768 DEBUG [rs(jenkins-hbase4.apache.org,44697,1676055795050)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676055796287.6b4a925bbaa3b95421bfaa80da606099. 2023-02-10 19:03:17,768 DEBUG [member: 'jenkins-hbase4.apache.org,44697,1676055795050' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 3/5 local region snapshots. 2023-02-10 19:03:17,779 DEBUG [rs(jenkins-hbase4.apache.org,35891,1676055795020)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,d\x84\x84,1676055796287.f8e2703c94874a9a6d0d1541b43c1eb3. completed. 2023-02-10 19:03:17,779 DEBUG [rs(jenkins-hbase4.apache.org,35891,1676055795020)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,d\x84\x84,1676055796287.f8e2703c94874a9a6d0d1541b43c1eb3. 2023-02-10 19:03:17,780 DEBUG [rs(jenkins-hbase4.apache.org,35891,1676055795020)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676055796287.08e6594f21fdd814bfb7b05ba0f4191b. 2023-02-10 19:03:17,780 DEBUG [member: 'jenkins-hbase4.apache.org,35891,1676055795020' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/5 local region snapshots. 2023-02-10 19:03:17,780 DEBUG [rs(jenkins-hbase4.apache.org,35891,1676055795020)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676055796287.08e6594f21fdd814bfb7b05ba0f4191b. started... 2023-02-10 19:03:17,780 DEBUG [rs(jenkins-hbase4.apache.org,44697,1676055795050)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,t43,1676055796287.54239cd4e87d877b10bac35ba4d2a8c8. completed. 2023-02-10 19:03:17,781 INFO [rs(jenkins-hbase4.apache.org,35891,1676055795020)-snapshot-pool-2] regionserver.HRegion(2744): Flushing 08e6594f21fdd814bfb7b05ba0f4191b 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-10 19:03:17,781 DEBUG [rs(jenkins-hbase4.apache.org,44697,1676055795050)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,t43,1676055796287.54239cd4e87d877b10bac35ba4d2a8c8. 2023-02-10 19:03:17,781 DEBUG [member: 'jenkins-hbase4.apache.org,44697,1676055795050' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 4/5 local region snapshots. 2023-02-10 19:03:17,783 DEBUG [rs(jenkins-hbase4.apache.org,35891,1676055795020)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,aaa,1676055796287.eca90e03b313fba8b7a1d6571ea05502. completed. 2023-02-10 19:03:17,783 DEBUG [rs(jenkins-hbase4.apache.org,35891,1676055795020)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,aaa,1676055796287.eca90e03b313fba8b7a1d6571ea05502. 2023-02-10 19:03:17,783 DEBUG [rs(jenkins-hbase4.apache.org,35891,1676055795020)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,wWV,1676055796287.bc3dafb6d0db6c740ff9583526924864. 2023-02-10 19:03:17,783 DEBUG [member: 'jenkins-hbase4.apache.org,35891,1676055795020' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 2/5 local region snapshots. 2023-02-10 19:03:17,783 DEBUG [rs(jenkins-hbase4.apache.org,35891,1676055795020)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,wWV,1676055796287.bc3dafb6d0db6c740ff9583526924864. started... 2023-02-10 19:03:17,784 INFO [rs(jenkins-hbase4.apache.org,35891,1676055795020)-snapshot-pool-1] regionserver.HRegion(2744): Flushing bc3dafb6d0db6c740ff9583526924864 2/2 column families, dataSize=158.44 KB heapSize=549.75 KB 2023-02-10 19:03:17,784 DEBUG [rs(jenkins-hbase4.apache.org,35891,1676055795020)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,q\x11\x10,1676055796287.4539b623282fa7d2beb504c373ad6181. completed. 2023-02-10 19:03:17,784 DEBUG [rs(jenkins-hbase4.apache.org,35891,1676055795020)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,q\x11\x10,1676055796287.4539b623282fa7d2beb504c373ad6181. 2023-02-10 19:03:17,784 DEBUG [member: 'jenkins-hbase4.apache.org,35891,1676055795020' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 3/5 local region snapshots. 2023-02-10 19:03:17,792 INFO [rs(jenkins-hbase4.apache.org,35891,1676055795020)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/data/default/testWithMockedMapReduceMultiRegion/08e6594f21fdd814bfb7b05ba0f4191b/.tmp/f1/02780ed49bbb427cae98941994a14752 2023-02-10 19:03:17,792 INFO [rs(jenkins-hbase4.apache.org,35891,1676055795020)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/data/default/testWithMockedMapReduceMultiRegion/bc3dafb6d0db6c740ff9583526924864/.tmp/f1/f79594e01a1349768d709f8a2f749ca9 2023-02-10 19:03:17,814 INFO [rs(jenkins-hbase4.apache.org,35891,1676055795020)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/data/default/testWithMockedMapReduceMultiRegion/bc3dafb6d0db6c740ff9583526924864/.tmp/f2/2976aa6a7e6c4781a1ed63a69eb04281 2023-02-10 19:03:17,819 DEBUG [rs(jenkins-hbase4.apache.org,35891,1676055795020)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/data/default/testWithMockedMapReduceMultiRegion/bc3dafb6d0db6c740ff9583526924864/.tmp/f1/f79594e01a1349768d709f8a2f749ca9 as hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/data/default/testWithMockedMapReduceMultiRegion/bc3dafb6d0db6c740ff9583526924864/f1/f79594e01a1349768d709f8a2f749ca9 2023-02-10 19:03:17,823 INFO [rs(jenkins-hbase4.apache.org,35891,1676055795020)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/data/default/testWithMockedMapReduceMultiRegion/bc3dafb6d0db6c740ff9583526924864/f1/f79594e01a1349768d709f8a2f749ca9, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-10 19:03:17,824 DEBUG [rs(jenkins-hbase4.apache.org,35891,1676055795020)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/data/default/testWithMockedMapReduceMultiRegion/bc3dafb6d0db6c740ff9583526924864/.tmp/f2/2976aa6a7e6c4781a1ed63a69eb04281 as hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/data/default/testWithMockedMapReduceMultiRegion/bc3dafb6d0db6c740ff9583526924864/f2/2976aa6a7e6c4781a1ed63a69eb04281 2023-02-10 19:03:17,829 INFO [rs(jenkins-hbase4.apache.org,35891,1676055795020)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/data/default/testWithMockedMapReduceMultiRegion/bc3dafb6d0db6c740ff9583526924864/f2/2976aa6a7e6c4781a1ed63a69eb04281, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-10 19:03:17,829 INFO [rs(jenkins-hbase4.apache.org,35891,1676055795020)-snapshot-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~158.44 KB/162240, heapSize ~549.72 KB/562912, currentSize=0 B/0 for bc3dafb6d0db6c740ff9583526924864 in 45ms, sequenceid=5, compaction requested=false 2023-02-10 19:03:17,830 DEBUG [rs(jenkins-hbase4.apache.org,35891,1676055795020)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for bc3dafb6d0db6c740ff9583526924864: 2023-02-10 19:03:17,830 DEBUG [rs(jenkins-hbase4.apache.org,35891,1676055795020)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,wWV,1676055796287.bc3dafb6d0db6c740ff9583526924864.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-10 19:03:17,830 DEBUG [rs(jenkins-hbase4.apache.org,35891,1676055795020)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-10 19:03:17,830 DEBUG [rs(jenkins-hbase4.apache.org,35891,1676055795020)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/data/default/testWithMockedMapReduceMultiRegion/bc3dafb6d0db6c740ff9583526924864/f1/f79594e01a1349768d709f8a2f749ca9] hfiles 2023-02-10 19:03:17,830 DEBUG [rs(jenkins-hbase4.apache.org,35891,1676055795020)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/data/default/testWithMockedMapReduceMultiRegion/bc3dafb6d0db6c740ff9583526924864/f1/f79594e01a1349768d709f8a2f749ca9 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-10 19:03:17,830 DEBUG [rs(jenkins-hbase4.apache.org,35891,1676055795020)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/data/default/testWithMockedMapReduceMultiRegion/bc3dafb6d0db6c740ff9583526924864/f2/2976aa6a7e6c4781a1ed63a69eb04281] hfiles 2023-02-10 19:03:17,830 DEBUG [rs(jenkins-hbase4.apache.org,35891,1676055795020)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/data/default/testWithMockedMapReduceMultiRegion/bc3dafb6d0db6c740ff9583526924864/f2/2976aa6a7e6c4781a1ed63a69eb04281 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-10 19:03:17,836 DEBUG [rs(jenkins-hbase4.apache.org,35891,1676055795020)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,wWV,1676055796287.bc3dafb6d0db6c740ff9583526924864. completed. 2023-02-10 19:03:17,836 DEBUG [rs(jenkins-hbase4.apache.org,35891,1676055795020)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,wWV,1676055796287.bc3dafb6d0db6c740ff9583526924864. 2023-02-10 19:03:17,836 DEBUG [member: 'jenkins-hbase4.apache.org,35891,1676055795020' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 4/5 local region snapshots. 2023-02-10 19:03:17,870 DEBUG [Listener at localhost/37107] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-10 19:03:17,871 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33383] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 } is done 2023-02-10 19:03:17,871 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33383] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 }' is still in progress! 2023-02-10 19:03:17,871 DEBUG [Listener at localhost/37107] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-02-10 19:03:18,159 DEBUG [rs(jenkins-hbase4.apache.org,44697,1676055795050)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,m\xED\xED,1676055796287.b324410564271f3c81fcd7c2326d0435. completed. 2023-02-10 19:03:18,159 DEBUG [rs(jenkins-hbase4.apache.org,44697,1676055795050)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,m\xED\xED,1676055796287.b324410564271f3c81fcd7c2326d0435. 2023-02-10 19:03:18,159 DEBUG [member: 'jenkins-hbase4.apache.org,44697,1676055795050' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 5/5 local region snapshots. 2023-02-10 19:03:18,159 DEBUG [member: 'jenkins-hbase4.apache.org,44697,1676055795050' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 5 local region snapshots. 2023-02-10 19:03:18,159 DEBUG [member: 'jenkins-hbase4.apache.org,44697,1676055795050' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,44697,1676055795050 2023-02-10 19:03:18,159 DEBUG [member: 'jenkins-hbase4.apache.org,44697,1676055795050' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMockedMapReduceMultiRegion' locally completed 2023-02-10 19:03:18,159 DEBUG [member: 'jenkins-hbase4.apache.org,44697,1676055795050' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMockedMapReduceMultiRegion' completed for member 'jenkins-hbase4.apache.org,44697,1676055795050' in zk 2023-02-10 19:03:18,162 DEBUG [member: 'jenkins-hbase4.apache.org,44697,1676055795050' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMockedMapReduceMultiRegion' has notified controller of completion 2023-02-10 19:03:18,162 DEBUG [Listener at localhost/37107-EventThread] zookeeper.ZKWatcher(600): master:33383-0x1003f9dbed10000, quorum=127.0.0.1:52230, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,44697,1676055795050 2023-02-10 19:03:18,162 DEBUG [member: 'jenkins-hbase4.apache.org,44697,1676055795050' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-10 19:03:18,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,44697,1676055795050 2023-02-10 19:03:18,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-10 19:03:18,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-10 19:03:18,162 DEBUG [member: 'jenkins-hbase4.apache.org,44697,1676055795050' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMockedMapReduceMultiRegion' completed. 2023-02-10 19:03:18,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-10 19:03:18,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-10 19:03:18,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-10 19:03:18,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44697,1676055795050 2023-02-10 19:03:18,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35891,1676055795020 2023-02-10 19:03:18,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-10 19:03:18,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-10 19:03:18,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44697,1676055795050 2023-02-10 19:03:18,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMockedMapReduceMultiRegion' member 'jenkins-hbase4.apache.org,44697,1676055795050': 2023-02-10 19:03:18,168 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44697,1676055795050' released barrier for procedure'testWithMockedMapReduceMultiRegion', counting down latch. Waiting for 1 more 2023-02-10 19:03:18,171 DEBUG [Listener at localhost/37107] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-10 19:03:18,172 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33383] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 } is done 2023-02-10 19:03:18,173 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33383] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 }' is still in progress! 2023-02-10 19:03:18,173 DEBUG [Listener at localhost/37107] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-02-10 19:03:18,215 INFO [rs(jenkins-hbase4.apache.org,35891,1676055795020)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/data/default/testWithMockedMapReduceMultiRegion/08e6594f21fdd814bfb7b05ba0f4191b/.tmp/f2/b2a0e21849bd458096fc6d91f86bb0b3 2023-02-10 19:03:18,220 DEBUG [rs(jenkins-hbase4.apache.org,35891,1676055795020)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/data/default/testWithMockedMapReduceMultiRegion/08e6594f21fdd814bfb7b05ba0f4191b/.tmp/f1/02780ed49bbb427cae98941994a14752 as hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/data/default/testWithMockedMapReduceMultiRegion/08e6594f21fdd814bfb7b05ba0f4191b/f1/02780ed49bbb427cae98941994a14752 2023-02-10 19:03:18,225 INFO [rs(jenkins-hbase4.apache.org,35891,1676055795020)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/data/default/testWithMockedMapReduceMultiRegion/08e6594f21fdd814bfb7b05ba0f4191b/f1/02780ed49bbb427cae98941994a14752, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-10 19:03:18,226 DEBUG [rs(jenkins-hbase4.apache.org,35891,1676055795020)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/data/default/testWithMockedMapReduceMultiRegion/08e6594f21fdd814bfb7b05ba0f4191b/.tmp/f2/b2a0e21849bd458096fc6d91f86bb0b3 as hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/data/default/testWithMockedMapReduceMultiRegion/08e6594f21fdd814bfb7b05ba0f4191b/f2/b2a0e21849bd458096fc6d91f86bb0b3 2023-02-10 19:03:18,230 INFO [rs(jenkins-hbase4.apache.org,35891,1676055795020)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/data/default/testWithMockedMapReduceMultiRegion/08e6594f21fdd814bfb7b05ba0f4191b/f2/b2a0e21849bd458096fc6d91f86bb0b3, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-10 19:03:18,231 INFO [rs(jenkins-hbase4.apache.org,35891,1676055795020)-snapshot-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 08e6594f21fdd814bfb7b05ba0f4191b in 450ms, sequenceid=5, compaction requested=false 2023-02-10 19:03:18,231 DEBUG [rs(jenkins-hbase4.apache.org,35891,1676055795020)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for 08e6594f21fdd814bfb7b05ba0f4191b: 2023-02-10 19:03:18,231 DEBUG [rs(jenkins-hbase4.apache.org,35891,1676055795020)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676055796287.08e6594f21fdd814bfb7b05ba0f4191b.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-10 19:03:18,231 DEBUG [rs(jenkins-hbase4.apache.org,35891,1676055795020)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-10 19:03:18,231 DEBUG [rs(jenkins-hbase4.apache.org,35891,1676055795020)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/data/default/testWithMockedMapReduceMultiRegion/08e6594f21fdd814bfb7b05ba0f4191b/f1/02780ed49bbb427cae98941994a14752] hfiles 2023-02-10 19:03:18,231 DEBUG [rs(jenkins-hbase4.apache.org,35891,1676055795020)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/data/default/testWithMockedMapReduceMultiRegion/08e6594f21fdd814bfb7b05ba0f4191b/f1/02780ed49bbb427cae98941994a14752 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-10 19:03:18,231 DEBUG [rs(jenkins-hbase4.apache.org,35891,1676055795020)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/data/default/testWithMockedMapReduceMultiRegion/08e6594f21fdd814bfb7b05ba0f4191b/f2/b2a0e21849bd458096fc6d91f86bb0b3] hfiles 2023-02-10 19:03:18,231 DEBUG [rs(jenkins-hbase4.apache.org,35891,1676055795020)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/data/default/testWithMockedMapReduceMultiRegion/08e6594f21fdd814bfb7b05ba0f4191b/f2/b2a0e21849bd458096fc6d91f86bb0b3 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-10 19:03:18,237 DEBUG [rs(jenkins-hbase4.apache.org,35891,1676055795020)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676055796287.08e6594f21fdd814bfb7b05ba0f4191b. completed. 2023-02-10 19:03:18,237 DEBUG [rs(jenkins-hbase4.apache.org,35891,1676055795020)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676055796287.08e6594f21fdd814bfb7b05ba0f4191b. 2023-02-10 19:03:18,237 DEBUG [member: 'jenkins-hbase4.apache.org,35891,1676055795020' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 5/5 local region snapshots. 2023-02-10 19:03:18,237 DEBUG [member: 'jenkins-hbase4.apache.org,35891,1676055795020' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 5 local region snapshots. 2023-02-10 19:03:18,237 DEBUG [member: 'jenkins-hbase4.apache.org,35891,1676055795020' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,35891,1676055795020 2023-02-10 19:03:18,237 DEBUG [member: 'jenkins-hbase4.apache.org,35891,1676055795020' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMockedMapReduceMultiRegion' locally completed 2023-02-10 19:03:18,237 DEBUG [member: 'jenkins-hbase4.apache.org,35891,1676055795020' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMockedMapReduceMultiRegion' completed for member 'jenkins-hbase4.apache.org,35891,1676055795020' in zk 2023-02-10 19:03:18,239 DEBUG [Listener at localhost/37107-EventThread] zookeeper.ZKWatcher(600): master:33383-0x1003f9dbed10000, quorum=127.0.0.1:52230, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,35891,1676055795020 2023-02-10 19:03:18,239 DEBUG [member: 'jenkins-hbase4.apache.org,35891,1676055795020' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMockedMapReduceMultiRegion' has notified controller of completion 2023-02-10 19:03:18,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,35891,1676055795020 2023-02-10 19:03:18,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-10 19:03:18,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-10 19:03:18,239 DEBUG [member: 'jenkins-hbase4.apache.org,35891,1676055795020' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-10 19:03:18,239 DEBUG [member: 'jenkins-hbase4.apache.org,35891,1676055795020' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMockedMapReduceMultiRegion' completed. 2023-02-10 19:03:18,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-10 19:03:18,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-10 19:03:18,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-10 19:03:18,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44697,1676055795050 2023-02-10 19:03:18,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35891,1676055795020 2023-02-10 19:03:18,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-10 19:03:18,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-10 19:03:18,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44697,1676055795050 2023-02-10 19:03:18,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35891,1676055795020 2023-02-10 19:03:18,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMockedMapReduceMultiRegion' member 'jenkins-hbase4.apache.org,35891,1676055795020': 2023-02-10 19:03:18,242 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35891,1676055795020' released barrier for procedure'testWithMockedMapReduceMultiRegion', counting down latch. Waiting for 0 more 2023-02-10 19:03:18,242 INFO [(jenkins-hbase4.apache.org,33383,1676055794975)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMockedMapReduceMultiRegion' execution completed 2023-02-10 19:03:18,242 DEBUG [(jenkins-hbase4.apache.org,33383,1676055794975)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-10 19:03:18,242 DEBUG [(jenkins-hbase4.apache.org,33383,1676055794975)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-10 19:03:18,242 DEBUG [(jenkins-hbase4.apache.org,33383,1676055794975)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMockedMapReduceMultiRegion 2023-02-10 19:03:18,242 INFO [(jenkins-hbase4.apache.org,33383,1676055794975)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMockedMapReduceMultiRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-02-10 19:03:18,244 DEBUG [Listener at localhost/37107-EventThread] zookeeper.ZKWatcher(600): regionserver:44697-0x1003f9dbed10002, quorum=127.0.0.1:52230, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-10 19:03:18,244 DEBUG [Listener at localhost/37107-EventThread] zookeeper.ZKWatcher(600): master:33383-0x1003f9dbed10000, quorum=127.0.0.1:52230, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-10 19:03:18,244 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-10 19:03:18,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-10 19:03:18,244 DEBUG [Listener at localhost/37107-EventThread] zookeeper.ZKWatcher(600): regionserver:35891-0x1003f9dbed10001, quorum=127.0.0.1:52230, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-10 19:03:18,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-10 19:03:18,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-10 19:03:18,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-10 19:03:18,244 DEBUG [Listener at localhost/37107-EventThread] zookeeper.ZKWatcher(600): regionserver:44697-0x1003f9dbed10002, quorum=127.0.0.1:52230, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-10 19:03:18,245 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-10 19:03:18,245 DEBUG [Listener at localhost/37107-EventThread] zookeeper.ZKWatcher(600): regionserver:35891-0x1003f9dbed10001, quorum=127.0.0.1:52230, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-10 19:03:18,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-10 19:03:18,245 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-10 19:03:18,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-10 19:03:18,245 DEBUG [(jenkins-hbase4.apache.org,33383,1676055794975)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33383-0x1003f9dbed10000, quorum=127.0.0.1:52230, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,44697,1676055795050 2023-02-10 19:03:18,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-10 19:03:18,245 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-10 19:03:18,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-10 19:03:18,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-10 19:03:18,245 DEBUG [(jenkins-hbase4.apache.org,33383,1676055794975)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33383-0x1003f9dbed10000, quorum=127.0.0.1:52230, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,35891,1676055795020 2023-02-10 19:03:18,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-10 19:03:18,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-10 19:03:18,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-10 19:03:18,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-10 19:03:18,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44697,1676055795050 2023-02-10 19:03:18,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35891,1676055795020 2023-02-10 19:03:18,247 DEBUG [(jenkins-hbase4.apache.org,33383,1676055794975)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33383-0x1003f9dbed10000, quorum=127.0.0.1:52230, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,44697,1676055795050 2023-02-10 19:03:18,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-10 19:03:18,247 DEBUG [(jenkins-hbase4.apache.org,33383,1676055794975)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33383-0x1003f9dbed10000, quorum=127.0.0.1:52230, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,35891,1676055795020 2023-02-10 19:03:18,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-10 19:03:18,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44697,1676055795050 2023-02-10 19:03:18,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35891,1676055795020 2023-02-10 19:03:18,254 DEBUG [Listener at localhost/37107-EventThread] zookeeper.ZKWatcher(600): master:33383-0x1003f9dbed10000, quorum=127.0.0.1:52230, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,35891,1676055795020 2023-02-10 19:03:18,254 DEBUG [Listener at localhost/37107-EventThread] zookeeper.ZKWatcher(600): regionserver:44697-0x1003f9dbed10002, quorum=127.0.0.1:52230, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-10 19:03:18,254 DEBUG [Listener at localhost/37107-EventThread] zookeeper.ZKWatcher(600): regionserver:35891-0x1003f9dbed10001, quorum=127.0.0.1:52230, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-10 19:03:18,254 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-10 19:03:18,254 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-10 19:03:18,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-10 19:03:18,254 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for testWithMockedMapReduceMultiRegion 2023-02-10 19:03:18,254 DEBUG [Listener at localhost/37107-EventThread] zookeeper.ZKWatcher(600): regionserver:35891-0x1003f9dbed10001, quorum=127.0.0.1:52230, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-10 19:03:18,254 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for testWithMockedMapReduceMultiRegion 2023-02-10 19:03:18,254 DEBUG [Listener at localhost/37107-EventThread] zookeeper.ZKWatcher(600): master:33383-0x1003f9dbed10000, quorum=127.0.0.1:52230, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion 2023-02-10 19:03:18,254 DEBUG [Listener at localhost/37107-EventThread] zookeeper.ZKWatcher(600): regionserver:44697-0x1003f9dbed10002, quorum=127.0.0.1:52230, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-10 19:03:18,254 DEBUG [(jenkins-hbase4.apache.org,33383,1676055794975)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-10 19:03:18,255 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-10 19:03:18,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-10 19:03:18,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-10 19:03:18,255 DEBUG [Listener at localhost/37107-EventThread] zookeeper.ZKWatcher(600): master:33383-0x1003f9dbed10000, quorum=127.0.0.1:52230, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,44697,1676055795050 2023-02-10 19:03:18,255 DEBUG [Listener at localhost/37107-EventThread] zookeeper.ZKWatcher(600): master:33383-0x1003f9dbed10000, quorum=127.0.0.1:52230, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion 2023-02-10 19:03:18,255 DEBUG [Listener at localhost/37107-EventThread] zookeeper.ZKWatcher(600): master:33383-0x1003f9dbed10000, quorum=127.0.0.1:52230, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,35891,1676055795020 2023-02-10 19:03:18,255 DEBUG [Listener at localhost/37107-EventThread] zookeeper.ZKWatcher(600): master:33383-0x1003f9dbed10000, quorum=127.0.0.1:52230, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-10 19:03:18,255 DEBUG [Listener at localhost/37107-EventThread] zookeeper.ZKWatcher(600): master:33383-0x1003f9dbed10000, quorum=127.0.0.1:52230, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,44697,1676055795050 2023-02-10 19:03:18,255 DEBUG [Listener at localhost/37107-EventThread] zookeeper.ZKWatcher(600): master:33383-0x1003f9dbed10000, quorum=127.0.0.1:52230, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-10 19:03:18,255 DEBUG [Listener at localhost/37107-EventThread] zookeeper.ZKWatcher(600): master:33383-0x1003f9dbed10000, quorum=127.0.0.1:52230, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-10 19:03:18,255 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-10 19:03:18,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-10 19:03:18,255 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/.hbase-snapshot/.tmp/testWithMockedMapReduceMultiRegion 2023-02-10 19:03:18,297 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/.hbase-snapshot/.tmp/testWithMockedMapReduceMultiRegion to hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/.hbase-snapshot/testWithMockedMapReduceMultiRegion 2023-02-10 19:03:18,321 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot testWithMockedMapReduceMultiRegion of table testWithMockedMapReduceMultiRegion completed 2023-02-10 19:03:18,321 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/.hbase-snapshot/.tmp/testWithMockedMapReduceMultiRegion 2023-02-10 19:03:18,321 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/.hbase-snapshot/.tmp/testWithMockedMapReduceMultiRegion 2023-02-10 19:03:18,322 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot testWithMockedMapReduceMultiRegion C_M_SNAPSHOT_TABLE on table testWithMockedMapReduceMultiRegion at 1676055797562Consolidate snapshot: testWithMockedMapReduceMultiRegion at 1676055798254 (+692 ms)Loading Region manifests for testWithMockedMapReduceMultiRegion at 1676055798255 (+1 ms)Writing data manifest for testWithMockedMapReduceMultiRegion at 1676055798268 (+13 ms)Verifying snapshot: testWithMockedMapReduceMultiRegion at 1676055798282 (+14 ms)Snapshot testWithMockedMapReduceMultiRegion of table testWithMockedMapReduceMultiRegion completed at 1676055798321 (+39 ms) 2023-02-10 19:03:18,323 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=32, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=SHARED 2023-02-10 19:03:18,324 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=32, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=SHARED in 759 msec 2023-02-10 19:03:18,673 DEBUG [Listener at localhost/37107] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-10 19:03:18,674 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33383] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 } is done 2023-02-10 19:03:18,674 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33383] snapshot.SnapshotManager(401): Snapshot '{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-02-10 19:03:18,675 INFO [Listener at localhost/37107] snapshot.SnapshotTestingUtils(399): Confirming snapshot exists. 2023-02-10 19:03:18,678 INFO [Listener at localhost/37107] snapshot.SnapshotTestingUtils(406): validating snapshot. 2023-02-10 19:03:18,684 INFO [Listener at localhost/37107] mapreduce.TableSnapshotInputFormatTestBase(218): load different values 2023-02-10 19:03:18,708 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44697] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 6084 Client: jenkins//172.31.14.131 first region in multi=testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676055796287.6b4a925bbaa3b95421bfaa80da606099. 2023-02-10 19:03:18,715 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35891] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 11492 Client: jenkins//172.31.14.131 first region in multi=testWithMockedMapReduceMultiRegion,aaa,1676055796287.eca90e03b313fba8b7a1d6571ea05502. 2023-02-10 19:03:18,774 INFO [Listener at localhost/37107] mapreduce.TableSnapshotInputFormatTestBase(222): cause flush to create new files in the region 2023-02-10 19:03:18,779 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33383] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-10 19:03:18,782 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33383] procedure.ProcedureCoordinator(165): Submitting procedure testWithMockedMapReduceMultiRegion 2023-02-10 19:03:18,782 INFO [(jenkins-hbase4.apache.org,33383,1676055794975)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMockedMapReduceMultiRegion' 2023-02-10 19:03:18,782 DEBUG [(jenkins-hbase4.apache.org,33383,1676055794975)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-10 19:03:18,783 DEBUG [(jenkins-hbase4.apache.org,33383,1676055794975)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMockedMapReduceMultiRegion' starting 'acquire' 2023-02-10 19:03:18,783 DEBUG [(jenkins-hbase4.apache.org,33383,1676055794975)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMockedMapReduceMultiRegion', kicking off acquire phase on members. 2023-02-10 19:03:18,784 DEBUG [(jenkins-hbase4.apache.org,33383,1676055794975)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33383-0x1003f9dbed10000, quorum=127.0.0.1:52230, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-10 19:03:18,784 DEBUG [(jenkins-hbase4.apache.org,33383,1676055794975)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion 2023-02-10 19:03:18,785 DEBUG [Listener at localhost/37107-EventThread] zookeeper.ZKWatcher(600): regionserver:44697-0x1003f9dbed10002, quorum=127.0.0.1:52230, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-10 19:03:18,785 DEBUG [Listener at localhost/37107-EventThread] zookeeper.ZKWatcher(600): regionserver:35891-0x1003f9dbed10001, quorum=127.0.0.1:52230, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-10 19:03:18,785 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-10 19:03:18,785 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-10 19:03:18,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-10 19:03:18,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-10 19:03:18,785 DEBUG [(jenkins-hbase4.apache.org,33383,1676055794975)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,44697,1676055795050 2023-02-10 19:03:18,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion 2023-02-10 19:03:18,786 DEBUG [(jenkins-hbase4.apache.org,33383,1676055794975)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33383-0x1003f9dbed10000, quorum=127.0.0.1:52230, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,44697,1676055795050 2023-02-10 19:03:18,786 DEBUG [(jenkins-hbase4.apache.org,33383,1676055794975)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,35891,1676055795020 2023-02-10 19:03:18,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion 2023-02-10 19:03:18,786 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44697-0x1003f9dbed10002, quorum=127.0.0.1:52230, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-10 19:03:18,786 DEBUG [(jenkins-hbase4.apache.org,33383,1676055794975)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33383-0x1003f9dbed10000, quorum=127.0.0.1:52230, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,35891,1676055795020 2023-02-10 19:03:18,786 DEBUG [(jenkins-hbase4.apache.org,33383,1676055794975)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-10 19:03:18,786 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35891-0x1003f9dbed10001, quorum=127.0.0.1:52230, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-10 19:03:18,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-10 19:03:18,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion 2023-02-10 19:03:18,786 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMockedMapReduceMultiRegion 2023-02-10 19:03:18,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-10 19:03:18,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion 2023-02-10 19:03:18,787 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMockedMapReduceMultiRegion 2023-02-10 19:03:18,787 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMockedMapReduceMultiRegion 2023-02-10 19:03:18,787 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMockedMapReduceMultiRegion 2023-02-10 19:03:18,788 DEBUG [member: 'jenkins-hbase4.apache.org,44697,1676055795050' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMockedMapReduceMultiRegion' with timeout 60000ms 2023-02-10 19:03:18,788 DEBUG [member: 'jenkins-hbase4.apache.org,44697,1676055795050' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-10 19:03:18,788 DEBUG [member: 'jenkins-hbase4.apache.org,35891,1676055795020' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMockedMapReduceMultiRegion' with timeout 60000ms 2023-02-10 19:03:18,788 DEBUG [member: 'jenkins-hbase4.apache.org,44697,1676055795050' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMockedMapReduceMultiRegion' starting 'acquire' stage 2023-02-10 19:03:18,789 DEBUG [member: 'jenkins-hbase4.apache.org,35891,1676055795020' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-10 19:03:18,789 DEBUG [member: 'jenkins-hbase4.apache.org,35891,1676055795020' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMockedMapReduceMultiRegion' starting 'acquire' stage 2023-02-10 19:03:18,789 DEBUG [rs(jenkins-hbase4.apache.org,44697,1676055795050)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,,1676055796287.2fd40e0179a0e968c4672055c041d740. 2023-02-10 19:03:18,789 DEBUG [rs(jenkins-hbase4.apache.org,44697,1676055795050)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,,1676055796287.2fd40e0179a0e968c4672055c041d740. started... 2023-02-10 19:03:18,789 DEBUG [rs(jenkins-hbase4.apache.org,44697,1676055795050)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676055796287.6b4a925bbaa3b95421bfaa80da606099. 2023-02-10 19:03:18,789 DEBUG [rs(jenkins-hbase4.apache.org,44697,1676055795050)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 2fd40e0179a0e968c4672055c041d740: 2023-02-10 19:03:18,790 DEBUG [rs(jenkins-hbase4.apache.org,44697,1676055795050)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,zz{,1676055796287.ca626b09070f3e18c31fb632b018370f. 2023-02-10 19:03:18,790 DEBUG [member: 'jenkins-hbase4.apache.org,35891,1676055795020' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 5 regions 2023-02-10 19:03:18,790 DEBUG [rs(jenkins-hbase4.apache.org,44697,1676055795050)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,zz{,1676055796287.ca626b09070f3e18c31fb632b018370f. started... 2023-02-10 19:03:18,790 DEBUG [rs(jenkins-hbase4.apache.org,35891,1676055795020)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,d\x84\x84,1676055796287.f8e2703c94874a9a6d0d1541b43c1eb3. 2023-02-10 19:03:18,790 DEBUG [rs(jenkins-hbase4.apache.org,44697,1676055795050)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676055796287.6b4a925bbaa3b95421bfaa80da606099. started... 2023-02-10 19:03:18,790 DEBUG [rs(jenkins-hbase4.apache.org,44697,1676055795050)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for ca626b09070f3e18c31fb632b018370f: 2023-02-10 19:03:18,790 DEBUG [rs(jenkins-hbase4.apache.org,35891,1676055795020)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,q\x11\x10,1676055796287.4539b623282fa7d2beb504c373ad6181. 2023-02-10 19:03:18,790 DEBUG [rs(jenkins-hbase4.apache.org,35891,1676055795020)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,q\x11\x10,1676055796287.4539b623282fa7d2beb504c373ad6181. started... 2023-02-10 19:03:18,789 DEBUG [member: 'jenkins-hbase4.apache.org,44697,1676055795050' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 5 regions 2023-02-10 19:03:18,790 DEBUG [member: 'jenkins-hbase4.apache.org,44697,1676055795050' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-10 19:03:18,790 INFO [rs(jenkins-hbase4.apache.org,44697,1676055795050)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 6b4a925bbaa3b95421bfaa80da606099 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-10 19:03:18,790 DEBUG [rs(jenkins-hbase4.apache.org,44697,1676055795050)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,zz{,1676055796287.ca626b09070f3e18c31fb632b018370f. 2023-02-10 19:03:18,790 DEBUG [rs(jenkins-hbase4.apache.org,35891,1676055795020)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,d\x84\x84,1676055796287.f8e2703c94874a9a6d0d1541b43c1eb3. started... 2023-02-10 19:03:18,790 DEBUG [rs(jenkins-hbase4.apache.org,44697,1676055795050)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,m\xED\xED,1676055796287.b324410564271f3c81fcd7c2326d0435. 2023-02-10 19:03:18,790 INFO [rs(jenkins-hbase4.apache.org,35891,1676055795020)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing f8e2703c94874a9a6d0d1541b43c1eb3 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-10 19:03:18,790 DEBUG [member: 'jenkins-hbase4.apache.org,35891,1676055795020' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-10 19:03:18,790 DEBUG [rs(jenkins-hbase4.apache.org,35891,1676055795020)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,aaa,1676055796287.eca90e03b313fba8b7a1d6571ea05502. 2023-02-10 19:03:18,790 DEBUG [rs(jenkins-hbase4.apache.org,44697,1676055795050)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,,1676055796287.2fd40e0179a0e968c4672055c041d740. 2023-02-10 19:03:18,790 DEBUG [rs(jenkins-hbase4.apache.org,35891,1676055795020)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,aaa,1676055796287.eca90e03b313fba8b7a1d6571ea05502. started... 2023-02-10 19:03:18,790 DEBUG [rs(jenkins-hbase4.apache.org,44697,1676055795050)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,m\xED\xED,1676055796287.b324410564271f3c81fcd7c2326d0435. started... 2023-02-10 19:03:18,790 INFO [rs(jenkins-hbase4.apache.org,35891,1676055795020)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing eca90e03b313fba8b7a1d6571ea05502 2/2 column families, dataSize=248.22 KB heapSize=634.25 KB 2023-02-10 19:03:18,790 DEBUG [member: 'jenkins-hbase4.apache.org,44697,1676055795050' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/5 local region flush tasks. 2023-02-10 19:03:18,791 INFO [rs(jenkins-hbase4.apache.org,44697,1676055795050)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing b324410564271f3c81fcd7c2326d0435 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-10 19:03:18,790 INFO [rs(jenkins-hbase4.apache.org,35891,1676055795020)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 4539b623282fa7d2beb504c373ad6181 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-10 19:03:18,791 DEBUG [member: 'jenkins-hbase4.apache.org,44697,1676055795050' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/5 local region flush tasks. 2023-02-10 19:03:18,790 DEBUG [rs(jenkins-hbase4.apache.org,44697,1676055795050)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,t43,1676055796287.54239cd4e87d877b10bac35ba4d2a8c8. 2023-02-10 19:03:18,793 DEBUG [rs(jenkins-hbase4.apache.org,44697,1676055795050)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,t43,1676055796287.54239cd4e87d877b10bac35ba4d2a8c8. started... 2023-02-10 19:03:18,793 INFO [rs(jenkins-hbase4.apache.org,44697,1676055795050)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 54239cd4e87d877b10bac35ba4d2a8c8 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-10 19:03:18,826 INFO [rs(jenkins-hbase4.apache.org,44697,1676055795050)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/data/default/testWithMockedMapReduceMultiRegion/54239cd4e87d877b10bac35ba4d2a8c8/.tmp/f1/0d22b1cedfea4891a95616a6879a59dc 2023-02-10 19:03:18,826 INFO [rs(jenkins-hbase4.apache.org,44697,1676055795050)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/data/default/testWithMockedMapReduceMultiRegion/6b4a925bbaa3b95421bfaa80da606099/.tmp/f1/c3feb61c5d104eeebcb9989af713b874 2023-02-10 19:03:18,832 INFO [rs(jenkins-hbase4.apache.org,35891,1676055795020)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/data/default/testWithMockedMapReduceMultiRegion/4539b623282fa7d2beb504c373ad6181/.tmp/f1/70b3f8bd840c48d0a58688a287eba5f0 2023-02-10 19:03:18,832 INFO [rs(jenkins-hbase4.apache.org,44697,1676055795050)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/data/default/testWithMockedMapReduceMultiRegion/b324410564271f3c81fcd7c2326d0435/.tmp/f1/0457c71de2024e95acea49e46bd89971 2023-02-10 19:03:18,835 INFO [rs(jenkins-hbase4.apache.org,35891,1676055795020)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/data/default/testWithMockedMapReduceMultiRegion/f8e2703c94874a9a6d0d1541b43c1eb3/.tmp/f1/ac71d2c7570e442ba475b649bdd4a554 2023-02-10 19:03:18,876 INFO [rs(jenkins-hbase4.apache.org,44697,1676055795050)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/data/default/testWithMockedMapReduceMultiRegion/b324410564271f3c81fcd7c2326d0435/.tmp/f2/029c8a992e4b44a79cdf4f16cdac241a 2023-02-10 19:03:18,876 INFO [rs(jenkins-hbase4.apache.org,44697,1676055795050)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/data/default/testWithMockedMapReduceMultiRegion/6b4a925bbaa3b95421bfaa80da606099/.tmp/f2/dda2973082734cdc85d3029325c41080 2023-02-10 19:03:18,877 INFO [rs(jenkins-hbase4.apache.org,35891,1676055795020)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/data/default/testWithMockedMapReduceMultiRegion/4539b623282fa7d2beb504c373ad6181/.tmp/f2/bbc34d53e4714bb4a1b31367cfe8eee4 2023-02-10 19:03:18,881 INFO [rs(jenkins-hbase4.apache.org,44697,1676055795050)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/data/default/testWithMockedMapReduceMultiRegion/54239cd4e87d877b10bac35ba4d2a8c8/.tmp/f2/637fd46a403d4450a9e9cee49bd89dd9 2023-02-10 19:03:18,883 DEBUG [rs(jenkins-hbase4.apache.org,35891,1676055795020)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/data/default/testWithMockedMapReduceMultiRegion/4539b623282fa7d2beb504c373ad6181/.tmp/f1/70b3f8bd840c48d0a58688a287eba5f0 as hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/data/default/testWithMockedMapReduceMultiRegion/4539b623282fa7d2beb504c373ad6181/f1/70b3f8bd840c48d0a58688a287eba5f0 2023-02-10 19:03:18,883 DEBUG [rs(jenkins-hbase4.apache.org,44697,1676055795050)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/data/default/testWithMockedMapReduceMultiRegion/b324410564271f3c81fcd7c2326d0435/.tmp/f1/0457c71de2024e95acea49e46bd89971 as hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/data/default/testWithMockedMapReduceMultiRegion/b324410564271f3c81fcd7c2326d0435/f1/0457c71de2024e95acea49e46bd89971 2023-02-10 19:03:18,887 INFO [rs(jenkins-hbase4.apache.org,35891,1676055795020)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/data/default/testWithMockedMapReduceMultiRegion/4539b623282fa7d2beb504c373ad6181/f1/70b3f8bd840c48d0a58688a287eba5f0, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-10 19:03:18,888 DEBUG [rs(jenkins-hbase4.apache.org,35891,1676055795020)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/data/default/testWithMockedMapReduceMultiRegion/4539b623282fa7d2beb504c373ad6181/.tmp/f2/bbc34d53e4714bb4a1b31367cfe8eee4 as hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/data/default/testWithMockedMapReduceMultiRegion/4539b623282fa7d2beb504c373ad6181/f2/bbc34d53e4714bb4a1b31367cfe8eee4 2023-02-10 19:03:18,888 DEBUG [rs(jenkins-hbase4.apache.org,44697,1676055795050)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/data/default/testWithMockedMapReduceMultiRegion/6b4a925bbaa3b95421bfaa80da606099/.tmp/f1/c3feb61c5d104eeebcb9989af713b874 as hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/data/default/testWithMockedMapReduceMultiRegion/6b4a925bbaa3b95421bfaa80da606099/f1/c3feb61c5d104eeebcb9989af713b874 2023-02-10 19:03:18,892 DEBUG [rs(jenkins-hbase4.apache.org,44697,1676055795050)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/data/default/testWithMockedMapReduceMultiRegion/54239cd4e87d877b10bac35ba4d2a8c8/.tmp/f1/0d22b1cedfea4891a95616a6879a59dc as hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/data/default/testWithMockedMapReduceMultiRegion/54239cd4e87d877b10bac35ba4d2a8c8/f1/0d22b1cedfea4891a95616a6879a59dc 2023-02-10 19:03:18,892 INFO [rs(jenkins-hbase4.apache.org,35891,1676055795020)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/data/default/testWithMockedMapReduceMultiRegion/4539b623282fa7d2beb504c373ad6181/f2/bbc34d53e4714bb4a1b31367cfe8eee4, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-10 19:03:18,892 INFO [rs(jenkins-hbase4.apache.org,44697,1676055795050)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/data/default/testWithMockedMapReduceMultiRegion/b324410564271f3c81fcd7c2326d0435/f1/0457c71de2024e95acea49e46bd89971, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-10 19:03:18,893 INFO [rs(jenkins-hbase4.apache.org,35891,1676055795020)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 4539b623282fa7d2beb504c373ad6181 in 103ms, sequenceid=9, compaction requested=false 2023-02-10 19:03:18,893 DEBUG [rs(jenkins-hbase4.apache.org,35891,1676055795020)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 4539b623282fa7d2beb504c373ad6181: 2023-02-10 19:03:18,893 DEBUG [rs(jenkins-hbase4.apache.org,35891,1676055795020)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,q\x11\x10,1676055796287.4539b623282fa7d2beb504c373ad6181. 2023-02-10 19:03:18,893 DEBUG [rs(jenkins-hbase4.apache.org,35891,1676055795020)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676055796287.08e6594f21fdd814bfb7b05ba0f4191b. 2023-02-10 19:03:18,893 DEBUG [rs(jenkins-hbase4.apache.org,44697,1676055795050)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/data/default/testWithMockedMapReduceMultiRegion/b324410564271f3c81fcd7c2326d0435/.tmp/f2/029c8a992e4b44a79cdf4f16cdac241a as hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/data/default/testWithMockedMapReduceMultiRegion/b324410564271f3c81fcd7c2326d0435/f2/029c8a992e4b44a79cdf4f16cdac241a 2023-02-10 19:03:18,893 DEBUG [member: 'jenkins-hbase4.apache.org,35891,1676055795020' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/5 local region flush tasks. 2023-02-10 19:03:18,893 DEBUG [rs(jenkins-hbase4.apache.org,35891,1676055795020)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676055796287.08e6594f21fdd814bfb7b05ba0f4191b. started... 2023-02-10 19:03:18,893 INFO [rs(jenkins-hbase4.apache.org,35891,1676055795020)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 08e6594f21fdd814bfb7b05ba0f4191b 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-10 19:03:18,893 INFO [rs(jenkins-hbase4.apache.org,44697,1676055795050)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/data/default/testWithMockedMapReduceMultiRegion/6b4a925bbaa3b95421bfaa80da606099/f1/c3feb61c5d104eeebcb9989af713b874, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-10 19:03:18,895 DEBUG [rs(jenkins-hbase4.apache.org,44697,1676055795050)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/data/default/testWithMockedMapReduceMultiRegion/6b4a925bbaa3b95421bfaa80da606099/.tmp/f2/dda2973082734cdc85d3029325c41080 as hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/data/default/testWithMockedMapReduceMultiRegion/6b4a925bbaa3b95421bfaa80da606099/f2/dda2973082734cdc85d3029325c41080 2023-02-10 19:03:18,898 INFO [rs(jenkins-hbase4.apache.org,44697,1676055795050)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/data/default/testWithMockedMapReduceMultiRegion/54239cd4e87d877b10bac35ba4d2a8c8/f1/0d22b1cedfea4891a95616a6879a59dc, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-10 19:03:18,898 INFO [rs(jenkins-hbase4.apache.org,44697,1676055795050)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/data/default/testWithMockedMapReduceMultiRegion/b324410564271f3c81fcd7c2326d0435/f2/029c8a992e4b44a79cdf4f16cdac241a, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-10 19:03:18,899 DEBUG [rs(jenkins-hbase4.apache.org,44697,1676055795050)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/data/default/testWithMockedMapReduceMultiRegion/54239cd4e87d877b10bac35ba4d2a8c8/.tmp/f2/637fd46a403d4450a9e9cee49bd89dd9 as hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/data/default/testWithMockedMapReduceMultiRegion/54239cd4e87d877b10bac35ba4d2a8c8/f2/637fd46a403d4450a9e9cee49bd89dd9 2023-02-10 19:03:18,899 INFO [rs(jenkins-hbase4.apache.org,44697,1676055795050)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for b324410564271f3c81fcd7c2326d0435 in 108ms, sequenceid=9, compaction requested=false 2023-02-10 19:03:18,899 DEBUG [rs(jenkins-hbase4.apache.org,44697,1676055795050)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for b324410564271f3c81fcd7c2326d0435: 2023-02-10 19:03:18,899 DEBUG [rs(jenkins-hbase4.apache.org,44697,1676055795050)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,m\xED\xED,1676055796287.b324410564271f3c81fcd7c2326d0435. 2023-02-10 19:03:18,899 DEBUG [member: 'jenkins-hbase4.apache.org,44697,1676055795050' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/5 local region flush tasks. 2023-02-10 19:03:18,901 INFO [rs(jenkins-hbase4.apache.org,44697,1676055795050)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/data/default/testWithMockedMapReduceMultiRegion/6b4a925bbaa3b95421bfaa80da606099/f2/dda2973082734cdc85d3029325c41080, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-10 19:03:18,902 INFO [rs(jenkins-hbase4.apache.org,44697,1676055795050)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 6b4a925bbaa3b95421bfaa80da606099 in 112ms, sequenceid=9, compaction requested=false 2023-02-10 19:03:18,902 DEBUG [rs(jenkins-hbase4.apache.org,44697,1676055795050)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 6b4a925bbaa3b95421bfaa80da606099: 2023-02-10 19:03:18,902 DEBUG [rs(jenkins-hbase4.apache.org,44697,1676055795050)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676055796287.6b4a925bbaa3b95421bfaa80da606099. 2023-02-10 19:03:18,902 DEBUG [member: 'jenkins-hbase4.apache.org,44697,1676055795050' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 4/5 local region flush tasks. 2023-02-10 19:03:18,904 INFO [rs(jenkins-hbase4.apache.org,44697,1676055795050)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/data/default/testWithMockedMapReduceMultiRegion/54239cd4e87d877b10bac35ba4d2a8c8/f2/637fd46a403d4450a9e9cee49bd89dd9, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-10 19:03:18,904 INFO [rs(jenkins-hbase4.apache.org,35891,1676055795020)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/data/default/testWithMockedMapReduceMultiRegion/08e6594f21fdd814bfb7b05ba0f4191b/.tmp/f1/87c546d6d21c488a82b0a321a85eb99c 2023-02-10 19:03:18,904 INFO [rs(jenkins-hbase4.apache.org,44697,1676055795050)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 54239cd4e87d877b10bac35ba4d2a8c8 in 111ms, sequenceid=9, compaction requested=false 2023-02-10 19:03:18,904 DEBUG [rs(jenkins-hbase4.apache.org,44697,1676055795050)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 54239cd4e87d877b10bac35ba4d2a8c8: 2023-02-10 19:03:18,905 DEBUG [rs(jenkins-hbase4.apache.org,44697,1676055795050)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,t43,1676055796287.54239cd4e87d877b10bac35ba4d2a8c8. 2023-02-10 19:03:18,905 DEBUG [member: 'jenkins-hbase4.apache.org,44697,1676055795050' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 5/5 local region flush tasks. 2023-02-10 19:03:18,905 DEBUG [member: 'jenkins-hbase4.apache.org,44697,1676055795050' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 5 local region flush tasks. 2023-02-10 19:03:18,905 DEBUG [member: 'jenkins-hbase4.apache.org,44697,1676055795050' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,44697,1676055795050 2023-02-10 19:03:18,905 DEBUG [member: 'jenkins-hbase4.apache.org,44697,1676055795050' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMockedMapReduceMultiRegion' locally acquired 2023-02-10 19:03:18,905 DEBUG [member: 'jenkins-hbase4.apache.org,44697,1676055795050' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44697,1676055795050' joining acquired barrier for procedure (testWithMockedMapReduceMultiRegion) in zk 2023-02-10 19:03:18,906 DEBUG [Listener at localhost/37107-EventThread] zookeeper.ZKWatcher(600): master:33383-0x1003f9dbed10000, quorum=127.0.0.1:52230, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,44697,1676055795050 2023-02-10 19:03:18,906 DEBUG [member: 'jenkins-hbase4.apache.org,44697,1676055795050' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-10 19:03:18,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,44697,1676055795050 2023-02-10 19:03:18,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-10 19:03:18,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-10 19:03:18,907 DEBUG [member: 'jenkins-hbase4.apache.org,44697,1676055795050' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44697-0x1003f9dbed10002, quorum=127.0.0.1:52230, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-10 19:03:18,907 DEBUG [member: 'jenkins-hbase4.apache.org,44697,1676055795050' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMockedMapReduceMultiRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-10 19:03:18,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-10 19:03:18,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-10 19:03:18,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-10 19:03:18,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44697,1676055795050 2023-02-10 19:03:18,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-10 19:03:18,909 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44697,1676055795050' joining acquired barrier for procedure 'testWithMockedMapReduceMultiRegion' on coordinator 2023-02-10 19:03:18,909 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6dc117ac[Count = 1] remaining members to acquire global barrier 2023-02-10 19:03:18,915 INFO [rs(jenkins-hbase4.apache.org,35891,1676055795020)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/data/default/testWithMockedMapReduceMultiRegion/08e6594f21fdd814bfb7b05ba0f4191b/.tmp/f2/92088c36ecbc40ebbc88d96bcb6b80ec 2023-02-10 19:03:18,919 DEBUG [rs(jenkins-hbase4.apache.org,35891,1676055795020)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/data/default/testWithMockedMapReduceMultiRegion/08e6594f21fdd814bfb7b05ba0f4191b/.tmp/f1/87c546d6d21c488a82b0a321a85eb99c as hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/data/default/testWithMockedMapReduceMultiRegion/08e6594f21fdd814bfb7b05ba0f4191b/f1/87c546d6d21c488a82b0a321a85eb99c 2023-02-10 19:03:18,922 INFO [rs(jenkins-hbase4.apache.org,35891,1676055795020)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/data/default/testWithMockedMapReduceMultiRegion/08e6594f21fdd814bfb7b05ba0f4191b/f1/87c546d6d21c488a82b0a321a85eb99c, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-10 19:03:18,923 DEBUG [rs(jenkins-hbase4.apache.org,35891,1676055795020)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/data/default/testWithMockedMapReduceMultiRegion/08e6594f21fdd814bfb7b05ba0f4191b/.tmp/f2/92088c36ecbc40ebbc88d96bcb6b80ec as hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/data/default/testWithMockedMapReduceMultiRegion/08e6594f21fdd814bfb7b05ba0f4191b/f2/92088c36ecbc40ebbc88d96bcb6b80ec 2023-02-10 19:03:18,926 INFO [rs(jenkins-hbase4.apache.org,35891,1676055795020)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/data/default/testWithMockedMapReduceMultiRegion/08e6594f21fdd814bfb7b05ba0f4191b/f2/92088c36ecbc40ebbc88d96bcb6b80ec, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-10 19:03:18,927 INFO [rs(jenkins-hbase4.apache.org,35891,1676055795020)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 08e6594f21fdd814bfb7b05ba0f4191b in 34ms, sequenceid=9, compaction requested=false 2023-02-10 19:03:18,927 DEBUG [rs(jenkins-hbase4.apache.org,35891,1676055795020)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 08e6594f21fdd814bfb7b05ba0f4191b: 2023-02-10 19:03:18,927 DEBUG [rs(jenkins-hbase4.apache.org,35891,1676055795020)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676055796287.08e6594f21fdd814bfb7b05ba0f4191b. 2023-02-10 19:03:18,927 DEBUG [rs(jenkins-hbase4.apache.org,35891,1676055795020)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,wWV,1676055796287.bc3dafb6d0db6c740ff9583526924864. 2023-02-10 19:03:18,927 DEBUG [member: 'jenkins-hbase4.apache.org,35891,1676055795020' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/5 local region flush tasks. 2023-02-10 19:03:18,927 DEBUG [rs(jenkins-hbase4.apache.org,35891,1676055795020)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,wWV,1676055796287.bc3dafb6d0db6c740ff9583526924864. started... 2023-02-10 19:03:18,927 INFO [rs(jenkins-hbase4.apache.org,35891,1676055795020)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing bc3dafb6d0db6c740ff9583526924864 2/2 column families, dataSize=248.22 KB heapSize=634.25 KB 2023-02-10 19:03:18,937 INFO [rs(jenkins-hbase4.apache.org,35891,1676055795020)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/data/default/testWithMockedMapReduceMultiRegion/bc3dafb6d0db6c740ff9583526924864/.tmp/f1/571d5c895c5e4d25964fbd20a498d4ba 2023-02-10 19:03:18,948 INFO [rs(jenkins-hbase4.apache.org,35891,1676055795020)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/data/default/testWithMockedMapReduceMultiRegion/bc3dafb6d0db6c740ff9583526924864/.tmp/f2/71f90a8a15934976898bfeb38acddee7 2023-02-10 19:03:18,952 DEBUG [rs(jenkins-hbase4.apache.org,35891,1676055795020)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/data/default/testWithMockedMapReduceMultiRegion/bc3dafb6d0db6c740ff9583526924864/.tmp/f1/571d5c895c5e4d25964fbd20a498d4ba as hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/data/default/testWithMockedMapReduceMultiRegion/bc3dafb6d0db6c740ff9583526924864/f1/571d5c895c5e4d25964fbd20a498d4ba 2023-02-10 19:03:18,955 INFO [rs(jenkins-hbase4.apache.org,35891,1676055795020)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/data/default/testWithMockedMapReduceMultiRegion/bc3dafb6d0db6c740ff9583526924864/f1/571d5c895c5e4d25964fbd20a498d4ba, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-10 19:03:18,956 DEBUG [rs(jenkins-hbase4.apache.org,35891,1676055795020)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/data/default/testWithMockedMapReduceMultiRegion/bc3dafb6d0db6c740ff9583526924864/.tmp/f2/71f90a8a15934976898bfeb38acddee7 as hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/data/default/testWithMockedMapReduceMultiRegion/bc3dafb6d0db6c740ff9583526924864/f2/71f90a8a15934976898bfeb38acddee7 2023-02-10 19:03:18,959 INFO [rs(jenkins-hbase4.apache.org,35891,1676055795020)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/data/default/testWithMockedMapReduceMultiRegion/bc3dafb6d0db6c740ff9583526924864/f2/71f90a8a15934976898bfeb38acddee7, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-10 19:03:18,960 INFO [rs(jenkins-hbase4.apache.org,35891,1676055795020)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~248.22 KB/254176, heapSize ~634.22 KB/649440, currentSize=0 B/0 for bc3dafb6d0db6c740ff9583526924864 in 33ms, sequenceid=9, compaction requested=false 2023-02-10 19:03:18,960 DEBUG [rs(jenkins-hbase4.apache.org,35891,1676055795020)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for bc3dafb6d0db6c740ff9583526924864: 2023-02-10 19:03:18,960 DEBUG [rs(jenkins-hbase4.apache.org,35891,1676055795020)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,wWV,1676055796287.bc3dafb6d0db6c740ff9583526924864. 2023-02-10 19:03:18,960 DEBUG [member: 'jenkins-hbase4.apache.org,35891,1676055795020' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/5 local region flush tasks. 2023-02-10 19:03:19,233 INFO [rs(jenkins-hbase4.apache.org,35891,1676055795020)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/data/default/testWithMockedMapReduceMultiRegion/eca90e03b313fba8b7a1d6571ea05502/.tmp/f1/47461599967142c2bd008568f428a114 2023-02-10 19:03:19,245 INFO [rs(jenkins-hbase4.apache.org,35891,1676055795020)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/data/default/testWithMockedMapReduceMultiRegion/eca90e03b313fba8b7a1d6571ea05502/.tmp/f2/6bcbaeabb8f049fca5c9c10dadb1b3f9 2023-02-10 19:03:19,250 DEBUG [rs(jenkins-hbase4.apache.org,35891,1676055795020)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/data/default/testWithMockedMapReduceMultiRegion/eca90e03b313fba8b7a1d6571ea05502/.tmp/f1/47461599967142c2bd008568f428a114 as hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/data/default/testWithMockedMapReduceMultiRegion/eca90e03b313fba8b7a1d6571ea05502/f1/47461599967142c2bd008568f428a114 2023-02-10 19:03:19,255 INFO [rs(jenkins-hbase4.apache.org,35891,1676055795020)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/data/default/testWithMockedMapReduceMultiRegion/eca90e03b313fba8b7a1d6571ea05502/f1/47461599967142c2bd008568f428a114, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-10 19:03:19,256 DEBUG [rs(jenkins-hbase4.apache.org,35891,1676055795020)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/data/default/testWithMockedMapReduceMultiRegion/eca90e03b313fba8b7a1d6571ea05502/.tmp/f2/6bcbaeabb8f049fca5c9c10dadb1b3f9 as hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/data/default/testWithMockedMapReduceMultiRegion/eca90e03b313fba8b7a1d6571ea05502/f2/6bcbaeabb8f049fca5c9c10dadb1b3f9 2023-02-10 19:03:19,261 INFO [rs(jenkins-hbase4.apache.org,35891,1676055795020)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/data/default/testWithMockedMapReduceMultiRegion/eca90e03b313fba8b7a1d6571ea05502/f2/6bcbaeabb8f049fca5c9c10dadb1b3f9, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-10 19:03:19,262 INFO [rs(jenkins-hbase4.apache.org,35891,1676055795020)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~248.22 KB/254176, heapSize ~634.22 KB/649440, currentSize=0 B/0 for eca90e03b313fba8b7a1d6571ea05502 in 472ms, sequenceid=9, compaction requested=false 2023-02-10 19:03:19,262 DEBUG [rs(jenkins-hbase4.apache.org,35891,1676055795020)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for eca90e03b313fba8b7a1d6571ea05502: 2023-02-10 19:03:19,262 DEBUG [rs(jenkins-hbase4.apache.org,35891,1676055795020)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,aaa,1676055796287.eca90e03b313fba8b7a1d6571ea05502. 2023-02-10 19:03:19,262 DEBUG [member: 'jenkins-hbase4.apache.org,35891,1676055795020' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 4/5 local region flush tasks. 2023-02-10 19:03:19,275 INFO [rs(jenkins-hbase4.apache.org,35891,1676055795020)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/data/default/testWithMockedMapReduceMultiRegion/f8e2703c94874a9a6d0d1541b43c1eb3/.tmp/f2/36fe696e5b914544b169d1ce0345d6d9 2023-02-10 19:03:19,280 DEBUG [rs(jenkins-hbase4.apache.org,35891,1676055795020)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/data/default/testWithMockedMapReduceMultiRegion/f8e2703c94874a9a6d0d1541b43c1eb3/.tmp/f1/ac71d2c7570e442ba475b649bdd4a554 as hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/data/default/testWithMockedMapReduceMultiRegion/f8e2703c94874a9a6d0d1541b43c1eb3/f1/ac71d2c7570e442ba475b649bdd4a554 2023-02-10 19:03:19,285 INFO [rs(jenkins-hbase4.apache.org,35891,1676055795020)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/data/default/testWithMockedMapReduceMultiRegion/f8e2703c94874a9a6d0d1541b43c1eb3/f1/ac71d2c7570e442ba475b649bdd4a554, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-10 19:03:19,285 DEBUG [rs(jenkins-hbase4.apache.org,35891,1676055795020)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/data/default/testWithMockedMapReduceMultiRegion/f8e2703c94874a9a6d0d1541b43c1eb3/.tmp/f2/36fe696e5b914544b169d1ce0345d6d9 as hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/data/default/testWithMockedMapReduceMultiRegion/f8e2703c94874a9a6d0d1541b43c1eb3/f2/36fe696e5b914544b169d1ce0345d6d9 2023-02-10 19:03:19,289 INFO [rs(jenkins-hbase4.apache.org,35891,1676055795020)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/data/default/testWithMockedMapReduceMultiRegion/f8e2703c94874a9a6d0d1541b43c1eb3/f2/36fe696e5b914544b169d1ce0345d6d9, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-10 19:03:19,290 INFO [rs(jenkins-hbase4.apache.org,35891,1676055795020)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for f8e2703c94874a9a6d0d1541b43c1eb3 in 500ms, sequenceid=9, compaction requested=false 2023-02-10 19:03:19,290 DEBUG [rs(jenkins-hbase4.apache.org,35891,1676055795020)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for f8e2703c94874a9a6d0d1541b43c1eb3: 2023-02-10 19:03:19,290 DEBUG [rs(jenkins-hbase4.apache.org,35891,1676055795020)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,d\x84\x84,1676055796287.f8e2703c94874a9a6d0d1541b43c1eb3. 2023-02-10 19:03:19,290 DEBUG [member: 'jenkins-hbase4.apache.org,35891,1676055795020' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 5/5 local region flush tasks. 2023-02-10 19:03:19,290 DEBUG [member: 'jenkins-hbase4.apache.org,35891,1676055795020' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 5 local region flush tasks. 2023-02-10 19:03:19,290 DEBUG [member: 'jenkins-hbase4.apache.org,35891,1676055795020' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,35891,1676055795020 2023-02-10 19:03:19,290 DEBUG [member: 'jenkins-hbase4.apache.org,35891,1676055795020' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMockedMapReduceMultiRegion' locally acquired 2023-02-10 19:03:19,290 DEBUG [member: 'jenkins-hbase4.apache.org,35891,1676055795020' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35891,1676055795020' joining acquired barrier for procedure (testWithMockedMapReduceMultiRegion) in zk 2023-02-10 19:03:19,292 DEBUG [member: 'jenkins-hbase4.apache.org,35891,1676055795020' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-10 19:03:19,292 DEBUG [Listener at localhost/37107-EventThread] zookeeper.ZKWatcher(600): master:33383-0x1003f9dbed10000, quorum=127.0.0.1:52230, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,35891,1676055795020 2023-02-10 19:03:19,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,35891,1676055795020 2023-02-10 19:03:19,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-10 19:03:19,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-10 19:03:19,292 DEBUG [member: 'jenkins-hbase4.apache.org,35891,1676055795020' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35891-0x1003f9dbed10001, quorum=127.0.0.1:52230, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-10 19:03:19,292 DEBUG [member: 'jenkins-hbase4.apache.org,35891,1676055795020' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMockedMapReduceMultiRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-10 19:03:19,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-10 19:03:19,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-10 19:03:19,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-10 19:03:19,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44697,1676055795050 2023-02-10 19:03:19,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35891,1676055795020 2023-02-10 19:03:19,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-10 19:03:19,294 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35891,1676055795020' joining acquired barrier for procedure 'testWithMockedMapReduceMultiRegion' on coordinator 2023-02-10 19:03:19,294 DEBUG [(jenkins-hbase4.apache.org,33383,1676055794975)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMockedMapReduceMultiRegion' starting 'in-barrier' execution. 2023-02-10 19:03:19,294 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6dc117ac[Count = 0] remaining members to acquire global barrier 2023-02-10 19:03:19,294 DEBUG [(jenkins-hbase4.apache.org,33383,1676055794975)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-10 19:03:19,296 DEBUG [Listener at localhost/37107-EventThread] zookeeper.ZKWatcher(600): regionserver:44697-0x1003f9dbed10002, quorum=127.0.0.1:52230, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-10 19:03:19,296 DEBUG [Listener at localhost/37107-EventThread] zookeeper.ZKWatcher(600): regionserver:35891-0x1003f9dbed10001, quorum=127.0.0.1:52230, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-10 19:03:19,296 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-10 19:03:19,296 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-10 19:03:19,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-10 19:03:19,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-10 19:03:19,297 DEBUG [member: 'jenkins-hbase4.apache.org,44697,1676055795050' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMockedMapReduceMultiRegion' received 'reached' from coordinator. 2023-02-10 19:03:19,297 DEBUG [member: 'jenkins-hbase4.apache.org,35891,1676055795020' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMockedMapReduceMultiRegion' received 'reached' from coordinator. 2023-02-10 19:03:19,297 DEBUG [(jenkins-hbase4.apache.org,33383,1676055794975)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33383-0x1003f9dbed10000, quorum=127.0.0.1:52230, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,44697,1676055795050 2023-02-10 19:03:19,297 DEBUG [member: 'jenkins-hbase4.apache.org,44697,1676055795050' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMockedMapReduceMultiRegion' locally completed 2023-02-10 19:03:19,297 DEBUG [member: 'jenkins-hbase4.apache.org,35891,1676055795020' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMockedMapReduceMultiRegion' locally completed 2023-02-10 19:03:19,297 DEBUG [member: 'jenkins-hbase4.apache.org,44697,1676055795050' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMockedMapReduceMultiRegion' completed for member 'jenkins-hbase4.apache.org,44697,1676055795050' in zk 2023-02-10 19:03:19,297 DEBUG [member: 'jenkins-hbase4.apache.org,35891,1676055795020' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMockedMapReduceMultiRegion' completed for member 'jenkins-hbase4.apache.org,35891,1676055795020' in zk 2023-02-10 19:03:19,297 DEBUG [(jenkins-hbase4.apache.org,33383,1676055794975)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33383-0x1003f9dbed10000, quorum=127.0.0.1:52230, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,35891,1676055795020 2023-02-10 19:03:19,297 DEBUG [(jenkins-hbase4.apache.org,33383,1676055794975)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-10 19:03:19,298 DEBUG [Listener at localhost/37107-EventThread] zookeeper.ZKWatcher(600): master:33383-0x1003f9dbed10000, quorum=127.0.0.1:52230, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,44697,1676055795050 2023-02-10 19:03:19,298 DEBUG [member: 'jenkins-hbase4.apache.org,44697,1676055795050' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMockedMapReduceMultiRegion' has notified controller of completion 2023-02-10 19:03:19,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,44697,1676055795050 2023-02-10 19:03:19,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-10 19:03:19,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-10 19:03:19,298 DEBUG [member: 'jenkins-hbase4.apache.org,44697,1676055795050' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-10 19:03:19,298 DEBUG [member: 'jenkins-hbase4.apache.org,44697,1676055795050' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMockedMapReduceMultiRegion' completed. 2023-02-10 19:03:19,299 DEBUG [Listener at localhost/37107-EventThread] zookeeper.ZKWatcher(600): master:33383-0x1003f9dbed10000, quorum=127.0.0.1:52230, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,35891,1676055795020 2023-02-10 19:03:19,299 DEBUG [member: 'jenkins-hbase4.apache.org,35891,1676055795020' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMockedMapReduceMultiRegion' has notified controller of completion 2023-02-10 19:03:19,299 DEBUG [member: 'jenkins-hbase4.apache.org,35891,1676055795020' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-10 19:03:19,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-10 19:03:19,299 DEBUG [member: 'jenkins-hbase4.apache.org,35891,1676055795020' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMockedMapReduceMultiRegion' completed. 2023-02-10 19:03:19,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-10 19:03:19,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-10 19:03:19,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44697,1676055795050 2023-02-10 19:03:19,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35891,1676055795020 2023-02-10 19:03:19,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-10 19:03:19,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-10 19:03:19,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44697,1676055795050 2023-02-10 19:03:19,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35891,1676055795020 2023-02-10 19:03:19,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMockedMapReduceMultiRegion' member 'jenkins-hbase4.apache.org,44697,1676055795050': 2023-02-10 19:03:19,301 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44697,1676055795050' released barrier for procedure'testWithMockedMapReduceMultiRegion', counting down latch. Waiting for 1 more 2023-02-10 19:03:19,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,35891,1676055795020 2023-02-10 19:03:19,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-10 19:03:19,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-10 19:03:19,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-10 19:03:19,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-10 19:03:19,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-10 19:03:19,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44697,1676055795050 2023-02-10 19:03:19,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35891,1676055795020 2023-02-10 19:03:19,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-10 19:03:19,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-10 19:03:19,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44697,1676055795050 2023-02-10 19:03:19,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35891,1676055795020 2023-02-10 19:03:19,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMockedMapReduceMultiRegion' member 'jenkins-hbase4.apache.org,35891,1676055795020': 2023-02-10 19:03:19,304 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35891,1676055795020' released barrier for procedure'testWithMockedMapReduceMultiRegion', counting down latch. Waiting for 0 more 2023-02-10 19:03:19,304 INFO [(jenkins-hbase4.apache.org,33383,1676055794975)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMockedMapReduceMultiRegion' execution completed 2023-02-10 19:03:19,304 DEBUG [(jenkins-hbase4.apache.org,33383,1676055794975)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-10 19:03:19,304 DEBUG [(jenkins-hbase4.apache.org,33383,1676055794975)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-10 19:03:19,304 DEBUG [(jenkins-hbase4.apache.org,33383,1676055794975)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMockedMapReduceMultiRegion 2023-02-10 19:03:19,304 INFO [(jenkins-hbase4.apache.org,33383,1676055794975)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMockedMapReduceMultiRegionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-10 19:03:19,305 DEBUG [Listener at localhost/37107-EventThread] zookeeper.ZKWatcher(600): regionserver:35891-0x1003f9dbed10001, quorum=127.0.0.1:52230, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-10 19:03:19,305 DEBUG [Listener at localhost/37107-EventThread] zookeeper.ZKWatcher(600): regionserver:35891-0x1003f9dbed10001, quorum=127.0.0.1:52230, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-10 19:03:19,305 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-10 19:03:19,305 DEBUG [Listener at localhost/37107-EventThread] zookeeper.ZKWatcher(600): master:33383-0x1003f9dbed10000, quorum=127.0.0.1:52230, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-10 19:03:19,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-10 19:03:19,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-10 19:03:19,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-10 19:03:19,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-10 19:03:19,306 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-10 19:03:19,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-10 19:03:19,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-10 19:03:19,306 DEBUG [(jenkins-hbase4.apache.org,33383,1676055794975)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33383-0x1003f9dbed10000, quorum=127.0.0.1:52230, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,44697,1676055795050 2023-02-10 19:03:19,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-10 19:03:19,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-10 19:03:19,307 DEBUG [(jenkins-hbase4.apache.org,33383,1676055794975)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33383-0x1003f9dbed10000, quorum=127.0.0.1:52230, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,35891,1676055795020 2023-02-10 19:03:19,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-10 19:03:19,307 DEBUG [Listener at localhost/37107-EventThread] zookeeper.ZKWatcher(600): regionserver:44697-0x1003f9dbed10002, quorum=127.0.0.1:52230, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-10 19:03:19,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-10 19:03:19,307 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-10 19:03:19,307 DEBUG [Listener at localhost/37107-EventThread] zookeeper.ZKWatcher(600): regionserver:44697-0x1003f9dbed10002, quorum=127.0.0.1:52230, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-10 19:03:19,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-10 19:03:19,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44697,1676055795050 2023-02-10 19:03:19,308 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-10 19:03:19,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-10 19:03:19,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35891,1676055795020 2023-02-10 19:03:19,308 DEBUG [(jenkins-hbase4.apache.org,33383,1676055794975)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33383-0x1003f9dbed10000, quorum=127.0.0.1:52230, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,44697,1676055795050 2023-02-10 19:03:19,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-10 19:03:19,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-10 19:03:19,308 DEBUG [(jenkins-hbase4.apache.org,33383,1676055794975)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33383-0x1003f9dbed10000, quorum=127.0.0.1:52230, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,35891,1676055795020 2023-02-10 19:03:19,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-10 19:03:19,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44697,1676055795050 2023-02-10 19:03:19,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35891,1676055795020 2023-02-10 19:03:19,312 DEBUG [Listener at localhost/37107-EventThread] zookeeper.ZKWatcher(600): regionserver:44697-0x1003f9dbed10002, quorum=127.0.0.1:52230, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-10 19:03:19,312 DEBUG [Listener at localhost/37107-EventThread] zookeeper.ZKWatcher(600): regionserver:35891-0x1003f9dbed10001, quorum=127.0.0.1:52230, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-10 19:03:19,312 DEBUG [Listener at localhost/37107-EventThread] zookeeper.ZKWatcher(600): master:33383-0x1003f9dbed10000, quorum=127.0.0.1:52230, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,35891,1676055795020 2023-02-10 19:03:19,312 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-10 19:03:19,312 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-10 19:03:19,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-10 19:03:19,313 DEBUG [(jenkins-hbase4.apache.org,33383,1676055794975)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-10 19:03:19,312 DEBUG [Listener at localhost/37107-EventThread] zookeeper.ZKWatcher(600): regionserver:44697-0x1003f9dbed10002, quorum=127.0.0.1:52230, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-10 19:03:19,313 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33383] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testWithMockedMapReduceMultiRegion' 2023-02-10 19:03:19,313 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33383] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-10 19:03:19,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-10 19:03:19,312 DEBUG [Listener at localhost/37107-EventThread] zookeeper.ZKWatcher(600): master:33383-0x1003f9dbed10000, quorum=127.0.0.1:52230, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion 2023-02-10 19:03:19,313 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-10 19:03:19,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-10 19:03:19,312 DEBUG [Listener at localhost/37107-EventThread] zookeeper.ZKWatcher(600): regionserver:35891-0x1003f9dbed10001, quorum=127.0.0.1:52230, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-10 19:03:19,313 DEBUG [Listener at localhost/37107-EventThread] zookeeper.ZKWatcher(600): master:33383-0x1003f9dbed10000, quorum=127.0.0.1:52230, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,44697,1676055795050 2023-02-10 19:03:19,313 DEBUG [Listener at localhost/37107-EventThread] zookeeper.ZKWatcher(600): master:33383-0x1003f9dbed10000, quorum=127.0.0.1:52230, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion 2023-02-10 19:03:19,313 DEBUG [Listener at localhost/37107-EventThread] zookeeper.ZKWatcher(600): master:33383-0x1003f9dbed10000, quorum=127.0.0.1:52230, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,35891,1676055795020 2023-02-10 19:03:19,313 DEBUG [Listener at localhost/37107] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testWithMockedMapReduceMultiRegion'' to complete. (max 20000 ms per retry) 2023-02-10 19:03:19,313 DEBUG [Listener at localhost/37107-EventThread] zookeeper.ZKWatcher(600): master:33383-0x1003f9dbed10000, quorum=127.0.0.1:52230, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-10 19:03:19,313 DEBUG [Listener at localhost/37107] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-10 19:03:19,313 DEBUG [Listener at localhost/37107-EventThread] zookeeper.ZKWatcher(600): master:33383-0x1003f9dbed10000, quorum=127.0.0.1:52230, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,44697,1676055795050 2023-02-10 19:03:19,313 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-10 19:03:19,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-10 19:03:19,313 DEBUG [Listener at localhost/37107-EventThread] zookeeper.ZKWatcher(600): master:33383-0x1003f9dbed10000, quorum=127.0.0.1:52230, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-10 19:03:19,314 DEBUG [Listener at localhost/37107-EventThread] zookeeper.ZKWatcher(600): master:33383-0x1003f9dbed10000, quorum=127.0.0.1:52230, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-10 19:03:19,413 DEBUG [Listener at localhost/37107] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-10 19:03:19,415 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33383] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-10 19:03:19,419 INFO [Listener at localhost/37107] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "testWithMockedMapReduceMultiRegion" table: "testWithMockedMapReduceMultiRegion" creation_time: 1676055797547 type: FLUSH version: 2 ttl: 0 2023-02-10 19:03:19,420 DEBUG [Listener at localhost/37107] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost:44513/user/jenkins/test-data/171bfff3-7974-3283-60d4-30ee0b6875b1/testWithMockedMapReduceMultiRegion/9d2ffd66-3e40-4722-a469-2ff5afd05a45/data/default/testWithMockedMapReduceMultiRegion 2023-02-10 19:03:19,420 INFO [Listener at localhost/37107] snapshot.RestoreSnapshotHelper(239): region to add: 4539b623282fa7d2beb504c373ad6181 2023-02-10 19:03:19,420 INFO [Listener at localhost/37107] snapshot.RestoreSnapshotHelper(239): region to add: eca90e03b313fba8b7a1d6571ea05502 2023-02-10 19:03:19,420 INFO [Listener at localhost/37107] snapshot.RestoreSnapshotHelper(239): region to add: 2fd40e0179a0e968c4672055c041d740 2023-02-10 19:03:19,420 INFO [Listener at localhost/37107] snapshot.RestoreSnapshotHelper(239): region to add: 6b4a925bbaa3b95421bfaa80da606099 2023-02-10 19:03:19,420 INFO [Listener at localhost/37107] snapshot.RestoreSnapshotHelper(239): region to add: ca626b09070f3e18c31fb632b018370f 2023-02-10 19:03:19,420 INFO [Listener at localhost/37107] snapshot.RestoreSnapshotHelper(239): region to add: f8e2703c94874a9a6d0d1541b43c1eb3 2023-02-10 19:03:19,420 INFO [Listener at localhost/37107] snapshot.RestoreSnapshotHelper(239): region to add: b324410564271f3c81fcd7c2326d0435 2023-02-10 19:03:19,420 INFO [Listener at localhost/37107] snapshot.RestoreSnapshotHelper(239): region to add: 08e6594f21fdd814bfb7b05ba0f4191b 2023-02-10 19:03:19,420 INFO [Listener at localhost/37107] snapshot.RestoreSnapshotHelper(239): region to add: 54239cd4e87d877b10bac35ba4d2a8c8 2023-02-10 19:03:19,420 INFO [Listener at localhost/37107] snapshot.RestoreSnapshotHelper(239): region to add: bc3dafb6d0db6c740ff9583526924864 2023-02-10 19:03:19,420 INFO [Listener at localhost/37107] snapshot.RestoreSnapshotHelper(585): clone region=4539b623282fa7d2beb504c373ad6181 as 4539b623282fa7d2beb504c373ad6181 in snapshot testWithMockedMapReduceMultiRegion 2023-02-10 19:03:19,421 INFO [Listener at localhost/37107] snapshot.RestoreSnapshotHelper(585): clone region=eca90e03b313fba8b7a1d6571ea05502 as eca90e03b313fba8b7a1d6571ea05502 in snapshot testWithMockedMapReduceMultiRegion 2023-02-10 19:03:19,421 INFO [Listener at localhost/37107] snapshot.RestoreSnapshotHelper(585): clone region=2fd40e0179a0e968c4672055c041d740 as 2fd40e0179a0e968c4672055c041d740 in snapshot testWithMockedMapReduceMultiRegion 2023-02-10 19:03:19,421 INFO [Listener at localhost/37107] snapshot.RestoreSnapshotHelper(585): clone region=6b4a925bbaa3b95421bfaa80da606099 as 6b4a925bbaa3b95421bfaa80da606099 in snapshot testWithMockedMapReduceMultiRegion 2023-02-10 19:03:19,421 INFO [Listener at localhost/37107] snapshot.RestoreSnapshotHelper(585): clone region=ca626b09070f3e18c31fb632b018370f as ca626b09070f3e18c31fb632b018370f in snapshot testWithMockedMapReduceMultiRegion 2023-02-10 19:03:19,421 INFO [Listener at localhost/37107] snapshot.RestoreSnapshotHelper(585): clone region=f8e2703c94874a9a6d0d1541b43c1eb3 as f8e2703c94874a9a6d0d1541b43c1eb3 in snapshot testWithMockedMapReduceMultiRegion 2023-02-10 19:03:19,421 INFO [Listener at localhost/37107] snapshot.RestoreSnapshotHelper(585): clone region=b324410564271f3c81fcd7c2326d0435 as b324410564271f3c81fcd7c2326d0435 in snapshot testWithMockedMapReduceMultiRegion 2023-02-10 19:03:19,421 INFO [Listener at localhost/37107] snapshot.RestoreSnapshotHelper(585): clone region=08e6594f21fdd814bfb7b05ba0f4191b as 08e6594f21fdd814bfb7b05ba0f4191b in snapshot testWithMockedMapReduceMultiRegion 2023-02-10 19:03:19,421 INFO [Listener at localhost/37107] snapshot.RestoreSnapshotHelper(585): clone region=54239cd4e87d877b10bac35ba4d2a8c8 as 54239cd4e87d877b10bac35ba4d2a8c8 in snapshot testWithMockedMapReduceMultiRegion 2023-02-10 19:03:19,421 INFO [Listener at localhost/37107] snapshot.RestoreSnapshotHelper(585): clone region=bc3dafb6d0db6c740ff9583526924864 as bc3dafb6d0db6c740ff9583526924864 in snapshot testWithMockedMapReduceMultiRegion 2023-02-10 19:03:19,422 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(7671): creating {ENCODED => 6b4a925bbaa3b95421bfaa80da606099, NAME => 'testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676055796287.6b4a925bbaa3b95421bfaa80da606099.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44513/user/jenkins/test-data/171bfff3-7974-3283-60d4-30ee0b6875b1/testWithMockedMapReduceMultiRegion/9d2ffd66-3e40-4722-a469-2ff5afd05a45 2023-02-10 19:03:19,422 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(7671): creating {ENCODED => eca90e03b313fba8b7a1d6571ea05502, NAME => 'testWithMockedMapReduceMultiRegion,aaa,1676055796287.eca90e03b313fba8b7a1d6571ea05502.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44513/user/jenkins/test-data/171bfff3-7974-3283-60d4-30ee0b6875b1/testWithMockedMapReduceMultiRegion/9d2ffd66-3e40-4722-a469-2ff5afd05a45 2023-02-10 19:03:19,422 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(7671): creating {ENCODED => 2fd40e0179a0e968c4672055c041d740, NAME => 'testWithMockedMapReduceMultiRegion,,1676055796287.2fd40e0179a0e968c4672055c041d740.', STARTKEY => '', ENDKEY => 'aaa'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44513/user/jenkins/test-data/171bfff3-7974-3283-60d4-30ee0b6875b1/testWithMockedMapReduceMultiRegion/9d2ffd66-3e40-4722-a469-2ff5afd05a45 2023-02-10 19:03:19,423 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(7671): creating {ENCODED => 08e6594f21fdd814bfb7b05ba0f4191b, NAME => 'testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676055796287.08e6594f21fdd814bfb7b05ba0f4191b.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44513/user/jenkins/test-data/171bfff3-7974-3283-60d4-30ee0b6875b1/testWithMockedMapReduceMultiRegion/9d2ffd66-3e40-4722-a469-2ff5afd05a45 2023-02-10 19:03:19,423 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(7671): creating {ENCODED => b324410564271f3c81fcd7c2326d0435, NAME => 'testWithMockedMapReduceMultiRegion,m\xED\xED,1676055796287.b324410564271f3c81fcd7c2326d0435.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44513/user/jenkins/test-data/171bfff3-7974-3283-60d4-30ee0b6875b1/testWithMockedMapReduceMultiRegion/9d2ffd66-3e40-4722-a469-2ff5afd05a45 2023-02-10 19:03:19,423 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(7671): creating {ENCODED => f8e2703c94874a9a6d0d1541b43c1eb3, NAME => 'testWithMockedMapReduceMultiRegion,d\x84\x84,1676055796287.f8e2703c94874a9a6d0d1541b43c1eb3.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44513/user/jenkins/test-data/171bfff3-7974-3283-60d4-30ee0b6875b1/testWithMockedMapReduceMultiRegion/9d2ffd66-3e40-4722-a469-2ff5afd05a45 2023-02-10 19:03:19,424 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(7671): creating {ENCODED => ca626b09070f3e18c31fb632b018370f, NAME => 'testWithMockedMapReduceMultiRegion,zz{,1676055796287.ca626b09070f3e18c31fb632b018370f.', STARTKEY => 'zz{', ENDKEY => ''}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44513/user/jenkins/test-data/171bfff3-7974-3283-60d4-30ee0b6875b1/testWithMockedMapReduceMultiRegion/9d2ffd66-3e40-4722-a469-2ff5afd05a45 2023-02-10 19:03:19,424 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(7671): creating {ENCODED => 4539b623282fa7d2beb504c373ad6181, NAME => 'testWithMockedMapReduceMultiRegion,q\x11\x10,1676055796287.4539b623282fa7d2beb504c373ad6181.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44513/user/jenkins/test-data/171bfff3-7974-3283-60d4-30ee0b6875b1/testWithMockedMapReduceMultiRegion/9d2ffd66-3e40-4722-a469-2ff5afd05a45 2023-02-10 19:03:19,452 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676055796287.08e6594f21fdd814bfb7b05ba0f4191b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-10 19:03:19,452 INFO [RestoreSnapshot-pool-7] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 02780ed49bbb427cae98941994a14752 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-10 19:03:19,459 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,zz{,1676055796287.ca626b09070f3e18c31fb632b018370f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-10 19:03:19,459 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1603): Closing ca626b09070f3e18c31fb632b018370f, disabling compactions & flushes 2023-02-10 19:03:19,459 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,zz{,1676055796287.ca626b09070f3e18c31fb632b018370f. 2023-02-10 19:03:19,459 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,zz{,1676055796287.ca626b09070f3e18c31fb632b018370f. 2023-02-10 19:03:19,459 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,zz{,1676055796287.ca626b09070f3e18c31fb632b018370f. after waiting 0 ms 2023-02-10 19:03:19,459 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,zz{,1676055796287.ca626b09070f3e18c31fb632b018370f. 2023-02-10 19:03:19,459 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,zz{,1676055796287.ca626b09070f3e18c31fb632b018370f. 2023-02-10 19:03:19,459 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1557): Region close journal for ca626b09070f3e18c31fb632b018370f: Waiting for close lock at 1676055799459Disabling compacts and flushes for region at 1676055799459Disabling writes for close at 1676055799459Writing region close event to WAL at 1676055799459Closed at 1676055799459 2023-02-10 19:03:19,460 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(7671): creating {ENCODED => 54239cd4e87d877b10bac35ba4d2a8c8, NAME => 'testWithMockedMapReduceMultiRegion,t43,1676055796287.54239cd4e87d877b10bac35ba4d2a8c8.', STARTKEY => 't43', ENDKEY => 'wWV'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44513/user/jenkins/test-data/171bfff3-7974-3283-60d4-30ee0b6875b1/testWithMockedMapReduceMultiRegion/9d2ffd66-3e40-4722-a469-2ff5afd05a45 2023-02-10 19:03:19,460 INFO [RestoreSnapshot-pool-7] snapshot.RestoreSnapshotHelper(628): Adding HFileLink b2a0e21849bd458096fc6d91f86bb0b3 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-10 19:03:19,462 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676055796287.6b4a925bbaa3b95421bfaa80da606099.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-10 19:03:19,462 INFO [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(628): Adding HFileLink b40c4c188cf84850af2e9f8cc89239b7 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-10 19:03:19,471 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,d\x84\x84,1676055796287.f8e2703c94874a9a6d0d1541b43c1eb3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-10 19:03:19,471 INFO [RestoreSnapshot-pool-5] snapshot.RestoreSnapshotHelper(628): Adding HFileLink d9cb9fdd72484ad5887d21abdea99fc6 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-10 19:03:19,473 INFO [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 5784d0007aae4b6587c2605c3982f3e5 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-10 19:03:19,480 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1603): Closing 08e6594f21fdd814bfb7b05ba0f4191b, disabling compactions & flushes 2023-02-10 19:03:19,480 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676055796287.08e6594f21fdd814bfb7b05ba0f4191b. 2023-02-10 19:03:19,480 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676055796287.08e6594f21fdd814bfb7b05ba0f4191b. 2023-02-10 19:03:19,480 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676055796287.08e6594f21fdd814bfb7b05ba0f4191b. after waiting 0 ms 2023-02-10 19:03:19,480 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,m\xED\xED,1676055796287.b324410564271f3c81fcd7c2326d0435.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-10 19:03:19,480 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676055796287.08e6594f21fdd814bfb7b05ba0f4191b. 2023-02-10 19:03:19,481 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1603): Closing 6b4a925bbaa3b95421bfaa80da606099, disabling compactions & flushes 2023-02-10 19:03:19,481 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676055796287.08e6594f21fdd814bfb7b05ba0f4191b. 2023-02-10 19:03:19,481 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,aaa,1676055796287.eca90e03b313fba8b7a1d6571ea05502.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-10 19:03:19,481 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,,1676055796287.2fd40e0179a0e968c4672055c041d740.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-10 19:03:19,480 INFO [RestoreSnapshot-pool-6] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 109ffb49435d4f9d8b2303143ce8c190 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-10 19:03:19,481 INFO [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(628): Adding HFileLink d3fc07d8a2dc437cbc5b0d6449b82ce5 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-10 19:03:19,481 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,q\x11\x10,1676055796287.4539b623282fa7d2beb504c373ad6181.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-10 19:03:19,481 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 162a7696e02a4a4c9611ac886893cd7e from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-10 19:03:19,481 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1557): Region close journal for 08e6594f21fdd814bfb7b05ba0f4191b: Waiting for close lock at 1676055799480Disabling compacts and flushes for region at 1676055799480Disabling writes for close at 1676055799480Writing region close event to WAL at 1676055799481 (+1 ms)Closed at 1676055799481 2023-02-10 19:03:19,481 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676055796287.6b4a925bbaa3b95421bfaa80da606099. 2023-02-10 19:03:19,481 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1603): Closing 2fd40e0179a0e968c4672055c041d740, disabling compactions & flushes 2023-02-10 19:03:19,483 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,,1676055796287.2fd40e0179a0e968c4672055c041d740. 2023-02-10 19:03:19,483 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(7671): creating {ENCODED => bc3dafb6d0db6c740ff9583526924864, NAME => 'testWithMockedMapReduceMultiRegion,wWV,1676055796287.bc3dafb6d0db6c740ff9583526924864.', STARTKEY => 'wWV', ENDKEY => 'zz{'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44513/user/jenkins/test-data/171bfff3-7974-3283-60d4-30ee0b6875b1/testWithMockedMapReduceMultiRegion/9d2ffd66-3e40-4722-a469-2ff5afd05a45 2023-02-10 19:03:19,483 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,,1676055796287.2fd40e0179a0e968c4672055c041d740. 2023-02-10 19:03:19,483 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676055796287.6b4a925bbaa3b95421bfaa80da606099. 2023-02-10 19:03:19,483 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,,1676055796287.2fd40e0179a0e968c4672055c041d740. after waiting 0 ms 2023-02-10 19:03:19,483 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676055796287.6b4a925bbaa3b95421bfaa80da606099. after waiting 0 ms 2023-02-10 19:03:19,483 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,,1676055796287.2fd40e0179a0e968c4672055c041d740. 2023-02-10 19:03:19,483 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676055796287.6b4a925bbaa3b95421bfaa80da606099. 2023-02-10 19:03:19,483 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676055796287.6b4a925bbaa3b95421bfaa80da606099. 2023-02-10 19:03:19,483 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,,1676055796287.2fd40e0179a0e968c4672055c041d740. 2023-02-10 19:03:19,483 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1557): Region close journal for 6b4a925bbaa3b95421bfaa80da606099: Waiting for close lock at 1676055799481Disabling compacts and flushes for region at 1676055799481Disabling writes for close at 1676055799483 (+2 ms)Writing region close event to WAL at 1676055799483Closed at 1676055799483 2023-02-10 19:03:19,483 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1557): Region close journal for 2fd40e0179a0e968c4672055c041d740: Waiting for close lock at 1676055799481Disabling compacts and flushes for region at 1676055799481Disabling writes for close at 1676055799483 (+2 ms)Writing region close event to WAL at 1676055799483Closed at 1676055799483 2023-02-10 19:03:19,484 INFO [RestoreSnapshot-pool-5] snapshot.RestoreSnapshotHelper(628): Adding HFileLink fa18b005bdb24003bc90c081e4bc0826 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-10 19:03:19,485 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 16a960ab437341ac939f98660d7ed9b5 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-10 19:03:19,485 INFO [RestoreSnapshot-pool-6] snapshot.RestoreSnapshotHelper(628): Adding HFileLink e3751b81f34246ada74148861c841aea from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-10 19:03:19,488 INFO [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 0750363b3f3243a587dec443702e524a from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-10 19:03:19,492 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1603): Closing b324410564271f3c81fcd7c2326d0435, disabling compactions & flushes 2023-02-10 19:03:19,492 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,m\xED\xED,1676055796287.b324410564271f3c81fcd7c2326d0435. 2023-02-10 19:03:19,492 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,m\xED\xED,1676055796287.b324410564271f3c81fcd7c2326d0435. 2023-02-10 19:03:19,492 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,m\xED\xED,1676055796287.b324410564271f3c81fcd7c2326d0435. after waiting 0 ms 2023-02-10 19:03:19,492 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,m\xED\xED,1676055796287.b324410564271f3c81fcd7c2326d0435. 2023-02-10 19:03:19,492 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,m\xED\xED,1676055796287.b324410564271f3c81fcd7c2326d0435. 2023-02-10 19:03:19,492 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1557): Region close journal for b324410564271f3c81fcd7c2326d0435: Waiting for close lock at 1676055799492Disabling compacts and flushes for region at 1676055799492Disabling writes for close at 1676055799492Writing region close event to WAL at 1676055799492Closed at 1676055799492 2023-02-10 19:03:19,493 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1603): Closing f8e2703c94874a9a6d0d1541b43c1eb3, disabling compactions & flushes 2023-02-10 19:03:19,493 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,d\x84\x84,1676055796287.f8e2703c94874a9a6d0d1541b43c1eb3. 2023-02-10 19:03:19,493 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,d\x84\x84,1676055796287.f8e2703c94874a9a6d0d1541b43c1eb3. 2023-02-10 19:03:19,493 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,d\x84\x84,1676055796287.f8e2703c94874a9a6d0d1541b43c1eb3. after waiting 0 ms 2023-02-10 19:03:19,493 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,d\x84\x84,1676055796287.f8e2703c94874a9a6d0d1541b43c1eb3. 2023-02-10 19:03:19,493 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,d\x84\x84,1676055796287.f8e2703c94874a9a6d0d1541b43c1eb3. 2023-02-10 19:03:19,493 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1557): Region close journal for f8e2703c94874a9a6d0d1541b43c1eb3: Waiting for close lock at 1676055799493Disabling compacts and flushes for region at 1676055799493Disabling writes for close at 1676055799493Writing region close event to WAL at 1676055799493Closed at 1676055799493 2023-02-10 19:03:19,493 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1603): Closing 4539b623282fa7d2beb504c373ad6181, disabling compactions & flushes 2023-02-10 19:03:19,493 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,q\x11\x10,1676055796287.4539b623282fa7d2beb504c373ad6181. 2023-02-10 19:03:19,494 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,q\x11\x10,1676055796287.4539b623282fa7d2beb504c373ad6181. 2023-02-10 19:03:19,494 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,q\x11\x10,1676055796287.4539b623282fa7d2beb504c373ad6181. after waiting 0 ms 2023-02-10 19:03:19,494 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,q\x11\x10,1676055796287.4539b623282fa7d2beb504c373ad6181. 2023-02-10 19:03:19,494 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,q\x11\x10,1676055796287.4539b623282fa7d2beb504c373ad6181. 2023-02-10 19:03:19,494 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1557): Region close journal for 4539b623282fa7d2beb504c373ad6181: Waiting for close lock at 1676055799493Disabling compacts and flushes for region at 1676055799493Disabling writes for close at 1676055799494 (+1 ms)Writing region close event to WAL at 1676055799494Closed at 1676055799494 2023-02-10 19:03:19,495 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,t43,1676055796287.54239cd4e87d877b10bac35ba4d2a8c8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-10 19:03:19,495 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1603): Closing eca90e03b313fba8b7a1d6571ea05502, disabling compactions & flushes 2023-02-10 19:03:19,495 INFO [RestoreSnapshot-pool-4] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 998ea972b9ba48cbbbdfc4c5644202c7 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-10 19:03:19,495 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,aaa,1676055796287.eca90e03b313fba8b7a1d6571ea05502. 2023-02-10 19:03:19,495 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,aaa,1676055796287.eca90e03b313fba8b7a1d6571ea05502. 2023-02-10 19:03:19,495 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,aaa,1676055796287.eca90e03b313fba8b7a1d6571ea05502. after waiting 0 ms 2023-02-10 19:03:19,495 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,aaa,1676055796287.eca90e03b313fba8b7a1d6571ea05502. 2023-02-10 19:03:19,495 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,aaa,1676055796287.eca90e03b313fba8b7a1d6571ea05502. 2023-02-10 19:03:19,495 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1557): Region close journal for eca90e03b313fba8b7a1d6571ea05502: Waiting for close lock at 1676055799495Disabling compacts and flushes for region at 1676055799495Disabling writes for close at 1676055799495Writing region close event to WAL at 1676055799495Closed at 1676055799495 2023-02-10 19:03:19,497 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,wWV,1676055796287.bc3dafb6d0db6c740ff9583526924864.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-10 19:03:19,497 INFO [RestoreSnapshot-pool-4] snapshot.RestoreSnapshotHelper(628): Adding HFileLink d23712496aef458b97ec335b1481382e from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-10 19:03:19,497 INFO [RestoreSnapshot-pool-7] snapshot.RestoreSnapshotHelper(628): Adding HFileLink f79594e01a1349768d709f8a2f749ca9 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-10 19:03:19,499 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1603): Closing 54239cd4e87d877b10bac35ba4d2a8c8, disabling compactions & flushes 2023-02-10 19:03:19,499 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,t43,1676055796287.54239cd4e87d877b10bac35ba4d2a8c8. 2023-02-10 19:03:19,499 INFO [RestoreSnapshot-pool-7] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 2976aa6a7e6c4781a1ed63a69eb04281 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-10 19:03:19,499 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,t43,1676055796287.54239cd4e87d877b10bac35ba4d2a8c8. 2023-02-10 19:03:19,499 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,t43,1676055796287.54239cd4e87d877b10bac35ba4d2a8c8. after waiting 0 ms 2023-02-10 19:03:19,499 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,t43,1676055796287.54239cd4e87d877b10bac35ba4d2a8c8. 2023-02-10 19:03:19,499 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,t43,1676055796287.54239cd4e87d877b10bac35ba4d2a8c8. 2023-02-10 19:03:19,499 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1557): Region close journal for 54239cd4e87d877b10bac35ba4d2a8c8: Waiting for close lock at 1676055799499Disabling compacts and flushes for region at 1676055799499Disabling writes for close at 1676055799499Writing region close event to WAL at 1676055799499Closed at 1676055799499 2023-02-10 19:03:19,500 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1603): Closing bc3dafb6d0db6c740ff9583526924864, disabling compactions & flushes 2023-02-10 19:03:19,501 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,wWV,1676055796287.bc3dafb6d0db6c740ff9583526924864. 2023-02-10 19:03:19,501 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,wWV,1676055796287.bc3dafb6d0db6c740ff9583526924864. 2023-02-10 19:03:19,501 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,wWV,1676055796287.bc3dafb6d0db6c740ff9583526924864. after waiting 0 ms 2023-02-10 19:03:19,501 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,wWV,1676055796287.bc3dafb6d0db6c740ff9583526924864. 2023-02-10 19:03:19,501 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,wWV,1676055796287.bc3dafb6d0db6c740ff9583526924864. 2023-02-10 19:03:19,501 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1557): Region close journal for bc3dafb6d0db6c740ff9583526924864: Waiting for close lock at 1676055799500Disabling compacts and flushes for region at 1676055799500Disabling writes for close at 1676055799501 (+1 ms)Writing region close event to WAL at 1676055799501Closed at 1676055799501 2023-02-10 19:03:19,501 INFO [Listener at localhost/37107] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "testWithMockedMapReduceMultiRegion" table: "testWithMockedMapReduceMultiRegion" creation_time: 1676055797547 type: FLUSH version: 2 ttl: 0 2023-02-10 19:03:19,501 DEBUG [Listener at localhost/37107] snapshot.RestoreSnapshotHelper(832): Restored table dir:hdfs://localhost:44513/user/jenkins/test-data/171bfff3-7974-3283-60d4-30ee0b6875b1/testWithMockedMapReduceMultiRegion/9d2ffd66-3e40-4722-a469-2ff5afd05a45 2023-02-10 19:03:19,501 DEBUG [Listener at localhost/37107] util.CommonFSUtils(682): File system contents for path hdfs://localhost:44513/user/jenkins/test-data/171bfff3-7974-3283-60d4-30ee0b6875b1/testWithMockedMapReduceMultiRegion/9d2ffd66-3e40-4722-a469-2ff5afd05a45 2023-02-10 19:03:19,502 DEBUG [Listener at localhost/37107] util.CommonFSUtils(699): |-data/ 2023-02-10 19:03:19,502 DEBUG [Listener at localhost/37107] util.CommonFSUtils(699): |----default/ 2023-02-10 19:03:19,503 DEBUG [Listener at localhost/37107] util.CommonFSUtils(699): |-------testWithMockedMapReduceMultiRegion/ 2023-02-10 19:03:19,503 DEBUG [Listener at localhost/37107] util.CommonFSUtils(699): |----------08e6594f21fdd814bfb7b05ba0f4191b/ 2023-02-10 19:03:19,504 DEBUG [Listener at localhost/37107] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-10 19:03:19,504 DEBUG [Listener at localhost/37107] util.CommonFSUtils(699): |-------------f1/ 2023-02-10 19:03:19,504 DEBUG [Listener at localhost/37107] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=08e6594f21fdd814bfb7b05ba0f4191b-02780ed49bbb427cae98941994a14752 2023-02-10 19:03:19,504 DEBUG [Listener at localhost/37107] util.CommonFSUtils(699): |-------------f2/ 2023-02-10 19:03:19,504 DEBUG [Listener at localhost/37107] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=08e6594f21fdd814bfb7b05ba0f4191b-b2a0e21849bd458096fc6d91f86bb0b3 2023-02-10 19:03:19,505 DEBUG [Listener at localhost/37107] util.CommonFSUtils(699): |----------2fd40e0179a0e968c4672055c041d740/ 2023-02-10 19:03:19,505 DEBUG [Listener at localhost/37107] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-10 19:03:19,505 DEBUG [Listener at localhost/37107] util.CommonFSUtils(699): |----------4539b623282fa7d2beb504c373ad6181/ 2023-02-10 19:03:19,505 DEBUG [Listener at localhost/37107] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-10 19:03:19,505 DEBUG [Listener at localhost/37107] util.CommonFSUtils(699): |-------------f1/ 2023-02-10 19:03:19,505 DEBUG [Listener at localhost/37107] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=4539b623282fa7d2beb504c373ad6181-162a7696e02a4a4c9611ac886893cd7e 2023-02-10 19:03:19,506 DEBUG [Listener at localhost/37107] util.CommonFSUtils(699): |-------------f2/ 2023-02-10 19:03:19,506 DEBUG [Listener at localhost/37107] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=4539b623282fa7d2beb504c373ad6181-16a960ab437341ac939f98660d7ed9b5 2023-02-10 19:03:19,506 DEBUG [Listener at localhost/37107] util.CommonFSUtils(699): |----------54239cd4e87d877b10bac35ba4d2a8c8/ 2023-02-10 19:03:19,506 DEBUG [Listener at localhost/37107] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-10 19:03:19,506 DEBUG [Listener at localhost/37107] util.CommonFSUtils(699): |-------------f1/ 2023-02-10 19:03:19,506 DEBUG [Listener at localhost/37107] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=54239cd4e87d877b10bac35ba4d2a8c8-998ea972b9ba48cbbbdfc4c5644202c7 2023-02-10 19:03:19,507 DEBUG [Listener at localhost/37107] util.CommonFSUtils(699): |-------------f2/ 2023-02-10 19:03:19,507 DEBUG [Listener at localhost/37107] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=54239cd4e87d877b10bac35ba4d2a8c8-d23712496aef458b97ec335b1481382e 2023-02-10 19:03:19,507 DEBUG [Listener at localhost/37107] util.CommonFSUtils(699): |----------6b4a925bbaa3b95421bfaa80da606099/ 2023-02-10 19:03:19,507 DEBUG [Listener at localhost/37107] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-10 19:03:19,507 DEBUG [Listener at localhost/37107] util.CommonFSUtils(699): |-------------f1/ 2023-02-10 19:03:19,507 DEBUG [Listener at localhost/37107] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=6b4a925bbaa3b95421bfaa80da606099-b40c4c188cf84850af2e9f8cc89239b7 2023-02-10 19:03:19,508 DEBUG [Listener at localhost/37107] util.CommonFSUtils(699): |-------------f2/ 2023-02-10 19:03:19,508 DEBUG [Listener at localhost/37107] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=6b4a925bbaa3b95421bfaa80da606099-5784d0007aae4b6587c2605c3982f3e5 2023-02-10 19:03:19,508 DEBUG [Listener at localhost/37107] util.CommonFSUtils(699): |----------b324410564271f3c81fcd7c2326d0435/ 2023-02-10 19:03:19,508 DEBUG [Listener at localhost/37107] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-10 19:03:19,508 DEBUG [Listener at localhost/37107] util.CommonFSUtils(699): |-------------f1/ 2023-02-10 19:03:19,509 DEBUG [Listener at localhost/37107] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=b324410564271f3c81fcd7c2326d0435-109ffb49435d4f9d8b2303143ce8c190 2023-02-10 19:03:19,509 DEBUG [Listener at localhost/37107] util.CommonFSUtils(699): |-------------f2/ 2023-02-10 19:03:19,509 DEBUG [Listener at localhost/37107] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=b324410564271f3c81fcd7c2326d0435-e3751b81f34246ada74148861c841aea 2023-02-10 19:03:19,509 DEBUG [Listener at localhost/37107] util.CommonFSUtils(699): |----------bc3dafb6d0db6c740ff9583526924864/ 2023-02-10 19:03:19,509 DEBUG [Listener at localhost/37107] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-10 19:03:19,509 DEBUG [Listener at localhost/37107] util.CommonFSUtils(699): |-------------f1/ 2023-02-10 19:03:19,510 DEBUG [Listener at localhost/37107] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=bc3dafb6d0db6c740ff9583526924864-f79594e01a1349768d709f8a2f749ca9 2023-02-10 19:03:19,510 DEBUG [Listener at localhost/37107] util.CommonFSUtils(699): |-------------f2/ 2023-02-10 19:03:19,510 DEBUG [Listener at localhost/37107] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=bc3dafb6d0db6c740ff9583526924864-2976aa6a7e6c4781a1ed63a69eb04281 2023-02-10 19:03:19,510 DEBUG [Listener at localhost/37107] util.CommonFSUtils(699): |----------ca626b09070f3e18c31fb632b018370f/ 2023-02-10 19:03:19,510 DEBUG [Listener at localhost/37107] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-10 19:03:19,510 DEBUG [Listener at localhost/37107] util.CommonFSUtils(699): |----------eca90e03b313fba8b7a1d6571ea05502/ 2023-02-10 19:03:19,511 DEBUG [Listener at localhost/37107] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-10 19:03:19,511 DEBUG [Listener at localhost/37107] util.CommonFSUtils(699): |-------------f1/ 2023-02-10 19:03:19,511 DEBUG [Listener at localhost/37107] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=eca90e03b313fba8b7a1d6571ea05502-d3fc07d8a2dc437cbc5b0d6449b82ce5 2023-02-10 19:03:19,511 DEBUG [Listener at localhost/37107] util.CommonFSUtils(699): |-------------f2/ 2023-02-10 19:03:19,511 DEBUG [Listener at localhost/37107] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=eca90e03b313fba8b7a1d6571ea05502-0750363b3f3243a587dec443702e524a 2023-02-10 19:03:19,511 DEBUG [Listener at localhost/37107] util.CommonFSUtils(699): |----------f8e2703c94874a9a6d0d1541b43c1eb3/ 2023-02-10 19:03:19,512 DEBUG [Listener at localhost/37107] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-10 19:03:19,512 DEBUG [Listener at localhost/37107] util.CommonFSUtils(699): |-------------f1/ 2023-02-10 19:03:19,512 DEBUG [Listener at localhost/37107] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=f8e2703c94874a9a6d0d1541b43c1eb3-d9cb9fdd72484ad5887d21abdea99fc6 2023-02-10 19:03:19,512 DEBUG [Listener at localhost/37107] util.CommonFSUtils(699): |-------------f2/ 2023-02-10 19:03:19,512 DEBUG [Listener at localhost/37107] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=f8e2703c94874a9a6d0d1541b43c1eb3-fa18b005bdb24003bc90c081e4bc0826 2023-02-10 19:03:19,515 INFO [Listener at localhost/37107] mapreduce.TableSnapshotInputFormatImpl(392): Provided Scan has DEFAULT ReadType, updating STREAM for Snapshot-based InputFormat 2023-02-10 19:03:20,031 DEBUG [Listener at localhost/37107] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676055796287.08e6594f21fdd814bfb7b05ba0f4191b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-10 19:03:20,031 INFO [Listener at localhost/37107] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-10 19:03:20,033 DEBUG [Listener at localhost/37107] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-10 19:03:20,035 INFO [StoreOpener-08e6594f21fdd814bfb7b05ba0f4191b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 08e6594f21fdd814bfb7b05ba0f4191b 2023-02-10 19:03:20,036 DEBUG [StoreOpener-08e6594f21fdd814bfb7b05ba0f4191b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44513/user/jenkins/test-data/171bfff3-7974-3283-60d4-30ee0b6875b1/testWithMockedMapReduceMultiRegion/9d2ffd66-3e40-4722-a469-2ff5afd05a45/data/default/testWithMockedMapReduceMultiRegion/08e6594f21fdd814bfb7b05ba0f4191b/f1 2023-02-10 19:03:20,036 INFO [StoreOpener-08e6594f21fdd814bfb7b05ba0f4191b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 08e6594f21fdd814bfb7b05ba0f4191b columnFamilyName f1 2023-02-10 19:03:20,041 DEBUG [StoreOpener-08e6594f21fdd814bfb7b05ba0f4191b-1] regionserver.HStore(539): loaded hdfs://localhost:44513/user/jenkins/test-data/171bfff3-7974-3283-60d4-30ee0b6875b1/testWithMockedMapReduceMultiRegion/9d2ffd66-3e40-4722-a469-2ff5afd05a45/data/default/testWithMockedMapReduceMultiRegion/08e6594f21fdd814bfb7b05ba0f4191b/f1/testWithMockedMapReduceMultiRegion=08e6594f21fdd814bfb7b05ba0f4191b-02780ed49bbb427cae98941994a14752 2023-02-10 19:03:20,041 INFO [StoreOpener-08e6594f21fdd814bfb7b05ba0f4191b-1] regionserver.HStore(310): Store=08e6594f21fdd814bfb7b05ba0f4191b/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-10 19:03:20,041 INFO [StoreOpener-08e6594f21fdd814bfb7b05ba0f4191b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 08e6594f21fdd814bfb7b05ba0f4191b 2023-02-10 19:03:20,042 DEBUG [StoreOpener-08e6594f21fdd814bfb7b05ba0f4191b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44513/user/jenkins/test-data/171bfff3-7974-3283-60d4-30ee0b6875b1/testWithMockedMapReduceMultiRegion/9d2ffd66-3e40-4722-a469-2ff5afd05a45/data/default/testWithMockedMapReduceMultiRegion/08e6594f21fdd814bfb7b05ba0f4191b/f2 2023-02-10 19:03:20,042 INFO [StoreOpener-08e6594f21fdd814bfb7b05ba0f4191b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 08e6594f21fdd814bfb7b05ba0f4191b columnFamilyName f2 2023-02-10 19:03:20,045 DEBUG [StoreOpener-08e6594f21fdd814bfb7b05ba0f4191b-1] regionserver.HStore(539): loaded hdfs://localhost:44513/user/jenkins/test-data/171bfff3-7974-3283-60d4-30ee0b6875b1/testWithMockedMapReduceMultiRegion/9d2ffd66-3e40-4722-a469-2ff5afd05a45/data/default/testWithMockedMapReduceMultiRegion/08e6594f21fdd814bfb7b05ba0f4191b/f2/testWithMockedMapReduceMultiRegion=08e6594f21fdd814bfb7b05ba0f4191b-b2a0e21849bd458096fc6d91f86bb0b3 2023-02-10 19:03:20,045 INFO [StoreOpener-08e6594f21fdd814bfb7b05ba0f4191b-1] regionserver.HStore(310): Store=08e6594f21fdd814bfb7b05ba0f4191b/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-10 19:03:20,046 DEBUG [Listener at localhost/37107] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-10 19:03:20,046 INFO [Listener at localhost/37107] regionserver.HRegion(1071): Opened 08e6594f21fdd814bfb7b05ba0f4191b; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72267566, jitterRate=0.07687065005302429}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-10 19:03:20,046 DEBUG [Listener at localhost/37107] regionserver.HRegion(964): Region open journal for 08e6594f21fdd814bfb7b05ba0f4191b: Writing region info on filesystem at 1676055800033Initializing all the Stores at 1676055800034 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676055800034Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676055800034Region opened successfully at 1676055800046 (+12 ms) 2023-02-10 19:03:20,055 DEBUG [Listener at localhost/37107] regionserver.HRegion(1603): Closing 08e6594f21fdd814bfb7b05ba0f4191b, disabling compactions & flushes 2023-02-10 19:03:20,056 INFO [Listener at localhost/37107] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676055796287.08e6594f21fdd814bfb7b05ba0f4191b. 2023-02-10 19:03:20,056 DEBUG [Listener at localhost/37107] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676055796287.08e6594f21fdd814bfb7b05ba0f4191b. 2023-02-10 19:03:20,056 DEBUG [Listener at localhost/37107] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676055796287.08e6594f21fdd814bfb7b05ba0f4191b. after waiting 0 ms 2023-02-10 19:03:20,056 DEBUG [Listener at localhost/37107] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676055796287.08e6594f21fdd814bfb7b05ba0f4191b. 2023-02-10 19:03:20,057 INFO [Listener at localhost/37107] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676055796287.08e6594f21fdd814bfb7b05ba0f4191b. 2023-02-10 19:03:20,057 DEBUG [Listener at localhost/37107] regionserver.HRegion(1557): Region close journal for 08e6594f21fdd814bfb7b05ba0f4191b: Waiting for close lock at 1676055800055Disabling compacts and flushes for region at 1676055800055Disabling writes for close at 1676055800056 (+1 ms)Writing region close event to WAL at 1676055800057 (+1 ms)Closed at 1676055800057 2023-02-10 19:03:20,058 DEBUG [Listener at localhost/37107] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,q\x11\x10,1676055796287.4539b623282fa7d2beb504c373ad6181.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-10 19:03:20,058 INFO [Listener at localhost/37107] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-10 19:03:20,059 DEBUG [Listener at localhost/37107] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-10 19:03:20,061 INFO [StoreOpener-4539b623282fa7d2beb504c373ad6181-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 4539b623282fa7d2beb504c373ad6181 2023-02-10 19:03:20,061 DEBUG [StoreOpener-4539b623282fa7d2beb504c373ad6181-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44513/user/jenkins/test-data/171bfff3-7974-3283-60d4-30ee0b6875b1/testWithMockedMapReduceMultiRegion/9d2ffd66-3e40-4722-a469-2ff5afd05a45/data/default/testWithMockedMapReduceMultiRegion/4539b623282fa7d2beb504c373ad6181/f1 2023-02-10 19:03:20,062 INFO [StoreOpener-4539b623282fa7d2beb504c373ad6181-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4539b623282fa7d2beb504c373ad6181 columnFamilyName f1 2023-02-10 19:03:20,066 DEBUG [StoreOpener-4539b623282fa7d2beb504c373ad6181-1] regionserver.HStore(539): loaded hdfs://localhost:44513/user/jenkins/test-data/171bfff3-7974-3283-60d4-30ee0b6875b1/testWithMockedMapReduceMultiRegion/9d2ffd66-3e40-4722-a469-2ff5afd05a45/data/default/testWithMockedMapReduceMultiRegion/4539b623282fa7d2beb504c373ad6181/f1/testWithMockedMapReduceMultiRegion=4539b623282fa7d2beb504c373ad6181-162a7696e02a4a4c9611ac886893cd7e 2023-02-10 19:03:20,066 INFO [StoreOpener-4539b623282fa7d2beb504c373ad6181-1] regionserver.HStore(310): Store=4539b623282fa7d2beb504c373ad6181/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-10 19:03:20,066 INFO [StoreOpener-4539b623282fa7d2beb504c373ad6181-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 4539b623282fa7d2beb504c373ad6181 2023-02-10 19:03:20,067 DEBUG [StoreOpener-4539b623282fa7d2beb504c373ad6181-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44513/user/jenkins/test-data/171bfff3-7974-3283-60d4-30ee0b6875b1/testWithMockedMapReduceMultiRegion/9d2ffd66-3e40-4722-a469-2ff5afd05a45/data/default/testWithMockedMapReduceMultiRegion/4539b623282fa7d2beb504c373ad6181/f2 2023-02-10 19:03:20,068 INFO [StoreOpener-4539b623282fa7d2beb504c373ad6181-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4539b623282fa7d2beb504c373ad6181 columnFamilyName f2 2023-02-10 19:03:20,071 DEBUG [StoreOpener-4539b623282fa7d2beb504c373ad6181-1] regionserver.HStore(539): loaded hdfs://localhost:44513/user/jenkins/test-data/171bfff3-7974-3283-60d4-30ee0b6875b1/testWithMockedMapReduceMultiRegion/9d2ffd66-3e40-4722-a469-2ff5afd05a45/data/default/testWithMockedMapReduceMultiRegion/4539b623282fa7d2beb504c373ad6181/f2/testWithMockedMapReduceMultiRegion=4539b623282fa7d2beb504c373ad6181-16a960ab437341ac939f98660d7ed9b5 2023-02-10 19:03:20,071 INFO [StoreOpener-4539b623282fa7d2beb504c373ad6181-1] regionserver.HStore(310): Store=4539b623282fa7d2beb504c373ad6181/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-10 19:03:20,072 DEBUG [Listener at localhost/37107] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-10 19:03:20,072 INFO [Listener at localhost/37107] regionserver.HRegion(1071): Opened 4539b623282fa7d2beb504c373ad6181; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62805416, jitterRate=-0.06412637233734131}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-10 19:03:20,072 DEBUG [Listener at localhost/37107] regionserver.HRegion(964): Region open journal for 4539b623282fa7d2beb504c373ad6181: Writing region info on filesystem at 1676055800059Initializing all the Stores at 1676055800060 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676055800060Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676055800060Region opened successfully at 1676055800072 (+12 ms) 2023-02-10 19:03:20,080 DEBUG [Listener at localhost/37107] regionserver.HRegion(1603): Closing 4539b623282fa7d2beb504c373ad6181, disabling compactions & flushes 2023-02-10 19:03:20,080 INFO [Listener at localhost/37107] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,q\x11\x10,1676055796287.4539b623282fa7d2beb504c373ad6181. 2023-02-10 19:03:20,080 DEBUG [Listener at localhost/37107] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,q\x11\x10,1676055796287.4539b623282fa7d2beb504c373ad6181. 2023-02-10 19:03:20,080 DEBUG [Listener at localhost/37107] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,q\x11\x10,1676055796287.4539b623282fa7d2beb504c373ad6181. after waiting 0 ms 2023-02-10 19:03:20,080 DEBUG [Listener at localhost/37107] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,q\x11\x10,1676055796287.4539b623282fa7d2beb504c373ad6181. 2023-02-10 19:03:20,081 INFO [Listener at localhost/37107] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,q\x11\x10,1676055796287.4539b623282fa7d2beb504c373ad6181. 2023-02-10 19:03:20,081 DEBUG [Listener at localhost/37107] regionserver.HRegion(1557): Region close journal for 4539b623282fa7d2beb504c373ad6181: Waiting for close lock at 1676055800080Disabling compacts and flushes for region at 1676055800080Disabling writes for close at 1676055800080Writing region close event to WAL at 1676055800081 (+1 ms)Closed at 1676055800081 2023-02-10 19:03:20,081 DEBUG [Listener at localhost/37107] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,wWV,1676055796287.bc3dafb6d0db6c740ff9583526924864.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-10 19:03:20,081 INFO [Listener at localhost/37107] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-10 19:03:20,088 DEBUG [Listener at localhost/37107] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-10 19:03:20,089 INFO [StoreOpener-bc3dafb6d0db6c740ff9583526924864-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region bc3dafb6d0db6c740ff9583526924864 2023-02-10 19:03:20,090 DEBUG [StoreOpener-bc3dafb6d0db6c740ff9583526924864-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44513/user/jenkins/test-data/171bfff3-7974-3283-60d4-30ee0b6875b1/testWithMockedMapReduceMultiRegion/9d2ffd66-3e40-4722-a469-2ff5afd05a45/data/default/testWithMockedMapReduceMultiRegion/bc3dafb6d0db6c740ff9583526924864/f1 2023-02-10 19:03:20,091 INFO [StoreOpener-bc3dafb6d0db6c740ff9583526924864-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region bc3dafb6d0db6c740ff9583526924864 columnFamilyName f1 2023-02-10 19:03:20,095 DEBUG [StoreOpener-bc3dafb6d0db6c740ff9583526924864-1] regionserver.HStore(539): loaded hdfs://localhost:44513/user/jenkins/test-data/171bfff3-7974-3283-60d4-30ee0b6875b1/testWithMockedMapReduceMultiRegion/9d2ffd66-3e40-4722-a469-2ff5afd05a45/data/default/testWithMockedMapReduceMultiRegion/bc3dafb6d0db6c740ff9583526924864/f1/testWithMockedMapReduceMultiRegion=bc3dafb6d0db6c740ff9583526924864-f79594e01a1349768d709f8a2f749ca9 2023-02-10 19:03:20,095 INFO [StoreOpener-bc3dafb6d0db6c740ff9583526924864-1] regionserver.HStore(310): Store=bc3dafb6d0db6c740ff9583526924864/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-10 19:03:20,096 INFO [StoreOpener-bc3dafb6d0db6c740ff9583526924864-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region bc3dafb6d0db6c740ff9583526924864 2023-02-10 19:03:20,096 DEBUG [StoreOpener-bc3dafb6d0db6c740ff9583526924864-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44513/user/jenkins/test-data/171bfff3-7974-3283-60d4-30ee0b6875b1/testWithMockedMapReduceMultiRegion/9d2ffd66-3e40-4722-a469-2ff5afd05a45/data/default/testWithMockedMapReduceMultiRegion/bc3dafb6d0db6c740ff9583526924864/f2 2023-02-10 19:03:20,097 INFO [StoreOpener-bc3dafb6d0db6c740ff9583526924864-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region bc3dafb6d0db6c740ff9583526924864 columnFamilyName f2 2023-02-10 19:03:20,103 DEBUG [StoreOpener-bc3dafb6d0db6c740ff9583526924864-1] regionserver.HStore(539): loaded hdfs://localhost:44513/user/jenkins/test-data/171bfff3-7974-3283-60d4-30ee0b6875b1/testWithMockedMapReduceMultiRegion/9d2ffd66-3e40-4722-a469-2ff5afd05a45/data/default/testWithMockedMapReduceMultiRegion/bc3dafb6d0db6c740ff9583526924864/f2/testWithMockedMapReduceMultiRegion=bc3dafb6d0db6c740ff9583526924864-2976aa6a7e6c4781a1ed63a69eb04281 2023-02-10 19:03:20,103 INFO [StoreOpener-bc3dafb6d0db6c740ff9583526924864-1] regionserver.HStore(310): Store=bc3dafb6d0db6c740ff9583526924864/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-10 19:03:20,103 DEBUG [Listener at localhost/37107] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-10 19:03:20,103 INFO [Listener at localhost/37107] regionserver.HRegion(1071): Opened bc3dafb6d0db6c740ff9583526924864; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59550378, jitterRate=-0.1126302182674408}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-10 19:03:20,103 DEBUG [Listener at localhost/37107] regionserver.HRegion(964): Region open journal for bc3dafb6d0db6c740ff9583526924864: Writing region info on filesystem at 1676055800088Initializing all the Stores at 1676055800088Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676055800089 (+1 ms)Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676055800089Region opened successfully at 1676055800103 (+14 ms) 2023-02-10 19:03:20,114 DEBUG [Listener at localhost/37107] regionserver.HRegion(1603): Closing bc3dafb6d0db6c740ff9583526924864, disabling compactions & flushes 2023-02-10 19:03:20,114 INFO [Listener at localhost/37107] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,wWV,1676055796287.bc3dafb6d0db6c740ff9583526924864. 2023-02-10 19:03:20,114 DEBUG [Listener at localhost/37107] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,wWV,1676055796287.bc3dafb6d0db6c740ff9583526924864. 2023-02-10 19:03:20,114 DEBUG [Listener at localhost/37107] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,wWV,1676055796287.bc3dafb6d0db6c740ff9583526924864. after waiting 0 ms 2023-02-10 19:03:20,114 DEBUG [Listener at localhost/37107] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,wWV,1676055796287.bc3dafb6d0db6c740ff9583526924864. 2023-02-10 19:03:20,116 INFO [Listener at localhost/37107] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,wWV,1676055796287.bc3dafb6d0db6c740ff9583526924864. 2023-02-10 19:03:20,116 DEBUG [Listener at localhost/37107] regionserver.HRegion(1557): Region close journal for bc3dafb6d0db6c740ff9583526924864: Waiting for close lock at 1676055800114Disabling compacts and flushes for region at 1676055800114Disabling writes for close at 1676055800114Writing region close event to WAL at 1676055800116 (+2 ms)Closed at 1676055800116 2023-02-10 19:03:20,117 DEBUG [Listener at localhost/37107] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,,1676055796287.2fd40e0179a0e968c4672055c041d740.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-10 19:03:20,117 INFO [Listener at localhost/37107] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-10 19:03:20,118 DEBUG [Listener at localhost/37107] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-10 19:03:20,120 INFO [StoreOpener-2fd40e0179a0e968c4672055c041d740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 2fd40e0179a0e968c4672055c041d740 2023-02-10 19:03:20,122 DEBUG [StoreOpener-2fd40e0179a0e968c4672055c041d740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44513/user/jenkins/test-data/171bfff3-7974-3283-60d4-30ee0b6875b1/testWithMockedMapReduceMultiRegion/9d2ffd66-3e40-4722-a469-2ff5afd05a45/data/default/testWithMockedMapReduceMultiRegion/2fd40e0179a0e968c4672055c041d740/f1 2023-02-10 19:03:20,122 INFO [StoreOpener-2fd40e0179a0e968c4672055c041d740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2fd40e0179a0e968c4672055c041d740 columnFamilyName f1 2023-02-10 19:03:20,122 INFO [StoreOpener-2fd40e0179a0e968c4672055c041d740-1] regionserver.HStore(310): Store=2fd40e0179a0e968c4672055c041d740/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-10 19:03:20,123 INFO [StoreOpener-2fd40e0179a0e968c4672055c041d740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 2fd40e0179a0e968c4672055c041d740 2023-02-10 19:03:20,124 DEBUG [StoreOpener-2fd40e0179a0e968c4672055c041d740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44513/user/jenkins/test-data/171bfff3-7974-3283-60d4-30ee0b6875b1/testWithMockedMapReduceMultiRegion/9d2ffd66-3e40-4722-a469-2ff5afd05a45/data/default/testWithMockedMapReduceMultiRegion/2fd40e0179a0e968c4672055c041d740/f2 2023-02-10 19:03:20,124 INFO [StoreOpener-2fd40e0179a0e968c4672055c041d740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2fd40e0179a0e968c4672055c041d740 columnFamilyName f2 2023-02-10 19:03:20,124 INFO [StoreOpener-2fd40e0179a0e968c4672055c041d740-1] regionserver.HStore(310): Store=2fd40e0179a0e968c4672055c041d740/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-10 19:03:20,125 DEBUG [Listener at localhost/37107] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-10 19:03:20,125 INFO [Listener at localhost/37107] regionserver.HRegion(1071): Opened 2fd40e0179a0e968c4672055c041d740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73526660, jitterRate=0.09563261270523071}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-10 19:03:20,125 DEBUG [Listener at localhost/37107] regionserver.HRegion(964): Region open journal for 2fd40e0179a0e968c4672055c041d740: Writing region info on filesystem at 1676055800118Initializing all the Stores at 1676055800119 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676055800119Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676055800119Region opened successfully at 1676055800125 (+6 ms) 2023-02-10 19:03:20,125 DEBUG [Listener at localhost/37107] regionserver.HRegion(1603): Closing 2fd40e0179a0e968c4672055c041d740, disabling compactions & flushes 2023-02-10 19:03:20,125 INFO [Listener at localhost/37107] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,,1676055796287.2fd40e0179a0e968c4672055c041d740. 2023-02-10 19:03:20,125 DEBUG [Listener at localhost/37107] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,,1676055796287.2fd40e0179a0e968c4672055c041d740. 2023-02-10 19:03:20,125 DEBUG [Listener at localhost/37107] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,,1676055796287.2fd40e0179a0e968c4672055c041d740. after waiting 0 ms 2023-02-10 19:03:20,125 DEBUG [Listener at localhost/37107] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,,1676055796287.2fd40e0179a0e968c4672055c041d740. 2023-02-10 19:03:20,125 INFO [Listener at localhost/37107] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,,1676055796287.2fd40e0179a0e968c4672055c041d740. 2023-02-10 19:03:20,126 DEBUG [Listener at localhost/37107] regionserver.HRegion(1557): Region close journal for 2fd40e0179a0e968c4672055c041d740: Waiting for close lock at 1676055800125Disabling compacts and flushes for region at 1676055800125Disabling writes for close at 1676055800125Writing region close event to WAL at 1676055800125Closed at 1676055800125 2023-02-10 19:03:20,126 DEBUG [Listener at localhost/37107] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,aaa,1676055796287.eca90e03b313fba8b7a1d6571ea05502.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-10 19:03:20,126 INFO [Listener at localhost/37107] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-10 19:03:20,130 DEBUG [Listener at localhost/37107] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-10 19:03:20,132 INFO [StoreOpener-eca90e03b313fba8b7a1d6571ea05502-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region eca90e03b313fba8b7a1d6571ea05502 2023-02-10 19:03:20,133 DEBUG [StoreOpener-eca90e03b313fba8b7a1d6571ea05502-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44513/user/jenkins/test-data/171bfff3-7974-3283-60d4-30ee0b6875b1/testWithMockedMapReduceMultiRegion/9d2ffd66-3e40-4722-a469-2ff5afd05a45/data/default/testWithMockedMapReduceMultiRegion/eca90e03b313fba8b7a1d6571ea05502/f1 2023-02-10 19:03:20,133 INFO [StoreOpener-eca90e03b313fba8b7a1d6571ea05502-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region eca90e03b313fba8b7a1d6571ea05502 columnFamilyName f1 2023-02-10 19:03:20,139 DEBUG [StoreOpener-eca90e03b313fba8b7a1d6571ea05502-1] regionserver.HStore(539): loaded hdfs://localhost:44513/user/jenkins/test-data/171bfff3-7974-3283-60d4-30ee0b6875b1/testWithMockedMapReduceMultiRegion/9d2ffd66-3e40-4722-a469-2ff5afd05a45/data/default/testWithMockedMapReduceMultiRegion/eca90e03b313fba8b7a1d6571ea05502/f1/testWithMockedMapReduceMultiRegion=eca90e03b313fba8b7a1d6571ea05502-d3fc07d8a2dc437cbc5b0d6449b82ce5 2023-02-10 19:03:20,139 INFO [StoreOpener-eca90e03b313fba8b7a1d6571ea05502-1] regionserver.HStore(310): Store=eca90e03b313fba8b7a1d6571ea05502/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-10 19:03:20,139 INFO [StoreOpener-eca90e03b313fba8b7a1d6571ea05502-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region eca90e03b313fba8b7a1d6571ea05502 2023-02-10 19:03:20,140 DEBUG [StoreOpener-eca90e03b313fba8b7a1d6571ea05502-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44513/user/jenkins/test-data/171bfff3-7974-3283-60d4-30ee0b6875b1/testWithMockedMapReduceMultiRegion/9d2ffd66-3e40-4722-a469-2ff5afd05a45/data/default/testWithMockedMapReduceMultiRegion/eca90e03b313fba8b7a1d6571ea05502/f2 2023-02-10 19:03:20,140 INFO [StoreOpener-eca90e03b313fba8b7a1d6571ea05502-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region eca90e03b313fba8b7a1d6571ea05502 columnFamilyName f2 2023-02-10 19:03:20,144 DEBUG [StoreOpener-eca90e03b313fba8b7a1d6571ea05502-1] regionserver.HStore(539): loaded hdfs://localhost:44513/user/jenkins/test-data/171bfff3-7974-3283-60d4-30ee0b6875b1/testWithMockedMapReduceMultiRegion/9d2ffd66-3e40-4722-a469-2ff5afd05a45/data/default/testWithMockedMapReduceMultiRegion/eca90e03b313fba8b7a1d6571ea05502/f2/testWithMockedMapReduceMultiRegion=eca90e03b313fba8b7a1d6571ea05502-0750363b3f3243a587dec443702e524a 2023-02-10 19:03:20,144 INFO [StoreOpener-eca90e03b313fba8b7a1d6571ea05502-1] regionserver.HStore(310): Store=eca90e03b313fba8b7a1d6571ea05502/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-10 19:03:20,144 DEBUG [Listener at localhost/37107] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-10 19:03:20,144 INFO [Listener at localhost/37107] regionserver.HRegion(1071): Opened eca90e03b313fba8b7a1d6571ea05502; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63899509, jitterRate=-0.047823116183280945}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-10 19:03:20,144 DEBUG [Listener at localhost/37107] regionserver.HRegion(964): Region open journal for eca90e03b313fba8b7a1d6571ea05502: Writing region info on filesystem at 1676055800130Initializing all the Stores at 1676055800131 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676055800131Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676055800131Region opened successfully at 1676055800144 (+13 ms) 2023-02-10 19:03:20,154 DEBUG [Listener at localhost/37107] regionserver.HRegion(1603): Closing eca90e03b313fba8b7a1d6571ea05502, disabling compactions & flushes 2023-02-10 19:03:20,154 INFO [Listener at localhost/37107] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,aaa,1676055796287.eca90e03b313fba8b7a1d6571ea05502. 2023-02-10 19:03:20,154 DEBUG [Listener at localhost/37107] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,aaa,1676055796287.eca90e03b313fba8b7a1d6571ea05502. 2023-02-10 19:03:20,154 DEBUG [Listener at localhost/37107] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,aaa,1676055796287.eca90e03b313fba8b7a1d6571ea05502. after waiting 0 ms 2023-02-10 19:03:20,154 DEBUG [Listener at localhost/37107] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,aaa,1676055796287.eca90e03b313fba8b7a1d6571ea05502. 2023-02-10 19:03:20,154 INFO [Listener at localhost/37107] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,aaa,1676055796287.eca90e03b313fba8b7a1d6571ea05502. 2023-02-10 19:03:20,155 DEBUG [Listener at localhost/37107] regionserver.HRegion(1557): Region close journal for eca90e03b313fba8b7a1d6571ea05502: Waiting for close lock at 1676055800154Disabling compacts and flushes for region at 1676055800154Disabling writes for close at 1676055800154Writing region close event to WAL at 1676055800154Closed at 1676055800154 2023-02-10 19:03:20,155 DEBUG [Listener at localhost/37107] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,d\x84\x84,1676055796287.f8e2703c94874a9a6d0d1541b43c1eb3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-10 19:03:20,155 INFO [Listener at localhost/37107] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-10 19:03:20,156 DEBUG [Listener at localhost/37107] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-10 19:03:20,158 INFO [StoreOpener-f8e2703c94874a9a6d0d1541b43c1eb3-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region f8e2703c94874a9a6d0d1541b43c1eb3 2023-02-10 19:03:20,159 DEBUG [StoreOpener-f8e2703c94874a9a6d0d1541b43c1eb3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44513/user/jenkins/test-data/171bfff3-7974-3283-60d4-30ee0b6875b1/testWithMockedMapReduceMultiRegion/9d2ffd66-3e40-4722-a469-2ff5afd05a45/data/default/testWithMockedMapReduceMultiRegion/f8e2703c94874a9a6d0d1541b43c1eb3/f1 2023-02-10 19:03:20,159 INFO [StoreOpener-f8e2703c94874a9a6d0d1541b43c1eb3-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f8e2703c94874a9a6d0d1541b43c1eb3 columnFamilyName f1 2023-02-10 19:03:20,162 DEBUG [StoreOpener-f8e2703c94874a9a6d0d1541b43c1eb3-1] regionserver.HStore(539): loaded hdfs://localhost:44513/user/jenkins/test-data/171bfff3-7974-3283-60d4-30ee0b6875b1/testWithMockedMapReduceMultiRegion/9d2ffd66-3e40-4722-a469-2ff5afd05a45/data/default/testWithMockedMapReduceMultiRegion/f8e2703c94874a9a6d0d1541b43c1eb3/f1/testWithMockedMapReduceMultiRegion=f8e2703c94874a9a6d0d1541b43c1eb3-d9cb9fdd72484ad5887d21abdea99fc6 2023-02-10 19:03:20,162 INFO [StoreOpener-f8e2703c94874a9a6d0d1541b43c1eb3-1] regionserver.HStore(310): Store=f8e2703c94874a9a6d0d1541b43c1eb3/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-10 19:03:20,162 INFO [StoreOpener-f8e2703c94874a9a6d0d1541b43c1eb3-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region f8e2703c94874a9a6d0d1541b43c1eb3 2023-02-10 19:03:20,163 DEBUG [StoreOpener-f8e2703c94874a9a6d0d1541b43c1eb3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44513/user/jenkins/test-data/171bfff3-7974-3283-60d4-30ee0b6875b1/testWithMockedMapReduceMultiRegion/9d2ffd66-3e40-4722-a469-2ff5afd05a45/data/default/testWithMockedMapReduceMultiRegion/f8e2703c94874a9a6d0d1541b43c1eb3/f2 2023-02-10 19:03:20,163 INFO [StoreOpener-f8e2703c94874a9a6d0d1541b43c1eb3-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f8e2703c94874a9a6d0d1541b43c1eb3 columnFamilyName f2 2023-02-10 19:03:20,167 DEBUG [StoreOpener-f8e2703c94874a9a6d0d1541b43c1eb3-1] regionserver.HStore(539): loaded hdfs://localhost:44513/user/jenkins/test-data/171bfff3-7974-3283-60d4-30ee0b6875b1/testWithMockedMapReduceMultiRegion/9d2ffd66-3e40-4722-a469-2ff5afd05a45/data/default/testWithMockedMapReduceMultiRegion/f8e2703c94874a9a6d0d1541b43c1eb3/f2/testWithMockedMapReduceMultiRegion=f8e2703c94874a9a6d0d1541b43c1eb3-fa18b005bdb24003bc90c081e4bc0826 2023-02-10 19:03:20,167 INFO [StoreOpener-f8e2703c94874a9a6d0d1541b43c1eb3-1] regionserver.HStore(310): Store=f8e2703c94874a9a6d0d1541b43c1eb3/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-10 19:03:20,167 DEBUG [Listener at localhost/37107] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-10 19:03:20,167 INFO [Listener at localhost/37107] regionserver.HRegion(1071): Opened f8e2703c94874a9a6d0d1541b43c1eb3; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63587491, jitterRate=-0.0524725466966629}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-10 19:03:20,167 DEBUG [Listener at localhost/37107] regionserver.HRegion(964): Region open journal for f8e2703c94874a9a6d0d1541b43c1eb3: Writing region info on filesystem at 1676055800156Initializing all the Stores at 1676055800157 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676055800157Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676055800157Region opened successfully at 1676055800167 (+10 ms) 2023-02-10 19:03:20,175 DEBUG [Listener at localhost/37107] regionserver.HRegion(1603): Closing f8e2703c94874a9a6d0d1541b43c1eb3, disabling compactions & flushes 2023-02-10 19:03:20,177 INFO [Listener at localhost/37107] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,d\x84\x84,1676055796287.f8e2703c94874a9a6d0d1541b43c1eb3. 2023-02-10 19:03:20,177 DEBUG [Listener at localhost/37107] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,d\x84\x84,1676055796287.f8e2703c94874a9a6d0d1541b43c1eb3. 2023-02-10 19:03:20,177 DEBUG [Listener at localhost/37107] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,d\x84\x84,1676055796287.f8e2703c94874a9a6d0d1541b43c1eb3. after waiting 0 ms 2023-02-10 19:03:20,177 DEBUG [Listener at localhost/37107] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,d\x84\x84,1676055796287.f8e2703c94874a9a6d0d1541b43c1eb3. 2023-02-10 19:03:20,177 INFO [Listener at localhost/37107] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,d\x84\x84,1676055796287.f8e2703c94874a9a6d0d1541b43c1eb3. 2023-02-10 19:03:20,178 DEBUG [Listener at localhost/37107] regionserver.HRegion(1557): Region close journal for f8e2703c94874a9a6d0d1541b43c1eb3: Waiting for close lock at 1676055800175Disabling compacts and flushes for region at 1676055800175Disabling writes for close at 1676055800177 (+2 ms)Writing region close event to WAL at 1676055800177Closed at 1676055800177 2023-02-10 19:03:20,178 DEBUG [Listener at localhost/37107] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676055796287.6b4a925bbaa3b95421bfaa80da606099.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-10 19:03:20,178 INFO [Listener at localhost/37107] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-10 19:03:20,179 DEBUG [Listener at localhost/37107] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-10 19:03:20,181 INFO [StoreOpener-6b4a925bbaa3b95421bfaa80da606099-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 6b4a925bbaa3b95421bfaa80da606099 2023-02-10 19:03:20,182 DEBUG [StoreOpener-6b4a925bbaa3b95421bfaa80da606099-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44513/user/jenkins/test-data/171bfff3-7974-3283-60d4-30ee0b6875b1/testWithMockedMapReduceMultiRegion/9d2ffd66-3e40-4722-a469-2ff5afd05a45/data/default/testWithMockedMapReduceMultiRegion/6b4a925bbaa3b95421bfaa80da606099/f1 2023-02-10 19:03:20,182 INFO [StoreOpener-6b4a925bbaa3b95421bfaa80da606099-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6b4a925bbaa3b95421bfaa80da606099 columnFamilyName f1 2023-02-10 19:03:20,186 DEBUG [StoreOpener-6b4a925bbaa3b95421bfaa80da606099-1] regionserver.HStore(539): loaded hdfs://localhost:44513/user/jenkins/test-data/171bfff3-7974-3283-60d4-30ee0b6875b1/testWithMockedMapReduceMultiRegion/9d2ffd66-3e40-4722-a469-2ff5afd05a45/data/default/testWithMockedMapReduceMultiRegion/6b4a925bbaa3b95421bfaa80da606099/f1/testWithMockedMapReduceMultiRegion=6b4a925bbaa3b95421bfaa80da606099-b40c4c188cf84850af2e9f8cc89239b7 2023-02-10 19:03:20,186 INFO [StoreOpener-6b4a925bbaa3b95421bfaa80da606099-1] regionserver.HStore(310): Store=6b4a925bbaa3b95421bfaa80da606099/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-10 19:03:20,186 INFO [StoreOpener-6b4a925bbaa3b95421bfaa80da606099-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 6b4a925bbaa3b95421bfaa80da606099 2023-02-10 19:03:20,187 DEBUG [StoreOpener-6b4a925bbaa3b95421bfaa80da606099-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44513/user/jenkins/test-data/171bfff3-7974-3283-60d4-30ee0b6875b1/testWithMockedMapReduceMultiRegion/9d2ffd66-3e40-4722-a469-2ff5afd05a45/data/default/testWithMockedMapReduceMultiRegion/6b4a925bbaa3b95421bfaa80da606099/f2 2023-02-10 19:03:20,187 INFO [StoreOpener-6b4a925bbaa3b95421bfaa80da606099-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6b4a925bbaa3b95421bfaa80da606099 columnFamilyName f2 2023-02-10 19:03:20,191 DEBUG [StoreOpener-6b4a925bbaa3b95421bfaa80da606099-1] regionserver.HStore(539): loaded hdfs://localhost:44513/user/jenkins/test-data/171bfff3-7974-3283-60d4-30ee0b6875b1/testWithMockedMapReduceMultiRegion/9d2ffd66-3e40-4722-a469-2ff5afd05a45/data/default/testWithMockedMapReduceMultiRegion/6b4a925bbaa3b95421bfaa80da606099/f2/testWithMockedMapReduceMultiRegion=6b4a925bbaa3b95421bfaa80da606099-5784d0007aae4b6587c2605c3982f3e5 2023-02-10 19:03:20,191 INFO [StoreOpener-6b4a925bbaa3b95421bfaa80da606099-1] regionserver.HStore(310): Store=6b4a925bbaa3b95421bfaa80da606099/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-10 19:03:20,191 DEBUG [Listener at localhost/37107] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-10 19:03:20,191 INFO [Listener at localhost/37107] regionserver.HRegion(1071): Opened 6b4a925bbaa3b95421bfaa80da606099; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63589598, jitterRate=-0.052441149950027466}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-10 19:03:20,191 DEBUG [Listener at localhost/37107] regionserver.HRegion(964): Region open journal for 6b4a925bbaa3b95421bfaa80da606099: Writing region info on filesystem at 1676055800179Initializing all the Stores at 1676055800180 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676055800180Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676055800180Region opened successfully at 1676055800191 (+11 ms) 2023-02-10 19:03:20,199 DEBUG [Listener at localhost/37107] regionserver.HRegion(1603): Closing 6b4a925bbaa3b95421bfaa80da606099, disabling compactions & flushes 2023-02-10 19:03:20,199 INFO [Listener at localhost/37107] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676055796287.6b4a925bbaa3b95421bfaa80da606099. 2023-02-10 19:03:20,199 DEBUG [Listener at localhost/37107] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676055796287.6b4a925bbaa3b95421bfaa80da606099. 2023-02-10 19:03:20,199 DEBUG [Listener at localhost/37107] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676055796287.6b4a925bbaa3b95421bfaa80da606099. after waiting 0 ms 2023-02-10 19:03:20,199 DEBUG [Listener at localhost/37107] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676055796287.6b4a925bbaa3b95421bfaa80da606099. 2023-02-10 19:03:20,200 INFO [Listener at localhost/37107] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676055796287.6b4a925bbaa3b95421bfaa80da606099. 2023-02-10 19:03:20,200 DEBUG [Listener at localhost/37107] regionserver.HRegion(1557): Region close journal for 6b4a925bbaa3b95421bfaa80da606099: Waiting for close lock at 1676055800199Disabling compacts and flushes for region at 1676055800199Disabling writes for close at 1676055800199Writing region close event to WAL at 1676055800200 (+1 ms)Closed at 1676055800200 2023-02-10 19:03:20,201 DEBUG [Listener at localhost/37107] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,m\xED\xED,1676055796287.b324410564271f3c81fcd7c2326d0435.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-10 19:03:20,201 INFO [Listener at localhost/37107] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-10 19:03:20,202 DEBUG [Listener at localhost/37107] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-10 19:03:20,203 INFO [StoreOpener-b324410564271f3c81fcd7c2326d0435-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region b324410564271f3c81fcd7c2326d0435 2023-02-10 19:03:20,204 DEBUG [StoreOpener-b324410564271f3c81fcd7c2326d0435-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44513/user/jenkins/test-data/171bfff3-7974-3283-60d4-30ee0b6875b1/testWithMockedMapReduceMultiRegion/9d2ffd66-3e40-4722-a469-2ff5afd05a45/data/default/testWithMockedMapReduceMultiRegion/b324410564271f3c81fcd7c2326d0435/f1 2023-02-10 19:03:20,204 INFO [StoreOpener-b324410564271f3c81fcd7c2326d0435-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b324410564271f3c81fcd7c2326d0435 columnFamilyName f1 2023-02-10 19:03:20,208 DEBUG [StoreOpener-b324410564271f3c81fcd7c2326d0435-1] regionserver.HStore(539): loaded hdfs://localhost:44513/user/jenkins/test-data/171bfff3-7974-3283-60d4-30ee0b6875b1/testWithMockedMapReduceMultiRegion/9d2ffd66-3e40-4722-a469-2ff5afd05a45/data/default/testWithMockedMapReduceMultiRegion/b324410564271f3c81fcd7c2326d0435/f1/testWithMockedMapReduceMultiRegion=b324410564271f3c81fcd7c2326d0435-109ffb49435d4f9d8b2303143ce8c190 2023-02-10 19:03:20,208 INFO [StoreOpener-b324410564271f3c81fcd7c2326d0435-1] regionserver.HStore(310): Store=b324410564271f3c81fcd7c2326d0435/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-10 19:03:20,208 INFO [StoreOpener-b324410564271f3c81fcd7c2326d0435-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region b324410564271f3c81fcd7c2326d0435 2023-02-10 19:03:20,209 DEBUG [StoreOpener-b324410564271f3c81fcd7c2326d0435-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44513/user/jenkins/test-data/171bfff3-7974-3283-60d4-30ee0b6875b1/testWithMockedMapReduceMultiRegion/9d2ffd66-3e40-4722-a469-2ff5afd05a45/data/default/testWithMockedMapReduceMultiRegion/b324410564271f3c81fcd7c2326d0435/f2 2023-02-10 19:03:20,209 INFO [StoreOpener-b324410564271f3c81fcd7c2326d0435-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b324410564271f3c81fcd7c2326d0435 columnFamilyName f2 2023-02-10 19:03:20,212 DEBUG [StoreOpener-b324410564271f3c81fcd7c2326d0435-1] regionserver.HStore(539): loaded hdfs://localhost:44513/user/jenkins/test-data/171bfff3-7974-3283-60d4-30ee0b6875b1/testWithMockedMapReduceMultiRegion/9d2ffd66-3e40-4722-a469-2ff5afd05a45/data/default/testWithMockedMapReduceMultiRegion/b324410564271f3c81fcd7c2326d0435/f2/testWithMockedMapReduceMultiRegion=b324410564271f3c81fcd7c2326d0435-e3751b81f34246ada74148861c841aea 2023-02-10 19:03:20,212 INFO [StoreOpener-b324410564271f3c81fcd7c2326d0435-1] regionserver.HStore(310): Store=b324410564271f3c81fcd7c2326d0435/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-10 19:03:20,213 DEBUG [Listener at localhost/37107] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-10 19:03:20,213 INFO [Listener at localhost/37107] regionserver.HRegion(1071): Opened b324410564271f3c81fcd7c2326d0435; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59314093, jitterRate=-0.11615113914012909}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-10 19:03:20,213 DEBUG [Listener at localhost/37107] regionserver.HRegion(964): Region open journal for b324410564271f3c81fcd7c2326d0435: Writing region info on filesystem at 1676055800202Initializing all the Stores at 1676055800203 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676055800203Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676055800203Region opened successfully at 1676055800213 (+10 ms) 2023-02-10 19:03:20,220 DEBUG [Listener at localhost/37107] regionserver.HRegion(1603): Closing b324410564271f3c81fcd7c2326d0435, disabling compactions & flushes 2023-02-10 19:03:20,220 INFO [Listener at localhost/37107] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,m\xED\xED,1676055796287.b324410564271f3c81fcd7c2326d0435. 2023-02-10 19:03:20,220 DEBUG [Listener at localhost/37107] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,m\xED\xED,1676055796287.b324410564271f3c81fcd7c2326d0435. 2023-02-10 19:03:20,220 DEBUG [Listener at localhost/37107] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,m\xED\xED,1676055796287.b324410564271f3c81fcd7c2326d0435. after waiting 0 ms 2023-02-10 19:03:20,220 DEBUG [Listener at localhost/37107] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,m\xED\xED,1676055796287.b324410564271f3c81fcd7c2326d0435. 2023-02-10 19:03:20,221 INFO [Listener at localhost/37107] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,m\xED\xED,1676055796287.b324410564271f3c81fcd7c2326d0435. 2023-02-10 19:03:20,221 DEBUG [Listener at localhost/37107] regionserver.HRegion(1557): Region close journal for b324410564271f3c81fcd7c2326d0435: Waiting for close lock at 1676055800220Disabling compacts and flushes for region at 1676055800220Disabling writes for close at 1676055800220Writing region close event to WAL at 1676055800221 (+1 ms)Closed at 1676055800221 2023-02-10 19:03:20,222 DEBUG [Listener at localhost/37107] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,t43,1676055796287.54239cd4e87d877b10bac35ba4d2a8c8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-10 19:03:20,222 INFO [Listener at localhost/37107] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-10 19:03:20,223 DEBUG [Listener at localhost/37107] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-10 19:03:20,224 INFO [StoreOpener-54239cd4e87d877b10bac35ba4d2a8c8-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 54239cd4e87d877b10bac35ba4d2a8c8 2023-02-10 19:03:20,225 DEBUG [StoreOpener-54239cd4e87d877b10bac35ba4d2a8c8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44513/user/jenkins/test-data/171bfff3-7974-3283-60d4-30ee0b6875b1/testWithMockedMapReduceMultiRegion/9d2ffd66-3e40-4722-a469-2ff5afd05a45/data/default/testWithMockedMapReduceMultiRegion/54239cd4e87d877b10bac35ba4d2a8c8/f1 2023-02-10 19:03:20,225 INFO [StoreOpener-54239cd4e87d877b10bac35ba4d2a8c8-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 54239cd4e87d877b10bac35ba4d2a8c8 columnFamilyName f1 2023-02-10 19:03:20,229 DEBUG [StoreOpener-54239cd4e87d877b10bac35ba4d2a8c8-1] regionserver.HStore(539): loaded hdfs://localhost:44513/user/jenkins/test-data/171bfff3-7974-3283-60d4-30ee0b6875b1/testWithMockedMapReduceMultiRegion/9d2ffd66-3e40-4722-a469-2ff5afd05a45/data/default/testWithMockedMapReduceMultiRegion/54239cd4e87d877b10bac35ba4d2a8c8/f1/testWithMockedMapReduceMultiRegion=54239cd4e87d877b10bac35ba4d2a8c8-998ea972b9ba48cbbbdfc4c5644202c7 2023-02-10 19:03:20,229 INFO [StoreOpener-54239cd4e87d877b10bac35ba4d2a8c8-1] regionserver.HStore(310): Store=54239cd4e87d877b10bac35ba4d2a8c8/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-10 19:03:20,229 INFO [StoreOpener-54239cd4e87d877b10bac35ba4d2a8c8-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 54239cd4e87d877b10bac35ba4d2a8c8 2023-02-10 19:03:20,230 DEBUG [StoreOpener-54239cd4e87d877b10bac35ba4d2a8c8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44513/user/jenkins/test-data/171bfff3-7974-3283-60d4-30ee0b6875b1/testWithMockedMapReduceMultiRegion/9d2ffd66-3e40-4722-a469-2ff5afd05a45/data/default/testWithMockedMapReduceMultiRegion/54239cd4e87d877b10bac35ba4d2a8c8/f2 2023-02-10 19:03:20,230 INFO [StoreOpener-54239cd4e87d877b10bac35ba4d2a8c8-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 54239cd4e87d877b10bac35ba4d2a8c8 columnFamilyName f2 2023-02-10 19:03:20,233 DEBUG [StoreOpener-54239cd4e87d877b10bac35ba4d2a8c8-1] regionserver.HStore(539): loaded hdfs://localhost:44513/user/jenkins/test-data/171bfff3-7974-3283-60d4-30ee0b6875b1/testWithMockedMapReduceMultiRegion/9d2ffd66-3e40-4722-a469-2ff5afd05a45/data/default/testWithMockedMapReduceMultiRegion/54239cd4e87d877b10bac35ba4d2a8c8/f2/testWithMockedMapReduceMultiRegion=54239cd4e87d877b10bac35ba4d2a8c8-d23712496aef458b97ec335b1481382e 2023-02-10 19:03:20,234 INFO [StoreOpener-54239cd4e87d877b10bac35ba4d2a8c8-1] regionserver.HStore(310): Store=54239cd4e87d877b10bac35ba4d2a8c8/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-10 19:03:20,234 DEBUG [Listener at localhost/37107] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-10 19:03:20,234 INFO [Listener at localhost/37107] regionserver.HRegion(1071): Opened 54239cd4e87d877b10bac35ba4d2a8c8; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69796130, jitterRate=0.040043383836746216}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-10 19:03:20,234 DEBUG [Listener at localhost/37107] regionserver.HRegion(964): Region open journal for 54239cd4e87d877b10bac35ba4d2a8c8: Writing region info on filesystem at 1676055800223Initializing all the Stores at 1676055800224 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676055800224Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676055800224Region opened successfully at 1676055800234 (+10 ms) 2023-02-10 19:03:20,242 DEBUG [Listener at localhost/37107] regionserver.HRegion(1603): Closing 54239cd4e87d877b10bac35ba4d2a8c8, disabling compactions & flushes 2023-02-10 19:03:20,242 INFO [Listener at localhost/37107] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,t43,1676055796287.54239cd4e87d877b10bac35ba4d2a8c8. 2023-02-10 19:03:20,242 DEBUG [Listener at localhost/37107] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,t43,1676055796287.54239cd4e87d877b10bac35ba4d2a8c8. 2023-02-10 19:03:20,242 DEBUG [Listener at localhost/37107] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,t43,1676055796287.54239cd4e87d877b10bac35ba4d2a8c8. after waiting 0 ms 2023-02-10 19:03:20,242 DEBUG [Listener at localhost/37107] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,t43,1676055796287.54239cd4e87d877b10bac35ba4d2a8c8. 2023-02-10 19:03:20,243 INFO [Listener at localhost/37107] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,t43,1676055796287.54239cd4e87d877b10bac35ba4d2a8c8. 2023-02-10 19:03:20,243 DEBUG [Listener at localhost/37107] regionserver.HRegion(1557): Region close journal for 54239cd4e87d877b10bac35ba4d2a8c8: Waiting for close lock at 1676055800242Disabling compacts and flushes for region at 1676055800242Disabling writes for close at 1676055800242Writing region close event to WAL at 1676055800243 (+1 ms)Closed at 1676055800243 2023-02-10 19:03:20,243 DEBUG [Listener at localhost/37107] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,zz{,1676055796287.ca626b09070f3e18c31fb632b018370f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-10 19:03:20,243 INFO [Listener at localhost/37107] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-10 19:03:20,245 DEBUG [Listener at localhost/37107] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-10 19:03:20,246 INFO [StoreOpener-ca626b09070f3e18c31fb632b018370f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region ca626b09070f3e18c31fb632b018370f 2023-02-10 19:03:20,248 DEBUG [StoreOpener-ca626b09070f3e18c31fb632b018370f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44513/user/jenkins/test-data/171bfff3-7974-3283-60d4-30ee0b6875b1/testWithMockedMapReduceMultiRegion/9d2ffd66-3e40-4722-a469-2ff5afd05a45/data/default/testWithMockedMapReduceMultiRegion/ca626b09070f3e18c31fb632b018370f/f1 2023-02-10 19:03:20,248 INFO [StoreOpener-ca626b09070f3e18c31fb632b018370f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ca626b09070f3e18c31fb632b018370f columnFamilyName f1 2023-02-10 19:03:20,248 INFO [StoreOpener-ca626b09070f3e18c31fb632b018370f-1] regionserver.HStore(310): Store=ca626b09070f3e18c31fb632b018370f/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-10 19:03:20,248 INFO [StoreOpener-ca626b09070f3e18c31fb632b018370f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region ca626b09070f3e18c31fb632b018370f 2023-02-10 19:03:20,249 DEBUG [StoreOpener-ca626b09070f3e18c31fb632b018370f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44513/user/jenkins/test-data/171bfff3-7974-3283-60d4-30ee0b6875b1/testWithMockedMapReduceMultiRegion/9d2ffd66-3e40-4722-a469-2ff5afd05a45/data/default/testWithMockedMapReduceMultiRegion/ca626b09070f3e18c31fb632b018370f/f2 2023-02-10 19:03:20,250 INFO [StoreOpener-ca626b09070f3e18c31fb632b018370f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ca626b09070f3e18c31fb632b018370f columnFamilyName f2 2023-02-10 19:03:20,250 INFO [StoreOpener-ca626b09070f3e18c31fb632b018370f-1] regionserver.HStore(310): Store=ca626b09070f3e18c31fb632b018370f/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-10 19:03:20,250 DEBUG [Listener at localhost/37107] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-10 19:03:20,250 INFO [Listener at localhost/37107] regionserver.HRegion(1071): Opened ca626b09070f3e18c31fb632b018370f; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68491755, jitterRate=0.02060668170452118}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-10 19:03:20,250 DEBUG [Listener at localhost/37107] regionserver.HRegion(964): Region open journal for ca626b09070f3e18c31fb632b018370f: Writing region info on filesystem at 1676055800245Initializing all the Stores at 1676055800246 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676055800246Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676055800246Region opened successfully at 1676055800250 (+4 ms) 2023-02-10 19:03:20,250 DEBUG [Listener at localhost/37107] regionserver.HRegion(1603): Closing ca626b09070f3e18c31fb632b018370f, disabling compactions & flushes 2023-02-10 19:03:20,250 INFO [Listener at localhost/37107] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,zz{,1676055796287.ca626b09070f3e18c31fb632b018370f. 2023-02-10 19:03:20,250 DEBUG [Listener at localhost/37107] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,zz{,1676055796287.ca626b09070f3e18c31fb632b018370f. 2023-02-10 19:03:20,251 DEBUG [Listener at localhost/37107] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,zz{,1676055796287.ca626b09070f3e18c31fb632b018370f. after waiting 0 ms 2023-02-10 19:03:20,251 DEBUG [Listener at localhost/37107] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,zz{,1676055796287.ca626b09070f3e18c31fb632b018370f. 2023-02-10 19:03:20,251 INFO [Listener at localhost/37107] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,zz{,1676055796287.ca626b09070f3e18c31fb632b018370f. 2023-02-10 19:03:20,251 DEBUG [Listener at localhost/37107] regionserver.HRegion(1557): Region close journal for ca626b09070f3e18c31fb632b018370f: Waiting for close lock at 1676055800250Disabling compacts and flushes for region at 1676055800250Disabling writes for close at 1676055800251 (+1 ms)Writing region close event to WAL at 1676055800251Closed at 1676055800251 2023-02-10 19:03:20,256 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33383] master.MasterRpcServices(748): Client=jenkins//172.31.14.131 delete name: "testWithMockedMapReduceMultiRegion" 2023-02-10 19:03:20,258 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33383] snapshot.SnapshotManager(333): Deleting snapshot: testWithMockedMapReduceMultiRegion 2023-02-10 19:03:20,259 INFO [Listener at localhost/37107] client.HBaseAdmin$15(890): Started disable of testWithMockedMapReduceMultiRegion 2023-02-10 19:03:20,260 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33383] master.HMaster$11(2405): Client=jenkins//172.31.14.131 disable testWithMockedMapReduceMultiRegion 2023-02-10 19:03:20,261 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33383] procedure2.ProcedureExecutor(1029): Stored pid=33, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testWithMockedMapReduceMultiRegion 2023-02-10 19:03:20,263 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33383] master.MasterRpcServices(1227): Checking to see if procedure is done pid=33 2023-02-10 19:03:20,263 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676055800263"}]},"ts":"1676055800263"} 2023-02-10 19:03:20,264 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testWithMockedMapReduceMultiRegion, state=DISABLING in hbase:meta 2023-02-10 19:03:20,333 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testWithMockedMapReduceMultiRegion to state=DISABLING 2023-02-10 19:03:20,334 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=34, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=2fd40e0179a0e968c4672055c041d740, UNASSIGN}, {pid=35, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=eca90e03b313fba8b7a1d6571ea05502, UNASSIGN}, {pid=36, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=f8e2703c94874a9a6d0d1541b43c1eb3, UNASSIGN}, {pid=37, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=6b4a925bbaa3b95421bfaa80da606099, UNASSIGN}, {pid=38, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=08e6594f21fdd814bfb7b05ba0f4191b, UNASSIGN}, {pid=39, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=b324410564271f3c81fcd7c2326d0435, UNASSIGN}, {pid=40, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=4539b623282fa7d2beb504c373ad6181, UNASSIGN}, {pid=41, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=54239cd4e87d877b10bac35ba4d2a8c8, UNASSIGN}, {pid=42, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=bc3dafb6d0db6c740ff9583526924864, UNASSIGN}, {pid=43, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=ca626b09070f3e18c31fb632b018370f, UNASSIGN}] 2023-02-10 19:03:20,336 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=36, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=f8e2703c94874a9a6d0d1541b43c1eb3, UNASSIGN 2023-02-10 19:03:20,336 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=35, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=eca90e03b313fba8b7a1d6571ea05502, UNASSIGN 2023-02-10 19:03:20,336 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=37, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=6b4a925bbaa3b95421bfaa80da606099, UNASSIGN 2023-02-10 19:03:20,336 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=38, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=08e6594f21fdd814bfb7b05ba0f4191b, UNASSIGN 2023-02-10 19:03:20,336 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=43, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=ca626b09070f3e18c31fb632b018370f, UNASSIGN 2023-02-10 19:03:20,337 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=36 updating hbase:meta row=f8e2703c94874a9a6d0d1541b43c1eb3, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,35891,1676055795020 2023-02-10 19:03:20,337 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,d\\x84\\x84,1676055796287.f8e2703c94874a9a6d0d1541b43c1eb3.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676055800336"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676055800336"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676055800336"}]},"ts":"1676055800336"} 2023-02-10 19:03:20,337 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=35 updating hbase:meta row=eca90e03b313fba8b7a1d6571ea05502, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,35891,1676055795020 2023-02-10 19:03:20,337 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=08e6594f21fdd814bfb7b05ba0f4191b, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,35891,1676055795020 2023-02-10 19:03:20,337 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=6b4a925bbaa3b95421bfaa80da606099, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,44697,1676055795050 2023-02-10 19:03:20,337 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=ca626b09070f3e18c31fb632b018370f, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,44697,1676055795050 2023-02-10 19:03:20,337 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,g\\xA7\\xA7,1676055796287.6b4a925bbaa3b95421bfaa80da606099.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676055800337"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676055800337"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676055800337"}]},"ts":"1676055800337"} 2023-02-10 19:03:20,337 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,zz{,1676055796287.ca626b09070f3e18c31fb632b018370f.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1676055800337"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676055800337"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676055800337"}]},"ts":"1676055800337"} 2023-02-10 19:03:20,337 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,aaa,1676055796287.eca90e03b313fba8b7a1d6571ea05502.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676055800337"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676055800337"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676055800337"}]},"ts":"1676055800337"} 2023-02-10 19:03:20,337 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,j\\xCA\\xCA,1676055796287.08e6594f21fdd814bfb7b05ba0f4191b.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676055800337"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676055800337"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676055800337"}]},"ts":"1676055800337"} 2023-02-10 19:03:20,338 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=44, ppid=36, state=RUNNABLE; CloseRegionProcedure f8e2703c94874a9a6d0d1541b43c1eb3, server=jenkins-hbase4.apache.org,35891,1676055795020}] 2023-02-10 19:03:20,339 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=45, ppid=37, state=RUNNABLE; CloseRegionProcedure 6b4a925bbaa3b95421bfaa80da606099, server=jenkins-hbase4.apache.org,44697,1676055795050}] 2023-02-10 19:03:20,340 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=46, ppid=43, state=RUNNABLE; CloseRegionProcedure ca626b09070f3e18c31fb632b018370f, server=jenkins-hbase4.apache.org,44697,1676055795050}] 2023-02-10 19:03:20,341 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=47, ppid=35, state=RUNNABLE; CloseRegionProcedure eca90e03b313fba8b7a1d6571ea05502, server=jenkins-hbase4.apache.org,35891,1676055795020}] 2023-02-10 19:03:20,341 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=48, ppid=38, state=RUNNABLE; CloseRegionProcedure 08e6594f21fdd814bfb7b05ba0f4191b, server=jenkins-hbase4.apache.org,35891,1676055795020}] 2023-02-10 19:03:20,341 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=42, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=bc3dafb6d0db6c740ff9583526924864, UNASSIGN 2023-02-10 19:03:20,342 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=41, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=54239cd4e87d877b10bac35ba4d2a8c8, UNASSIGN 2023-02-10 19:03:20,342 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=42 updating hbase:meta row=bc3dafb6d0db6c740ff9583526924864, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,35891,1676055795020 2023-02-10 19:03:20,342 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,wWV,1676055796287.bc3dafb6d0db6c740ff9583526924864.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676055800342"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676055800342"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676055800342"}]},"ts":"1676055800342"} 2023-02-10 19:03:20,343 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=40, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=4539b623282fa7d2beb504c373ad6181, UNASSIGN 2023-02-10 19:03:20,343 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=41 updating hbase:meta row=54239cd4e87d877b10bac35ba4d2a8c8, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,44697,1676055795050 2023-02-10 19:03:20,343 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,t43,1676055796287.54239cd4e87d877b10bac35ba4d2a8c8.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676055800343"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676055800343"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676055800343"}]},"ts":"1676055800343"} 2023-02-10 19:03:20,343 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=40 updating hbase:meta row=4539b623282fa7d2beb504c373ad6181, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,35891,1676055795020 2023-02-10 19:03:20,343 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=39, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=b324410564271f3c81fcd7c2326d0435, UNASSIGN 2023-02-10 19:03:20,343 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,q\\x11\\x10,1676055796287.4539b623282fa7d2beb504c373ad6181.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676055800343"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676055800343"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676055800343"}]},"ts":"1676055800343"} 2023-02-10 19:03:20,344 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=49, ppid=42, state=RUNNABLE; CloseRegionProcedure bc3dafb6d0db6c740ff9583526924864, server=jenkins-hbase4.apache.org,35891,1676055795020}] 2023-02-10 19:03:20,344 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=34, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=2fd40e0179a0e968c4672055c041d740, UNASSIGN 2023-02-10 19:03:20,344 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=39 updating hbase:meta row=b324410564271f3c81fcd7c2326d0435, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,44697,1676055795050 2023-02-10 19:03:20,344 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,m\\xED\\xED,1676055796287.b324410564271f3c81fcd7c2326d0435.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676055800344"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676055800344"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676055800344"}]},"ts":"1676055800344"} 2023-02-10 19:03:20,345 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=50, ppid=41, state=RUNNABLE; CloseRegionProcedure 54239cd4e87d877b10bac35ba4d2a8c8, server=jenkins-hbase4.apache.org,44697,1676055795050}] 2023-02-10 19:03:20,345 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=34 updating hbase:meta row=2fd40e0179a0e968c4672055c041d740, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,44697,1676055795050 2023-02-10 19:03:20,345 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,,1676055796287.2fd40e0179a0e968c4672055c041d740.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1676055800345"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676055800345"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676055800345"}]},"ts":"1676055800345"} 2023-02-10 19:03:20,345 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=51, ppid=40, state=RUNNABLE; CloseRegionProcedure 4539b623282fa7d2beb504c373ad6181, server=jenkins-hbase4.apache.org,35891,1676055795020}] 2023-02-10 19:03:20,349 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=52, ppid=39, state=RUNNABLE; CloseRegionProcedure b324410564271f3c81fcd7c2326d0435, server=jenkins-hbase4.apache.org,44697,1676055795050}] 2023-02-10 19:03:20,349 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=53, ppid=34, state=RUNNABLE; CloseRegionProcedure 2fd40e0179a0e968c4672055c041d740, server=jenkins-hbase4.apache.org,44697,1676055795050}] 2023-02-10 19:03:20,364 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33383] master.MasterRpcServices(1227): Checking to see if procedure is done pid=33 2023-02-10 19:03:20,491 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close f8e2703c94874a9a6d0d1541b43c1eb3 2023-02-10 19:03:20,491 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close ca626b09070f3e18c31fb632b018370f 2023-02-10 19:03:20,491 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing f8e2703c94874a9a6d0d1541b43c1eb3, disabling compactions & flushes 2023-02-10 19:03:20,491 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing ca626b09070f3e18c31fb632b018370f, disabling compactions & flushes 2023-02-10 19:03:20,491 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,d\x84\x84,1676055796287.f8e2703c94874a9a6d0d1541b43c1eb3. 2023-02-10 19:03:20,492 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,zz{,1676055796287.ca626b09070f3e18c31fb632b018370f. 2023-02-10 19:03:20,492 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,zz{,1676055796287.ca626b09070f3e18c31fb632b018370f. 2023-02-10 19:03:20,492 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,d\x84\x84,1676055796287.f8e2703c94874a9a6d0d1541b43c1eb3. 2023-02-10 19:03:20,492 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,zz{,1676055796287.ca626b09070f3e18c31fb632b018370f. after waiting 0 ms 2023-02-10 19:03:20,492 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,zz{,1676055796287.ca626b09070f3e18c31fb632b018370f. 2023-02-10 19:03:20,492 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,d\x84\x84,1676055796287.f8e2703c94874a9a6d0d1541b43c1eb3. after waiting 0 ms 2023-02-10 19:03:20,492 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,d\x84\x84,1676055796287.f8e2703c94874a9a6d0d1541b43c1eb3. 2023-02-10 19:03:20,495 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/data/default/testWithMockedMapReduceMultiRegion/ca626b09070f3e18c31fb632b018370f/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-02-10 19:03:20,495 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/data/default/testWithMockedMapReduceMultiRegion/f8e2703c94874a9a6d0d1541b43c1eb3/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-10 19:03:20,496 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,zz{,1676055796287.ca626b09070f3e18c31fb632b018370f. 2023-02-10 19:03:20,496 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,d\x84\x84,1676055796287.f8e2703c94874a9a6d0d1541b43c1eb3. 2023-02-10 19:03:20,496 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for ca626b09070f3e18c31fb632b018370f: Waiting for close lock at 1676055800491Running coprocessor pre-close hooks at 1676055800491Disabling compacts and flushes for region at 1676055800491Disabling writes for close at 1676055800492 (+1 ms)Writing region close event to WAL at 1676055800492Running coprocessor post-close hooks at 1676055800495 (+3 ms)Closed at 1676055800496 (+1 ms) 2023-02-10 19:03:20,496 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for f8e2703c94874a9a6d0d1541b43c1eb3: Waiting for close lock at 1676055800491Running coprocessor pre-close hooks at 1676055800491Disabling compacts and flushes for region at 1676055800491Disabling writes for close at 1676055800492 (+1 ms)Writing region close event to WAL at 1676055800492Running coprocessor post-close hooks at 1676055800496 (+4 ms)Closed at 1676055800496 2023-02-10 19:03:20,497 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed ca626b09070f3e18c31fb632b018370f 2023-02-10 19:03:20,497 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 54239cd4e87d877b10bac35ba4d2a8c8 2023-02-10 19:03:20,497 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 54239cd4e87d877b10bac35ba4d2a8c8, disabling compactions & flushes 2023-02-10 19:03:20,497 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,t43,1676055796287.54239cd4e87d877b10bac35ba4d2a8c8. 2023-02-10 19:03:20,497 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,t43,1676055796287.54239cd4e87d877b10bac35ba4d2a8c8. 2023-02-10 19:03:20,497 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,t43,1676055796287.54239cd4e87d877b10bac35ba4d2a8c8. after waiting 0 ms 2023-02-10 19:03:20,497 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,t43,1676055796287.54239cd4e87d877b10bac35ba4d2a8c8. 2023-02-10 19:03:20,497 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=ca626b09070f3e18c31fb632b018370f, regionState=CLOSED 2023-02-10 19:03:20,497 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,zz{,1676055796287.ca626b09070f3e18c31fb632b018370f.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1676055800497"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676055800497"}]},"ts":"1676055800497"} 2023-02-10 19:03:20,498 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed f8e2703c94874a9a6d0d1541b43c1eb3 2023-02-10 19:03:20,498 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close eca90e03b313fba8b7a1d6571ea05502 2023-02-10 19:03:20,498 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing eca90e03b313fba8b7a1d6571ea05502, disabling compactions & flushes 2023-02-10 19:03:20,498 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,aaa,1676055796287.eca90e03b313fba8b7a1d6571ea05502. 2023-02-10 19:03:20,498 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,aaa,1676055796287.eca90e03b313fba8b7a1d6571ea05502. 2023-02-10 19:03:20,498 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,aaa,1676055796287.eca90e03b313fba8b7a1d6571ea05502. after waiting 0 ms 2023-02-10 19:03:20,498 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,aaa,1676055796287.eca90e03b313fba8b7a1d6571ea05502. 2023-02-10 19:03:20,498 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=36 updating hbase:meta row=f8e2703c94874a9a6d0d1541b43c1eb3, regionState=CLOSED 2023-02-10 19:03:20,498 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,d\\x84\\x84,1676055796287.f8e2703c94874a9a6d0d1541b43c1eb3.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676055800498"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676055800498"}]},"ts":"1676055800498"} 2023-02-10 19:03:20,501 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=46, resume processing ppid=43 2023-02-10 19:03:20,501 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=46, ppid=43, state=SUCCESS; CloseRegionProcedure ca626b09070f3e18c31fb632b018370f, server=jenkins-hbase4.apache.org,44697,1676055795050 in 160 msec 2023-02-10 19:03:20,501 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=44, resume processing ppid=36 2023-02-10 19:03:20,501 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=44, ppid=36, state=SUCCESS; CloseRegionProcedure f8e2703c94874a9a6d0d1541b43c1eb3, server=jenkins-hbase4.apache.org,35891,1676055795020 in 162 msec 2023-02-10 19:03:20,502 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/data/default/testWithMockedMapReduceMultiRegion/eca90e03b313fba8b7a1d6571ea05502/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-10 19:03:20,502 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,aaa,1676055796287.eca90e03b313fba8b7a1d6571ea05502. 2023-02-10 19:03:20,502 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for eca90e03b313fba8b7a1d6571ea05502: Waiting for close lock at 1676055800498Running coprocessor pre-close hooks at 1676055800498Disabling compacts and flushes for region at 1676055800498Disabling writes for close at 1676055800498Writing region close event to WAL at 1676055800499 (+1 ms)Running coprocessor post-close hooks at 1676055800502 (+3 ms)Closed at 1676055800502 2023-02-10 19:03:20,502 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=43, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=ca626b09070f3e18c31fb632b018370f, UNASSIGN in 167 msec 2023-02-10 19:03:20,503 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/data/default/testWithMockedMapReduceMultiRegion/54239cd4e87d877b10bac35ba4d2a8c8/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-10 19:03:20,503 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=36, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=f8e2703c94874a9a6d0d1541b43c1eb3, UNASSIGN in 167 msec 2023-02-10 19:03:20,503 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,t43,1676055796287.54239cd4e87d877b10bac35ba4d2a8c8. 2023-02-10 19:03:20,503 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed eca90e03b313fba8b7a1d6571ea05502 2023-02-10 19:03:20,503 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 54239cd4e87d877b10bac35ba4d2a8c8: Waiting for close lock at 1676055800497Running coprocessor pre-close hooks at 1676055800497Disabling compacts and flushes for region at 1676055800497Disabling writes for close at 1676055800497Writing region close event to WAL at 1676055800498 (+1 ms)Running coprocessor post-close hooks at 1676055800503 (+5 ms)Closed at 1676055800503 2023-02-10 19:03:20,503 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 08e6594f21fdd814bfb7b05ba0f4191b 2023-02-10 19:03:20,503 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 08e6594f21fdd814bfb7b05ba0f4191b, disabling compactions & flushes 2023-02-10 19:03:20,503 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676055796287.08e6594f21fdd814bfb7b05ba0f4191b. 2023-02-10 19:03:20,504 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676055796287.08e6594f21fdd814bfb7b05ba0f4191b. 2023-02-10 19:03:20,504 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676055796287.08e6594f21fdd814bfb7b05ba0f4191b. after waiting 0 ms 2023-02-10 19:03:20,504 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676055796287.08e6594f21fdd814bfb7b05ba0f4191b. 2023-02-10 19:03:20,504 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=35 updating hbase:meta row=eca90e03b313fba8b7a1d6571ea05502, regionState=CLOSED 2023-02-10 19:03:20,504 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,aaa,1676055796287.eca90e03b313fba8b7a1d6571ea05502.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676055800504"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676055800504"}]},"ts":"1676055800504"} 2023-02-10 19:03:20,505 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 54239cd4e87d877b10bac35ba4d2a8c8 2023-02-10 19:03:20,505 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close b324410564271f3c81fcd7c2326d0435 2023-02-10 19:03:20,505 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing b324410564271f3c81fcd7c2326d0435, disabling compactions & flushes 2023-02-10 19:03:20,505 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,m\xED\xED,1676055796287.b324410564271f3c81fcd7c2326d0435. 2023-02-10 19:03:20,505 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,m\xED\xED,1676055796287.b324410564271f3c81fcd7c2326d0435. 2023-02-10 19:03:20,505 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,m\xED\xED,1676055796287.b324410564271f3c81fcd7c2326d0435. after waiting 0 ms 2023-02-10 19:03:20,505 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,m\xED\xED,1676055796287.b324410564271f3c81fcd7c2326d0435. 2023-02-10 19:03:20,506 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=41 updating hbase:meta row=54239cd4e87d877b10bac35ba4d2a8c8, regionState=CLOSED 2023-02-10 19:03:20,506 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,t43,1676055796287.54239cd4e87d877b10bac35ba4d2a8c8.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676055800506"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676055800506"}]},"ts":"1676055800506"} 2023-02-10 19:03:20,507 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=47, resume processing ppid=35 2023-02-10 19:03:20,507 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=47, ppid=35, state=SUCCESS; CloseRegionProcedure eca90e03b313fba8b7a1d6571ea05502, server=jenkins-hbase4.apache.org,35891,1676055795020 in 165 msec 2023-02-10 19:03:20,508 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/data/default/testWithMockedMapReduceMultiRegion/08e6594f21fdd814bfb7b05ba0f4191b/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-10 19:03:20,509 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=35, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=eca90e03b313fba8b7a1d6571ea05502, UNASSIGN in 173 msec 2023-02-10 19:03:20,509 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=50, resume processing ppid=41 2023-02-10 19:03:20,509 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676055796287.08e6594f21fdd814bfb7b05ba0f4191b. 2023-02-10 19:03:20,509 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=50, ppid=41, state=SUCCESS; CloseRegionProcedure 54239cd4e87d877b10bac35ba4d2a8c8, server=jenkins-hbase4.apache.org,44697,1676055795050 in 162 msec 2023-02-10 19:03:20,509 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 08e6594f21fdd814bfb7b05ba0f4191b: Waiting for close lock at 1676055800503Running coprocessor pre-close hooks at 1676055800503Disabling compacts and flushes for region at 1676055800503Disabling writes for close at 1676055800504 (+1 ms)Writing region close event to WAL at 1676055800505 (+1 ms)Running coprocessor post-close hooks at 1676055800509 (+4 ms)Closed at 1676055800509 2023-02-10 19:03:20,510 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=41, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=54239cd4e87d877b10bac35ba4d2a8c8, UNASSIGN in 175 msec 2023-02-10 19:03:20,510 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 08e6594f21fdd814bfb7b05ba0f4191b 2023-02-10 19:03:20,510 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close bc3dafb6d0db6c740ff9583526924864 2023-02-10 19:03:20,510 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing bc3dafb6d0db6c740ff9583526924864, disabling compactions & flushes 2023-02-10 19:03:20,510 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,wWV,1676055796287.bc3dafb6d0db6c740ff9583526924864. 2023-02-10 19:03:20,510 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,wWV,1676055796287.bc3dafb6d0db6c740ff9583526924864. 2023-02-10 19:03:20,511 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,wWV,1676055796287.bc3dafb6d0db6c740ff9583526924864. after waiting 0 ms 2023-02-10 19:03:20,511 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,wWV,1676055796287.bc3dafb6d0db6c740ff9583526924864. 2023-02-10 19:03:20,511 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=08e6594f21fdd814bfb7b05ba0f4191b, regionState=CLOSED 2023-02-10 19:03:20,511 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,j\\xCA\\xCA,1676055796287.08e6594f21fdd814bfb7b05ba0f4191b.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676055800511"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676055800511"}]},"ts":"1676055800511"} 2023-02-10 19:03:20,512 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/data/default/testWithMockedMapReduceMultiRegion/b324410564271f3c81fcd7c2326d0435/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-10 19:03:20,513 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,m\xED\xED,1676055796287.b324410564271f3c81fcd7c2326d0435. 2023-02-10 19:03:20,513 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for b324410564271f3c81fcd7c2326d0435: Waiting for close lock at 1676055800505Running coprocessor pre-close hooks at 1676055800505Disabling compacts and flushes for region at 1676055800505Disabling writes for close at 1676055800505Writing region close event to WAL at 1676055800509 (+4 ms)Running coprocessor post-close hooks at 1676055800513 (+4 ms)Closed at 1676055800513 2023-02-10 19:03:20,513 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=48, resume processing ppid=38 2023-02-10 19:03:20,513 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=48, ppid=38, state=SUCCESS; CloseRegionProcedure 08e6594f21fdd814bfb7b05ba0f4191b, server=jenkins-hbase4.apache.org,35891,1676055795020 in 171 msec 2023-02-10 19:03:20,515 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed b324410564271f3c81fcd7c2326d0435 2023-02-10 19:03:20,515 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=38, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=08e6594f21fdd814bfb7b05ba0f4191b, UNASSIGN in 179 msec 2023-02-10 19:03:20,515 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 2fd40e0179a0e968c4672055c041d740 2023-02-10 19:03:20,515 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 2fd40e0179a0e968c4672055c041d740, disabling compactions & flushes 2023-02-10 19:03:20,515 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,,1676055796287.2fd40e0179a0e968c4672055c041d740. 2023-02-10 19:03:20,515 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,,1676055796287.2fd40e0179a0e968c4672055c041d740. 2023-02-10 19:03:20,515 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,,1676055796287.2fd40e0179a0e968c4672055c041d740. after waiting 0 ms 2023-02-10 19:03:20,515 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,,1676055796287.2fd40e0179a0e968c4672055c041d740. 2023-02-10 19:03:20,515 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=39 updating hbase:meta row=b324410564271f3c81fcd7c2326d0435, regionState=CLOSED 2023-02-10 19:03:20,515 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,m\\xED\\xED,1676055796287.b324410564271f3c81fcd7c2326d0435.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676055800515"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676055800515"}]},"ts":"1676055800515"} 2023-02-10 19:03:20,516 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/data/default/testWithMockedMapReduceMultiRegion/bc3dafb6d0db6c740ff9583526924864/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-10 19:03:20,516 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,wWV,1676055796287.bc3dafb6d0db6c740ff9583526924864. 2023-02-10 19:03:20,516 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for bc3dafb6d0db6c740ff9583526924864: Waiting for close lock at 1676055800510Running coprocessor pre-close hooks at 1676055800510Disabling compacts and flushes for region at 1676055800510Disabling writes for close at 1676055800511 (+1 ms)Writing region close event to WAL at 1676055800513 (+2 ms)Running coprocessor post-close hooks at 1676055800516 (+3 ms)Closed at 1676055800516 2023-02-10 19:03:20,518 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed bc3dafb6d0db6c740ff9583526924864 2023-02-10 19:03:20,518 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 4539b623282fa7d2beb504c373ad6181 2023-02-10 19:03:20,518 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 4539b623282fa7d2beb504c373ad6181, disabling compactions & flushes 2023-02-10 19:03:20,518 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,q\x11\x10,1676055796287.4539b623282fa7d2beb504c373ad6181. 2023-02-10 19:03:20,518 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,q\x11\x10,1676055796287.4539b623282fa7d2beb504c373ad6181. 2023-02-10 19:03:20,518 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,q\x11\x10,1676055796287.4539b623282fa7d2beb504c373ad6181. after waiting 0 ms 2023-02-10 19:03:20,518 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,q\x11\x10,1676055796287.4539b623282fa7d2beb504c373ad6181. 2023-02-10 19:03:20,518 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=52, resume processing ppid=39 2023-02-10 19:03:20,518 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=42 updating hbase:meta row=bc3dafb6d0db6c740ff9583526924864, regionState=CLOSED 2023-02-10 19:03:20,518 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=52, ppid=39, state=SUCCESS; CloseRegionProcedure b324410564271f3c81fcd7c2326d0435, server=jenkins-hbase4.apache.org,44697,1676055795050 in 170 msec 2023-02-10 19:03:20,518 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/data/default/testWithMockedMapReduceMultiRegion/2fd40e0179a0e968c4672055c041d740/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-02-10 19:03:20,518 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,wWV,1676055796287.bc3dafb6d0db6c740ff9583526924864.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676055800518"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676055800518"}]},"ts":"1676055800518"} 2023-02-10 19:03:20,519 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,,1676055796287.2fd40e0179a0e968c4672055c041d740. 2023-02-10 19:03:20,519 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 2fd40e0179a0e968c4672055c041d740: Waiting for close lock at 1676055800515Running coprocessor pre-close hooks at 1676055800515Disabling compacts and flushes for region at 1676055800515Disabling writes for close at 1676055800515Writing region close event to WAL at 1676055800515Running coprocessor post-close hooks at 1676055800519 (+4 ms)Closed at 1676055800519 2023-02-10 19:03:20,520 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=39, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=b324410564271f3c81fcd7c2326d0435, UNASSIGN in 184 msec 2023-02-10 19:03:20,520 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 2fd40e0179a0e968c4672055c041d740 2023-02-10 19:03:20,520 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 6b4a925bbaa3b95421bfaa80da606099 2023-02-10 19:03:20,520 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 6b4a925bbaa3b95421bfaa80da606099, disabling compactions & flushes 2023-02-10 19:03:20,520 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676055796287.6b4a925bbaa3b95421bfaa80da606099. 2023-02-10 19:03:20,520 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676055796287.6b4a925bbaa3b95421bfaa80da606099. 2023-02-10 19:03:20,520 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676055796287.6b4a925bbaa3b95421bfaa80da606099. after waiting 0 ms 2023-02-10 19:03:20,520 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676055796287.6b4a925bbaa3b95421bfaa80da606099. 2023-02-10 19:03:20,520 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=34 updating hbase:meta row=2fd40e0179a0e968c4672055c041d740, regionState=CLOSED 2023-02-10 19:03:20,521 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,,1676055796287.2fd40e0179a0e968c4672055c041d740.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1676055800520"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676055800520"}]},"ts":"1676055800520"} 2023-02-10 19:03:20,521 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=49, resume processing ppid=42 2023-02-10 19:03:20,521 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=49, ppid=42, state=SUCCESS; CloseRegionProcedure bc3dafb6d0db6c740ff9583526924864, server=jenkins-hbase4.apache.org,35891,1676055795020 in 176 msec 2023-02-10 19:03:20,522 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/data/default/testWithMockedMapReduceMultiRegion/4539b623282fa7d2beb504c373ad6181/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-10 19:03:20,523 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=42, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=bc3dafb6d0db6c740ff9583526924864, UNASSIGN in 187 msec 2023-02-10 19:03:20,523 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,q\x11\x10,1676055796287.4539b623282fa7d2beb504c373ad6181. 2023-02-10 19:03:20,523 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 4539b623282fa7d2beb504c373ad6181: Waiting for close lock at 1676055800518Running coprocessor pre-close hooks at 1676055800518Disabling compacts and flushes for region at 1676055800518Disabling writes for close at 1676055800518Writing region close event to WAL at 1676055800519 (+1 ms)Running coprocessor post-close hooks at 1676055800523 (+4 ms)Closed at 1676055800523 2023-02-10 19:03:20,523 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=53, resume processing ppid=34 2023-02-10 19:03:20,523 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=53, ppid=34, state=SUCCESS; CloseRegionProcedure 2fd40e0179a0e968c4672055c041d740, server=jenkins-hbase4.apache.org,44697,1676055795050 in 173 msec 2023-02-10 19:03:20,524 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 4539b623282fa7d2beb504c373ad6181 2023-02-10 19:03:20,524 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=34, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=2fd40e0179a0e968c4672055c041d740, UNASSIGN in 189 msec 2023-02-10 19:03:20,525 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=40 updating hbase:meta row=4539b623282fa7d2beb504c373ad6181, regionState=CLOSED 2023-02-10 19:03:20,525 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,q\\x11\\x10,1676055796287.4539b623282fa7d2beb504c373ad6181.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676055800525"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676055800525"}]},"ts":"1676055800525"} 2023-02-10 19:03:20,525 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/data/default/testWithMockedMapReduceMultiRegion/6b4a925bbaa3b95421bfaa80da606099/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-10 19:03:20,530 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676055796287.6b4a925bbaa3b95421bfaa80da606099. 2023-02-10 19:03:20,530 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 6b4a925bbaa3b95421bfaa80da606099: Waiting for close lock at 1676055800520Running coprocessor pre-close hooks at 1676055800520Disabling compacts and flushes for region at 1676055800520Disabling writes for close at 1676055800520Writing region close event to WAL at 1676055800522 (+2 ms)Running coprocessor post-close hooks at 1676055800530 (+8 ms)Closed at 1676055800530 2023-02-10 19:03:20,531 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 6b4a925bbaa3b95421bfaa80da606099 2023-02-10 19:03:20,531 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=6b4a925bbaa3b95421bfaa80da606099, regionState=CLOSED 2023-02-10 19:03:20,532 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,g\\xA7\\xA7,1676055796287.6b4a925bbaa3b95421bfaa80da606099.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676055800531"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676055800531"}]},"ts":"1676055800531"} 2023-02-10 19:03:20,532 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=51, resume processing ppid=40 2023-02-10 19:03:20,532 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=51, ppid=40, state=SUCCESS; CloseRegionProcedure 4539b623282fa7d2beb504c373ad6181, server=jenkins-hbase4.apache.org,35891,1676055795020 in 185 msec 2023-02-10 19:03:20,533 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=40, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=4539b623282fa7d2beb504c373ad6181, UNASSIGN in 198 msec 2023-02-10 19:03:20,534 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=45, resume processing ppid=37 2023-02-10 19:03:20,534 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=45, ppid=37, state=SUCCESS; CloseRegionProcedure 6b4a925bbaa3b95421bfaa80da606099, server=jenkins-hbase4.apache.org,44697,1676055795050 in 194 msec 2023-02-10 19:03:20,536 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=37, resume processing ppid=33 2023-02-10 19:03:20,536 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=37, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=6b4a925bbaa3b95421bfaa80da606099, UNASSIGN in 200 msec 2023-02-10 19:03:20,536 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676055800536"}]},"ts":"1676055800536"} 2023-02-10 19:03:20,537 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testWithMockedMapReduceMultiRegion, state=DISABLED in hbase:meta 2023-02-10 19:03:20,565 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33383] master.MasterRpcServices(1227): Checking to see if procedure is done pid=33 2023-02-10 19:03:20,594 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testWithMockedMapReduceMultiRegion to state=DISABLED 2023-02-10 19:03:20,596 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=33, state=SUCCESS; DisableTableProcedure table=testWithMockedMapReduceMultiRegion in 335 msec 2023-02-10 19:03:20,867 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33383] master.MasterRpcServices(1227): Checking to see if procedure is done pid=33 2023-02-10 19:03:20,867 INFO [Listener at localhost/37107] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testWithMockedMapReduceMultiRegion, procId: 33 completed 2023-02-10 19:03:20,868 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33383] master.HMaster$5(2215): Client=jenkins//172.31.14.131 delete testWithMockedMapReduceMultiRegion 2023-02-10 19:03:20,869 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33383] procedure2.ProcedureExecutor(1029): Stored pid=54, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testWithMockedMapReduceMultiRegion 2023-02-10 19:03:20,870 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=54, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testWithMockedMapReduceMultiRegion 2023-02-10 19:03:20,871 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=54, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testWithMockedMapReduceMultiRegion 2023-02-10 19:03:20,871 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33383] master.MasterRpcServices(1227): Checking to see if procedure is done pid=54 2023-02-10 19:03:20,881 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/.tmp/data/default/testWithMockedMapReduceMultiRegion/2fd40e0179a0e968c4672055c041d740 2023-02-10 19:03:20,881 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/.tmp/data/default/testWithMockedMapReduceMultiRegion/f8e2703c94874a9a6d0d1541b43c1eb3 2023-02-10 19:03:20,881 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/.tmp/data/default/testWithMockedMapReduceMultiRegion/b324410564271f3c81fcd7c2326d0435 2023-02-10 19:03:20,881 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/.tmp/data/default/testWithMockedMapReduceMultiRegion/54239cd4e87d877b10bac35ba4d2a8c8 2023-02-10 19:03:20,881 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/.tmp/data/default/testWithMockedMapReduceMultiRegion/4539b623282fa7d2beb504c373ad6181 2023-02-10 19:03:20,881 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/.tmp/data/default/testWithMockedMapReduceMultiRegion/08e6594f21fdd814bfb7b05ba0f4191b 2023-02-10 19:03:20,881 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/.tmp/data/default/testWithMockedMapReduceMultiRegion/6b4a925bbaa3b95421bfaa80da606099 2023-02-10 19:03:20,881 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/.tmp/data/default/testWithMockedMapReduceMultiRegion/eca90e03b313fba8b7a1d6571ea05502 2023-02-10 19:03:20,889 DEBUG [HFileArchiver-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/.tmp/data/default/testWithMockedMapReduceMultiRegion/f8e2703c94874a9a6d0d1541b43c1eb3/f1, FileablePath, hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/.tmp/data/default/testWithMockedMapReduceMultiRegion/f8e2703c94874a9a6d0d1541b43c1eb3/f2, FileablePath, hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/.tmp/data/default/testWithMockedMapReduceMultiRegion/f8e2703c94874a9a6d0d1541b43c1eb3/recovered.edits] 2023-02-10 19:03:20,889 DEBUG [HFileArchiver-1] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/.tmp/data/default/testWithMockedMapReduceMultiRegion/4539b623282fa7d2beb504c373ad6181/f1, FileablePath, hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/.tmp/data/default/testWithMockedMapReduceMultiRegion/4539b623282fa7d2beb504c373ad6181/f2, FileablePath, hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/.tmp/data/default/testWithMockedMapReduceMultiRegion/4539b623282fa7d2beb504c373ad6181/recovered.edits] 2023-02-10 19:03:20,890 DEBUG [HFileArchiver-7] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/.tmp/data/default/testWithMockedMapReduceMultiRegion/eca90e03b313fba8b7a1d6571ea05502/f1, FileablePath, hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/.tmp/data/default/testWithMockedMapReduceMultiRegion/eca90e03b313fba8b7a1d6571ea05502/f2, FileablePath, hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/.tmp/data/default/testWithMockedMapReduceMultiRegion/eca90e03b313fba8b7a1d6571ea05502/recovered.edits] 2023-02-10 19:03:20,890 DEBUG [HFileArchiver-2] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/.tmp/data/default/testWithMockedMapReduceMultiRegion/08e6594f21fdd814bfb7b05ba0f4191b/f1, FileablePath, hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/.tmp/data/default/testWithMockedMapReduceMultiRegion/08e6594f21fdd814bfb7b05ba0f4191b/f2, FileablePath, hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/.tmp/data/default/testWithMockedMapReduceMultiRegion/08e6594f21fdd814bfb7b05ba0f4191b/recovered.edits] 2023-02-10 19:03:20,891 DEBUG [HFileArchiver-4] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/.tmp/data/default/testWithMockedMapReduceMultiRegion/b324410564271f3c81fcd7c2326d0435/f1, FileablePath, hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/.tmp/data/default/testWithMockedMapReduceMultiRegion/b324410564271f3c81fcd7c2326d0435/f2, FileablePath, hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/.tmp/data/default/testWithMockedMapReduceMultiRegion/b324410564271f3c81fcd7c2326d0435/recovered.edits] 2023-02-10 19:03:20,891 DEBUG [HFileArchiver-3] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/.tmp/data/default/testWithMockedMapReduceMultiRegion/2fd40e0179a0e968c4672055c041d740/f1, FileablePath, hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/.tmp/data/default/testWithMockedMapReduceMultiRegion/2fd40e0179a0e968c4672055c041d740/f2, FileablePath, hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/.tmp/data/default/testWithMockedMapReduceMultiRegion/2fd40e0179a0e968c4672055c041d740/recovered.edits] 2023-02-10 19:03:20,891 DEBUG [HFileArchiver-6] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/.tmp/data/default/testWithMockedMapReduceMultiRegion/6b4a925bbaa3b95421bfaa80da606099/f1, FileablePath, hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/.tmp/data/default/testWithMockedMapReduceMultiRegion/6b4a925bbaa3b95421bfaa80da606099/f2, FileablePath, hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/.tmp/data/default/testWithMockedMapReduceMultiRegion/6b4a925bbaa3b95421bfaa80da606099/recovered.edits] 2023-02-10 19:03:20,892 DEBUG [HFileArchiver-8] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/.tmp/data/default/testWithMockedMapReduceMultiRegion/54239cd4e87d877b10bac35ba4d2a8c8/f1, FileablePath, hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/.tmp/data/default/testWithMockedMapReduceMultiRegion/54239cd4e87d877b10bac35ba4d2a8c8/f2, FileablePath, hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/.tmp/data/default/testWithMockedMapReduceMultiRegion/54239cd4e87d877b10bac35ba4d2a8c8/recovered.edits] 2023-02-10 19:03:20,898 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/.tmp/data/default/testWithMockedMapReduceMultiRegion/08e6594f21fdd814bfb7b05ba0f4191b/f1/02780ed49bbb427cae98941994a14752 to hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/archive/data/default/testWithMockedMapReduceMultiRegion/08e6594f21fdd814bfb7b05ba0f4191b/f1/02780ed49bbb427cae98941994a14752 2023-02-10 19:03:20,899 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/.tmp/data/default/testWithMockedMapReduceMultiRegion/6b4a925bbaa3b95421bfaa80da606099/f1/b40c4c188cf84850af2e9f8cc89239b7 to hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/archive/data/default/testWithMockedMapReduceMultiRegion/6b4a925bbaa3b95421bfaa80da606099/f1/b40c4c188cf84850af2e9f8cc89239b7 2023-02-10 19:03:20,899 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/.tmp/data/default/testWithMockedMapReduceMultiRegion/eca90e03b313fba8b7a1d6571ea05502/f1/47461599967142c2bd008568f428a114 to hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/archive/data/default/testWithMockedMapReduceMultiRegion/eca90e03b313fba8b7a1d6571ea05502/f1/47461599967142c2bd008568f428a114 2023-02-10 19:03:20,900 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/.tmp/data/default/testWithMockedMapReduceMultiRegion/f8e2703c94874a9a6d0d1541b43c1eb3/f1/ac71d2c7570e442ba475b649bdd4a554 to hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/archive/data/default/testWithMockedMapReduceMultiRegion/f8e2703c94874a9a6d0d1541b43c1eb3/f1/ac71d2c7570e442ba475b649bdd4a554 2023-02-10 19:03:20,900 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/.tmp/data/default/testWithMockedMapReduceMultiRegion/4539b623282fa7d2beb504c373ad6181/f1/162a7696e02a4a4c9611ac886893cd7e to hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/archive/data/default/testWithMockedMapReduceMultiRegion/4539b623282fa7d2beb504c373ad6181/f1/162a7696e02a4a4c9611ac886893cd7e 2023-02-10 19:03:20,905 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/.tmp/data/default/testWithMockedMapReduceMultiRegion/b324410564271f3c81fcd7c2326d0435/f1/0457c71de2024e95acea49e46bd89971 to hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/archive/data/default/testWithMockedMapReduceMultiRegion/b324410564271f3c81fcd7c2326d0435/f1/0457c71de2024e95acea49e46bd89971 2023-02-10 19:03:20,906 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/.tmp/data/default/testWithMockedMapReduceMultiRegion/b324410564271f3c81fcd7c2326d0435/f1/109ffb49435d4f9d8b2303143ce8c190 to hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/archive/data/default/testWithMockedMapReduceMultiRegion/b324410564271f3c81fcd7c2326d0435/f1/109ffb49435d4f9d8b2303143ce8c190 2023-02-10 19:03:20,909 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/.tmp/data/default/testWithMockedMapReduceMultiRegion/54239cd4e87d877b10bac35ba4d2a8c8/f1/0d22b1cedfea4891a95616a6879a59dc to hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/archive/data/default/testWithMockedMapReduceMultiRegion/54239cd4e87d877b10bac35ba4d2a8c8/f1/0d22b1cedfea4891a95616a6879a59dc 2023-02-10 19:03:20,909 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/.tmp/data/default/testWithMockedMapReduceMultiRegion/6b4a925bbaa3b95421bfaa80da606099/f1/c3feb61c5d104eeebcb9989af713b874 to hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/archive/data/default/testWithMockedMapReduceMultiRegion/6b4a925bbaa3b95421bfaa80da606099/f1/c3feb61c5d104eeebcb9989af713b874 2023-02-10 19:03:20,910 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/.tmp/data/default/testWithMockedMapReduceMultiRegion/08e6594f21fdd814bfb7b05ba0f4191b/f1/87c546d6d21c488a82b0a321a85eb99c to hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/archive/data/default/testWithMockedMapReduceMultiRegion/08e6594f21fdd814bfb7b05ba0f4191b/f1/87c546d6d21c488a82b0a321a85eb99c 2023-02-10 19:03:20,910 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/.tmp/data/default/testWithMockedMapReduceMultiRegion/eca90e03b313fba8b7a1d6571ea05502/f1/d3fc07d8a2dc437cbc5b0d6449b82ce5 to hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/archive/data/default/testWithMockedMapReduceMultiRegion/eca90e03b313fba8b7a1d6571ea05502/f1/d3fc07d8a2dc437cbc5b0d6449b82ce5 2023-02-10 19:03:20,911 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/.tmp/data/default/testWithMockedMapReduceMultiRegion/4539b623282fa7d2beb504c373ad6181/f1/70b3f8bd840c48d0a58688a287eba5f0 to hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/archive/data/default/testWithMockedMapReduceMultiRegion/4539b623282fa7d2beb504c373ad6181/f1/70b3f8bd840c48d0a58688a287eba5f0 2023-02-10 19:03:20,911 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/.tmp/data/default/testWithMockedMapReduceMultiRegion/b324410564271f3c81fcd7c2326d0435/f2/029c8a992e4b44a79cdf4f16cdac241a to hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/archive/data/default/testWithMockedMapReduceMultiRegion/b324410564271f3c81fcd7c2326d0435/f2/029c8a992e4b44a79cdf4f16cdac241a 2023-02-10 19:03:20,911 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/.tmp/data/default/testWithMockedMapReduceMultiRegion/f8e2703c94874a9a6d0d1541b43c1eb3/f1/d9cb9fdd72484ad5887d21abdea99fc6 to hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/archive/data/default/testWithMockedMapReduceMultiRegion/f8e2703c94874a9a6d0d1541b43c1eb3/f1/d9cb9fdd72484ad5887d21abdea99fc6 2023-02-10 19:03:20,912 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/.tmp/data/default/testWithMockedMapReduceMultiRegion/2fd40e0179a0e968c4672055c041d740/recovered.edits/6.seqid to hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/archive/data/default/testWithMockedMapReduceMultiRegion/2fd40e0179a0e968c4672055c041d740/recovered.edits/6.seqid 2023-02-10 19:03:20,913 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/.tmp/data/default/testWithMockedMapReduceMultiRegion/54239cd4e87d877b10bac35ba4d2a8c8/f1/998ea972b9ba48cbbbdfc4c5644202c7 to hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/archive/data/default/testWithMockedMapReduceMultiRegion/54239cd4e87d877b10bac35ba4d2a8c8/f1/998ea972b9ba48cbbbdfc4c5644202c7 2023-02-10 19:03:20,913 DEBUG [HFileArchiver-3] backup.HFileArchiver(596): Deleted hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/.tmp/data/default/testWithMockedMapReduceMultiRegion/2fd40e0179a0e968c4672055c041d740 2023-02-10 19:03:20,913 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/.tmp/data/default/testWithMockedMapReduceMultiRegion/bc3dafb6d0db6c740ff9583526924864 2023-02-10 19:03:20,914 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/.tmp/data/default/testWithMockedMapReduceMultiRegion/b324410564271f3c81fcd7c2326d0435/f2/e3751b81f34246ada74148861c841aea to hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/archive/data/default/testWithMockedMapReduceMultiRegion/b324410564271f3c81fcd7c2326d0435/f2/e3751b81f34246ada74148861c841aea 2023-02-10 19:03:20,916 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/.tmp/data/default/testWithMockedMapReduceMultiRegion/6b4a925bbaa3b95421bfaa80da606099/f2/5784d0007aae4b6587c2605c3982f3e5 to hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/archive/data/default/testWithMockedMapReduceMultiRegion/6b4a925bbaa3b95421bfaa80da606099/f2/5784d0007aae4b6587c2605c3982f3e5 2023-02-10 19:03:20,917 DEBUG [HFileArchiver-3] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/.tmp/data/default/testWithMockedMapReduceMultiRegion/bc3dafb6d0db6c740ff9583526924864/f1, FileablePath, hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/.tmp/data/default/testWithMockedMapReduceMultiRegion/bc3dafb6d0db6c740ff9583526924864/f2, FileablePath, hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/.tmp/data/default/testWithMockedMapReduceMultiRegion/bc3dafb6d0db6c740ff9583526924864/recovered.edits] 2023-02-10 19:03:20,918 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/.tmp/data/default/testWithMockedMapReduceMultiRegion/4539b623282fa7d2beb504c373ad6181/f2/16a960ab437341ac939f98660d7ed9b5 to hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/archive/data/default/testWithMockedMapReduceMultiRegion/4539b623282fa7d2beb504c373ad6181/f2/16a960ab437341ac939f98660d7ed9b5 2023-02-10 19:03:20,919 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/.tmp/data/default/testWithMockedMapReduceMultiRegion/f8e2703c94874a9a6d0d1541b43c1eb3/f2/36fe696e5b914544b169d1ce0345d6d9 to hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/archive/data/default/testWithMockedMapReduceMultiRegion/f8e2703c94874a9a6d0d1541b43c1eb3/f2/36fe696e5b914544b169d1ce0345d6d9 2023-02-10 19:03:20,919 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/.tmp/data/default/testWithMockedMapReduceMultiRegion/08e6594f21fdd814bfb7b05ba0f4191b/f2/92088c36ecbc40ebbc88d96bcb6b80ec to hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/archive/data/default/testWithMockedMapReduceMultiRegion/08e6594f21fdd814bfb7b05ba0f4191b/f2/92088c36ecbc40ebbc88d96bcb6b80ec 2023-02-10 19:03:20,919 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/.tmp/data/default/testWithMockedMapReduceMultiRegion/eca90e03b313fba8b7a1d6571ea05502/f2/0750363b3f3243a587dec443702e524a to hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/archive/data/default/testWithMockedMapReduceMultiRegion/eca90e03b313fba8b7a1d6571ea05502/f2/0750363b3f3243a587dec443702e524a 2023-02-10 19:03:20,919 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/.tmp/data/default/testWithMockedMapReduceMultiRegion/6b4a925bbaa3b95421bfaa80da606099/f2/dda2973082734cdc85d3029325c41080 to hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/archive/data/default/testWithMockedMapReduceMultiRegion/6b4a925bbaa3b95421bfaa80da606099/f2/dda2973082734cdc85d3029325c41080 2023-02-10 19:03:20,921 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/.tmp/data/default/testWithMockedMapReduceMultiRegion/54239cd4e87d877b10bac35ba4d2a8c8/f2/637fd46a403d4450a9e9cee49bd89dd9 to hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/archive/data/default/testWithMockedMapReduceMultiRegion/54239cd4e87d877b10bac35ba4d2a8c8/f2/637fd46a403d4450a9e9cee49bd89dd9 2023-02-10 19:03:20,921 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/.tmp/data/default/testWithMockedMapReduceMultiRegion/4539b623282fa7d2beb504c373ad6181/f2/bbc34d53e4714bb4a1b31367cfe8eee4 to hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/archive/data/default/testWithMockedMapReduceMultiRegion/4539b623282fa7d2beb504c373ad6181/f2/bbc34d53e4714bb4a1b31367cfe8eee4 2023-02-10 19:03:20,921 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/.tmp/data/default/testWithMockedMapReduceMultiRegion/b324410564271f3c81fcd7c2326d0435/recovered.edits/12.seqid to hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/archive/data/default/testWithMockedMapReduceMultiRegion/b324410564271f3c81fcd7c2326d0435/recovered.edits/12.seqid 2023-02-10 19:03:20,922 DEBUG [HFileArchiver-4] backup.HFileArchiver(596): Deleted hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/.tmp/data/default/testWithMockedMapReduceMultiRegion/b324410564271f3c81fcd7c2326d0435 2023-02-10 19:03:20,922 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/.tmp/data/default/testWithMockedMapReduceMultiRegion/ca626b09070f3e18c31fb632b018370f 2023-02-10 19:03:20,922 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/.tmp/data/default/testWithMockedMapReduceMultiRegion/f8e2703c94874a9a6d0d1541b43c1eb3/f2/fa18b005bdb24003bc90c081e4bc0826 to hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/archive/data/default/testWithMockedMapReduceMultiRegion/f8e2703c94874a9a6d0d1541b43c1eb3/f2/fa18b005bdb24003bc90c081e4bc0826 2023-02-10 19:03:20,923 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/.tmp/data/default/testWithMockedMapReduceMultiRegion/08e6594f21fdd814bfb7b05ba0f4191b/f2/b2a0e21849bd458096fc6d91f86bb0b3 to hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/archive/data/default/testWithMockedMapReduceMultiRegion/08e6594f21fdd814bfb7b05ba0f4191b/f2/b2a0e21849bd458096fc6d91f86bb0b3 2023-02-10 19:03:20,924 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/.tmp/data/default/testWithMockedMapReduceMultiRegion/eca90e03b313fba8b7a1d6571ea05502/f2/6bcbaeabb8f049fca5c9c10dadb1b3f9 to hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/archive/data/default/testWithMockedMapReduceMultiRegion/eca90e03b313fba8b7a1d6571ea05502/f2/6bcbaeabb8f049fca5c9c10dadb1b3f9 2023-02-10 19:03:20,924 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/.tmp/data/default/testWithMockedMapReduceMultiRegion/54239cd4e87d877b10bac35ba4d2a8c8/f2/d23712496aef458b97ec335b1481382e to hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/archive/data/default/testWithMockedMapReduceMultiRegion/54239cd4e87d877b10bac35ba4d2a8c8/f2/d23712496aef458b97ec335b1481382e 2023-02-10 19:03:20,925 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/.tmp/data/default/testWithMockedMapReduceMultiRegion/bc3dafb6d0db6c740ff9583526924864/f1/571d5c895c5e4d25964fbd20a498d4ba to hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/archive/data/default/testWithMockedMapReduceMultiRegion/bc3dafb6d0db6c740ff9583526924864/f1/571d5c895c5e4d25964fbd20a498d4ba 2023-02-10 19:03:20,926 DEBUG [HFileArchiver-4] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/.tmp/data/default/testWithMockedMapReduceMultiRegion/ca626b09070f3e18c31fb632b018370f/f1, FileablePath, hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/.tmp/data/default/testWithMockedMapReduceMultiRegion/ca626b09070f3e18c31fb632b018370f/f2, FileablePath, hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/.tmp/data/default/testWithMockedMapReduceMultiRegion/ca626b09070f3e18c31fb632b018370f/recovered.edits] 2023-02-10 19:03:20,928 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/.tmp/data/default/testWithMockedMapReduceMultiRegion/6b4a925bbaa3b95421bfaa80da606099/recovered.edits/12.seqid to hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/archive/data/default/testWithMockedMapReduceMultiRegion/6b4a925bbaa3b95421bfaa80da606099/recovered.edits/12.seqid 2023-02-10 19:03:20,928 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/.tmp/data/default/testWithMockedMapReduceMultiRegion/4539b623282fa7d2beb504c373ad6181/recovered.edits/12.seqid to hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/archive/data/default/testWithMockedMapReduceMultiRegion/4539b623282fa7d2beb504c373ad6181/recovered.edits/12.seqid 2023-02-10 19:03:20,929 DEBUG [HFileArchiver-6] backup.HFileArchiver(596): Deleted hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/.tmp/data/default/testWithMockedMapReduceMultiRegion/6b4a925bbaa3b95421bfaa80da606099 2023-02-10 19:03:20,929 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/.tmp/data/default/testWithMockedMapReduceMultiRegion/bc3dafb6d0db6c740ff9583526924864/f1/f79594e01a1349768d709f8a2f749ca9 to hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/archive/data/default/testWithMockedMapReduceMultiRegion/bc3dafb6d0db6c740ff9583526924864/f1/f79594e01a1349768d709f8a2f749ca9 2023-02-10 19:03:20,929 DEBUG [HFileArchiver-1] backup.HFileArchiver(596): Deleted hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/.tmp/data/default/testWithMockedMapReduceMultiRegion/4539b623282fa7d2beb504c373ad6181 2023-02-10 19:03:20,934 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/.tmp/data/default/testWithMockedMapReduceMultiRegion/f8e2703c94874a9a6d0d1541b43c1eb3/recovered.edits/12.seqid to hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/archive/data/default/testWithMockedMapReduceMultiRegion/f8e2703c94874a9a6d0d1541b43c1eb3/recovered.edits/12.seqid 2023-02-10 19:03:20,935 DEBUG [HFileArchiver-5] backup.HFileArchiver(596): Deleted hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/.tmp/data/default/testWithMockedMapReduceMultiRegion/f8e2703c94874a9a6d0d1541b43c1eb3 2023-02-10 19:03:20,936 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/.tmp/data/default/testWithMockedMapReduceMultiRegion/54239cd4e87d877b10bac35ba4d2a8c8/recovered.edits/12.seqid to hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/archive/data/default/testWithMockedMapReduceMultiRegion/54239cd4e87d877b10bac35ba4d2a8c8/recovered.edits/12.seqid 2023-02-10 19:03:20,936 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/.tmp/data/default/testWithMockedMapReduceMultiRegion/eca90e03b313fba8b7a1d6571ea05502/recovered.edits/12.seqid to hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/archive/data/default/testWithMockedMapReduceMultiRegion/eca90e03b313fba8b7a1d6571ea05502/recovered.edits/12.seqid 2023-02-10 19:03:20,936 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/.tmp/data/default/testWithMockedMapReduceMultiRegion/08e6594f21fdd814bfb7b05ba0f4191b/recovered.edits/12.seqid to hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/archive/data/default/testWithMockedMapReduceMultiRegion/08e6594f21fdd814bfb7b05ba0f4191b/recovered.edits/12.seqid 2023-02-10 19:03:20,937 DEBUG [HFileArchiver-8] backup.HFileArchiver(596): Deleted hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/.tmp/data/default/testWithMockedMapReduceMultiRegion/54239cd4e87d877b10bac35ba4d2a8c8 2023-02-10 19:03:20,937 DEBUG [HFileArchiver-2] backup.HFileArchiver(596): Deleted hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/.tmp/data/default/testWithMockedMapReduceMultiRegion/08e6594f21fdd814bfb7b05ba0f4191b 2023-02-10 19:03:20,937 DEBUG [HFileArchiver-7] backup.HFileArchiver(596): Deleted hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/.tmp/data/default/testWithMockedMapReduceMultiRegion/eca90e03b313fba8b7a1d6571ea05502 2023-02-10 19:03:20,938 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/.tmp/data/default/testWithMockedMapReduceMultiRegion/bc3dafb6d0db6c740ff9583526924864/f2/2976aa6a7e6c4781a1ed63a69eb04281 to hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/archive/data/default/testWithMockedMapReduceMultiRegion/bc3dafb6d0db6c740ff9583526924864/f2/2976aa6a7e6c4781a1ed63a69eb04281 2023-02-10 19:03:20,941 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/.tmp/data/default/testWithMockedMapReduceMultiRegion/bc3dafb6d0db6c740ff9583526924864/f2/71f90a8a15934976898bfeb38acddee7 to hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/archive/data/default/testWithMockedMapReduceMultiRegion/bc3dafb6d0db6c740ff9583526924864/f2/71f90a8a15934976898bfeb38acddee7 2023-02-10 19:03:20,944 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/.tmp/data/default/testWithMockedMapReduceMultiRegion/ca626b09070f3e18c31fb632b018370f/recovered.edits/6.seqid to hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/archive/data/default/testWithMockedMapReduceMultiRegion/ca626b09070f3e18c31fb632b018370f/recovered.edits/6.seqid 2023-02-10 19:03:20,945 DEBUG [HFileArchiver-4] backup.HFileArchiver(596): Deleted hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/.tmp/data/default/testWithMockedMapReduceMultiRegion/ca626b09070f3e18c31fb632b018370f 2023-02-10 19:03:20,946 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/.tmp/data/default/testWithMockedMapReduceMultiRegion/bc3dafb6d0db6c740ff9583526924864/recovered.edits/12.seqid to hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/archive/data/default/testWithMockedMapReduceMultiRegion/bc3dafb6d0db6c740ff9583526924864/recovered.edits/12.seqid 2023-02-10 19:03:20,947 DEBUG [HFileArchiver-3] backup.HFileArchiver(596): Deleted hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/.tmp/data/default/testWithMockedMapReduceMultiRegion/bc3dafb6d0db6c740ff9583526924864 2023-02-10 19:03:20,947 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testWithMockedMapReduceMultiRegion regions 2023-02-10 19:03:20,949 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=54, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testWithMockedMapReduceMultiRegion 2023-02-10 19:03:20,951 WARN [PEWorker-2] procedure.DeleteTableProcedure(384): Deleting some vestigial 10 rows of testWithMockedMapReduceMultiRegion from hbase:meta 2023-02-10 19:03:20,954 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(421): Removing 'testWithMockedMapReduceMultiRegion' descriptor. 2023-02-10 19:03:20,954 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=54, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testWithMockedMapReduceMultiRegion 2023-02-10 19:03:20,954 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(411): Removing 'testWithMockedMapReduceMultiRegion' from region states. 2023-02-10 19:03:20,955 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,,1676055796287.2fd40e0179a0e968c4672055c041d740.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676055800954"}]},"ts":"9223372036854775807"} 2023-02-10 19:03:20,955 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,aaa,1676055796287.eca90e03b313fba8b7a1d6571ea05502.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676055800954"}]},"ts":"9223372036854775807"} 2023-02-10 19:03:20,955 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,d\\x84\\x84,1676055796287.f8e2703c94874a9a6d0d1541b43c1eb3.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676055800954"}]},"ts":"9223372036854775807"} 2023-02-10 19:03:20,955 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,g\\xA7\\xA7,1676055796287.6b4a925bbaa3b95421bfaa80da606099.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676055800954"}]},"ts":"9223372036854775807"} 2023-02-10 19:03:20,955 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,j\\xCA\\xCA,1676055796287.08e6594f21fdd814bfb7b05ba0f4191b.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676055800954"}]},"ts":"9223372036854775807"} 2023-02-10 19:03:20,955 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,m\\xED\\xED,1676055796287.b324410564271f3c81fcd7c2326d0435.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676055800954"}]},"ts":"9223372036854775807"} 2023-02-10 19:03:20,955 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,q\\x11\\x10,1676055796287.4539b623282fa7d2beb504c373ad6181.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676055800954"}]},"ts":"9223372036854775807"} 2023-02-10 19:03:20,955 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,t43,1676055796287.54239cd4e87d877b10bac35ba4d2a8c8.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676055800954"}]},"ts":"9223372036854775807"} 2023-02-10 19:03:20,955 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,wWV,1676055796287.bc3dafb6d0db6c740ff9583526924864.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676055800954"}]},"ts":"9223372036854775807"} 2023-02-10 19:03:20,955 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,zz{,1676055796287.ca626b09070f3e18c31fb632b018370f.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676055800954"}]},"ts":"9223372036854775807"} 2023-02-10 19:03:20,957 INFO [PEWorker-2] hbase.MetaTableAccessor(1788): Deleted 10 regions from META 2023-02-10 19:03:20,957 DEBUG [PEWorker-2] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 2fd40e0179a0e968c4672055c041d740, NAME => 'testWithMockedMapReduceMultiRegion,,1676055796287.2fd40e0179a0e968c4672055c041d740.', STARTKEY => '', ENDKEY => 'aaa'}, {ENCODED => eca90e03b313fba8b7a1d6571ea05502, NAME => 'testWithMockedMapReduceMultiRegion,aaa,1676055796287.eca90e03b313fba8b7a1d6571ea05502.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'}, {ENCODED => f8e2703c94874a9a6d0d1541b43c1eb3, NAME => 'testWithMockedMapReduceMultiRegion,d\x84\x84,1676055796287.f8e2703c94874a9a6d0d1541b43c1eb3.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'}, {ENCODED => 6b4a925bbaa3b95421bfaa80da606099, NAME => 'testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676055796287.6b4a925bbaa3b95421bfaa80da606099.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'}, {ENCODED => 08e6594f21fdd814bfb7b05ba0f4191b, NAME => 'testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676055796287.08e6594f21fdd814bfb7b05ba0f4191b.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'}, {ENCODED => b324410564271f3c81fcd7c2326d0435, NAME => 'testWithMockedMapReduceMultiRegion,m\xED\xED,1676055796287.b324410564271f3c81fcd7c2326d0435.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'}, {ENCODED => 4539b623282fa7d2beb504c373ad6181, NAME => 'testWithMockedMapReduceMultiRegion,q\x11\x10,1676055796287.4539b623282fa7d2beb504c373ad6181.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'}, {ENCODED => 54239cd4e87d877b10bac35ba4d2a8c8, NAME => 'testWithMockedMapReduceMultiRegion,t43,1676055796287.54239cd4e87d877b10bac35ba4d2a8c8.', STARTKEY => 't43', ENDKEY => 'wWV'}, {ENCODED => bc3dafb6d0db6c740ff9583526924864, NAME => 'testWithMockedMapReduceMultiRegion,wWV,1676055796287.bc3dafb6d0db6c740ff9583526924864.', STARTKEY => 'wWV', ENDKEY => 'zz{'}, {ENCODED => ca626b09070f3e18c31fb632b018370f, NAME => 'testWithMockedMapReduceMultiRegion,zz{,1676055796287.ca626b09070f3e18c31fb632b018370f.', STARTKEY => 'zz{', ENDKEY => ''}] 2023-02-10 19:03:20,957 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(415): Marking 'testWithMockedMapReduceMultiRegion' as deleted. 2023-02-10 19:03:20,957 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1676055800957"}]},"ts":"9223372036854775807"} 2023-02-10 19:03:20,959 INFO [PEWorker-2] hbase.MetaTableAccessor(1658): Deleted table testWithMockedMapReduceMultiRegion state from META 2023-02-10 19:03:20,972 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33383] master.MasterRpcServices(1227): Checking to see if procedure is done pid=54 2023-02-10 19:03:21,010 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(130): Finished pid=54, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testWithMockedMapReduceMultiRegion 2023-02-10 19:03:21,011 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=54, state=SUCCESS; DeleteTableProcedure table=testWithMockedMapReduceMultiRegion in 142 msec 2023-02-10 19:03:21,106 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-datanode.properties,hadoop-metrics2.properties 2023-02-10 19:03:21,173 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33383] master.MasterRpcServices(1227): Checking to see if procedure is done pid=54 2023-02-10 19:03:21,174 INFO [Listener at localhost/37107] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testWithMockedMapReduceMultiRegion, procId: 54 completed 2023-02-10 19:03:21,174 INFO [Listener at localhost/37107] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-02-10 19:03:21,174 INFO [Listener at localhost/37107] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-10 19:03:21,174 DEBUG [Listener at localhost/37107] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x62935b5a to 127.0.0.1:52230 2023-02-10 19:03:21,174 DEBUG [Listener at localhost/37107] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-10 19:03:21,174 DEBUG [Listener at localhost/37107] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-02-10 19:03:21,174 DEBUG [Listener at localhost/37107] util.JVMClusterUtil(257): Found active master hash=1886535566, stopped=false 2023-02-10 19:03:21,174 INFO [Listener at localhost/37107] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,33383,1676055794975 2023-02-10 19:03:21,225 DEBUG [Listener at localhost/37107-EventThread] zookeeper.ZKWatcher(600): regionserver:35891-0x1003f9dbed10001, quorum=127.0.0.1:52230, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-10 19:03:21,225 DEBUG [Listener at localhost/37107-EventThread] zookeeper.ZKWatcher(600): regionserver:44697-0x1003f9dbed10002, quorum=127.0.0.1:52230, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-10 19:03:21,225 INFO [Listener at localhost/37107] procedure2.ProcedureExecutor(629): Stopping 2023-02-10 19:03:21,225 DEBUG [Listener at localhost/37107-EventThread] zookeeper.ZKWatcher(600): master:33383-0x1003f9dbed10000, quorum=127.0.0.1:52230, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-10 19:03:21,225 DEBUG [Listener at localhost/37107-EventThread] zookeeper.ZKWatcher(600): master:33383-0x1003f9dbed10000, quorum=127.0.0.1:52230, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-10 19:03:21,227 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35891-0x1003f9dbed10001, quorum=127.0.0.1:52230, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-10 19:03:21,227 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44697-0x1003f9dbed10002, quorum=127.0.0.1:52230, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-10 19:03:21,227 DEBUG [Listener at localhost/37107] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x712afd87 to 127.0.0.1:52230 2023-02-10 19:03:21,227 DEBUG [Listener at localhost/37107] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-10 19:03:21,227 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:33383-0x1003f9dbed10000, quorum=127.0.0.1:52230, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-10 19:03:21,227 INFO [Listener at localhost/37107] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,35891,1676055795020' ***** 2023-02-10 19:03:21,227 INFO [Listener at localhost/37107] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-10 19:03:21,227 INFO [Listener at localhost/37107] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,44697,1676055795050' ***** 2023-02-10 19:03:21,227 INFO [Listener at localhost/37107] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-10 19:03:21,228 INFO [RS:0;jenkins-hbase4:35891] regionserver.HeapMemoryManager(220): Stopping 2023-02-10 19:03:21,228 INFO [RS:1;jenkins-hbase4:44697] regionserver.HeapMemoryManager(220): Stopping 2023-02-10 19:03:21,228 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-10 19:03:21,228 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-10 19:03:21,228 INFO [RS:0;jenkins-hbase4:35891] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-10 19:03:21,228 INFO [RS:1;jenkins-hbase4:44697] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-10 19:03:21,230 INFO [RS:0;jenkins-hbase4:35891] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-10 19:03:21,230 INFO [RS:1;jenkins-hbase4:44697] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-10 19:03:21,230 INFO [RS:0;jenkins-hbase4:35891] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,35891,1676055795020 2023-02-10 19:03:21,230 INFO [RS:1;jenkins-hbase4:44697] regionserver.HRegionServer(3304): Received CLOSE for c14f5740dcaa778d9823206a6b1ca0eb 2023-02-10 19:03:21,230 DEBUG [RS:0;jenkins-hbase4:35891] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x09d87452 to 127.0.0.1:52230 2023-02-10 19:03:21,230 INFO [RS:1;jenkins-hbase4:44697] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,44697,1676055795050 2023-02-10 19:03:21,230 DEBUG [RS:0;jenkins-hbase4:35891] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-10 19:03:21,231 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing c14f5740dcaa778d9823206a6b1ca0eb, disabling compactions & flushes 2023-02-10 19:03:21,231 INFO [RS:0;jenkins-hbase4:35891] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-10 19:03:21,231 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676055795643.c14f5740dcaa778d9823206a6b1ca0eb. 2023-02-10 19:03:21,231 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676055795643.c14f5740dcaa778d9823206a6b1ca0eb. 2023-02-10 19:03:21,230 DEBUG [RS:1;jenkins-hbase4:44697] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x16d440e4 to 127.0.0.1:52230 2023-02-10 19:03:21,231 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676055795643.c14f5740dcaa778d9823206a6b1ca0eb. after waiting 0 ms 2023-02-10 19:03:21,231 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676055795643.c14f5740dcaa778d9823206a6b1ca0eb. 2023-02-10 19:03:21,231 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing c14f5740dcaa778d9823206a6b1ca0eb 1/1 column families, dataSize=78 B heapSize=488 B 2023-02-10 19:03:21,231 INFO [RS:0;jenkins-hbase4:35891] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-10 19:03:21,231 DEBUG [RS:1;jenkins-hbase4:44697] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-10 19:03:21,231 INFO [RS:0;jenkins-hbase4:35891] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-10 19:03:21,231 INFO [RS:1;jenkins-hbase4:44697] regionserver.HRegionServer(1475): Waiting on 1 regions to close 2023-02-10 19:03:21,231 INFO [RS:0;jenkins-hbase4:35891] regionserver.HRegionServer(3304): Received CLOSE for 1588230740 2023-02-10 19:03:21,231 DEBUG [RS:1;jenkins-hbase4:44697] regionserver.HRegionServer(1479): Online Regions={c14f5740dcaa778d9823206a6b1ca0eb=hbase:namespace,,1676055795643.c14f5740dcaa778d9823206a6b1ca0eb.} 2023-02-10 19:03:21,231 DEBUG [RS:1;jenkins-hbase4:44697] regionserver.HRegionServer(1505): Waiting on c14f5740dcaa778d9823206a6b1ca0eb 2023-02-10 19:03:21,231 INFO [RS:0;jenkins-hbase4:35891] regionserver.HRegionServer(1475): Waiting on 1 regions to close 2023-02-10 19:03:21,231 DEBUG [RS:0;jenkins-hbase4:35891] regionserver.HRegionServer(1479): Online Regions={1588230740=hbase:meta,,1.1588230740} 2023-02-10 19:03:21,231 DEBUG [RS:0;jenkins-hbase4:35891] regionserver.HRegionServer(1505): Waiting on 1588230740 2023-02-10 19:03:21,233 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-10 19:03:21,233 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-10 19:03:21,233 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-10 19:03:21,233 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-10 19:03:21,234 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-10 19:03:21,234 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 1588230740 3/3 column families, dataSize=28.36 KB heapSize=44.48 KB 2023-02-10 19:03:21,239 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-10 19:03:21,242 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=25.73 KB at sequenceid=57 (bloomFilter=false), to=hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/data/hbase/meta/1588230740/.tmp/info/c973724807434ac5b4b2a1efcf5dcf25 2023-02-10 19:03:21,243 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/data/hbase/namespace/c14f5740dcaa778d9823206a6b1ca0eb/.tmp/info/f7c90d96b082409bb3aaf3de20288ded 2023-02-10 19:03:21,247 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c973724807434ac5b4b2a1efcf5dcf25 2023-02-10 19:03:21,248 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/data/hbase/namespace/c14f5740dcaa778d9823206a6b1ca0eb/.tmp/info/f7c90d96b082409bb3aaf3de20288ded as hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/data/hbase/namespace/c14f5740dcaa778d9823206a6b1ca0eb/info/f7c90d96b082409bb3aaf3de20288ded 2023-02-10 19:03:21,251 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/data/hbase/namespace/c14f5740dcaa778d9823206a6b1ca0eb/info/f7c90d96b082409bb3aaf3de20288ded, entries=2, sequenceid=6, filesize=4.8 K 2023-02-10 19:03:21,252 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for c14f5740dcaa778d9823206a6b1ca0eb in 21ms, sequenceid=6, compaction requested=false 2023-02-10 19:03:21,268 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.14 KB at sequenceid=57 (bloomFilter=false), to=hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/data/hbase/meta/1588230740/.tmp/rep_barrier/4ef259eacfc448dfa9395830f8d12586 2023-02-10 19:03:21,268 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/data/hbase/namespace/c14f5740dcaa778d9823206a6b1ca0eb/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-02-10 19:03:21,270 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676055795643.c14f5740dcaa778d9823206a6b1ca0eb. 2023-02-10 19:03:21,270 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for c14f5740dcaa778d9823206a6b1ca0eb: Waiting for close lock at 1676055801230Running coprocessor pre-close hooks at 1676055801230Disabling compacts and flushes for region at 1676055801230Disabling writes for close at 1676055801231 (+1 ms)Obtaining lock to block concurrent updates at 1676055801231Preparing flush snapshotting stores in c14f5740dcaa778d9823206a6b1ca0eb at 1676055801231Finished memstore snapshotting hbase:namespace,,1676055795643.c14f5740dcaa778d9823206a6b1ca0eb., syncing WAL and waiting on mvcc, flushsize=dataSize=78, getHeapSize=472, getOffHeapSize=0, getCellsCount=2 at 1676055801231Flushing stores of hbase:namespace,,1676055795643.c14f5740dcaa778d9823206a6b1ca0eb. at 1676055801234 (+3 ms)Flushing c14f5740dcaa778d9823206a6b1ca0eb/info: creating writer at 1676055801234Flushing c14f5740dcaa778d9823206a6b1ca0eb/info: appending metadata at 1676055801236 (+2 ms)Flushing c14f5740dcaa778d9823206a6b1ca0eb/info: closing flushed file at 1676055801236Flushing c14f5740dcaa778d9823206a6b1ca0eb/info: reopening flushed file at 1676055801248 (+12 ms)Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for c14f5740dcaa778d9823206a6b1ca0eb in 21ms, sequenceid=6, compaction requested=false at 1676055801252 (+4 ms)Writing region close event to WAL at 1676055801260 (+8 ms)Running coprocessor post-close hooks at 1676055801269 (+9 ms)Closed at 1676055801270 (+1 ms) 2023-02-10 19:03:21,271 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1676055795643.c14f5740dcaa778d9823206a6b1ca0eb. 2023-02-10 19:03:21,273 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 4ef259eacfc448dfa9395830f8d12586 2023-02-10 19:03:21,281 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.49 KB at sequenceid=57 (bloomFilter=false), to=hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/data/hbase/meta/1588230740/.tmp/table/6059fb8ad53f49bc80bf7eed479150c7 2023-02-10 19:03:21,285 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 6059fb8ad53f49bc80bf7eed479150c7 2023-02-10 19:03:21,285 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/data/hbase/meta/1588230740/.tmp/info/c973724807434ac5b4b2a1efcf5dcf25 as hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/data/hbase/meta/1588230740/info/c973724807434ac5b4b2a1efcf5dcf25 2023-02-10 19:03:21,289 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c973724807434ac5b4b2a1efcf5dcf25 2023-02-10 19:03:21,289 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/data/hbase/meta/1588230740/info/c973724807434ac5b4b2a1efcf5dcf25, entries=30, sequenceid=57, filesize=8.3 K 2023-02-10 19:03:21,290 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/data/hbase/meta/1588230740/.tmp/rep_barrier/4ef259eacfc448dfa9395830f8d12586 as hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/data/hbase/meta/1588230740/rep_barrier/4ef259eacfc448dfa9395830f8d12586 2023-02-10 19:03:21,294 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 4ef259eacfc448dfa9395830f8d12586 2023-02-10 19:03:21,294 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/data/hbase/meta/1588230740/rep_barrier/4ef259eacfc448dfa9395830f8d12586, entries=10, sequenceid=57, filesize=6.1 K 2023-02-10 19:03:21,295 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/data/hbase/meta/1588230740/.tmp/table/6059fb8ad53f49bc80bf7eed479150c7 as hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/data/hbase/meta/1588230740/table/6059fb8ad53f49bc80bf7eed479150c7 2023-02-10 19:03:21,298 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 6059fb8ad53f49bc80bf7eed479150c7 2023-02-10 19:03:21,298 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/data/hbase/meta/1588230740/table/6059fb8ad53f49bc80bf7eed479150c7, entries=13, sequenceid=57, filesize=6.1 K 2023-02-10 19:03:21,299 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~28.36 KB/29041, heapSize ~44.44 KB/45504, currentSize=0 B/0 for 1588230740 in 65ms, sequenceid=57, compaction requested=false 2023-02-10 19:03:21,302 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/data/hbase/meta/1588230740/recovered.edits/60.seqid, newMaxSeqId=60, maxSeqId=1 2023-02-10 19:03:21,302 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-10 19:03:21,303 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-10 19:03:21,303 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1676055801231Running coprocessor pre-close hooks at 1676055801231Disabling compacts and flushes for region at 1676055801231Disabling writes for close at 1676055801234 (+3 ms)Obtaining lock to block concurrent updates at 1676055801234Preparing flush snapshotting stores in 1588230740 at 1676055801234Finished memstore snapshotting hbase:meta,,1.1588230740, syncing WAL and waiting on mvcc, flushsize=dataSize=29041, getHeapSize=45504, getOffHeapSize=0, getCellsCount=207 at 1676055801234Flushing stores of hbase:meta,,1.1588230740 at 1676055801234Flushing 1588230740/info: creating writer at 1676055801234Flushing 1588230740/info: appending metadata at 1676055801237 (+3 ms)Flushing 1588230740/info: closing flushed file at 1676055801237Flushing 1588230740/rep_barrier: creating writer at 1676055801247 (+10 ms)Flushing 1588230740/rep_barrier: appending metadata at 1676055801252 (+5 ms)Flushing 1588230740/rep_barrier: closing flushed file at 1676055801252Flushing 1588230740/table: creating writer at 1676055801273 (+21 ms)Flushing 1588230740/table: appending metadata at 1676055801275 (+2 ms)Flushing 1588230740/table: closing flushed file at 1676055801275Flushing 1588230740/info: reopening flushed file at 1676055801286 (+11 ms)Flushing 1588230740/rep_barrier: reopening flushed file at 1676055801291 (+5 ms)Flushing 1588230740/table: reopening flushed file at 1676055801295 (+4 ms)Finished flush of dataSize ~28.36 KB/29041, heapSize ~44.44 KB/45504, currentSize=0 B/0 for 1588230740 in 65ms, sequenceid=57, compaction requested=false at 1676055801299 (+4 ms)Writing region close event to WAL at 1676055801300 (+1 ms)Running coprocessor post-close hooks at 1676055801302 (+2 ms)Closed at 1676055801303 (+1 ms) 2023-02-10 19:03:21,304 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-02-10 19:03:21,323 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-10 19:03:21,331 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-02-10 19:03:21,331 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-02-10 19:03:21,402 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-02-10 19:03:21,402 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-02-10 19:03:21,431 INFO [RS:1;jenkins-hbase4:44697] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,44697,1676055795050; all regions closed. 2023-02-10 19:03:21,432 INFO [RS:0;jenkins-hbase4:35891] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,35891,1676055795020; all regions closed. 2023-02-10 19:03:21,438 DEBUG [RS:1;jenkins-hbase4:44697] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/oldWALs 2023-02-10 19:03:21,438 INFO [RS:1;jenkins-hbase4:44697] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C44697%2C1676055795050:(num 1676055796016) 2023-02-10 19:03:21,439 DEBUG [RS:0;jenkins-hbase4:35891] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/oldWALs 2023-02-10 19:03:21,439 DEBUG [RS:1;jenkins-hbase4:44697] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-10 19:03:21,439 INFO [RS:0;jenkins-hbase4:35891] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C35891%2C1676055795020.meta:.meta(num 1676055795586) 2023-02-10 19:03:21,439 INFO [RS:1;jenkins-hbase4:44697] regionserver.LeaseManager(133): Closed leases 2023-02-10 19:03:21,439 INFO [RS:1;jenkins-hbase4:44697] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-02-10 19:03:21,439 INFO [RS:1;jenkins-hbase4:44697] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-10 19:03:21,439 INFO [RS:1;jenkins-hbase4:44697] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-10 19:03:21,439 INFO [RS:1;jenkins-hbase4:44697] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-10 19:03:21,439 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-10 19:03:21,440 INFO [RS:1;jenkins-hbase4:44697] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:44697 2023-02-10 19:03:21,442 DEBUG [Listener at localhost/37107-EventThread] zookeeper.ZKWatcher(600): master:33383-0x1003f9dbed10000, quorum=127.0.0.1:52230, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-10 19:03:21,442 DEBUG [Listener at localhost/37107-EventThread] zookeeper.ZKWatcher(600): regionserver:44697-0x1003f9dbed10002, quorum=127.0.0.1:52230, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,44697,1676055795050 2023-02-10 19:03:21,442 DEBUG [Listener at localhost/37107-EventThread] zookeeper.ZKWatcher(600): regionserver:35891-0x1003f9dbed10001, quorum=127.0.0.1:52230, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,44697,1676055795050 2023-02-10 19:03:21,442 ERROR [Listener at localhost/37107-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@483562e8 rejected from java.util.concurrent.ThreadPoolExecutor@4c0aff36[Shutting down, pool size = 1, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-10 19:03:21,443 DEBUG [Listener at localhost/37107-EventThread] zookeeper.ZKWatcher(600): regionserver:44697-0x1003f9dbed10002, quorum=127.0.0.1:52230, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-10 19:03:21,443 ERROR [Listener at localhost/37107-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@5b8a8d10 rejected from java.util.concurrent.ThreadPoolExecutor@4c0aff36[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-10 19:03:21,442 DEBUG [Listener at localhost/37107-EventThread] zookeeper.ZKWatcher(600): regionserver:35891-0x1003f9dbed10001, quorum=127.0.0.1:52230, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-10 19:03:21,443 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,44697,1676055795050] 2023-02-10 19:03:21,443 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,44697,1676055795050; numProcessing=1 2023-02-10 19:03:21,444 DEBUG [RS:0;jenkins-hbase4:35891] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/oldWALs 2023-02-10 19:03:21,444 INFO [RS:0;jenkins-hbase4:35891] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C35891%2C1676055795020:(num 1676055796344) 2023-02-10 19:03:21,444 DEBUG [RS:0;jenkins-hbase4:35891] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-10 19:03:21,444 INFO [RS:0;jenkins-hbase4:35891] regionserver.LeaseManager(133): Closed leases 2023-02-10 19:03:21,444 INFO [RS:0;jenkins-hbase4:35891] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-02-10 19:03:21,444 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-10 19:03:21,445 INFO [RS:0;jenkins-hbase4:35891] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:35891 2023-02-10 19:03:21,446 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,44697,1676055795050 already deleted, retry=false 2023-02-10 19:03:21,446 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,44697,1676055795050 expired; onlineServers=1 2023-02-10 19:03:21,447 DEBUG [Listener at localhost/37107-EventThread] zookeeper.ZKWatcher(600): master:33383-0x1003f9dbed10000, quorum=127.0.0.1:52230, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-10 19:03:21,447 DEBUG [Listener at localhost/37107-EventThread] zookeeper.ZKWatcher(600): regionserver:35891-0x1003f9dbed10001, quorum=127.0.0.1:52230, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,35891,1676055795020 2023-02-10 19:03:21,447 ERROR [Listener at localhost/37107-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@73a232f5 rejected from java.util.concurrent.ThreadPoolExecutor@779db859[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 19] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-10 19:03:21,447 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,35891,1676055795020] 2023-02-10 19:03:21,447 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,35891,1676055795020; numProcessing=2 2023-02-10 19:03:21,450 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,35891,1676055795020 already deleted, retry=false 2023-02-10 19:03:21,450 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,35891,1676055795020 expired; onlineServers=0 2023-02-10 19:03:21,450 INFO [RegionServerTracker-0] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,33383,1676055794975' ***** 2023-02-10 19:03:21,450 INFO [RegionServerTracker-0] regionserver.HRegionServer(2310): STOPPED: Cluster shutdown set; onlineServer=0 2023-02-10 19:03:21,450 DEBUG [M:0;jenkins-hbase4:33383] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@744db558, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-10 19:03:21,450 INFO [M:0;jenkins-hbase4:33383] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,33383,1676055794975 2023-02-10 19:03:21,450 INFO [M:0;jenkins-hbase4:33383] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,33383,1676055794975; all regions closed. 2023-02-10 19:03:21,450 DEBUG [M:0;jenkins-hbase4:33383] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-10 19:03:21,451 DEBUG [M:0;jenkins-hbase4:33383] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-02-10 19:03:21,451 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-02-10 19:03:21,451 DEBUG [M:0;jenkins-hbase4:33383] cleaner.HFileCleaner(317): Stopping file delete threads 2023-02-10 19:03:21,451 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676055795228] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676055795228,5,FailOnTimeoutGroup] 2023-02-10 19:03:21,451 INFO [M:0;jenkins-hbase4:33383] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-02-10 19:03:21,451 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676055795227] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676055795227,5,FailOnTimeoutGroup] 2023-02-10 19:03:21,451 INFO [M:0;jenkins-hbase4:33383] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-02-10 19:03:21,452 INFO [M:0;jenkins-hbase4:33383] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-02-10 19:03:21,452 DEBUG [Listener at localhost/37107-EventThread] zookeeper.ZKWatcher(600): master:33383-0x1003f9dbed10000, quorum=127.0.0.1:52230, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-02-10 19:03:21,452 DEBUG [M:0;jenkins-hbase4:33383] master.HMaster(1502): Stopping service threads 2023-02-10 19:03:21,452 DEBUG [Listener at localhost/37107-EventThread] zookeeper.ZKWatcher(600): master:33383-0x1003f9dbed10000, quorum=127.0.0.1:52230, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-10 19:03:21,452 INFO [M:0;jenkins-hbase4:33383] procedure2.RemoteProcedureDispatcher(118): Stopping procedure remote dispatcher 2023-02-10 19:03:21,453 ERROR [M:0;jenkins-hbase4:33383] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-02-10 19:03:21,453 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:33383-0x1003f9dbed10000, quorum=127.0.0.1:52230, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-10 19:03:21,453 INFO [M:0;jenkins-hbase4:33383] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-02-10 19:03:21,453 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-02-10 19:03:21,454 DEBUG [M:0;jenkins-hbase4:33383] zookeeper.ZKUtil(398): master:33383-0x1003f9dbed10000, quorum=127.0.0.1:52230, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-02-10 19:03:21,454 WARN [M:0;jenkins-hbase4:33383] master.ActiveMasterManager(323): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-02-10 19:03:21,454 INFO [M:0;jenkins-hbase4:33383] assignment.AssignmentManager(315): Stopping assignment manager 2023-02-10 19:03:21,454 INFO [M:0;jenkins-hbase4:33383] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-02-10 19:03:21,454 DEBUG [M:0;jenkins-hbase4:33383] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-10 19:03:21,454 INFO [M:0;jenkins-hbase4:33383] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-10 19:03:21,454 DEBUG [M:0;jenkins-hbase4:33383] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-10 19:03:21,454 DEBUG [M:0;jenkins-hbase4:33383] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-10 19:03:21,454 DEBUG [M:0;jenkins-hbase4:33383] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-10 19:03:21,454 INFO [M:0;jenkins-hbase4:33383] regionserver.HRegion(2744): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=167.12 KB heapSize=200.04 KB 2023-02-10 19:03:21,462 INFO [M:0;jenkins-hbase4:33383] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=167.12 KB at sequenceid=357 (bloomFilter=true), to=hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/cf672e1492824f2d969b2bf1e9c5097e 2023-02-10 19:03:21,466 DEBUG [M:0;jenkins-hbase4:33383] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/cf672e1492824f2d969b2bf1e9c5097e as hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/cf672e1492824f2d969b2bf1e9c5097e 2023-02-10 19:03:21,470 INFO [M:0;jenkins-hbase4:33383] regionserver.HStore(1080): Added hdfs://localhost:44513/user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/cf672e1492824f2d969b2bf1e9c5097e, entries=53, sequenceid=357, filesize=10.7 K 2023-02-10 19:03:21,470 INFO [M:0;jenkins-hbase4:33383] regionserver.HRegion(2947): Finished flush of dataSize ~167.12 KB/171134, heapSize ~200.02 KB/204824, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 16ms, sequenceid=357, compaction requested=false 2023-02-10 19:03:21,471 INFO [M:0;jenkins-hbase4:33383] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-10 19:03:21,471 DEBUG [M:0;jenkins-hbase4:33383] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1676055801454Disabling compacts and flushes for region at 1676055801454Disabling writes for close at 1676055801454Obtaining lock to block concurrent updates at 1676055801454Preparing flush snapshotting stores in 1595e783b53d99cd5eef43b6debb2682 at 1676055801454Finished memstore snapshotting master:store,,1.1595e783b53d99cd5eef43b6debb2682., syncing WAL and waiting on mvcc, flushsize=dataSize=171134, getHeapSize=204824, getOffHeapSize=0, getCellsCount=442 at 1676055801455 (+1 ms)Flushing stores of master:store,,1.1595e783b53d99cd5eef43b6debb2682. at 1676055801456 (+1 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: creating writer at 1676055801456Flushing 1595e783b53d99cd5eef43b6debb2682/proc: appending metadata at 1676055801458 (+2 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: closing flushed file at 1676055801458Flushing 1595e783b53d99cd5eef43b6debb2682/proc: reopening flushed file at 1676055801467 (+9 ms)Finished flush of dataSize ~167.12 KB/171134, heapSize ~200.02 KB/204824, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 16ms, sequenceid=357, compaction requested=false at 1676055801471 (+4 ms)Writing region close event to WAL at 1676055801471Closed at 1676055801471 2023-02-10 19:03:21,473 WARN [Close-WAL-Writer-0] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(641): complete file /user/jenkins/test-data/50cbcd78-e680-d71e-818c-5b79fbf8a44c/MasterData/WALs/jenkins-hbase4.apache.org,33383,1676055794975/jenkins-hbase4.apache.org%2C33383%2C1676055794975.1676055795130 not finished, retry = 0 2023-02-10 19:03:21,574 INFO [M:0;jenkins-hbase4:33383] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-02-10 19:03:21,575 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-10 19:03:21,575 INFO [M:0;jenkins-hbase4:33383] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:33383 2023-02-10 19:03:21,578 DEBUG [M:0;jenkins-hbase4:33383] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,33383,1676055794975 already deleted, retry=false 2023-02-10 19:03:21,605 DEBUG [Listener at localhost/37107-EventThread] zookeeper.ZKWatcher(600): regionserver:35891-0x1003f9dbed10001, quorum=127.0.0.1:52230, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-10 19:03:21,605 INFO [RS:0;jenkins-hbase4:35891] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,35891,1676055795020; zookeeper connection closed. 2023-02-10 19:03:21,605 ERROR [Listener at localhost/37107-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@61b0592f rejected from java.util.concurrent.ThreadPoolExecutor@779db859[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 19] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-10 19:03:21,605 DEBUG [Listener at localhost/37107-EventThread] zookeeper.ZKWatcher(600): regionserver:35891-0x1003f9dbed10001, quorum=127.0.0.1:52230, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-10 19:03:21,605 ERROR [Listener at localhost/37107-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@1922d523 rejected from java.util.concurrent.ThreadPoolExecutor@779db859[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 19] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-10 19:03:21,605 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@66f015e1] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@66f015e1 2023-02-10 19:03:21,705 DEBUG [Listener at localhost/37107-EventThread] zookeeper.ZKWatcher(600): regionserver:44697-0x1003f9dbed10002, quorum=127.0.0.1:52230, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-10 19:03:21,705 INFO [RS:1;jenkins-hbase4:44697] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,44697,1676055795050; zookeeper connection closed. 2023-02-10 19:03:21,705 ERROR [Listener at localhost/37107-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@23a33dcb rejected from java.util.concurrent.ThreadPoolExecutor@4c0aff36[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-10 19:03:21,705 DEBUG [Listener at localhost/37107-EventThread] zookeeper.ZKWatcher(600): regionserver:44697-0x1003f9dbed10002, quorum=127.0.0.1:52230, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-10 19:03:21,705 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@4e26b9a1] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@4e26b9a1 2023-02-10 19:03:21,705 ERROR [Listener at localhost/37107-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@66ca75a5 rejected from java.util.concurrent.ThreadPoolExecutor@4c0aff36[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-10 19:03:21,706 INFO [Listener at localhost/37107] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 2 regionserver(s) complete 2023-02-10 19:03:21,805 DEBUG [Listener at localhost/37107-EventThread] zookeeper.ZKWatcher(600): master:33383-0x1003f9dbed10000, quorum=127.0.0.1:52230, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-10 19:03:21,805 INFO [M:0;jenkins-hbase4:33383] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,33383,1676055794975; zookeeper connection closed. 2023-02-10 19:03:21,805 ERROR [Listener at localhost/37107-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@1780f8b rejected from java.util.concurrent.ThreadPoolExecutor@5479b7c[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 56] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-10 19:03:21,807 DEBUG [Listener at localhost/37107-EventThread] zookeeper.ZKWatcher(600): master:33383-0x1003f9dbed10000, quorum=127.0.0.1:52230, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-10 19:03:21,807 ERROR [Listener at localhost/37107-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@308ab224 rejected from java.util.concurrent.ThreadPoolExecutor@5479b7c[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 56] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-10 19:03:21,807 WARN [Listener at localhost/37107] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-10 19:03:21,811 INFO [Listener at localhost/37107] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-10 19:03:21,919 WARN [BP-985931440-172.31.14.131-1676055794392 heartbeating to localhost/127.0.0.1:44513] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-10 19:03:21,920 WARN [BP-985931440-172.31.14.131-1676055794392 heartbeating to localhost/127.0.0.1:44513] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-985931440-172.31.14.131-1676055794392 (Datanode Uuid 332eb48f-611f-4828-a940-8d74a207dbb0) service to localhost/127.0.0.1:44513 2023-02-10 19:03:21,920 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/757a71d1-7690-509e-0487-fb796263e86c/cluster_58a94646-bb78-d4e4-4033-d6cf027883fb/dfs/data/data3/current/BP-985931440-172.31.14.131-1676055794392] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-10 19:03:21,921 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/757a71d1-7690-509e-0487-fb796263e86c/cluster_58a94646-bb78-d4e4-4033-d6cf027883fb/dfs/data/data4/current/BP-985931440-172.31.14.131-1676055794392] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-10 19:03:21,922 WARN [Listener at localhost/37107] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-10 19:03:21,925 INFO [Listener at localhost/37107] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-10 19:03:22,030 WARN [BP-985931440-172.31.14.131-1676055794392 heartbeating to localhost/127.0.0.1:44513] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-10 19:03:22,031 WARN [BP-985931440-172.31.14.131-1676055794392 heartbeating to localhost/127.0.0.1:44513] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-985931440-172.31.14.131-1676055794392 (Datanode Uuid 4775a56b-ef25-4b7a-8ab9-9355b3e4fdd3) service to localhost/127.0.0.1:44513 2023-02-10 19:03:22,033 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/757a71d1-7690-509e-0487-fb796263e86c/cluster_58a94646-bb78-d4e4-4033-d6cf027883fb/dfs/data/data1/current/BP-985931440-172.31.14.131-1676055794392] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-10 19:03:22,033 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/757a71d1-7690-509e-0487-fb796263e86c/cluster_58a94646-bb78-d4e4-4033-d6cf027883fb/dfs/data/data2/current/BP-985931440-172.31.14.131-1676055794392] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-10 19:03:22,043 INFO [Listener at localhost/37107] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-10 19:03:22,163 INFO [Listener at localhost/37107] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-02-10 19:03:22,199 INFO [Listener at localhost/37107] hbase.HBaseTestingUtility(1293): Minicluster is down 2023-02-10 19:03:22,214 INFO [Listener at localhost/37107] hbase.ResourceChecker(175): after: mapred.TestTableSnapshotInputFormat#testWithMockedMapReduceMultiRegion Thread=229 (was 177) Potentially hanging thread: IPC Client (1688088802) connection to localhost/127.0.0.1:44513 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-17-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-14-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/37107 java.lang.Thread.dumpThreads(Native Method) java.lang.Thread.getAllStackTraces(Thread.java:1615) org.apache.hadoop.hbase.ResourceCheckerJUnitListener$ThreadResourceAnalyzer.getVal(ResourceCheckerJUnitListener.java:49) org.apache.hadoop.hbase.ResourceChecker.fill(ResourceChecker.java:110) org.apache.hadoop.hbase.ResourceChecker.fillEndings(ResourceChecker.java:104) org.apache.hadoop.hbase.ResourceChecker.end(ResourceChecker.java:206) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.end(ResourceCheckerJUnitListener.java:165) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.testFinished(ResourceCheckerJUnitListener.java:185) org.junit.runner.notification.SynchronizedRunListener.testFinished(SynchronizedRunListener.java:87) org.junit.runner.notification.RunNotifier$9.notifyListener(RunNotifier.java:225) org.junit.runner.notification.RunNotifier$SafeNotifier.run(RunNotifier.java:72) org.junit.runner.notification.RunNotifier.fireTestFinished(RunNotifier.java:222) org.junit.internal.runners.model.EachTestNotifier.fireTestFinished(EachTestNotifier.java:38) org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:372) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) org.apache.hadoop.hbase.SystemExitRule$1.evaluate(SystemExitRule.java:39) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/37107.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: Listener at localhost/37107.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: nioEventLoopGroup-15-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-16-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-17-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins@localhost:44513 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-13-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-17-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-16-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-14-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/37107.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: RS-EventLoopGroup-14-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-16-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-12-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-15-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/37107.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-10 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/37107.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: nioEventLoopGroup-15-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/37107.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: RS-EventLoopGroup-12-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1688088802) connection to localhost/127.0.0.1:44513 from jenkins.hfs.6 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: IPC Client (1688088802) connection to localhost/127.0.0.1:44513 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: IPC Client (1688088802) connection to localhost/127.0.0.1:44513 from jenkins.hfs.7 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS-EventLoopGroup-12-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/37107.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: Listener at localhost/37107.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: Listener at localhost/37107.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: RS-EventLoopGroup-13-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/37107.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: nioEventLoopGroup-14-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-11 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.7@localhost:44513 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-13-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.6@localhost:44513 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-14-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-12 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-14-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase4.apache.org,33383,1676055794975)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=634 (was 567) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=359 (was 371), ProcessCount=167 (was 167), AvailableMemoryMB=3414 (was 3484) 2023-02-10 19:03:22,224 INFO [Listener at localhost/37107] hbase.ResourceChecker(147): before: mapred.TestTableSnapshotInputFormat#testWithMockedMapReduceSingleRegion Thread=229, OpenFileDescriptor=634, MaxFileDescriptor=60000, SystemLoadAverage=359, ProcessCount=167, AvailableMemoryMB=3414 2023-02-10 19:03:22,235 INFO [Listener at localhost/37107] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.log.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/757a71d1-7690-509e-0487-fb796263e86c/hadoop.log.dir so I do NOT create it in target/test-data/5f701de7-b9db-7a79-7062-8ee81962e145 2023-02-10 19:03:22,235 WARN [Listener at localhost/37107] hbase.HBaseTestingUtility(449): hadoop.log.dir property value differs in configuration and system: Configuration=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/../logs while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/757a71d1-7690-509e-0487-fb796263e86c/hadoop.log.dir Erasing configuration value by system value. 2023-02-10 19:03:22,235 INFO [Listener at localhost/37107] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.tmp.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/757a71d1-7690-509e-0487-fb796263e86c/hadoop.tmp.dir so I do NOT create it in target/test-data/5f701de7-b9db-7a79-7062-8ee81962e145 2023-02-10 19:03:22,235 WARN [Listener at localhost/37107] hbase.HBaseTestingUtility(449): hadoop.tmp.dir property value differs in configuration and system: Configuration=/tmp/hadoop-jenkins while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/757a71d1-7690-509e-0487-fb796263e86c/hadoop.tmp.dir Erasing configuration value by system value. 2023-02-10 19:03:22,235 DEBUG [Listener at localhost/37107] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5f701de7-b9db-7a79-7062-8ee81962e145 2023-02-10 19:03:22,235 INFO [Listener at localhost/37107] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=2, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=true, createWALDir=false} 2023-02-10 19:03:22,235 INFO [Listener at localhost/37107] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5f701de7-b9db-7a79-7062-8ee81962e145/cluster_ac1c84d9-60af-e122-da76-032408a561af, deleteOnExit=true 2023-02-10 19:03:22,235 INFO [Listener at localhost/37107] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-02-10 19:03:22,235 INFO [Listener at localhost/37107] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5f701de7-b9db-7a79-7062-8ee81962e145/test.cache.data in system properties and HBase conf 2023-02-10 19:03:22,235 INFO [Listener at localhost/37107] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5f701de7-b9db-7a79-7062-8ee81962e145/hadoop.tmp.dir in system properties and HBase conf 2023-02-10 19:03:22,235 INFO [Listener at localhost/37107] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5f701de7-b9db-7a79-7062-8ee81962e145/hadoop.log.dir in system properties and HBase conf 2023-02-10 19:03:22,236 INFO [Listener at localhost/37107] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5f701de7-b9db-7a79-7062-8ee81962e145/mapreduce.cluster.local.dir in system properties and HBase conf 2023-02-10 19:03:22,236 INFO [Listener at localhost/37107] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5f701de7-b9db-7a79-7062-8ee81962e145/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-02-10 19:03:22,236 INFO [Listener at localhost/37107] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-02-10 19:03:22,236 DEBUG [Listener at localhost/37107] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-02-10 19:03:22,236 INFO [Listener at localhost/37107] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5f701de7-b9db-7a79-7062-8ee81962e145/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-02-10 19:03:22,236 INFO [Listener at localhost/37107] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5f701de7-b9db-7a79-7062-8ee81962e145/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-02-10 19:03:22,236 INFO [Listener at localhost/37107] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5f701de7-b9db-7a79-7062-8ee81962e145/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-02-10 19:03:22,236 INFO [Listener at localhost/37107] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5f701de7-b9db-7a79-7062-8ee81962e145/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-10 19:03:22,237 INFO [Listener at localhost/37107] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5f701de7-b9db-7a79-7062-8ee81962e145/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-02-10 19:03:22,237 INFO [Listener at localhost/37107] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5f701de7-b9db-7a79-7062-8ee81962e145/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-02-10 19:03:22,237 INFO [Listener at localhost/37107] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5f701de7-b9db-7a79-7062-8ee81962e145/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-10 19:03:22,237 INFO [Listener at localhost/37107] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5f701de7-b9db-7a79-7062-8ee81962e145/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-10 19:03:22,237 INFO [Listener at localhost/37107] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5f701de7-b9db-7a79-7062-8ee81962e145/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-02-10 19:03:22,237 INFO [Listener at localhost/37107] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5f701de7-b9db-7a79-7062-8ee81962e145/nfs.dump.dir in system properties and HBase conf 2023-02-10 19:03:22,237 INFO [Listener at localhost/37107] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5f701de7-b9db-7a79-7062-8ee81962e145/java.io.tmpdir in system properties and HBase conf 2023-02-10 19:03:22,237 INFO [Listener at localhost/37107] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5f701de7-b9db-7a79-7062-8ee81962e145/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-10 19:03:22,237 INFO [Listener at localhost/37107] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5f701de7-b9db-7a79-7062-8ee81962e145/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-02-10 19:03:22,237 INFO [Listener at localhost/37107] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5f701de7-b9db-7a79-7062-8ee81962e145/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-02-10 19:03:22,241 WARN [Listener at localhost/37107] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-10 19:03:22,241 WARN [Listener at localhost/37107] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-10 19:03:22,312 WARN [Listener at localhost/37107] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-10 19:03:22,314 INFO [Listener at localhost/37107] log.Slf4jLog(67): jetty-6.1.26 2023-02-10 19:03:22,321 INFO [Listener at localhost/37107] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5f701de7-b9db-7a79-7062-8ee81962e145/java.io.tmpdir/Jetty_localhost_43325_hdfs____ixpx8h/webapp 2023-02-10 19:03:22,415 INFO [Listener at localhost/37107] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:43325 2023-02-10 19:03:22,420 WARN [Listener at localhost/37107] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-10 19:03:22,420 WARN [Listener at localhost/37107] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-10 19:03:22,460 WARN [Listener at localhost/46525] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-10 19:03:22,472 WARN [Listener at localhost/46525] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-10 19:03:22,475 WARN [Listener at localhost/46525] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-10 19:03:22,476 INFO [Listener at localhost/46525] log.Slf4jLog(67): jetty-6.1.26 2023-02-10 19:03:22,483 INFO [Listener at localhost/46525] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5f701de7-b9db-7a79-7062-8ee81962e145/java.io.tmpdir/Jetty_localhost_37293_datanode____xrwmhb/webapp 2023-02-10 19:03:22,574 INFO [Listener at localhost/46525] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:37293 2023-02-10 19:03:22,584 WARN [Listener at localhost/42055] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-10 19:03:22,600 WARN [Listener at localhost/42055] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-10 19:03:22,602 WARN [Listener at localhost/42055] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-10 19:03:22,603 INFO [Listener at localhost/42055] log.Slf4jLog(67): jetty-6.1.26 2023-02-10 19:03:22,607 INFO [Listener at localhost/42055] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5f701de7-b9db-7a79-7062-8ee81962e145/java.io.tmpdir/Jetty_localhost_35081_datanode____iv2oz2/webapp 2023-02-10 19:03:22,680 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x146e3ca3801147ee: Processing first storage report for DS-ae22d516-01d3-476b-b729-85d2f7ded568 from datanode 095232dc-35e9-403e-9149-fa5529e78e51 2023-02-10 19:03:22,681 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x146e3ca3801147ee: from storage DS-ae22d516-01d3-476b-b729-85d2f7ded568 node DatanodeRegistration(127.0.0.1:39971, datanodeUuid=095232dc-35e9-403e-9149-fa5529e78e51, infoPort=40615, infoSecurePort=0, ipcPort=42055, storageInfo=lv=-57;cid=testClusterID;nsid=449959860;c=1676055802273), blocks: 0, hasStaleStorage: true, processing time: 1 msecs, invalidatedBlocks: 0 2023-02-10 19:03:22,681 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x146e3ca3801147ee: Processing first storage report for DS-13ae9cd0-e3f0-421f-977a-a8d6ad975121 from datanode 095232dc-35e9-403e-9149-fa5529e78e51 2023-02-10 19:03:22,681 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x146e3ca3801147ee: from storage DS-13ae9cd0-e3f0-421f-977a-a8d6ad975121 node DatanodeRegistration(127.0.0.1:39971, datanodeUuid=095232dc-35e9-403e-9149-fa5529e78e51, infoPort=40615, infoSecurePort=0, ipcPort=42055, storageInfo=lv=-57;cid=testClusterID;nsid=449959860;c=1676055802273), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-10 19:03:22,706 INFO [Listener at localhost/42055] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:35081 2023-02-10 19:03:22,716 WARN [Listener at localhost/38427] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-10 19:03:22,811 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xfba9d6310847020b: Processing first storage report for DS-14717d91-894c-4cbf-9b7e-00654833572c from datanode 5b87d203-1109-457e-b1b7-724b583b90e4 2023-02-10 19:03:22,811 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xfba9d6310847020b: from storage DS-14717d91-894c-4cbf-9b7e-00654833572c node DatanodeRegistration(127.0.0.1:35131, datanodeUuid=5b87d203-1109-457e-b1b7-724b583b90e4, infoPort=36237, infoSecurePort=0, ipcPort=38427, storageInfo=lv=-57;cid=testClusterID;nsid=449959860;c=1676055802273), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-10 19:03:22,811 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xfba9d6310847020b: Processing first storage report for DS-9247fbcd-a392-4ffd-9645-e579897e2f33 from datanode 5b87d203-1109-457e-b1b7-724b583b90e4 2023-02-10 19:03:22,811 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xfba9d6310847020b: from storage DS-9247fbcd-a392-4ffd-9645-e579897e2f33 node DatanodeRegistration(127.0.0.1:35131, datanodeUuid=5b87d203-1109-457e-b1b7-724b583b90e4, infoPort=36237, infoSecurePort=0, ipcPort=38427, storageInfo=lv=-57;cid=testClusterID;nsid=449959860;c=1676055802273), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-10 19:03:22,822 DEBUG [Listener at localhost/38427] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5f701de7-b9db-7a79-7062-8ee81962e145 2023-02-10 19:03:22,824 INFO [Listener at localhost/38427] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5f701de7-b9db-7a79-7062-8ee81962e145/cluster_ac1c84d9-60af-e122-da76-032408a561af/zookeeper_0, clientPort=58765, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5f701de7-b9db-7a79-7062-8ee81962e145/cluster_ac1c84d9-60af-e122-da76-032408a561af/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5f701de7-b9db-7a79-7062-8ee81962e145/cluster_ac1c84d9-60af-e122-da76-032408a561af/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-02-10 19:03:22,826 INFO [Listener at localhost/38427] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=58765 2023-02-10 19:03:22,826 INFO [Listener at localhost/38427] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-10 19:03:22,827 INFO [Listener at localhost/38427] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-10 19:03:22,842 INFO [Listener at localhost/38427] util.FSUtils(479): Created version file at hdfs://localhost:46525/user/jenkins/test-data/f68bbe99-417e-4fda-4301-36f56a4b6e73 with version=8 2023-02-10 19:03:22,842 INFO [Listener at localhost/38427] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-10 19:03:22,843 INFO [Listener at localhost/38427] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-10 19:03:22,844 INFO [Listener at localhost/38427] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:46525/user/jenkins/test-data/c59aa4a0-287a-d68f-419a-c4a4b1b210b5/hbase-staging 2023-02-10 19:03:22,846 INFO [Listener at localhost/38427] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-02-10 19:03:22,846 INFO [Listener at localhost/38427] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-10 19:03:22,846 INFO [Listener at localhost/38427] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-10 19:03:22,846 INFO [Listener at localhost/38427] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-10 19:03:22,846 INFO [Listener at localhost/38427] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-10 19:03:22,846 INFO [Listener at localhost/38427] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-10 19:03:22,846 INFO [Listener at localhost/38427] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-02-10 19:03:22,847 INFO [Listener at localhost/38427] ipc.NettyRpcServer(120): Bind to /172.31.14.131:37641 2023-02-10 19:03:22,848 INFO [Listener at localhost/38427] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-10 19:03:22,848 INFO [Listener at localhost/38427] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-10 19:03:22,849 INFO [Listener at localhost/38427] zookeeper.RecoverableZooKeeper(93): Process identifier=master:37641 connecting to ZooKeeper ensemble=127.0.0.1:58765 2023-02-10 19:03:22,857 DEBUG [Listener at localhost/38427-EventThread] zookeeper.ZKWatcher(600): master:376410x0, quorum=127.0.0.1:58765, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-10 19:03:22,858 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): master:37641-0x1003f9ddd8d0000 connected 2023-02-10 19:03:22,875 DEBUG [Listener at localhost/38427] zookeeper.ZKUtil(164): master:37641-0x1003f9ddd8d0000, quorum=127.0.0.1:58765, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-10 19:03:22,875 DEBUG [Listener at localhost/38427] zookeeper.ZKUtil(164): master:37641-0x1003f9ddd8d0000, quorum=127.0.0.1:58765, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-10 19:03:22,876 DEBUG [Listener at localhost/38427] zookeeper.ZKUtil(164): master:37641-0x1003f9ddd8d0000, quorum=127.0.0.1:58765, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-10 19:03:22,880 DEBUG [Listener at localhost/38427] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=37641 2023-02-10 19:03:22,880 DEBUG [Listener at localhost/38427] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=37641 2023-02-10 19:03:22,884 DEBUG [Listener at localhost/38427] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=37641 2023-02-10 19:03:22,887 DEBUG [Listener at localhost/38427] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=37641 2023-02-10 19:03:22,888 DEBUG [Listener at localhost/38427] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=37641 2023-02-10 19:03:22,888 INFO [Listener at localhost/38427] master.HMaster(439): hbase.rootdir=hdfs://localhost:46525/user/jenkins/test-data/f68bbe99-417e-4fda-4301-36f56a4b6e73, hbase.cluster.distributed=false 2023-02-10 19:03:22,900 INFO [Listener at localhost/38427] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-10 19:03:22,900 INFO [Listener at localhost/38427] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-10 19:03:22,900 INFO [Listener at localhost/38427] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-10 19:03:22,900 INFO [Listener at localhost/38427] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-10 19:03:22,900 INFO [Listener at localhost/38427] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-10 19:03:22,900 INFO [Listener at localhost/38427] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-10 19:03:22,901 INFO [Listener at localhost/38427] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-10 19:03:22,904 INFO [Listener at localhost/38427] ipc.NettyRpcServer(120): Bind to /172.31.14.131:43705 2023-02-10 19:03:22,904 INFO [Listener at localhost/38427] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-10 19:03:22,907 DEBUG [Listener at localhost/38427] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-10 19:03:22,907 INFO [Listener at localhost/38427] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-10 19:03:22,908 INFO [Listener at localhost/38427] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-10 19:03:22,909 INFO [Listener at localhost/38427] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:43705 connecting to ZooKeeper ensemble=127.0.0.1:58765 2023-02-10 19:03:22,913 DEBUG [Listener at localhost/38427-EventThread] zookeeper.ZKWatcher(600): regionserver:437050x0, quorum=127.0.0.1:58765, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-10 19:03:22,915 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:43705-0x1003f9ddd8d0001 connected 2023-02-10 19:03:22,915 DEBUG [Listener at localhost/38427] zookeeper.ZKUtil(164): regionserver:43705-0x1003f9ddd8d0001, quorum=127.0.0.1:58765, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-10 19:03:22,915 DEBUG [Listener at localhost/38427] zookeeper.ZKUtil(164): regionserver:43705-0x1003f9ddd8d0001, quorum=127.0.0.1:58765, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-10 19:03:22,916 DEBUG [Listener at localhost/38427] zookeeper.ZKUtil(164): regionserver:43705-0x1003f9ddd8d0001, quorum=127.0.0.1:58765, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-10 19:03:22,920 DEBUG [Listener at localhost/38427] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=43705 2023-02-10 19:03:22,920 DEBUG [Listener at localhost/38427] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=43705 2023-02-10 19:03:22,924 DEBUG [Listener at localhost/38427] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=43705 2023-02-10 19:03:22,924 DEBUG [Listener at localhost/38427] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=43705 2023-02-10 19:03:22,924 DEBUG [Listener at localhost/38427] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=43705 2023-02-10 19:03:22,941 INFO [Listener at localhost/38427] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-10 19:03:22,941 INFO [Listener at localhost/38427] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-10 19:03:22,941 INFO [Listener at localhost/38427] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-10 19:03:22,942 INFO [Listener at localhost/38427] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-10 19:03:22,942 INFO [Listener at localhost/38427] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-10 19:03:22,942 INFO [Listener at localhost/38427] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-10 19:03:22,942 INFO [Listener at localhost/38427] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-10 19:03:22,944 INFO [Listener at localhost/38427] ipc.NettyRpcServer(120): Bind to /172.31.14.131:37167 2023-02-10 19:03:22,944 INFO [Listener at localhost/38427] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-10 19:03:22,948 DEBUG [Listener at localhost/38427] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-10 19:03:22,948 INFO [Listener at localhost/38427] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-10 19:03:22,949 INFO [Listener at localhost/38427] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-10 19:03:22,950 INFO [Listener at localhost/38427] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:37167 connecting to ZooKeeper ensemble=127.0.0.1:58765 2023-02-10 19:03:22,954 DEBUG [Listener at localhost/38427-EventThread] zookeeper.ZKWatcher(600): regionserver:371670x0, quorum=127.0.0.1:58765, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-10 19:03:22,955 DEBUG [Listener at localhost/38427] zookeeper.ZKUtil(164): regionserver:371670x0, quorum=127.0.0.1:58765, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-10 19:03:22,955 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:37167-0x1003f9ddd8d0002 connected 2023-02-10 19:03:22,956 DEBUG [Listener at localhost/38427] zookeeper.ZKUtil(164): regionserver:37167-0x1003f9ddd8d0002, quorum=127.0.0.1:58765, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-10 19:03:22,956 DEBUG [Listener at localhost/38427] zookeeper.ZKUtil(164): regionserver:37167-0x1003f9ddd8d0002, quorum=127.0.0.1:58765, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-10 19:03:22,956 DEBUG [Listener at localhost/38427] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=37167 2023-02-10 19:03:22,957 DEBUG [Listener at localhost/38427] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=37167 2023-02-10 19:03:22,960 DEBUG [Listener at localhost/38427] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=37167 2023-02-10 19:03:22,962 DEBUG [Listener at localhost/38427] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=37167 2023-02-10 19:03:22,963 DEBUG [Listener at localhost/38427] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=37167 2023-02-10 19:03:22,964 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2158): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,37641,1676055802845 2023-02-10 19:03:22,967 DEBUG [Listener at localhost/38427-EventThread] zookeeper.ZKWatcher(600): master:37641-0x1003f9ddd8d0000, quorum=127.0.0.1:58765, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-10 19:03:22,967 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:37641-0x1003f9ddd8d0000, quorum=127.0.0.1:58765, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,37641,1676055802845 2023-02-10 19:03:22,968 DEBUG [Listener at localhost/38427-EventThread] zookeeper.ZKWatcher(600): master:37641-0x1003f9ddd8d0000, quorum=127.0.0.1:58765, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-10 19:03:22,968 DEBUG [Listener at localhost/38427-EventThread] zookeeper.ZKWatcher(600): regionserver:43705-0x1003f9ddd8d0001, quorum=127.0.0.1:58765, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-10 19:03:22,968 DEBUG [Listener at localhost/38427-EventThread] zookeeper.ZKWatcher(600): regionserver:37167-0x1003f9ddd8d0002, quorum=127.0.0.1:58765, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-10 19:03:22,968 DEBUG [Listener at localhost/38427-EventThread] zookeeper.ZKWatcher(600): master:37641-0x1003f9ddd8d0000, quorum=127.0.0.1:58765, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-10 19:03:22,969 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:37641-0x1003f9ddd8d0000, quorum=127.0.0.1:58765, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-10 19:03:22,972 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(224): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,37641,1676055802845 from backup master directory 2023-02-10 19:03:22,972 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:37641-0x1003f9ddd8d0000, quorum=127.0.0.1:58765, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-10 19:03:22,973 DEBUG [Listener at localhost/38427-EventThread] zookeeper.ZKWatcher(600): master:37641-0x1003f9ddd8d0000, quorum=127.0.0.1:58765, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,37641,1676055802845 2023-02-10 19:03:22,973 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-10 19:03:22,973 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(234): Registered as active master=jenkins-hbase4.apache.org,37641,1676055802845 2023-02-10 19:03:22,973 DEBUG [Listener at localhost/38427-EventThread] zookeeper.ZKWatcher(600): master:37641-0x1003f9ddd8d0000, quorum=127.0.0.1:58765, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-10 19:03:22,992 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(628): Created cluster ID file at hdfs://localhost:46525/user/jenkins/test-data/f68bbe99-417e-4fda-4301-36f56a4b6e73/hbase.id with ID: 2ec8ca0c-d14d-499e-b94a-1582b07153ae 2023-02-10 19:03:23,000 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-10 19:03:23,002 DEBUG [Listener at localhost/38427-EventThread] zookeeper.ZKWatcher(600): master:37641-0x1003f9ddd8d0000, quorum=127.0.0.1:58765, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-10 19:03:23,011 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x211a09ca to 127.0.0.1:58765 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-10 19:03:23,016 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7ab45bbe, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-10 19:03:23,016 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-10 19:03:23,017 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-02-10 19:03:23,017 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-10 19:03:23,018 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7689): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:46525/user/jenkins/test-data/f68bbe99-417e-4fda-4301-36f56a4b6e73/MasterData/data/master/store-tmp 2023-02-10 19:03:23,030 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-10 19:03:23,030 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-10 19:03:23,030 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-10 19:03:23,030 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-10 19:03:23,030 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-10 19:03:23,030 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-10 19:03:23,030 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-10 19:03:23,030 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1676055803030Disabling compacts and flushes for region at 1676055803030Disabling writes for close at 1676055803030Writing region close event to WAL at 1676055803030Closed at 1676055803030 2023-02-10 19:03:23,030 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:46525/user/jenkins/test-data/f68bbe99-417e-4fda-4301-36f56a4b6e73/MasterData/WALs/jenkins-hbase4.apache.org,37641,1676055802845 2023-02-10 19:03:23,032 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C37641%2C1676055802845, suffix=, logDir=hdfs://localhost:46525/user/jenkins/test-data/f68bbe99-417e-4fda-4301-36f56a4b6e73/MasterData/WALs/jenkins-hbase4.apache.org,37641,1676055802845, archiveDir=hdfs://localhost:46525/user/jenkins/test-data/f68bbe99-417e-4fda-4301-36f56a4b6e73/MasterData/oldWALs, maxLogs=10 2023-02-10 19:03:23,044 DEBUG [RS-EventLoopGroup-17-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35131,DS-14717d91-894c-4cbf-9b7e-00654833572c,DISK] 2023-02-10 19:03:23,045 DEBUG [RS-EventLoopGroup-17-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39971,DS-ae22d516-01d3-476b-b729-85d2f7ded568,DISK] 2023-02-10 19:03:23,046 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/f68bbe99-417e-4fda-4301-36f56a4b6e73/MasterData/WALs/jenkins-hbase4.apache.org,37641,1676055802845/jenkins-hbase4.apache.org%2C37641%2C1676055802845.1676055803033 2023-02-10 19:03:23,047 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:35131,DS-14717d91-894c-4cbf-9b7e-00654833572c,DISK], DatanodeInfoWithStorage[127.0.0.1:39971,DS-ae22d516-01d3-476b-b729-85d2f7ded568,DISK]] 2023-02-10 19:03:23,047 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7850): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-02-10 19:03:23,047 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-10 19:03:23,047 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7890): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-02-10 19:03:23,047 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7893): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-02-10 19:03:23,048 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-02-10 19:03:23,049 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46525/user/jenkins/test-data/f68bbe99-417e-4fda-4301-36f56a4b6e73/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-02-10 19:03:23,049 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-02-10 19:03:23,050 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-10 19:03:23,050 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46525/user/jenkins/test-data/f68bbe99-417e-4fda-4301-36f56a4b6e73/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-10 19:03:23,051 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46525/user/jenkins/test-data/f68bbe99-417e-4fda-4301-36f56a4b6e73/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-10 19:03:23,053 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1054): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-02-10 19:03:23,056 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46525/user/jenkins/test-data/f68bbe99-417e-4fda-4301-36f56a4b6e73/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-10 19:03:23,057 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1071): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64432396, jitterRate=-0.03988248109817505}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-10 19:03:23,057 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(964): Region open journal for 1595e783b53d99cd5eef43b6debb2682: Writing region info on filesystem at 1676055803047Initializing all the Stores at 1676055803048 (+1 ms)Instantiating store for column family {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676055803048Cleaning up temporary data from old regions at 1676055803051 (+3 ms)Cleaning up detritus from prior splits at 1676055803051Region opened successfully at 1676055803057 (+6 ms) 2023-02-10 19:03:23,057 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-02-10 19:03:23,058 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-02-10 19:03:23,058 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-02-10 19:03:23,058 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-02-10 19:03:23,059 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 0 msec 2023-02-10 19:03:23,059 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 0 msec 2023-02-10 19:03:23,059 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(95): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-02-10 19:03:23,061 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-02-10 19:03:23,062 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-02-10 19:03:23,071 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-02-10 19:03:23,072 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-02-10 19:03:23,072 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:37641-0x1003f9ddd8d0000, quorum=127.0.0.1:58765, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-02-10 19:03:23,072 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-02-10 19:03:23,072 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:37641-0x1003f9ddd8d0000, quorum=127.0.0.1:58765, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-02-10 19:03:23,074 DEBUG [Listener at localhost/38427-EventThread] zookeeper.ZKWatcher(600): master:37641-0x1003f9ddd8d0000, quorum=127.0.0.1:58765, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-10 19:03:23,074 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:37641-0x1003f9ddd8d0000, quorum=127.0.0.1:58765, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-02-10 19:03:23,075 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:37641-0x1003f9ddd8d0000, quorum=127.0.0.1:58765, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-02-10 19:03:23,075 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:37641-0x1003f9ddd8d0000, quorum=127.0.0.1:58765, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-02-10 19:03:23,076 DEBUG [Listener at localhost/38427-EventThread] zookeeper.ZKWatcher(600): master:37641-0x1003f9ddd8d0000, quorum=127.0.0.1:58765, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-10 19:03:23,076 DEBUG [Listener at localhost/38427-EventThread] zookeeper.ZKWatcher(600): regionserver:37167-0x1003f9ddd8d0002, quorum=127.0.0.1:58765, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-10 19:03:23,077 DEBUG [Listener at localhost/38427-EventThread] zookeeper.ZKWatcher(600): master:37641-0x1003f9ddd8d0000, quorum=127.0.0.1:58765, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-10 19:03:23,076 DEBUG [Listener at localhost/38427-EventThread] zookeeper.ZKWatcher(600): regionserver:43705-0x1003f9ddd8d0001, quorum=127.0.0.1:58765, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-10 19:03:23,077 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(739): Active/primary master=jenkins-hbase4.apache.org,37641,1676055802845, sessionid=0x1003f9ddd8d0000, setting cluster-up flag (Was=false) 2023-02-10 19:03:23,083 DEBUG [Listener at localhost/38427-EventThread] zookeeper.ZKWatcher(600): master:37641-0x1003f9ddd8d0000, quorum=127.0.0.1:58765, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-10 19:03:23,086 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-02-10 19:03:23,086 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,37641,1676055802845 2023-02-10 19:03:23,090 DEBUG [Listener at localhost/38427-EventThread] zookeeper.ZKWatcher(600): master:37641-0x1003f9ddd8d0000, quorum=127.0.0.1:58765, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-10 19:03:23,094 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-02-10 19:03:23,095 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,37641,1676055802845 2023-02-10 19:03:23,095 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:46525/user/jenkins/test-data/f68bbe99-417e-4fda-4301-36f56a4b6e73/.hbase-snapshot/.tmp 2023-02-10 19:03:23,096 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-02-10 19:03:23,097 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-10 19:03:23,097 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-10 19:03:23,097 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-10 19:03:23,097 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-10 19:03:23,097 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-02-10 19:03:23,097 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-10 19:03:23,097 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-10 19:03:23,097 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-10 19:03:23,106 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1676055833106 2023-02-10 19:03:23,106 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-02-10 19:03:23,106 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-02-10 19:03:23,106 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-02-10 19:03:23,106 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-02-10 19:03:23,106 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-02-10 19:03:23,106 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-02-10 19:03:23,106 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-10 19:03:23,106 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-02-10 19:03:23,106 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-02-10 19:03:23,106 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-02-10 19:03:23,107 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-02-10 19:03:23,107 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-02-10 19:03:23,107 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-02-10 19:03:23,108 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-02-10 19:03:23,108 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676055803108,5,FailOnTimeoutGroup] 2023-02-10 19:03:23,108 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-10 19:03:23,108 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676055803108,5,FailOnTimeoutGroup] 2023-02-10 19:03:23,108 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-10 19:03:23,108 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1451): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-02-10 19:03:23,108 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-02-10 19:03:23,108 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-02-10 19:03:23,119 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:46525/user/jenkins/test-data/f68bbe99-417e-4fda-4301-36f56a4b6e73/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-10 19:03:23,119 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:46525/user/jenkins/test-data/f68bbe99-417e-4fda-4301-36f56a4b6e73/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-10 19:03:23,120 INFO [PEWorker-1] regionserver.HRegion(7671): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:46525/user/jenkins/test-data/f68bbe99-417e-4fda-4301-36f56a4b6e73 2023-02-10 19:03:23,127 DEBUG [PEWorker-1] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-10 19:03:23,128 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-10 19:03:23,129 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46525/user/jenkins/test-data/f68bbe99-417e-4fda-4301-36f56a4b6e73/data/hbase/meta/1588230740/info 2023-02-10 19:03:23,129 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-10 19:03:23,130 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-10 19:03:23,130 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-10 19:03:23,131 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46525/user/jenkins/test-data/f68bbe99-417e-4fda-4301-36f56a4b6e73/data/hbase/meta/1588230740/rep_barrier 2023-02-10 19:03:23,131 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-10 19:03:23,131 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-10 19:03:23,131 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-10 19:03:23,132 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46525/user/jenkins/test-data/f68bbe99-417e-4fda-4301-36f56a4b6e73/data/hbase/meta/1588230740/table 2023-02-10 19:03:23,133 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-10 19:03:23,133 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-10 19:03:23,134 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46525/user/jenkins/test-data/f68bbe99-417e-4fda-4301-36f56a4b6e73/data/hbase/meta/1588230740 2023-02-10 19:03:23,134 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46525/user/jenkins/test-data/f68bbe99-417e-4fda-4301-36f56a4b6e73/data/hbase/meta/1588230740 2023-02-10 19:03:23,135 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-10 19:03:23,136 DEBUG [PEWorker-1] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-10 19:03:23,138 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46525/user/jenkins/test-data/f68bbe99-417e-4fda-4301-36f56a4b6e73/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-10 19:03:23,138 INFO [PEWorker-1] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61872636, jitterRate=-0.07802587747573853}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-10 19:03:23,138 DEBUG [PEWorker-1] regionserver.HRegion(964): Region open journal for 1588230740: Writing region info on filesystem at 1676055803127Initializing all the Stores at 1676055803128 (+1 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676055803128Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676055803128Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676055803128Cleaning up temporary data from old regions at 1676055803135 (+7 ms)Cleaning up detritus from prior splits at 1676055803135Region opened successfully at 1676055803138 (+3 ms) 2023-02-10 19:03:23,138 DEBUG [PEWorker-1] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-10 19:03:23,138 INFO [PEWorker-1] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-10 19:03:23,138 DEBUG [PEWorker-1] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-10 19:03:23,138 DEBUG [PEWorker-1] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-10 19:03:23,138 DEBUG [PEWorker-1] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-10 19:03:23,140 INFO [PEWorker-1] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-10 19:03:23,140 DEBUG [PEWorker-1] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1676055803138Disabling compacts and flushes for region at 1676055803138Disabling writes for close at 1676055803138Writing region close event to WAL at 1676055803140 (+2 ms)Closed at 1676055803140 2023-02-10 19:03:23,141 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-02-10 19:03:23,141 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-02-10 19:03:23,141 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-02-10 19:03:23,142 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-02-10 19:03:23,144 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-02-10 19:03:23,165 INFO [RS:0;jenkins-hbase4:43705] regionserver.HRegionServer(952): ClusterId : 2ec8ca0c-d14d-499e-b94a-1582b07153ae 2023-02-10 19:03:23,165 INFO [RS:1;jenkins-hbase4:37167] regionserver.HRegionServer(952): ClusterId : 2ec8ca0c-d14d-499e-b94a-1582b07153ae 2023-02-10 19:03:23,165 DEBUG [RS:0;jenkins-hbase4:43705] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-10 19:03:23,165 DEBUG [RS:1;jenkins-hbase4:37167] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-10 19:03:23,167 DEBUG [RS:1;jenkins-hbase4:37167] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-10 19:03:23,167 DEBUG [RS:0;jenkins-hbase4:43705] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-10 19:03:23,167 DEBUG [RS:0;jenkins-hbase4:43705] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-10 19:03:23,167 DEBUG [RS:1;jenkins-hbase4:37167] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-10 19:03:23,169 DEBUG [RS:1;jenkins-hbase4:37167] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-10 19:03:23,169 DEBUG [RS:0;jenkins-hbase4:43705] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-10 19:03:23,172 DEBUG [RS:1;jenkins-hbase4:37167] zookeeper.ReadOnlyZKClient(139): Connect 0x3bf28e10 to 127.0.0.1:58765 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-10 19:03:23,172 DEBUG [RS:0;jenkins-hbase4:43705] zookeeper.ReadOnlyZKClient(139): Connect 0x7d46cf12 to 127.0.0.1:58765 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-10 19:03:23,180 DEBUG [RS:1;jenkins-hbase4:37167] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3535771e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-10 19:03:23,180 DEBUG [RS:0;jenkins-hbase4:43705] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@73813eca, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-10 19:03:23,180 DEBUG [RS:1;jenkins-hbase4:37167] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@310ae560, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-10 19:03:23,180 DEBUG [RS:0;jenkins-hbase4:43705] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@77bea462, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-10 19:03:23,188 DEBUG [RS:1;jenkins-hbase4:37167] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:37167 2023-02-10 19:03:23,189 INFO [RS:1;jenkins-hbase4:37167] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-10 19:03:23,189 INFO [RS:1;jenkins-hbase4:37167] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-10 19:03:23,189 DEBUG [RS:1;jenkins-hbase4:37167] regionserver.HRegionServer(1023): About to register with Master. 2023-02-10 19:03:23,189 INFO [RS:1;jenkins-hbase4:37167] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,37641,1676055802845 with isa=jenkins-hbase4.apache.org/172.31.14.131:37167, startcode=1676055802941 2023-02-10 19:03:23,189 DEBUG [RS:1;jenkins-hbase4:37167] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-10 19:03:23,191 INFO [RS-EventLoopGroup-15-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60453, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.9 (auth:SIMPLE), service=RegionServerStatusService 2023-02-10 19:03:23,192 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37641] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,37167,1676055802941 2023-02-10 19:03:23,193 DEBUG [RS:1;jenkins-hbase4:37167] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:46525/user/jenkins/test-data/f68bbe99-417e-4fda-4301-36f56a4b6e73 2023-02-10 19:03:23,193 DEBUG [RS:1;jenkins-hbase4:37167] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:46525 2023-02-10 19:03:23,193 DEBUG [RS:1;jenkins-hbase4:37167] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-10 19:03:23,193 DEBUG [RS:0;jenkins-hbase4:43705] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:43705 2023-02-10 19:03:23,193 INFO [RS:0;jenkins-hbase4:43705] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-10 19:03:23,193 INFO [RS:0;jenkins-hbase4:43705] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-10 19:03:23,193 DEBUG [RS:0;jenkins-hbase4:43705] regionserver.HRegionServer(1023): About to register with Master. 2023-02-10 19:03:23,194 DEBUG [Listener at localhost/38427-EventThread] zookeeper.ZKWatcher(600): master:37641-0x1003f9ddd8d0000, quorum=127.0.0.1:58765, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-10 19:03:23,194 INFO [RS:0;jenkins-hbase4:43705] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,37641,1676055802845 with isa=jenkins-hbase4.apache.org/172.31.14.131:43705, startcode=1676055802900 2023-02-10 19:03:23,194 DEBUG [RS:1;jenkins-hbase4:37167] zookeeper.ZKUtil(162): regionserver:37167-0x1003f9ddd8d0002, quorum=127.0.0.1:58765, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,37167,1676055802941 2023-02-10 19:03:23,194 DEBUG [RS:0;jenkins-hbase4:43705] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-10 19:03:23,194 WARN [RS:1;jenkins-hbase4:37167] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-10 19:03:23,195 INFO [RS:1;jenkins-hbase4:37167] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-10 19:03:23,195 DEBUG [RS:1;jenkins-hbase4:37167] regionserver.HRegionServer(1947): logDir=hdfs://localhost:46525/user/jenkins/test-data/f68bbe99-417e-4fda-4301-36f56a4b6e73/WALs/jenkins-hbase4.apache.org,37167,1676055802941 2023-02-10 19:03:23,195 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,37167,1676055802941] 2023-02-10 19:03:23,200 INFO [RS-EventLoopGroup-15-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39833, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.8 (auth:SIMPLE), service=RegionServerStatusService 2023-02-10 19:03:23,201 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37641] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,43705,1676055802900 2023-02-10 19:03:23,202 DEBUG [RS:0;jenkins-hbase4:43705] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:46525/user/jenkins/test-data/f68bbe99-417e-4fda-4301-36f56a4b6e73 2023-02-10 19:03:23,202 DEBUG [RS:0;jenkins-hbase4:43705] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:46525 2023-02-10 19:03:23,202 DEBUG [RS:0;jenkins-hbase4:43705] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-10 19:03:23,202 DEBUG [RS:1;jenkins-hbase4:37167] zookeeper.ZKUtil(162): regionserver:37167-0x1003f9ddd8d0002, quorum=127.0.0.1:58765, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,37167,1676055802941 2023-02-10 19:03:23,205 DEBUG [Listener at localhost/38427-EventThread] zookeeper.ZKWatcher(600): regionserver:37167-0x1003f9ddd8d0002, quorum=127.0.0.1:58765, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-10 19:03:23,205 DEBUG [Listener at localhost/38427-EventThread] zookeeper.ZKWatcher(600): master:37641-0x1003f9ddd8d0000, quorum=127.0.0.1:58765, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-10 19:03:23,205 DEBUG [RS:0;jenkins-hbase4:43705] zookeeper.ZKUtil(162): regionserver:43705-0x1003f9ddd8d0001, quorum=127.0.0.1:58765, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,43705,1676055802900 2023-02-10 19:03:23,205 WARN [RS:0;jenkins-hbase4:43705] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-10 19:03:23,205 DEBUG [RS:1;jenkins-hbase4:37167] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-10 19:03:23,205 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,43705,1676055802900] 2023-02-10 19:03:23,206 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): regionserver:37167-0x1003f9ddd8d0002, quorum=127.0.0.1:58765, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,43705,1676055802900 2023-02-10 19:03:23,206 INFO [RS:1;jenkins-hbase4:37167] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-10 19:03:23,205 INFO [RS:0;jenkins-hbase4:43705] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-10 19:03:23,206 DEBUG [RS:0;jenkins-hbase4:43705] regionserver.HRegionServer(1947): logDir=hdfs://localhost:46525/user/jenkins/test-data/f68bbe99-417e-4fda-4301-36f56a4b6e73/WALs/jenkins-hbase4.apache.org,43705,1676055802900 2023-02-10 19:03:23,206 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): regionserver:37167-0x1003f9ddd8d0002, quorum=127.0.0.1:58765, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,37167,1676055802941 2023-02-10 19:03:23,207 INFO [RS:1;jenkins-hbase4:37167] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-10 19:03:23,208 INFO [RS:1;jenkins-hbase4:37167] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-10 19:03:23,208 INFO [RS:1;jenkins-hbase4:37167] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-10 19:03:23,208 INFO [RS:1;jenkins-hbase4:37167] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-10 19:03:23,209 INFO [RS:1;jenkins-hbase4:37167] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-10 19:03:23,209 DEBUG [RS:1;jenkins-hbase4:37167] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-10 19:03:23,209 DEBUG [RS:1;jenkins-hbase4:37167] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-10 19:03:23,209 DEBUG [RS:1;jenkins-hbase4:37167] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-10 19:03:23,209 DEBUG [RS:1;jenkins-hbase4:37167] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-10 19:03:23,209 DEBUG [RS:0;jenkins-hbase4:43705] zookeeper.ZKUtil(162): regionserver:43705-0x1003f9ddd8d0001, quorum=127.0.0.1:58765, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,43705,1676055802900 2023-02-10 19:03:23,209 DEBUG [RS:1;jenkins-hbase4:37167] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-10 19:03:23,210 DEBUG [RS:1;jenkins-hbase4:37167] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-10 19:03:23,210 DEBUG [RS:1;jenkins-hbase4:37167] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-10 19:03:23,210 DEBUG [RS:1;jenkins-hbase4:37167] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-10 19:03:23,210 DEBUG [RS:1;jenkins-hbase4:37167] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-10 19:03:23,210 DEBUG [RS:1;jenkins-hbase4:37167] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-10 19:03:23,210 DEBUG [RS:0;jenkins-hbase4:43705] zookeeper.ZKUtil(162): regionserver:43705-0x1003f9ddd8d0001, quorum=127.0.0.1:58765, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,37167,1676055802941 2023-02-10 19:03:23,211 INFO [RS:1;jenkins-hbase4:37167] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-10 19:03:23,211 INFO [RS:1;jenkins-hbase4:37167] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-10 19:03:23,211 INFO [RS:1;jenkins-hbase4:37167] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-10 19:03:23,211 DEBUG [RS:0;jenkins-hbase4:43705] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-10 19:03:23,211 INFO [RS:0;jenkins-hbase4:43705] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-10 19:03:23,213 INFO [RS:0;jenkins-hbase4:43705] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-10 19:03:23,216 INFO [RS:0;jenkins-hbase4:43705] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-10 19:03:23,216 INFO [RS:0;jenkins-hbase4:43705] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-10 19:03:23,220 INFO [RS:0;jenkins-hbase4:43705] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-10 19:03:23,221 INFO [RS:0;jenkins-hbase4:43705] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-10 19:03:23,221 DEBUG [RS:0;jenkins-hbase4:43705] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-10 19:03:23,221 DEBUG [RS:0;jenkins-hbase4:43705] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-10 19:03:23,222 DEBUG [RS:0;jenkins-hbase4:43705] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-10 19:03:23,222 DEBUG [RS:0;jenkins-hbase4:43705] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-10 19:03:23,222 DEBUG [RS:0;jenkins-hbase4:43705] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-10 19:03:23,222 DEBUG [RS:0;jenkins-hbase4:43705] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-10 19:03:23,222 DEBUG [RS:0;jenkins-hbase4:43705] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-10 19:03:23,222 DEBUG [RS:0;jenkins-hbase4:43705] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-10 19:03:23,222 DEBUG [RS:0;jenkins-hbase4:43705] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-10 19:03:23,222 DEBUG [RS:0;jenkins-hbase4:43705] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-10 19:03:23,224 INFO [RS:1;jenkins-hbase4:37167] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-10 19:03:23,224 INFO [RS:1;jenkins-hbase4:37167] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,37167,1676055802941-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-10 19:03:23,225 INFO [RS:0;jenkins-hbase4:43705] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-10 19:03:23,225 INFO [RS:0;jenkins-hbase4:43705] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-10 19:03:23,225 INFO [RS:0;jenkins-hbase4:43705] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-10 19:03:23,235 INFO [RS:0;jenkins-hbase4:43705] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-10 19:03:23,235 INFO [RS:0;jenkins-hbase4:43705] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,43705,1676055802900-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-10 19:03:23,235 INFO [RS:1;jenkins-hbase4:37167] regionserver.Replication(203): jenkins-hbase4.apache.org,37167,1676055802941 started 2023-02-10 19:03:23,236 INFO [RS:1;jenkins-hbase4:37167] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,37167,1676055802941, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:37167, sessionid=0x1003f9ddd8d0002 2023-02-10 19:03:23,236 DEBUG [RS:1;jenkins-hbase4:37167] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-10 19:03:23,236 DEBUG [RS:1;jenkins-hbase4:37167] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,37167,1676055802941 2023-02-10 19:03:23,236 DEBUG [RS:1;jenkins-hbase4:37167] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,37167,1676055802941' 2023-02-10 19:03:23,236 DEBUG [RS:1;jenkins-hbase4:37167] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-10 19:03:23,236 DEBUG [RS:1;jenkins-hbase4:37167] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-10 19:03:23,236 DEBUG [RS:1;jenkins-hbase4:37167] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-10 19:03:23,236 DEBUG [RS:1;jenkins-hbase4:37167] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-10 19:03:23,236 DEBUG [RS:1;jenkins-hbase4:37167] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,37167,1676055802941 2023-02-10 19:03:23,236 DEBUG [RS:1;jenkins-hbase4:37167] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,37167,1676055802941' 2023-02-10 19:03:23,236 DEBUG [RS:1;jenkins-hbase4:37167] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-10 19:03:23,237 DEBUG [RS:1;jenkins-hbase4:37167] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-10 19:03:23,237 DEBUG [RS:1;jenkins-hbase4:37167] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-10 19:03:23,237 INFO [RS:1;jenkins-hbase4:37167] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-10 19:03:23,237 INFO [RS:1;jenkins-hbase4:37167] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-10 19:03:23,245 INFO [RS:0;jenkins-hbase4:43705] regionserver.Replication(203): jenkins-hbase4.apache.org,43705,1676055802900 started 2023-02-10 19:03:23,245 INFO [RS:0;jenkins-hbase4:43705] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,43705,1676055802900, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:43705, sessionid=0x1003f9ddd8d0001 2023-02-10 19:03:23,245 DEBUG [RS:0;jenkins-hbase4:43705] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-10 19:03:23,245 DEBUG [RS:0;jenkins-hbase4:43705] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,43705,1676055802900 2023-02-10 19:03:23,245 DEBUG [RS:0;jenkins-hbase4:43705] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,43705,1676055802900' 2023-02-10 19:03:23,245 DEBUG [RS:0;jenkins-hbase4:43705] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-10 19:03:23,246 DEBUG [RS:0;jenkins-hbase4:43705] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-10 19:03:23,246 DEBUG [RS:0;jenkins-hbase4:43705] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-10 19:03:23,246 DEBUG [RS:0;jenkins-hbase4:43705] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-10 19:03:23,246 DEBUG [RS:0;jenkins-hbase4:43705] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,43705,1676055802900 2023-02-10 19:03:23,246 DEBUG [RS:0;jenkins-hbase4:43705] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,43705,1676055802900' 2023-02-10 19:03:23,246 DEBUG [RS:0;jenkins-hbase4:43705] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-10 19:03:23,246 DEBUG [RS:0;jenkins-hbase4:43705] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-10 19:03:23,246 DEBUG [RS:0;jenkins-hbase4:43705] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-10 19:03:23,246 INFO [RS:0;jenkins-hbase4:43705] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-10 19:03:23,246 INFO [RS:0;jenkins-hbase4:43705] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-10 19:03:23,294 DEBUG [jenkins-hbase4:37641] assignment.AssignmentManager(2178): Processing assignQueue; systemServersCount=2, allServersCount=2 2023-02-10 19:03:23,294 DEBUG [jenkins-hbase4:37641] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-10 19:03:23,295 DEBUG [jenkins-hbase4:37641] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-10 19:03:23,295 DEBUG [jenkins-hbase4:37641] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-10 19:03:23,295 DEBUG [jenkins-hbase4:37641] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-10 19:03:23,296 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,37167,1676055802941, state=OPENING 2023-02-10 19:03:23,298 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-02-10 19:03:23,299 DEBUG [Listener at localhost/38427-EventThread] zookeeper.ZKWatcher(600): master:37641-0x1003f9ddd8d0000, quorum=127.0.0.1:58765, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-10 19:03:23,299 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,37167,1676055802941}] 2023-02-10 19:03:23,299 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-10 19:03:23,454 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,37167,1676055802941 2023-02-10 19:03:23,454 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-10 19:03:23,455 INFO [RS-EventLoopGroup-17-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55366, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-10 19:03:23,459 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:meta,,1.1588230740 2023-02-10 19:03:23,459 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-10 19:03:23,460 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C37167%2C1676055802941.meta, suffix=.meta, logDir=hdfs://localhost:46525/user/jenkins/test-data/f68bbe99-417e-4fda-4301-36f56a4b6e73/WALs/jenkins-hbase4.apache.org,37167,1676055802941, archiveDir=hdfs://localhost:46525/user/jenkins/test-data/f68bbe99-417e-4fda-4301-36f56a4b6e73/oldWALs, maxLogs=32 2023-02-10 19:03:23,473 DEBUG [RS-EventLoopGroup-17-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35131,DS-14717d91-894c-4cbf-9b7e-00654833572c,DISK] 2023-02-10 19:03:23,473 DEBUG [RS-EventLoopGroup-17-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39971,DS-ae22d516-01d3-476b-b729-85d2f7ded568,DISK] 2023-02-10 19:03:23,475 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/f68bbe99-417e-4fda-4301-36f56a4b6e73/WALs/jenkins-hbase4.apache.org,37167,1676055802941/jenkins-hbase4.apache.org%2C37167%2C1676055802941.meta.1676055803461.meta 2023-02-10 19:03:23,475 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:35131,DS-14717d91-894c-4cbf-9b7e-00654833572c,DISK], DatanodeInfoWithStorage[127.0.0.1:39971,DS-ae22d516-01d3-476b-b729-85d2f7ded568,DISK]] 2023-02-10 19:03:23,475 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-02-10 19:03:23,475 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-02-10 19:03:23,476 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8546): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-02-10 19:03:23,476 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-02-10 19:03:23,476 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-02-10 19:03:23,476 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-10 19:03:23,476 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 1588230740 2023-02-10 19:03:23,476 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 1588230740 2023-02-10 19:03:23,479 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-10 19:03:23,479 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46525/user/jenkins/test-data/f68bbe99-417e-4fda-4301-36f56a4b6e73/data/hbase/meta/1588230740/info 2023-02-10 19:03:23,479 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46525/user/jenkins/test-data/f68bbe99-417e-4fda-4301-36f56a4b6e73/data/hbase/meta/1588230740/info 2023-02-10 19:03:23,480 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-10 19:03:23,480 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-10 19:03:23,480 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-10 19:03:23,481 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46525/user/jenkins/test-data/f68bbe99-417e-4fda-4301-36f56a4b6e73/data/hbase/meta/1588230740/rep_barrier 2023-02-10 19:03:23,481 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46525/user/jenkins/test-data/f68bbe99-417e-4fda-4301-36f56a4b6e73/data/hbase/meta/1588230740/rep_barrier 2023-02-10 19:03:23,481 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-10 19:03:23,482 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-10 19:03:23,482 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-10 19:03:23,482 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46525/user/jenkins/test-data/f68bbe99-417e-4fda-4301-36f56a4b6e73/data/hbase/meta/1588230740/table 2023-02-10 19:03:23,482 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46525/user/jenkins/test-data/f68bbe99-417e-4fda-4301-36f56a4b6e73/data/hbase/meta/1588230740/table 2023-02-10 19:03:23,482 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-10 19:03:23,483 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-10 19:03:23,483 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46525/user/jenkins/test-data/f68bbe99-417e-4fda-4301-36f56a4b6e73/data/hbase/meta/1588230740 2023-02-10 19:03:23,484 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46525/user/jenkins/test-data/f68bbe99-417e-4fda-4301-36f56a4b6e73/data/hbase/meta/1588230740 2023-02-10 19:03:23,486 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-10 19:03:23,487 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-10 19:03:23,487 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59718889, jitterRate=-0.11011920869350433}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-10 19:03:23,488 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 1588230740: Running coprocessor pre-open hook at 1676055803476Writing region info on filesystem at 1676055803476Initializing all the Stores at 1676055803477 (+1 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676055803477Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676055803479 (+2 ms)Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676055803479Cleaning up temporary data from old regions at 1676055803485 (+6 ms)Cleaning up detritus from prior splits at 1676055803485Running coprocessor post-open hooks at 1676055803487 (+2 ms)Region opened successfully at 1676055803488 (+1 ms) 2023-02-10 19:03:23,488 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1676055803454 2023-02-10 19:03:23,492 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:meta,,1.1588230740 2023-02-10 19:03:23,492 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:meta,,1.1588230740 2023-02-10 19:03:23,492 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,37167,1676055802941, state=OPEN 2023-02-10 19:03:23,494 DEBUG [Listener at localhost/38427-EventThread] zookeeper.ZKWatcher(600): master:37641-0x1003f9ddd8d0000, quorum=127.0.0.1:58765, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-02-10 19:03:23,494 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-10 19:03:23,495 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-02-10 19:03:23,495 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,37167,1676055802941 in 195 msec 2023-02-10 19:03:23,497 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-02-10 19:03:23,497 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 354 msec 2023-02-10 19:03:23,498 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 401 msec 2023-02-10 19:03:23,498 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(946): Master startup: status=Wait for region servers to report in, state=RUNNING, startTime=1676055802967, completionTime=-1 2023-02-10 19:03:23,498 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=2; waited=0ms, expected min=2 server(s), max=2 server(s), master is running 2023-02-10 19:03:23,498 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1519): Joining cluster... 2023-02-10 19:03:23,501 DEBUG [hconnection-0x3525099a-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-10 19:03:23,502 INFO [RS-EventLoopGroup-17-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55372, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-10 19:03:23,504 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1531): Number of RegionServers=2 2023-02-10 19:03:23,504 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1676055863504 2023-02-10 19:03:23,504 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1676055923504 2023-02-10 19:03:23,504 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1538): Joined the cluster in 5 msec 2023-02-10 19:03:23,515 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,37641,1676055802845-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-10 19:03:23,515 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,37641,1676055802845-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-10 19:03:23,515 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,37641,1676055802845-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-10 19:03:23,515 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:37641, period=300000, unit=MILLISECONDS is enabled. 2023-02-10 19:03:23,515 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-02-10 19:03:23,515 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-02-10 19:03:23,515 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2138): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-10 19:03:23,516 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-02-10 19:03:23,516 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-02-10 19:03:23,517 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-02-10 19:03:23,518 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-10 19:03:23,519 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46525/user/jenkins/test-data/f68bbe99-417e-4fda-4301-36f56a4b6e73/.tmp/data/hbase/namespace/e051548d5a5fc2886c739ac60a76688f 2023-02-10 19:03:23,520 DEBUG [HFileArchiver-6] backup.HFileArchiver(153): Directory hdfs://localhost:46525/user/jenkins/test-data/f68bbe99-417e-4fda-4301-36f56a4b6e73/.tmp/data/hbase/namespace/e051548d5a5fc2886c739ac60a76688f empty. 2023-02-10 19:03:23,520 DEBUG [HFileArchiver-6] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:46525/user/jenkins/test-data/f68bbe99-417e-4fda-4301-36f56a4b6e73/.tmp/data/hbase/namespace/e051548d5a5fc2886c739ac60a76688f 2023-02-10 19:03:23,520 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-02-10 19:03:23,528 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:46525/user/jenkins/test-data/f68bbe99-417e-4fda-4301-36f56a4b6e73/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-02-10 19:03:23,529 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7671): creating {ENCODED => e051548d5a5fc2886c739ac60a76688f, NAME => 'hbase:namespace,,1676055803515.e051548d5a5fc2886c739ac60a76688f.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:46525/user/jenkins/test-data/f68bbe99-417e-4fda-4301-36f56a4b6e73/.tmp 2023-02-10 19:03:23,535 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676055803515.e051548d5a5fc2886c739ac60a76688f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-10 19:03:23,535 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1603): Closing e051548d5a5fc2886c739ac60a76688f, disabling compactions & flushes 2023-02-10 19:03:23,535 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676055803515.e051548d5a5fc2886c739ac60a76688f. 2023-02-10 19:03:23,535 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676055803515.e051548d5a5fc2886c739ac60a76688f. 2023-02-10 19:03:23,535 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676055803515.e051548d5a5fc2886c739ac60a76688f. after waiting 0 ms 2023-02-10 19:03:23,535 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676055803515.e051548d5a5fc2886c739ac60a76688f. 2023-02-10 19:03:23,535 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676055803515.e051548d5a5fc2886c739ac60a76688f. 2023-02-10 19:03:23,535 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1557): Region close journal for e051548d5a5fc2886c739ac60a76688f: Waiting for close lock at 1676055803535Disabling compacts and flushes for region at 1676055803535Disabling writes for close at 1676055803535Writing region close event to WAL at 1676055803535Closed at 1676055803535 2023-02-10 19:03:23,537 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-02-10 19:03:23,537 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1676055803515.e051548d5a5fc2886c739ac60a76688f.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676055803537"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676055803537"}]},"ts":"1676055803537"} 2023-02-10 19:03:23,540 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-10 19:03:23,540 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-10 19:03:23,541 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676055803540"}]},"ts":"1676055803540"} 2023-02-10 19:03:23,542 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-02-10 19:03:23,544 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-10 19:03:23,545 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-10 19:03:23,545 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-10 19:03:23,545 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-10 19:03:23,545 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=e051548d5a5fc2886c739ac60a76688f, ASSIGN}] 2023-02-10 19:03:23,547 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=e051548d5a5fc2886c739ac60a76688f, ASSIGN 2023-02-10 19:03:23,548 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=e051548d5a5fc2886c739ac60a76688f, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43705,1676055802900; forceNewPlan=false, retain=false 2023-02-10 19:03:23,698 INFO [jenkins-hbase4:37641] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-10 19:03:23,698 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=e051548d5a5fc2886c739ac60a76688f, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43705,1676055802900 2023-02-10 19:03:23,698 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1676055803515.e051548d5a5fc2886c739ac60a76688f.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676055803698"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676055803698"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676055803698"}]},"ts":"1676055803698"} 2023-02-10 19:03:23,702 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure e051548d5a5fc2886c739ac60a76688f, server=jenkins-hbase4.apache.org,43705,1676055802900}] 2023-02-10 19:03:23,819 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-10 19:03:23,819 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2023-02-10 19:03:23,855 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,43705,1676055802900 2023-02-10 19:03:23,855 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-10 19:03:23,857 INFO [RS-EventLoopGroup-16-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50430, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-10 19:03:23,861 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:namespace,,1676055803515.e051548d5a5fc2886c739ac60a76688f. 2023-02-10 19:03:23,862 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C43705%2C1676055802900, suffix=, logDir=hdfs://localhost:46525/user/jenkins/test-data/f68bbe99-417e-4fda-4301-36f56a4b6e73/WALs/jenkins-hbase4.apache.org,43705,1676055802900, archiveDir=hdfs://localhost:46525/user/jenkins/test-data/f68bbe99-417e-4fda-4301-36f56a4b6e73/oldWALs, maxLogs=32 2023-02-10 19:03:23,875 DEBUG [RS-EventLoopGroup-17-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39971,DS-ae22d516-01d3-476b-b729-85d2f7ded568,DISK] 2023-02-10 19:03:23,875 DEBUG [RS-EventLoopGroup-17-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35131,DS-14717d91-894c-4cbf-9b7e-00654833572c,DISK] 2023-02-10 19:03:23,877 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/f68bbe99-417e-4fda-4301-36f56a4b6e73/WALs/jenkins-hbase4.apache.org,43705,1676055802900/jenkins-hbase4.apache.org%2C43705%2C1676055802900.1676055803862 2023-02-10 19:03:23,877 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:35131,DS-14717d91-894c-4cbf-9b7e-00654833572c,DISK], DatanodeInfoWithStorage[127.0.0.1:39971,DS-ae22d516-01d3-476b-b729-85d2f7ded568,DISK]] 2023-02-10 19:03:23,877 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => e051548d5a5fc2886c739ac60a76688f, NAME => 'hbase:namespace,,1676055803515.e051548d5a5fc2886c739ac60a76688f.', STARTKEY => '', ENDKEY => ''} 2023-02-10 19:03:23,877 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace e051548d5a5fc2886c739ac60a76688f 2023-02-10 19:03:23,877 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676055803515.e051548d5a5fc2886c739ac60a76688f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-10 19:03:23,877 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for e051548d5a5fc2886c739ac60a76688f 2023-02-10 19:03:23,877 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for e051548d5a5fc2886c739ac60a76688f 2023-02-10 19:03:23,878 INFO [StoreOpener-e051548d5a5fc2886c739ac60a76688f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region e051548d5a5fc2886c739ac60a76688f 2023-02-10 19:03:23,880 DEBUG [StoreOpener-e051548d5a5fc2886c739ac60a76688f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46525/user/jenkins/test-data/f68bbe99-417e-4fda-4301-36f56a4b6e73/data/hbase/namespace/e051548d5a5fc2886c739ac60a76688f/info 2023-02-10 19:03:23,880 DEBUG [StoreOpener-e051548d5a5fc2886c739ac60a76688f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46525/user/jenkins/test-data/f68bbe99-417e-4fda-4301-36f56a4b6e73/data/hbase/namespace/e051548d5a5fc2886c739ac60a76688f/info 2023-02-10 19:03:23,880 INFO [StoreOpener-e051548d5a5fc2886c739ac60a76688f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e051548d5a5fc2886c739ac60a76688f columnFamilyName info 2023-02-10 19:03:23,880 INFO [StoreOpener-e051548d5a5fc2886c739ac60a76688f-1] regionserver.HStore(310): Store=e051548d5a5fc2886c739ac60a76688f/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-10 19:03:23,881 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46525/user/jenkins/test-data/f68bbe99-417e-4fda-4301-36f56a4b6e73/data/hbase/namespace/e051548d5a5fc2886c739ac60a76688f 2023-02-10 19:03:23,881 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46525/user/jenkins/test-data/f68bbe99-417e-4fda-4301-36f56a4b6e73/data/hbase/namespace/e051548d5a5fc2886c739ac60a76688f 2023-02-10 19:03:23,883 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for e051548d5a5fc2886c739ac60a76688f 2023-02-10 19:03:23,885 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46525/user/jenkins/test-data/f68bbe99-417e-4fda-4301-36f56a4b6e73/data/hbase/namespace/e051548d5a5fc2886c739ac60a76688f/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-10 19:03:23,885 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened e051548d5a5fc2886c739ac60a76688f; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59148123, jitterRate=-0.11862428486347198}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-10 19:03:23,885 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for e051548d5a5fc2886c739ac60a76688f: Running coprocessor pre-open hook at 1676055803877Writing region info on filesystem at 1676055803877Initializing all the Stores at 1676055803878 (+1 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676055803878Cleaning up temporary data from old regions at 1676055803882 (+4 ms)Cleaning up detritus from prior splits at 1676055803882Running coprocessor post-open hooks at 1676055803885 (+3 ms)Region opened successfully at 1676055803885 2023-02-10 19:03:23,886 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:namespace,,1676055803515.e051548d5a5fc2886c739ac60a76688f., pid=6, masterSystemTime=1676055803855 2023-02-10 19:03:23,889 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:namespace,,1676055803515.e051548d5a5fc2886c739ac60a76688f. 2023-02-10 19:03:23,889 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:namespace,,1676055803515.e051548d5a5fc2886c739ac60a76688f. 2023-02-10 19:03:23,890 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=e051548d5a5fc2886c739ac60a76688f, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43705,1676055802900 2023-02-10 19:03:23,890 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1676055803515.e051548d5a5fc2886c739ac60a76688f.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676055803890"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676055803890"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676055803890"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676055803890"}]},"ts":"1676055803890"} 2023-02-10 19:03:23,893 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-02-10 19:03:23,893 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure e051548d5a5fc2886c739ac60a76688f, server=jenkins-hbase4.apache.org,43705,1676055802900 in 192 msec 2023-02-10 19:03:23,894 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-02-10 19:03:23,895 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=e051548d5a5fc2886c739ac60a76688f, ASSIGN in 348 msec 2023-02-10 19:03:23,895 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-10 19:03:23,895 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676055803895"}]},"ts":"1676055803895"} 2023-02-10 19:03:23,896 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-02-10 19:03:23,898 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-02-10 19:03:23,899 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 383 msec 2023-02-10 19:03:23,917 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:37641-0x1003f9ddd8d0000, quorum=127.0.0.1:58765, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-02-10 19:03:23,919 DEBUG [Listener at localhost/38427-EventThread] zookeeper.ZKWatcher(600): master:37641-0x1003f9ddd8d0000, quorum=127.0.0.1:58765, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-02-10 19:03:23,919 DEBUG [Listener at localhost/38427-EventThread] zookeeper.ZKWatcher(600): master:37641-0x1003f9ddd8d0000, quorum=127.0.0.1:58765, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-10 19:03:23,921 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-10 19:03:23,923 INFO [RS-EventLoopGroup-16-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50442, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-10 19:03:23,928 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-02-10 19:03:23,935 DEBUG [Listener at localhost/38427-EventThread] zookeeper.ZKWatcher(600): master:37641-0x1003f9ddd8d0000, quorum=127.0.0.1:58765, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-10 19:03:23,937 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 12 msec 2023-02-10 19:03:23,939 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-02-10 19:03:23,944 DEBUG [Listener at localhost/38427-EventThread] zookeeper.ZKWatcher(600): master:37641-0x1003f9ddd8d0000, quorum=127.0.0.1:58765, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-10 19:03:23,948 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 8 msec 2023-02-10 19:03:23,952 DEBUG [Listener at localhost/38427-EventThread] zookeeper.ZKWatcher(600): master:37641-0x1003f9ddd8d0000, quorum=127.0.0.1:58765, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-02-10 19:03:23,955 DEBUG [Listener at localhost/38427-EventThread] zookeeper.ZKWatcher(600): master:37641-0x1003f9ddd8d0000, quorum=127.0.0.1:58765, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-02-10 19:03:23,955 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1077): Master has completed initialization 0.982sec 2023-02-10 19:03:23,955 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-02-10 19:03:23,955 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-02-10 19:03:23,955 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-02-10 19:03:23,955 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,37641,1676055802845-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-02-10 19:03:23,955 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,37641,1676055802845-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-02-10 19:03:23,957 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1166): Balancer post startup initialization complete, took 0 seconds 2023-02-10 19:03:23,977 DEBUG [Listener at localhost/38427] zookeeper.ReadOnlyZKClient(139): Connect 0x4d07ea0d to 127.0.0.1:58765 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-10 19:03:23,984 DEBUG [Listener at localhost/38427] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7dbf3f32, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-10 19:03:23,986 DEBUG [hconnection-0x3ee091b2-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-10 19:03:23,987 INFO [RS-EventLoopGroup-17-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55376, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-10 19:03:23,989 INFO [Listener at localhost/38427] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,37641,1676055802845 2023-02-10 19:03:23,989 DEBUG [Listener at localhost/38427] mapreduce.TableSnapshotInputFormatTestBase(193): Ensuring table doesn't exist. 2023-02-10 19:03:23,993 DEBUG [Listener at localhost/38427] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-10 19:03:23,994 INFO [RS-EventLoopGroup-15-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58112, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-10 19:03:23,995 INFO [Listener at localhost/38427] client.HBaseAdmin$15(890): Started disable of testWithMockedMapReduceSingleRegion 2023-02-10 19:03:23,995 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37641] master.HMaster$11(2405): Client=jenkins//172.31.14.131 disable testWithMockedMapReduceSingleRegion 2023-02-10 19:03:23,995 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37641] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.TableNotFoundException: testWithMockedMapReduceSingleRegion at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.checkTableModifiable(AbstractStateMachineTableProcedure.java:125) at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.preflightChecks(AbstractStateMachineTableProcedure.java:157) at org.apache.hadoop.hbase.master.procedure.DisableTableProcedure.(DisableTableProcedure.java:78) at org.apache.hadoop.hbase.master.HMaster$11.run(HMaster.java:2416) at org.apache.hadoop.hbase.master.procedure.MasterProcedureUtil.submitProcedure(MasterProcedureUtil.java:132) at org.apache.hadoop.hbase.master.HMaster.disableTable(HMaster.java:2400) at org.apache.hadoop.hbase.master.MasterRpcServices.disableTable(MasterRpcServices.java:784) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-02-10 19:03:23,995 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37641] ipc.CallRunner(144): callId: 2 service: MasterService methodName: DisableTable size: 95 connection: 172.31.14.131:58112 deadline: 1676055863995, exception=org.apache.hadoop.hbase.TableNotFoundException: testWithMockedMapReduceSingleRegion 2023-02-10 19:03:23,996 INFO [Listener at localhost/38427] mapreduce.TableSnapshotInputFormatTestBase(199): creating table 'testWithMockedMapReduceSingleRegion' 2023-02-10 19:03:23,997 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37641] master.HMaster$4(2102): Client=jenkins//172.31.14.131 create 'testWithMockedMapReduceSingleRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-10 19:03:23,998 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37641] procedure2.ProcedureExecutor(1029): Stored pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testWithMockedMapReduceSingleRegion 2023-02-10 19:03:23,999 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testWithMockedMapReduceSingleRegion execute state=CREATE_TABLE_PRE_OPERATION 2023-02-10 19:03:23,999 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37641] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testWithMockedMapReduceSingleRegion" procId is: 10 2023-02-10 19:03:24,000 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testWithMockedMapReduceSingleRegion execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-10 19:03:24,000 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37641] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-10 19:03:24,001 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46525/user/jenkins/test-data/f68bbe99-417e-4fda-4301-36f56a4b6e73/.tmp/data/default/testWithMockedMapReduceSingleRegion/3aaa3c611c77cd63177f080c34315b49 2023-02-10 19:03:24,002 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:46525/user/jenkins/test-data/f68bbe99-417e-4fda-4301-36f56a4b6e73/.tmp/data/default/testWithMockedMapReduceSingleRegion/3aaa3c611c77cd63177f080c34315b49 empty. 2023-02-10 19:03:24,002 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:46525/user/jenkins/test-data/f68bbe99-417e-4fda-4301-36f56a4b6e73/.tmp/data/default/testWithMockedMapReduceSingleRegion/3aaa3c611c77cd63177f080c34315b49 2023-02-10 19:03:24,002 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testWithMockedMapReduceSingleRegion regions 2023-02-10 19:03:24,011 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:46525/user/jenkins/test-data/f68bbe99-417e-4fda-4301-36f56a4b6e73/.tmp/data/default/testWithMockedMapReduceSingleRegion/.tabledesc/.tableinfo.0000000001 2023-02-10 19:03:24,012 INFO [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(7671): creating {ENCODED => 3aaa3c611c77cd63177f080c34315b49, NAME => 'testWithMockedMapReduceSingleRegion,,1676055803997.3aaa3c611c77cd63177f080c34315b49.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testWithMockedMapReduceSingleRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:46525/user/jenkins/test-data/f68bbe99-417e-4fda-4301-36f56a4b6e73/.tmp 2023-02-10 19:03:24,020 DEBUG [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceSingleRegion,,1676055803997.3aaa3c611c77cd63177f080c34315b49.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-10 19:03:24,020 DEBUG [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(1603): Closing 3aaa3c611c77cd63177f080c34315b49, disabling compactions & flushes 2023-02-10 19:03:24,020 INFO [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceSingleRegion,,1676055803997.3aaa3c611c77cd63177f080c34315b49. 2023-02-10 19:03:24,020 DEBUG [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceSingleRegion,,1676055803997.3aaa3c611c77cd63177f080c34315b49. 2023-02-10 19:03:24,020 DEBUG [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceSingleRegion,,1676055803997.3aaa3c611c77cd63177f080c34315b49. after waiting 0 ms 2023-02-10 19:03:24,020 DEBUG [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceSingleRegion,,1676055803997.3aaa3c611c77cd63177f080c34315b49. 2023-02-10 19:03:24,020 INFO [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceSingleRegion,,1676055803997.3aaa3c611c77cd63177f080c34315b49. 2023-02-10 19:03:24,020 DEBUG [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(1557): Region close journal for 3aaa3c611c77cd63177f080c34315b49: Waiting for close lock at 1676055804020Disabling compacts and flushes for region at 1676055804020Disabling writes for close at 1676055804020Writing region close event to WAL at 1676055804020Closed at 1676055804020 2023-02-10 19:03:24,022 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testWithMockedMapReduceSingleRegion execute state=CREATE_TABLE_ADD_TO_META 2023-02-10 19:03:24,023 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceSingleRegion,,1676055803997.3aaa3c611c77cd63177f080c34315b49.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1676055804023"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676055804023"}]},"ts":"1676055804023"} 2023-02-10 19:03:24,024 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-10 19:03:24,025 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testWithMockedMapReduceSingleRegion execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-10 19:03:24,025 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMockedMapReduceSingleRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676055804025"}]},"ts":"1676055804025"} 2023-02-10 19:03:24,026 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testWithMockedMapReduceSingleRegion, state=ENABLING in hbase:meta 2023-02-10 19:03:24,028 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-10 19:03:24,029 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-10 19:03:24,029 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-10 19:03:24,029 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-10 19:03:24,029 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceSingleRegion, region=3aaa3c611c77cd63177f080c34315b49, ASSIGN}] 2023-02-10 19:03:24,031 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceSingleRegion, region=3aaa3c611c77cd63177f080c34315b49, ASSIGN 2023-02-10 19:03:24,032 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceSingleRegion, region=3aaa3c611c77cd63177f080c34315b49, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,37167,1676055802941; forceNewPlan=false, retain=false 2023-02-10 19:03:24,102 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37641] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-10 19:03:24,182 INFO [jenkins-hbase4:37641] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-10 19:03:24,182 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=3aaa3c611c77cd63177f080c34315b49, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,37167,1676055802941 2023-02-10 19:03:24,182 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceSingleRegion,,1676055803997.3aaa3c611c77cd63177f080c34315b49.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1676055804182"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676055804182"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676055804182"}]},"ts":"1676055804182"} 2023-02-10 19:03:24,184 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=12, ppid=11, state=RUNNABLE; OpenRegionProcedure 3aaa3c611c77cd63177f080c34315b49, server=jenkins-hbase4.apache.org,37167,1676055802941}] 2023-02-10 19:03:24,238 INFO [RS:1;jenkins-hbase4:37167] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C37167%2C1676055802941, suffix=, logDir=hdfs://localhost:46525/user/jenkins/test-data/f68bbe99-417e-4fda-4301-36f56a4b6e73/WALs/jenkins-hbase4.apache.org,37167,1676055802941, archiveDir=hdfs://localhost:46525/user/jenkins/test-data/f68bbe99-417e-4fda-4301-36f56a4b6e73/oldWALs, maxLogs=32 2023-02-10 19:03:24,250 DEBUG [RS-EventLoopGroup-17-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35131,DS-14717d91-894c-4cbf-9b7e-00654833572c,DISK] 2023-02-10 19:03:24,250 DEBUG [RS-EventLoopGroup-17-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39971,DS-ae22d516-01d3-476b-b729-85d2f7ded568,DISK] 2023-02-10 19:03:24,252 INFO [RS:1;jenkins-hbase4:37167] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/f68bbe99-417e-4fda-4301-36f56a4b6e73/WALs/jenkins-hbase4.apache.org,37167,1676055802941/jenkins-hbase4.apache.org%2C37167%2C1676055802941.1676055804239 2023-02-10 19:03:24,252 DEBUG [RS:1;jenkins-hbase4:37167] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:35131,DS-14717d91-894c-4cbf-9b7e-00654833572c,DISK], DatanodeInfoWithStorage[127.0.0.1:39971,DS-ae22d516-01d3-476b-b729-85d2f7ded568,DISK]] 2023-02-10 19:03:24,303 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37641] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-10 19:03:24,338 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceSingleRegion,,1676055803997.3aaa3c611c77cd63177f080c34315b49. 2023-02-10 19:03:24,339 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 3aaa3c611c77cd63177f080c34315b49, NAME => 'testWithMockedMapReduceSingleRegion,,1676055803997.3aaa3c611c77cd63177f080c34315b49.', STARTKEY => '', ENDKEY => ''} 2023-02-10 19:03:24,339 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceSingleRegion 3aaa3c611c77cd63177f080c34315b49 2023-02-10 19:03:24,339 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceSingleRegion,,1676055803997.3aaa3c611c77cd63177f080c34315b49.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-10 19:03:24,339 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 3aaa3c611c77cd63177f080c34315b49 2023-02-10 19:03:24,339 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 3aaa3c611c77cd63177f080c34315b49 2023-02-10 19:03:24,340 INFO [StoreOpener-3aaa3c611c77cd63177f080c34315b49-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 3aaa3c611c77cd63177f080c34315b49 2023-02-10 19:03:24,341 DEBUG [StoreOpener-3aaa3c611c77cd63177f080c34315b49-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46525/user/jenkins/test-data/f68bbe99-417e-4fda-4301-36f56a4b6e73/data/default/testWithMockedMapReduceSingleRegion/3aaa3c611c77cd63177f080c34315b49/f1 2023-02-10 19:03:24,341 DEBUG [StoreOpener-3aaa3c611c77cd63177f080c34315b49-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46525/user/jenkins/test-data/f68bbe99-417e-4fda-4301-36f56a4b6e73/data/default/testWithMockedMapReduceSingleRegion/3aaa3c611c77cd63177f080c34315b49/f1 2023-02-10 19:03:24,342 INFO [StoreOpener-3aaa3c611c77cd63177f080c34315b49-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3aaa3c611c77cd63177f080c34315b49 columnFamilyName f1 2023-02-10 19:03:24,342 INFO [StoreOpener-3aaa3c611c77cd63177f080c34315b49-1] regionserver.HStore(310): Store=3aaa3c611c77cd63177f080c34315b49/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-10 19:03:24,342 INFO [StoreOpener-3aaa3c611c77cd63177f080c34315b49-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 3aaa3c611c77cd63177f080c34315b49 2023-02-10 19:03:24,343 DEBUG [StoreOpener-3aaa3c611c77cd63177f080c34315b49-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46525/user/jenkins/test-data/f68bbe99-417e-4fda-4301-36f56a4b6e73/data/default/testWithMockedMapReduceSingleRegion/3aaa3c611c77cd63177f080c34315b49/f2 2023-02-10 19:03:24,343 DEBUG [StoreOpener-3aaa3c611c77cd63177f080c34315b49-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46525/user/jenkins/test-data/f68bbe99-417e-4fda-4301-36f56a4b6e73/data/default/testWithMockedMapReduceSingleRegion/3aaa3c611c77cd63177f080c34315b49/f2 2023-02-10 19:03:24,343 INFO [StoreOpener-3aaa3c611c77cd63177f080c34315b49-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3aaa3c611c77cd63177f080c34315b49 columnFamilyName f2 2023-02-10 19:03:24,344 INFO [StoreOpener-3aaa3c611c77cd63177f080c34315b49-1] regionserver.HStore(310): Store=3aaa3c611c77cd63177f080c34315b49/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-10 19:03:24,344 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46525/user/jenkins/test-data/f68bbe99-417e-4fda-4301-36f56a4b6e73/data/default/testWithMockedMapReduceSingleRegion/3aaa3c611c77cd63177f080c34315b49 2023-02-10 19:03:24,345 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46525/user/jenkins/test-data/f68bbe99-417e-4fda-4301-36f56a4b6e73/data/default/testWithMockedMapReduceSingleRegion/3aaa3c611c77cd63177f080c34315b49 2023-02-10 19:03:24,346 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceSingleRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-10 19:03:24,347 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 3aaa3c611c77cd63177f080c34315b49 2023-02-10 19:03:24,348 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46525/user/jenkins/test-data/f68bbe99-417e-4fda-4301-36f56a4b6e73/data/default/testWithMockedMapReduceSingleRegion/3aaa3c611c77cd63177f080c34315b49/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-10 19:03:24,349 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 3aaa3c611c77cd63177f080c34315b49; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67236725, jitterRate=0.0019052773714065552}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-10 19:03:24,349 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 3aaa3c611c77cd63177f080c34315b49: Running coprocessor pre-open hook at 1676055804339Writing region info on filesystem at 1676055804339Initializing all the Stores at 1676055804340 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676055804340Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676055804340Cleaning up temporary data from old regions at 1676055804345 (+5 ms)Cleaning up detritus from prior splits at 1676055804345Running coprocessor post-open hooks at 1676055804349 (+4 ms)Region opened successfully at 1676055804349 2023-02-10 19:03:24,350 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceSingleRegion,,1676055803997.3aaa3c611c77cd63177f080c34315b49., pid=12, masterSystemTime=1676055804336 2023-02-10 19:03:24,351 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceSingleRegion,,1676055803997.3aaa3c611c77cd63177f080c34315b49. 2023-02-10 19:03:24,351 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceSingleRegion,,1676055803997.3aaa3c611c77cd63177f080c34315b49. 2023-02-10 19:03:24,351 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=3aaa3c611c77cd63177f080c34315b49, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,37167,1676055802941 2023-02-10 19:03:24,352 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceSingleRegion,,1676055803997.3aaa3c611c77cd63177f080c34315b49.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1676055804351"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676055804351"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676055804351"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676055804351"}]},"ts":"1676055804351"} 2023-02-10 19:03:24,354 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=12, resume processing ppid=11 2023-02-10 19:03:24,354 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=12, ppid=11, state=SUCCESS; OpenRegionProcedure 3aaa3c611c77cd63177f080c34315b49, server=jenkins-hbase4.apache.org,37167,1676055802941 in 169 msec 2023-02-10 19:03:24,355 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-02-10 19:03:24,355 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceSingleRegion, region=3aaa3c611c77cd63177f080c34315b49, ASSIGN in 325 msec 2023-02-10 19:03:24,356 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testWithMockedMapReduceSingleRegion execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-10 19:03:24,356 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMockedMapReduceSingleRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676055804356"}]},"ts":"1676055804356"} 2023-02-10 19:03:24,357 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testWithMockedMapReduceSingleRegion, state=ENABLED in hbase:meta 2023-02-10 19:03:24,360 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testWithMockedMapReduceSingleRegion execute state=CREATE_TABLE_POST_OPERATION 2023-02-10 19:03:24,361 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=10, state=SUCCESS; CreateTableProcedure table=testWithMockedMapReduceSingleRegion in 362 msec 2023-02-10 19:03:24,604 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37641] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-10 19:03:24,604 INFO [Listener at localhost/38427] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testWithMockedMapReduceSingleRegion, procId: 10 completed 2023-02-10 19:03:24,605 DEBUG [Listener at localhost/38427] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testWithMockedMapReduceSingleRegion get assigned. Timeout = 60000ms 2023-02-10 19:03:24,605 INFO [Listener at localhost/38427] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-10 19:03:24,608 INFO [Listener at localhost/38427] hbase.HBaseTestingUtility(3484): All regions for table testWithMockedMapReduceSingleRegion assigned to meta. Checking AM states. 2023-02-10 19:03:24,609 INFO [Listener at localhost/38427] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-10 19:03:24,609 INFO [Listener at localhost/38427] hbase.HBaseTestingUtility(3504): All regions for table testWithMockedMapReduceSingleRegion assigned. 2023-02-10 19:03:24,609 INFO [Listener at localhost/38427] mapreduce.TableSnapshotInputFormatTestBase(207): put some stuff in the table 2023-02-10 19:03:24,639 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37167] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 17576 Client: jenkins//172.31.14.131 first region in multi=testWithMockedMapReduceSingleRegion,,1676055803997.3aaa3c611c77cd63177f080c34315b49. 2023-02-10 19:03:24,734 INFO [Listener at localhost/38427] mapreduce.TableSnapshotInputFormatTestBase(214): snapshot 2023-02-10 19:03:24,735 INFO [Listener at localhost/38427] snapshot.SnapshotTestingUtils(396): taking snapshot. 2023-02-10 19:03:24,736 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37641] master.MasterRpcServices(1580): Client=jenkins//172.31.14.131 snapshot request for:{ ss=testWithMockedMapReduceSingleRegion table=testWithMockedMapReduceSingleRegion type=FLUSH ttl=0 } 2023-02-10 19:03:24,736 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37641] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1676055804736 (current time:1676055804736). 2023-02-10 19:03:24,736 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37641] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-02-10 19:03:24,736 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37641] zookeeper.ReadOnlyZKClient(139): Connect 0x5adeb3ad to 127.0.0.1:58765 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-10 19:03:24,739 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37641] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1a7e33a8, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-10 19:03:24,740 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37641] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-10 19:03:24,741 INFO [RS-EventLoopGroup-17-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55392, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-10 19:03:24,742 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37641] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5adeb3ad to 127.0.0.1:58765 2023-02-10 19:03:24,742 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37641] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-10 19:03:24,743 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37641] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-02-10 19:03:24,743 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37641] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=testWithMockedMapReduceSingleRegion table=testWithMockedMapReduceSingleRegion type=FLUSH ttl=0 } 2023-02-10 19:03:24,745 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37641] procedure2.ProcedureExecutor(1029): Stored pid=13, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=EXCLUSIVE 2023-02-10 19:03:24,746 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=13, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=EXCLUSIVE 2023-02-10 19:03:24,747 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=13, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=EXCLUSIVE; timeout=600000, timestamp=1676056404747 2023-02-10 19:03:24,747 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37641] snapshot.SnapshotManager(653): Started snapshot: { ss=testWithMockedMapReduceSingleRegion table=testWithMockedMapReduceSingleRegion type=FLUSH ttl=0 } 2023-02-10 19:03:24,747 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot testWithMockedMapReduceSingleRegion C_M_SNAPSHOT_TABLE on table testWithMockedMapReduceSingleRegion 2023-02-10 19:03:24,748 DEBUG [Listener at localhost/38427] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=testWithMockedMapReduceSingleRegion table=testWithMockedMapReduceSingleRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-02-10 19:03:24,749 DEBUG [Listener at localhost/38427] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-02-10 19:03:24,749 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=13, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=EXCLUSIVE 2023-02-10 19:03:24,750 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=14, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=SHARED 2023-02-10 19:03:24,750 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=13, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=EXCLUSIVE in 4 msec 2023-02-10 19:03:24,751 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=14, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=SHARED 2023-02-10 19:03:24,751 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=14, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=SHARED; timeout=600000, timestamp=1676056404751 2023-02-10 19:03:24,758 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure testWithMockedMapReduceSingleRegion 2023-02-10 19:03:24,758 INFO [(jenkins-hbase4.apache.org,37641,1676055802845)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMockedMapReduceSingleRegion' 2023-02-10 19:03:24,758 DEBUG [(jenkins-hbase4.apache.org,37641,1676055802845)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-10 19:03:24,759 DEBUG [(jenkins-hbase4.apache.org,37641,1676055802845)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMockedMapReduceSingleRegion' starting 'acquire' 2023-02-10 19:03:24,759 DEBUG [(jenkins-hbase4.apache.org,37641,1676055802845)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMockedMapReduceSingleRegion', kicking off acquire phase on members. 2023-02-10 19:03:24,759 DEBUG [(jenkins-hbase4.apache.org,37641,1676055802845)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37641-0x1003f9ddd8d0000, quorum=127.0.0.1:58765, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-10 19:03:24,759 DEBUG [(jenkins-hbase4.apache.org,37641,1676055802845)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion 2023-02-10 19:03:24,760 DEBUG [Listener at localhost/38427-EventThread] zookeeper.ZKWatcher(600): regionserver:37167-0x1003f9ddd8d0002, quorum=127.0.0.1:58765, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-10 19:03:24,760 DEBUG [Listener at localhost/38427-EventThread] zookeeper.ZKWatcher(600): regionserver:43705-0x1003f9ddd8d0001, quorum=127.0.0.1:58765, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-10 19:03:24,760 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-10 19:03:24,761 DEBUG [(jenkins-hbase4.apache.org,37641,1676055802845)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,37167,1676055802941 2023-02-10 19:03:24,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-10 19:03:24,761 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-10 19:03:24,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-10 19:03:24,761 DEBUG [(jenkins-hbase4.apache.org,37641,1676055802845)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37641-0x1003f9ddd8d0000, quorum=127.0.0.1:58765, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,37167,1676055802941 2023-02-10 19:03:24,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion 2023-02-10 19:03:24,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion 2023-02-10 19:03:24,761 DEBUG [(jenkins-hbase4.apache.org,37641,1676055802845)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-10 19:03:24,761 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37167-0x1003f9ddd8d0002, quorum=127.0.0.1:58765, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-10 19:03:24,761 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43705-0x1003f9ddd8d0001, quorum=127.0.0.1:58765, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-10 19:03:24,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 91 2023-02-10 19:03:24,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 91 2023-02-10 19:03:24,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion 2023-02-10 19:03:24,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion 2023-02-10 19:03:24,762 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMockedMapReduceSingleRegion from table testWithMockedMapReduceSingleRegion type FLUSH 2023-02-10 19:03:24,762 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMockedMapReduceSingleRegion from table testWithMockedMapReduceSingleRegion type FLUSH 2023-02-10 19:03:24,762 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMockedMapReduceSingleRegion 2023-02-10 19:03:24,762 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMockedMapReduceSingleRegion 2023-02-10 19:03:24,762 DEBUG [member: 'jenkins-hbase4.apache.org,43705,1676055802900' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMockedMapReduceSingleRegion' with timeout 300000ms 2023-02-10 19:03:24,762 DEBUG [member: 'jenkins-hbase4.apache.org,43705,1676055802900' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-10 19:03:24,762 DEBUG [member: 'jenkins-hbase4.apache.org,37167,1676055802941' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMockedMapReduceSingleRegion' with timeout 300000ms 2023-02-10 19:03:24,763 DEBUG [member: 'jenkins-hbase4.apache.org,37167,1676055802941' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-10 19:03:24,763 DEBUG [member: 'jenkins-hbase4.apache.org,43705,1676055802900' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMockedMapReduceSingleRegion' starting 'acquire' stage 2023-02-10 19:03:24,763 DEBUG [member: 'jenkins-hbase4.apache.org,37167,1676055802941' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMockedMapReduceSingleRegion' starting 'acquire' stage 2023-02-10 19:03:24,763 DEBUG [member: 'jenkins-hbase4.apache.org,43705,1676055802900' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMockedMapReduceSingleRegion' locally acquired 2023-02-10 19:03:24,764 DEBUG [member: 'jenkins-hbase4.apache.org,37167,1676055802941' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMockedMapReduceSingleRegion' locally acquired 2023-02-10 19:03:24,764 DEBUG [member: 'jenkins-hbase4.apache.org,43705,1676055802900' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43705,1676055802900' joining acquired barrier for procedure (testWithMockedMapReduceSingleRegion) in zk 2023-02-10 19:03:24,764 DEBUG [member: 'jenkins-hbase4.apache.org,37167,1676055802941' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37167,1676055802941' joining acquired barrier for procedure (testWithMockedMapReduceSingleRegion) in zk 2023-02-10 19:03:24,766 DEBUG [member: 'jenkins-hbase4.apache.org,43705,1676055802900' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-10 19:03:24,766 DEBUG [Listener at localhost/38427-EventThread] zookeeper.ZKWatcher(600): master:37641-0x1003f9ddd8d0000, quorum=127.0.0.1:58765, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,37167,1676055802941 2023-02-10 19:03:24,767 DEBUG [member: 'jenkins-hbase4.apache.org,43705,1676055802900' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43705-0x1003f9ddd8d0001, quorum=127.0.0.1:58765, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-10 19:03:24,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,37167,1676055802941 2023-02-10 19:03:24,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-10 19:03:24,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-10 19:03:24,767 DEBUG [member: 'jenkins-hbase4.apache.org,43705,1676055802900' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMockedMapReduceSingleRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-10 19:03:24,767 DEBUG [member: 'jenkins-hbase4.apache.org,37167,1676055802941' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-10 19:03:24,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-10 19:03:24,767 DEBUG [member: 'jenkins-hbase4.apache.org,37167,1676055802941' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37167-0x1003f9ddd8d0002, quorum=127.0.0.1:58765, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-10 19:03:24,767 DEBUG [member: 'jenkins-hbase4.apache.org,37167,1676055802941' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMockedMapReduceSingleRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-10 19:03:24,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-10 19:03:24,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-10 19:03:24,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43705,1676055802900 2023-02-10 19:03:24,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37167,1676055802941 2023-02-10 19:03:24,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-10 19:03:24,768 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37167,1676055802941' joining acquired barrier for procedure 'testWithMockedMapReduceSingleRegion' on coordinator 2023-02-10 19:03:24,768 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@27864372[Count = 0] remaining members to acquire global barrier 2023-02-10 19:03:24,768 DEBUG [(jenkins-hbase4.apache.org,37641,1676055802845)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMockedMapReduceSingleRegion' starting 'in-barrier' execution. 2023-02-10 19:03:24,768 DEBUG [(jenkins-hbase4.apache.org,37641,1676055802845)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-10 19:03:24,769 DEBUG [Listener at localhost/38427-EventThread] zookeeper.ZKWatcher(600): regionserver:37167-0x1003f9ddd8d0002, quorum=127.0.0.1:58765, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-10 19:03:24,769 DEBUG [Listener at localhost/38427-EventThread] zookeeper.ZKWatcher(600): regionserver:43705-0x1003f9ddd8d0001, quorum=127.0.0.1:58765, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-10 19:03:24,769 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-10 19:03:24,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-10 19:03:24,769 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-10 19:03:24,769 DEBUG [(jenkins-hbase4.apache.org,37641,1676055802845)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37641-0x1003f9ddd8d0000, quorum=127.0.0.1:58765, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,37167,1676055802941 2023-02-10 19:03:24,769 DEBUG [(jenkins-hbase4.apache.org,37641,1676055802845)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-10 19:03:24,769 DEBUG [member: 'jenkins-hbase4.apache.org,37167,1676055802941' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMockedMapReduceSingleRegion' received 'reached' from coordinator. 2023-02-10 19:03:24,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-10 19:03:24,770 DEBUG [member: 'jenkins-hbase4.apache.org,43705,1676055802900' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMockedMapReduceSingleRegion' received 'reached' from coordinator. 2023-02-10 19:03:24,770 DEBUG [member: 'jenkins-hbase4.apache.org,43705,1676055802900' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMockedMapReduceSingleRegion' locally completed 2023-02-10 19:03:24,770 DEBUG [member: 'jenkins-hbase4.apache.org,43705,1676055802900' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMockedMapReduceSingleRegion' completed for member 'jenkins-hbase4.apache.org,43705,1676055802900' in zk 2023-02-10 19:03:24,770 DEBUG [member: 'jenkins-hbase4.apache.org,37167,1676055802941' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-02-10 19:03:24,770 DEBUG [member: 'jenkins-hbase4.apache.org,37167,1676055802941' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-10 19:03:24,770 DEBUG [rs(jenkins-hbase4.apache.org,37167,1676055802941)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceSingleRegion,,1676055803997.3aaa3c611c77cd63177f080c34315b49. 2023-02-10 19:03:24,770 DEBUG [rs(jenkins-hbase4.apache.org,37167,1676055802941)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceSingleRegion,,1676055803997.3aaa3c611c77cd63177f080c34315b49. started... 2023-02-10 19:03:24,770 INFO [rs(jenkins-hbase4.apache.org,37167,1676055802941)-snapshot-pool-0] regionserver.HRegion(2744): Flushing 3aaa3c611c77cd63177f080c34315b49 2/2 column families, dataSize=1.01 MB heapSize=3.49 MB 2023-02-10 19:03:24,771 DEBUG [member: 'jenkins-hbase4.apache.org,43705,1676055802900' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMockedMapReduceSingleRegion' has notified controller of completion 2023-02-10 19:03:24,771 DEBUG [member: 'jenkins-hbase4.apache.org,43705,1676055802900' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-10 19:03:24,771 DEBUG [member: 'jenkins-hbase4.apache.org,43705,1676055802900' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMockedMapReduceSingleRegion' completed. 2023-02-10 19:03:24,792 INFO [rs(jenkins-hbase4.apache.org,37167,1676055802941)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=514.92 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:46525/user/jenkins/test-data/f68bbe99-417e-4fda-4301-36f56a4b6e73/data/default/testWithMockedMapReduceSingleRegion/3aaa3c611c77cd63177f080c34315b49/.tmp/f1/6863d59a4082454aa6cf61c09b836593 2023-02-10 19:03:24,809 INFO [rs(jenkins-hbase4.apache.org,37167,1676055802941)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=514.92 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:46525/user/jenkins/test-data/f68bbe99-417e-4fda-4301-36f56a4b6e73/data/default/testWithMockedMapReduceSingleRegion/3aaa3c611c77cd63177f080c34315b49/.tmp/f2/f8bfb7b8bd3c446194982d4d6c1ff45d 2023-02-10 19:03:24,813 DEBUG [rs(jenkins-hbase4.apache.org,37167,1676055802941)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46525/user/jenkins/test-data/f68bbe99-417e-4fda-4301-36f56a4b6e73/data/default/testWithMockedMapReduceSingleRegion/3aaa3c611c77cd63177f080c34315b49/.tmp/f1/6863d59a4082454aa6cf61c09b836593 as hdfs://localhost:46525/user/jenkins/test-data/f68bbe99-417e-4fda-4301-36f56a4b6e73/data/default/testWithMockedMapReduceSingleRegion/3aaa3c611c77cd63177f080c34315b49/f1/6863d59a4082454aa6cf61c09b836593 2023-02-10 19:03:24,816 INFO [rs(jenkins-hbase4.apache.org,37167,1676055802941)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46525/user/jenkins/test-data/f68bbe99-417e-4fda-4301-36f56a4b6e73/data/default/testWithMockedMapReduceSingleRegion/3aaa3c611c77cd63177f080c34315b49/f1/6863d59a4082454aa6cf61c09b836593, entries=17576, sequenceid=5, filesize=537.3 K 2023-02-10 19:03:24,817 DEBUG [rs(jenkins-hbase4.apache.org,37167,1676055802941)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46525/user/jenkins/test-data/f68bbe99-417e-4fda-4301-36f56a4b6e73/data/default/testWithMockedMapReduceSingleRegion/3aaa3c611c77cd63177f080c34315b49/.tmp/f2/f8bfb7b8bd3c446194982d4d6c1ff45d as hdfs://localhost:46525/user/jenkins/test-data/f68bbe99-417e-4fda-4301-36f56a4b6e73/data/default/testWithMockedMapReduceSingleRegion/3aaa3c611c77cd63177f080c34315b49/f2/f8bfb7b8bd3c446194982d4d6c1ff45d 2023-02-10 19:03:24,820 INFO [rs(jenkins-hbase4.apache.org,37167,1676055802941)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46525/user/jenkins/test-data/f68bbe99-417e-4fda-4301-36f56a4b6e73/data/default/testWithMockedMapReduceSingleRegion/3aaa3c611c77cd63177f080c34315b49/f2/f8bfb7b8bd3c446194982d4d6c1ff45d, entries=17576, sequenceid=5, filesize=537.3 K 2023-02-10 19:03:24,821 INFO [rs(jenkins-hbase4.apache.org,37167,1676055802941)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~1.01 MB/1054560, heapSize ~3.49 MB/3656288, currentSize=0 B/0 for 3aaa3c611c77cd63177f080c34315b49 in 51ms, sequenceid=5, compaction requested=false 2023-02-10 19:03:24,821 DEBUG [rs(jenkins-hbase4.apache.org,37167,1676055802941)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testWithMockedMapReduceSingleRegion' 2023-02-10 19:03:24,821 DEBUG [rs(jenkins-hbase4.apache.org,37167,1676055802941)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 3aaa3c611c77cd63177f080c34315b49: 2023-02-10 19:03:24,821 DEBUG [rs(jenkins-hbase4.apache.org,37167,1676055802941)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceSingleRegion,,1676055803997.3aaa3c611c77cd63177f080c34315b49.' region-info for snapshot=testWithMockedMapReduceSingleRegion 2023-02-10 19:03:24,821 DEBUG [rs(jenkins-hbase4.apache.org,37167,1676055802941)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-10 19:03:24,822 DEBUG [rs(jenkins-hbase4.apache.org,37167,1676055802941)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:46525/user/jenkins/test-data/f68bbe99-417e-4fda-4301-36f56a4b6e73/data/default/testWithMockedMapReduceSingleRegion/3aaa3c611c77cd63177f080c34315b49/f1/6863d59a4082454aa6cf61c09b836593] hfiles 2023-02-10 19:03:24,822 DEBUG [rs(jenkins-hbase4.apache.org,37167,1676055802941)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:46525/user/jenkins/test-data/f68bbe99-417e-4fda-4301-36f56a4b6e73/data/default/testWithMockedMapReduceSingleRegion/3aaa3c611c77cd63177f080c34315b49/f1/6863d59a4082454aa6cf61c09b836593 for snapshot=testWithMockedMapReduceSingleRegion 2023-02-10 19:03:24,822 DEBUG [rs(jenkins-hbase4.apache.org,37167,1676055802941)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:46525/user/jenkins/test-data/f68bbe99-417e-4fda-4301-36f56a4b6e73/data/default/testWithMockedMapReduceSingleRegion/3aaa3c611c77cd63177f080c34315b49/f2/f8bfb7b8bd3c446194982d4d6c1ff45d] hfiles 2023-02-10 19:03:24,822 DEBUG [rs(jenkins-hbase4.apache.org,37167,1676055802941)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:46525/user/jenkins/test-data/f68bbe99-417e-4fda-4301-36f56a4b6e73/data/default/testWithMockedMapReduceSingleRegion/3aaa3c611c77cd63177f080c34315b49/f2/f8bfb7b8bd3c446194982d4d6c1ff45d for snapshot=testWithMockedMapReduceSingleRegion 2023-02-10 19:03:24,826 DEBUG [rs(jenkins-hbase4.apache.org,37167,1676055802941)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceSingleRegion,,1676055803997.3aaa3c611c77cd63177f080c34315b49. completed. 2023-02-10 19:03:24,827 DEBUG [rs(jenkins-hbase4.apache.org,37167,1676055802941)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceSingleRegion,,1676055803997.3aaa3c611c77cd63177f080c34315b49. 2023-02-10 19:03:24,827 DEBUG [member: 'jenkins-hbase4.apache.org,37167,1676055802941' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-02-10 19:03:24,827 DEBUG [member: 'jenkins-hbase4.apache.org,37167,1676055802941' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-02-10 19:03:24,827 DEBUG [member: 'jenkins-hbase4.apache.org,37167,1676055802941' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,37167,1676055802941 2023-02-10 19:03:24,827 DEBUG [member: 'jenkins-hbase4.apache.org,37167,1676055802941' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMockedMapReduceSingleRegion' locally completed 2023-02-10 19:03:24,827 DEBUG [member: 'jenkins-hbase4.apache.org,37167,1676055802941' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMockedMapReduceSingleRegion' completed for member 'jenkins-hbase4.apache.org,37167,1676055802941' in zk 2023-02-10 19:03:24,829 DEBUG [Listener at localhost/38427-EventThread] zookeeper.ZKWatcher(600): master:37641-0x1003f9ddd8d0000, quorum=127.0.0.1:58765, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,37167,1676055802941 2023-02-10 19:03:24,829 DEBUG [member: 'jenkins-hbase4.apache.org,37167,1676055802941' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMockedMapReduceSingleRegion' has notified controller of completion 2023-02-10 19:03:24,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,37167,1676055802941 2023-02-10 19:03:24,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-10 19:03:24,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-10 19:03:24,829 DEBUG [member: 'jenkins-hbase4.apache.org,37167,1676055802941' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-10 19:03:24,829 DEBUG [member: 'jenkins-hbase4.apache.org,37167,1676055802941' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMockedMapReduceSingleRegion' completed. 2023-02-10 19:03:24,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-10 19:03:24,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-10 19:03:24,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-10 19:03:24,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43705,1676055802900 2023-02-10 19:03:24,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37167,1676055802941 2023-02-10 19:03:24,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-10 19:03:24,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-10 19:03:24,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43705,1676055802900 2023-02-10 19:03:24,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37167,1676055802941 2023-02-10 19:03:24,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMockedMapReduceSingleRegion' member 'jenkins-hbase4.apache.org,37167,1676055802941': 2023-02-10 19:03:24,832 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37167,1676055802941' released barrier for procedure'testWithMockedMapReduceSingleRegion', counting down latch. Waiting for 0 more 2023-02-10 19:03:24,832 INFO [(jenkins-hbase4.apache.org,37641,1676055802845)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMockedMapReduceSingleRegion' execution completed 2023-02-10 19:03:24,832 DEBUG [(jenkins-hbase4.apache.org,37641,1676055802845)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-10 19:03:24,832 DEBUG [(jenkins-hbase4.apache.org,37641,1676055802845)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-10 19:03:24,832 DEBUG [(jenkins-hbase4.apache.org,37641,1676055802845)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMockedMapReduceSingleRegion 2023-02-10 19:03:24,832 INFO [(jenkins-hbase4.apache.org,37641,1676055802845)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMockedMapReduceSingleRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-02-10 19:03:24,833 DEBUG [Listener at localhost/38427-EventThread] zookeeper.ZKWatcher(600): master:37641-0x1003f9ddd8d0000, quorum=127.0.0.1:58765, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-10 19:03:24,833 DEBUG [Listener at localhost/38427-EventThread] zookeeper.ZKWatcher(600): regionserver:37167-0x1003f9ddd8d0002, quorum=127.0.0.1:58765, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-10 19:03:24,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-10 19:03:24,834 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-10 19:03:24,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-10 19:03:24,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-10 19:03:24,834 DEBUG [Listener at localhost/38427-EventThread] zookeeper.ZKWatcher(600): regionserver:37167-0x1003f9ddd8d0002, quorum=127.0.0.1:58765, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-10 19:03:24,833 DEBUG [Listener at localhost/38427-EventThread] zookeeper.ZKWatcher(600): regionserver:43705-0x1003f9ddd8d0001, quorum=127.0.0.1:58765, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-10 19:03:24,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-10 19:03:24,834 DEBUG [Listener at localhost/38427-EventThread] zookeeper.ZKWatcher(600): regionserver:43705-0x1003f9ddd8d0001, quorum=127.0.0.1:58765, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-10 19:03:24,834 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-10 19:03:24,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-10 19:03:24,834 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-10 19:03:24,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-10 19:03:24,834 DEBUG [(jenkins-hbase4.apache.org,37641,1676055802845)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37641-0x1003f9ddd8d0000, quorum=127.0.0.1:58765, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,43705,1676055802900 2023-02-10 19:03:24,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-10 19:03:24,834 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-10 19:03:24,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-10 19:03:24,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-10 19:03:24,834 DEBUG [(jenkins-hbase4.apache.org,37641,1676055802845)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37641-0x1003f9ddd8d0000, quorum=127.0.0.1:58765, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,37167,1676055802941 2023-02-10 19:03:24,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-10 19:03:24,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-10 19:03:24,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-10 19:03:24,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-10 19:03:24,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43705,1676055802900 2023-02-10 19:03:24,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37167,1676055802941 2023-02-10 19:03:24,836 DEBUG [(jenkins-hbase4.apache.org,37641,1676055802845)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37641-0x1003f9ddd8d0000, quorum=127.0.0.1:58765, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,43705,1676055802900 2023-02-10 19:03:24,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-10 19:03:24,836 DEBUG [(jenkins-hbase4.apache.org,37641,1676055802845)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37641-0x1003f9ddd8d0000, quorum=127.0.0.1:58765, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,37167,1676055802941 2023-02-10 19:03:24,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-10 19:03:24,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43705,1676055802900 2023-02-10 19:03:24,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37167,1676055802941 2023-02-10 19:03:24,841 DEBUG [Listener at localhost/38427-EventThread] zookeeper.ZKWatcher(600): master:37641-0x1003f9ddd8d0000, quorum=127.0.0.1:58765, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,37167,1676055802941 2023-02-10 19:03:24,841 DEBUG [Listener at localhost/38427-EventThread] zookeeper.ZKWatcher(600): master:37641-0x1003f9ddd8d0000, quorum=127.0.0.1:58765, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion 2023-02-10 19:03:24,841 DEBUG [Listener at localhost/38427-EventThread] zookeeper.ZKWatcher(600): regionserver:37167-0x1003f9ddd8d0002, quorum=127.0.0.1:58765, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-10 19:03:24,841 DEBUG [Listener at localhost/38427-EventThread] zookeeper.ZKWatcher(600): regionserver:43705-0x1003f9ddd8d0001, quorum=127.0.0.1:58765, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-10 19:03:24,841 DEBUG [Listener at localhost/38427-EventThread] zookeeper.ZKWatcher(600): regionserver:37167-0x1003f9ddd8d0002, quorum=127.0.0.1:58765, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-10 19:03:24,841 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-10 19:03:24,841 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-10 19:03:24,841 DEBUG [Listener at localhost/38427-EventThread] zookeeper.ZKWatcher(600): master:37641-0x1003f9ddd8d0000, quorum=127.0.0.1:58765, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,43705,1676055802900 2023-02-10 19:03:24,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-10 19:03:24,841 DEBUG [Listener at localhost/38427-EventThread] zookeeper.ZKWatcher(600): regionserver:43705-0x1003f9ddd8d0001, quorum=127.0.0.1:58765, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-10 19:03:24,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-10 19:03:24,841 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for testWithMockedMapReduceSingleRegion 2023-02-10 19:03:24,841 DEBUG [(jenkins-hbase4.apache.org,37641,1676055802845)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-10 19:03:24,842 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for testWithMockedMapReduceSingleRegion 2023-02-10 19:03:24,841 DEBUG [Listener at localhost/38427-EventThread] zookeeper.ZKWatcher(600): master:37641-0x1003f9ddd8d0000, quorum=127.0.0.1:58765, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion 2023-02-10 19:03:24,842 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-10 19:03:24,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-10 19:03:24,842 DEBUG [Listener at localhost/38427-EventThread] zookeeper.ZKWatcher(600): master:37641-0x1003f9ddd8d0000, quorum=127.0.0.1:58765, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,37167,1676055802941 2023-02-10 19:03:24,842 DEBUG [Listener at localhost/38427-EventThread] zookeeper.ZKWatcher(600): master:37641-0x1003f9ddd8d0000, quorum=127.0.0.1:58765, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-10 19:03:24,842 DEBUG [Listener at localhost/38427-EventThread] zookeeper.ZKWatcher(600): master:37641-0x1003f9ddd8d0000, quorum=127.0.0.1:58765, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,43705,1676055802900 2023-02-10 19:03:24,842 DEBUG [Listener at localhost/38427-EventThread] zookeeper.ZKWatcher(600): master:37641-0x1003f9ddd8d0000, quorum=127.0.0.1:58765, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-10 19:03:24,842 DEBUG [Listener at localhost/38427-EventThread] zookeeper.ZKWatcher(600): master:37641-0x1003f9ddd8d0000, quorum=127.0.0.1:58765, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-10 19:03:24,842 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-10 19:03:24,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-10 19:03:24,842 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:46525/user/jenkins/test-data/f68bbe99-417e-4fda-4301-36f56a4b6e73/.hbase-snapshot/.tmp/testWithMockedMapReduceSingleRegion 2023-02-10 19:03:24,849 DEBUG [Listener at localhost/38427] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-10 19:03:24,850 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37641] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMockedMapReduceSingleRegion table=testWithMockedMapReduceSingleRegion type=FLUSH ttl=0 } is done 2023-02-10 19:03:24,850 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37641] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMockedMapReduceSingleRegion table=testWithMockedMapReduceSingleRegion type=FLUSH ttl=0 }' is still in progress! 2023-02-10 19:03:24,851 DEBUG [Listener at localhost/38427] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-02-10 19:03:24,860 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:46525/user/jenkins/test-data/f68bbe99-417e-4fda-4301-36f56a4b6e73/.hbase-snapshot/.tmp/testWithMockedMapReduceSingleRegion to hdfs://localhost:46525/user/jenkins/test-data/f68bbe99-417e-4fda-4301-36f56a4b6e73/.hbase-snapshot/testWithMockedMapReduceSingleRegion 2023-02-10 19:03:24,873 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot testWithMockedMapReduceSingleRegion of table testWithMockedMapReduceSingleRegion completed 2023-02-10 19:03:24,873 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:46525/user/jenkins/test-data/f68bbe99-417e-4fda-4301-36f56a4b6e73/.hbase-snapshot/.tmp/testWithMockedMapReduceSingleRegion 2023-02-10 19:03:24,873 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:46525/user/jenkins/test-data/f68bbe99-417e-4fda-4301-36f56a4b6e73/.hbase-snapshot/.tmp/testWithMockedMapReduceSingleRegion 2023-02-10 19:03:24,873 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot testWithMockedMapReduceSingleRegion C_M_SNAPSHOT_TABLE on table testWithMockedMapReduceSingleRegion at 1676055804747Consolidate snapshot: testWithMockedMapReduceSingleRegion at 1676055804842 (+95 ms)Loading Region manifests for testWithMockedMapReduceSingleRegion at 1676055804842Writing data manifest for testWithMockedMapReduceSingleRegion at 1676055804845 (+3 ms)Verifying snapshot: testWithMockedMapReduceSingleRegion at 1676055804855 (+10 ms)Snapshot testWithMockedMapReduceSingleRegion of table testWithMockedMapReduceSingleRegion completed at 1676055804873 (+18 ms) 2023-02-10 19:03:24,875 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=14, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=SHARED 2023-02-10 19:03:24,876 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=14, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=SHARED in 127 msec 2023-02-10 19:03:25,051 DEBUG [Listener at localhost/38427] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-10 19:03:25,052 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37641] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMockedMapReduceSingleRegion table=testWithMockedMapReduceSingleRegion type=FLUSH ttl=0 } is done 2023-02-10 19:03:25,052 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37641] snapshot.SnapshotManager(401): Snapshot '{ ss=testWithMockedMapReduceSingleRegion table=testWithMockedMapReduceSingleRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-02-10 19:03:25,052 INFO [Listener at localhost/38427] snapshot.SnapshotTestingUtils(399): Confirming snapshot exists. 2023-02-10 19:03:25,056 INFO [Listener at localhost/38427] snapshot.SnapshotTestingUtils(406): validating snapshot. 2023-02-10 19:03:25,060 INFO [Listener at localhost/38427] mapreduce.TableSnapshotInputFormatTestBase(218): load different values 2023-02-10 19:03:25,091 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37167] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 17576 Client: jenkins//172.31.14.131 first region in multi=testWithMockedMapReduceSingleRegion,,1676055803997.3aaa3c611c77cd63177f080c34315b49. 2023-02-10 19:03:25,171 INFO [Listener at localhost/38427] mapreduce.TableSnapshotInputFormatTestBase(222): cause flush to create new files in the region 2023-02-10 19:03:25,176 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37641] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-10 19:03:25,178 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37641] procedure.ProcedureCoordinator(165): Submitting procedure testWithMockedMapReduceSingleRegion 2023-02-10 19:03:25,178 INFO [(jenkins-hbase4.apache.org,37641,1676055802845)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMockedMapReduceSingleRegion' 2023-02-10 19:03:25,178 DEBUG [(jenkins-hbase4.apache.org,37641,1676055802845)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-10 19:03:25,179 DEBUG [(jenkins-hbase4.apache.org,37641,1676055802845)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMockedMapReduceSingleRegion' starting 'acquire' 2023-02-10 19:03:25,179 DEBUG [(jenkins-hbase4.apache.org,37641,1676055802845)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMockedMapReduceSingleRegion', kicking off acquire phase on members. 2023-02-10 19:03:25,180 DEBUG [(jenkins-hbase4.apache.org,37641,1676055802845)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37641-0x1003f9ddd8d0000, quorum=127.0.0.1:58765, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-10 19:03:25,180 DEBUG [(jenkins-hbase4.apache.org,37641,1676055802845)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion 2023-02-10 19:03:25,181 DEBUG [Listener at localhost/38427-EventThread] zookeeper.ZKWatcher(600): regionserver:37167-0x1003f9ddd8d0002, quorum=127.0.0.1:58765, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-10 19:03:25,181 DEBUG [Listener at localhost/38427-EventThread] zookeeper.ZKWatcher(600): regionserver:43705-0x1003f9ddd8d0001, quorum=127.0.0.1:58765, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-10 19:03:25,182 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-10 19:03:25,181 DEBUG [(jenkins-hbase4.apache.org,37641,1676055802845)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,37167,1676055802941 2023-02-10 19:03:25,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-10 19:03:25,182 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-10 19:03:25,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-10 19:03:25,182 DEBUG [(jenkins-hbase4.apache.org,37641,1676055802845)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37641-0x1003f9ddd8d0000, quorum=127.0.0.1:58765, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,37167,1676055802941 2023-02-10 19:03:25,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion 2023-02-10 19:03:25,182 DEBUG [(jenkins-hbase4.apache.org,37641,1676055802845)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-10 19:03:25,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion 2023-02-10 19:03:25,182 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37167-0x1003f9ddd8d0002, quorum=127.0.0.1:58765, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-10 19:03:25,182 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43705-0x1003f9ddd8d0001, quorum=127.0.0.1:58765, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-10 19:03:25,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-10 19:03:25,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion 2023-02-10 19:03:25,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-10 19:03:25,183 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMockedMapReduceSingleRegion 2023-02-10 19:03:25,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion 2023-02-10 19:03:25,183 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMockedMapReduceSingleRegion 2023-02-10 19:03:25,183 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMockedMapReduceSingleRegion 2023-02-10 19:03:25,183 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMockedMapReduceSingleRegion 2023-02-10 19:03:25,183 DEBUG [member: 'jenkins-hbase4.apache.org,37167,1676055802941' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMockedMapReduceSingleRegion' with timeout 60000ms 2023-02-10 19:03:25,183 DEBUG [member: 'jenkins-hbase4.apache.org,37167,1676055802941' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-10 19:03:25,183 DEBUG [member: 'jenkins-hbase4.apache.org,43705,1676055802900' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMockedMapReduceSingleRegion' with timeout 60000ms 2023-02-10 19:03:25,183 DEBUG [member: 'jenkins-hbase4.apache.org,43705,1676055802900' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-10 19:03:25,184 DEBUG [member: 'jenkins-hbase4.apache.org,37167,1676055802941' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMockedMapReduceSingleRegion' starting 'acquire' stage 2023-02-10 19:03:25,185 DEBUG [member: 'jenkins-hbase4.apache.org,43705,1676055802900' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMockedMapReduceSingleRegion' starting 'acquire' stage 2023-02-10 19:03:25,185 DEBUG [member: 'jenkins-hbase4.apache.org,43705,1676055802900' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMockedMapReduceSingleRegion' locally acquired 2023-02-10 19:03:25,185 DEBUG [member: 'jenkins-hbase4.apache.org,43705,1676055802900' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43705,1676055802900' joining acquired barrier for procedure (testWithMockedMapReduceSingleRegion) in zk 2023-02-10 19:03:25,185 DEBUG [member: 'jenkins-hbase4.apache.org,37167,1676055802941' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-10 19:03:25,185 DEBUG [member: 'jenkins-hbase4.apache.org,37167,1676055802941' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-10 19:03:25,185 DEBUG [rs(jenkins-hbase4.apache.org,37167,1676055802941)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceSingleRegion,,1676055803997.3aaa3c611c77cd63177f080c34315b49. 2023-02-10 19:03:25,185 DEBUG [rs(jenkins-hbase4.apache.org,37167,1676055802941)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceSingleRegion,,1676055803997.3aaa3c611c77cd63177f080c34315b49. started... 2023-02-10 19:03:25,185 INFO [rs(jenkins-hbase4.apache.org,37167,1676055802941)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 3aaa3c611c77cd63177f080c34315b49 2/2 column families, dataSize=1.58 MB heapSize=4.02 MB 2023-02-10 19:03:25,187 DEBUG [member: 'jenkins-hbase4.apache.org,43705,1676055802900' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-10 19:03:25,187 DEBUG [member: 'jenkins-hbase4.apache.org,43705,1676055802900' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43705-0x1003f9ddd8d0001, quorum=127.0.0.1:58765, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-10 19:03:25,187 DEBUG [member: 'jenkins-hbase4.apache.org,43705,1676055802900' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMockedMapReduceSingleRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-10 19:03:25,199 INFO [rs(jenkins-hbase4.apache.org,37167,1676055802941)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=806.71 KB at sequenceid=9 (bloomFilter=false), to=hdfs://localhost:46525/user/jenkins/test-data/f68bbe99-417e-4fda-4301-36f56a4b6e73/data/default/testWithMockedMapReduceSingleRegion/3aaa3c611c77cd63177f080c34315b49/.tmp/f1/d9c0762d33914d72b3a8aee00424f9ef 2023-02-10 19:03:25,217 INFO [rs(jenkins-hbase4.apache.org,37167,1676055802941)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=806.71 KB at sequenceid=9 (bloomFilter=false), to=hdfs://localhost:46525/user/jenkins/test-data/f68bbe99-417e-4fda-4301-36f56a4b6e73/data/default/testWithMockedMapReduceSingleRegion/3aaa3c611c77cd63177f080c34315b49/.tmp/f2/f8e441ee8c6b460c8ac894fa33095812 2023-02-10 19:03:25,221 DEBUG [rs(jenkins-hbase4.apache.org,37167,1676055802941)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46525/user/jenkins/test-data/f68bbe99-417e-4fda-4301-36f56a4b6e73/data/default/testWithMockedMapReduceSingleRegion/3aaa3c611c77cd63177f080c34315b49/.tmp/f1/d9c0762d33914d72b3a8aee00424f9ef as hdfs://localhost:46525/user/jenkins/test-data/f68bbe99-417e-4fda-4301-36f56a4b6e73/data/default/testWithMockedMapReduceSingleRegion/3aaa3c611c77cd63177f080c34315b49/f1/d9c0762d33914d72b3a8aee00424f9ef 2023-02-10 19:03:25,225 INFO [rs(jenkins-hbase4.apache.org,37167,1676055802941)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46525/user/jenkins/test-data/f68bbe99-417e-4fda-4301-36f56a4b6e73/data/default/testWithMockedMapReduceSingleRegion/3aaa3c611c77cd63177f080c34315b49/f1/d9c0762d33914d72b3a8aee00424f9ef, entries=17576, sequenceid=9, filesize=829.4 K 2023-02-10 19:03:25,225 DEBUG [rs(jenkins-hbase4.apache.org,37167,1676055802941)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46525/user/jenkins/test-data/f68bbe99-417e-4fda-4301-36f56a4b6e73/data/default/testWithMockedMapReduceSingleRegion/3aaa3c611c77cd63177f080c34315b49/.tmp/f2/f8e441ee8c6b460c8ac894fa33095812 as hdfs://localhost:46525/user/jenkins/test-data/f68bbe99-417e-4fda-4301-36f56a4b6e73/data/default/testWithMockedMapReduceSingleRegion/3aaa3c611c77cd63177f080c34315b49/f2/f8e441ee8c6b460c8ac894fa33095812 2023-02-10 19:03:25,229 INFO [rs(jenkins-hbase4.apache.org,37167,1676055802941)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46525/user/jenkins/test-data/f68bbe99-417e-4fda-4301-36f56a4b6e73/data/default/testWithMockedMapReduceSingleRegion/3aaa3c611c77cd63177f080c34315b49/f2/f8e441ee8c6b460c8ac894fa33095812, entries=17576, sequenceid=9, filesize=829.4 K 2023-02-10 19:03:25,229 INFO [rs(jenkins-hbase4.apache.org,37167,1676055802941)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~1.58 MB/1652144, heapSize ~4.02 MB/4218720, currentSize=0 B/0 for 3aaa3c611c77cd63177f080c34315b49 in 44ms, sequenceid=9, compaction requested=false 2023-02-10 19:03:25,230 DEBUG [rs(jenkins-hbase4.apache.org,37167,1676055802941)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 3aaa3c611c77cd63177f080c34315b49: 2023-02-10 19:03:25,230 DEBUG [rs(jenkins-hbase4.apache.org,37167,1676055802941)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceSingleRegion,,1676055803997.3aaa3c611c77cd63177f080c34315b49. 2023-02-10 19:03:25,230 DEBUG [member: 'jenkins-hbase4.apache.org,37167,1676055802941' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-10 19:03:25,230 DEBUG [member: 'jenkins-hbase4.apache.org,37167,1676055802941' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-10 19:03:25,231 DEBUG [member: 'jenkins-hbase4.apache.org,37167,1676055802941' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,37167,1676055802941 2023-02-10 19:03:25,231 DEBUG [member: 'jenkins-hbase4.apache.org,37167,1676055802941' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMockedMapReduceSingleRegion' locally acquired 2023-02-10 19:03:25,231 DEBUG [member: 'jenkins-hbase4.apache.org,37167,1676055802941' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37167,1676055802941' joining acquired barrier for procedure (testWithMockedMapReduceSingleRegion) in zk 2023-02-10 19:03:25,232 DEBUG [Listener at localhost/38427-EventThread] zookeeper.ZKWatcher(600): master:37641-0x1003f9ddd8d0000, quorum=127.0.0.1:58765, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,37167,1676055802941 2023-02-10 19:03:25,232 DEBUG [member: 'jenkins-hbase4.apache.org,37167,1676055802941' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-10 19:03:25,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,37167,1676055802941 2023-02-10 19:03:25,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-10 19:03:25,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-10 19:03:25,232 DEBUG [member: 'jenkins-hbase4.apache.org,37167,1676055802941' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37167-0x1003f9ddd8d0002, quorum=127.0.0.1:58765, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-10 19:03:25,232 DEBUG [member: 'jenkins-hbase4.apache.org,37167,1676055802941' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMockedMapReduceSingleRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-10 19:03:25,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-10 19:03:25,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-10 19:03:25,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-10 19:03:25,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43705,1676055802900 2023-02-10 19:03:25,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37167,1676055802941 2023-02-10 19:03:25,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-10 19:03:25,234 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37167,1676055802941' joining acquired barrier for procedure 'testWithMockedMapReduceSingleRegion' on coordinator 2023-02-10 19:03:25,234 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@23b9c35a[Count = 0] remaining members to acquire global barrier 2023-02-10 19:03:25,234 DEBUG [(jenkins-hbase4.apache.org,37641,1676055802845)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMockedMapReduceSingleRegion' starting 'in-barrier' execution. 2023-02-10 19:03:25,234 DEBUG [(jenkins-hbase4.apache.org,37641,1676055802845)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-10 19:03:25,235 DEBUG [Listener at localhost/38427-EventThread] zookeeper.ZKWatcher(600): regionserver:37167-0x1003f9ddd8d0002, quorum=127.0.0.1:58765, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-10 19:03:25,235 DEBUG [Listener at localhost/38427-EventThread] zookeeper.ZKWatcher(600): regionserver:43705-0x1003f9ddd8d0001, quorum=127.0.0.1:58765, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-10 19:03:25,235 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-10 19:03:25,235 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-10 19:03:25,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-10 19:03:25,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-10 19:03:25,235 DEBUG [member: 'jenkins-hbase4.apache.org,37167,1676055802941' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMockedMapReduceSingleRegion' received 'reached' from coordinator. 2023-02-10 19:03:25,235 DEBUG [member: 'jenkins-hbase4.apache.org,43705,1676055802900' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMockedMapReduceSingleRegion' received 'reached' from coordinator. 2023-02-10 19:03:25,235 DEBUG [member: 'jenkins-hbase4.apache.org,43705,1676055802900' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMockedMapReduceSingleRegion' locally completed 2023-02-10 19:03:25,235 DEBUG [member: 'jenkins-hbase4.apache.org,37167,1676055802941' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMockedMapReduceSingleRegion' locally completed 2023-02-10 19:03:25,235 DEBUG [(jenkins-hbase4.apache.org,37641,1676055802845)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37641-0x1003f9ddd8d0000, quorum=127.0.0.1:58765, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,37167,1676055802941 2023-02-10 19:03:25,235 DEBUG [(jenkins-hbase4.apache.org,37641,1676055802845)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-10 19:03:25,235 DEBUG [member: 'jenkins-hbase4.apache.org,43705,1676055802900' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMockedMapReduceSingleRegion' completed for member 'jenkins-hbase4.apache.org,43705,1676055802900' in zk 2023-02-10 19:03:25,235 DEBUG [member: 'jenkins-hbase4.apache.org,37167,1676055802941' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMockedMapReduceSingleRegion' completed for member 'jenkins-hbase4.apache.org,37167,1676055802941' in zk 2023-02-10 19:03:25,237 DEBUG [Listener at localhost/38427-EventThread] zookeeper.ZKWatcher(600): master:37641-0x1003f9ddd8d0000, quorum=127.0.0.1:58765, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,37167,1676055802941 2023-02-10 19:03:25,237 DEBUG [member: 'jenkins-hbase4.apache.org,43705,1676055802900' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMockedMapReduceSingleRegion' has notified controller of completion 2023-02-10 19:03:25,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,37167,1676055802941 2023-02-10 19:03:25,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-10 19:03:25,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-10 19:03:25,237 DEBUG [member: 'jenkins-hbase4.apache.org,43705,1676055802900' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-10 19:03:25,237 DEBUG [member: 'jenkins-hbase4.apache.org,37167,1676055802941' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMockedMapReduceSingleRegion' has notified controller of completion 2023-02-10 19:03:25,237 DEBUG [member: 'jenkins-hbase4.apache.org,37167,1676055802941' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-10 19:03:25,237 DEBUG [member: 'jenkins-hbase4.apache.org,43705,1676055802900' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMockedMapReduceSingleRegion' completed. 2023-02-10 19:03:25,237 DEBUG [member: 'jenkins-hbase4.apache.org,37167,1676055802941' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMockedMapReduceSingleRegion' completed. 2023-02-10 19:03:25,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-10 19:03:25,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-10 19:03:25,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-10 19:03:25,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43705,1676055802900 2023-02-10 19:03:25,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37167,1676055802941 2023-02-10 19:03:25,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-10 19:03:25,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-10 19:03:25,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43705,1676055802900 2023-02-10 19:03:25,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37167,1676055802941 2023-02-10 19:03:25,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMockedMapReduceSingleRegion' member 'jenkins-hbase4.apache.org,37167,1676055802941': 2023-02-10 19:03:25,240 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37167,1676055802941' released barrier for procedure'testWithMockedMapReduceSingleRegion', counting down latch. Waiting for 0 more 2023-02-10 19:03:25,240 INFO [(jenkins-hbase4.apache.org,37641,1676055802845)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMockedMapReduceSingleRegion' execution completed 2023-02-10 19:03:25,240 DEBUG [(jenkins-hbase4.apache.org,37641,1676055802845)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-10 19:03:25,240 DEBUG [(jenkins-hbase4.apache.org,37641,1676055802845)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-10 19:03:25,240 DEBUG [(jenkins-hbase4.apache.org,37641,1676055802845)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMockedMapReduceSingleRegion 2023-02-10 19:03:25,240 INFO [(jenkins-hbase4.apache.org,37641,1676055802845)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMockedMapReduceSingleRegionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-10 19:03:25,241 DEBUG [Listener at localhost/38427-EventThread] zookeeper.ZKWatcher(600): regionserver:37167-0x1003f9ddd8d0002, quorum=127.0.0.1:58765, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-10 19:03:25,241 DEBUG [Listener at localhost/38427-EventThread] zookeeper.ZKWatcher(600): regionserver:43705-0x1003f9ddd8d0001, quorum=127.0.0.1:58765, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-10 19:03:25,241 DEBUG [Listener at localhost/38427-EventThread] zookeeper.ZKWatcher(600): regionserver:37167-0x1003f9ddd8d0002, quorum=127.0.0.1:58765, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-10 19:03:25,241 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-10 19:03:25,241 DEBUG [Listener at localhost/38427-EventThread] zookeeper.ZKWatcher(600): master:37641-0x1003f9ddd8d0000, quorum=127.0.0.1:58765, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-10 19:03:25,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-10 19:03:25,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-10 19:03:25,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-10 19:03:25,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-10 19:03:25,241 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-10 19:03:25,241 DEBUG [Listener at localhost/38427-EventThread] zookeeper.ZKWatcher(600): regionserver:43705-0x1003f9ddd8d0001, quorum=127.0.0.1:58765, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-10 19:03:25,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-10 19:03:25,242 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-10 19:03:25,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-10 19:03:25,242 DEBUG [(jenkins-hbase4.apache.org,37641,1676055802845)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37641-0x1003f9ddd8d0000, quorum=127.0.0.1:58765, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,43705,1676055802900 2023-02-10 19:03:25,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-10 19:03:25,242 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-10 19:03:25,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-10 19:03:25,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-10 19:03:25,242 DEBUG [(jenkins-hbase4.apache.org,37641,1676055802845)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37641-0x1003f9ddd8d0000, quorum=127.0.0.1:58765, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,37167,1676055802941 2023-02-10 19:03:25,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-10 19:03:25,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-10 19:03:25,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-10 19:03:25,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-10 19:03:25,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43705,1676055802900 2023-02-10 19:03:25,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37167,1676055802941 2023-02-10 19:03:25,244 DEBUG [(jenkins-hbase4.apache.org,37641,1676055802845)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37641-0x1003f9ddd8d0000, quorum=127.0.0.1:58765, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,43705,1676055802900 2023-02-10 19:03:25,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-10 19:03:25,244 DEBUG [(jenkins-hbase4.apache.org,37641,1676055802845)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37641-0x1003f9ddd8d0000, quorum=127.0.0.1:58765, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,37167,1676055802941 2023-02-10 19:03:25,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-10 19:03:25,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43705,1676055802900 2023-02-10 19:03:25,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37167,1676055802941 2023-02-10 19:03:25,246 DEBUG [Listener at localhost/38427-EventThread] zookeeper.ZKWatcher(600): master:37641-0x1003f9ddd8d0000, quorum=127.0.0.1:58765, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,37167,1676055802941 2023-02-10 19:03:25,246 DEBUG [Listener at localhost/38427-EventThread] zookeeper.ZKWatcher(600): regionserver:43705-0x1003f9ddd8d0001, quorum=127.0.0.1:58765, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-10 19:03:25,246 DEBUG [Listener at localhost/38427-EventThread] zookeeper.ZKWatcher(600): master:37641-0x1003f9ddd8d0000, quorum=127.0.0.1:58765, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion 2023-02-10 19:03:25,246 DEBUG [(jenkins-hbase4.apache.org,37641,1676055802845)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-10 19:03:25,246 DEBUG [Listener at localhost/38427-EventThread] zookeeper.ZKWatcher(600): master:37641-0x1003f9ddd8d0000, quorum=127.0.0.1:58765, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,43705,1676055802900 2023-02-10 19:03:25,246 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37641] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testWithMockedMapReduceSingleRegion' 2023-02-10 19:03:25,246 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37641] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-10 19:03:25,246 DEBUG [Listener at localhost/38427-EventThread] zookeeper.ZKWatcher(600): regionserver:37167-0x1003f9ddd8d0002, quorum=127.0.0.1:58765, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-10 19:03:25,246 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-10 19:03:25,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-10 19:03:25,246 DEBUG [Listener at localhost/38427-EventThread] zookeeper.ZKWatcher(600): regionserver:43705-0x1003f9ddd8d0001, quorum=127.0.0.1:58765, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-10 19:03:25,246 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-10 19:03:25,246 DEBUG [Listener at localhost/38427-EventThread] zookeeper.ZKWatcher(600): regionserver:37167-0x1003f9ddd8d0002, quorum=127.0.0.1:58765, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-10 19:03:25,246 DEBUG [Listener at localhost/38427-EventThread] zookeeper.ZKWatcher(600): master:37641-0x1003f9ddd8d0000, quorum=127.0.0.1:58765, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion 2023-02-10 19:03:25,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-10 19:03:25,246 DEBUG [Listener at localhost/38427-EventThread] zookeeper.ZKWatcher(600): master:37641-0x1003f9ddd8d0000, quorum=127.0.0.1:58765, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,37167,1676055802941 2023-02-10 19:03:25,247 DEBUG [Listener at localhost/38427] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testWithMockedMapReduceSingleRegion'' to complete. (max 20000 ms per retry) 2023-02-10 19:03:25,247 DEBUG [Listener at localhost/38427-EventThread] zookeeper.ZKWatcher(600): master:37641-0x1003f9ddd8d0000, quorum=127.0.0.1:58765, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-10 19:03:25,247 DEBUG [Listener at localhost/38427] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-10 19:03:25,247 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-10 19:03:25,247 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-10 19:03:25,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-10 19:03:25,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-10 19:03:25,247 DEBUG [Listener at localhost/38427-EventThread] zookeeper.ZKWatcher(600): master:37641-0x1003f9ddd8d0000, quorum=127.0.0.1:58765, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,43705,1676055802900 2023-02-10 19:03:25,247 DEBUG [Listener at localhost/38427-EventThread] zookeeper.ZKWatcher(600): master:37641-0x1003f9ddd8d0000, quorum=127.0.0.1:58765, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-10 19:03:25,247 DEBUG [Listener at localhost/38427-EventThread] zookeeper.ZKWatcher(600): master:37641-0x1003f9ddd8d0000, quorum=127.0.0.1:58765, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-10 19:03:25,347 DEBUG [Listener at localhost/38427] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-10 19:03:25,348 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37641] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-10 19:03:25,352 INFO [Listener at localhost/38427] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "testWithMockedMapReduceSingleRegion" table: "testWithMockedMapReduceSingleRegion" creation_time: 1676055804736 type: FLUSH version: 2 ttl: 0 2023-02-10 19:03:25,352 DEBUG [Listener at localhost/38427] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost:46525/user/jenkins/test-data/c59aa4a0-287a-d68f-419a-c4a4b1b210b5/testWithMockedMapReduceSingleRegion/a6f14e2a-8edf-490e-8801-73a1dac69e0d/data/default/testWithMockedMapReduceSingleRegion 2023-02-10 19:03:25,353 INFO [Listener at localhost/38427] snapshot.RestoreSnapshotHelper(239): region to add: 3aaa3c611c77cd63177f080c34315b49 2023-02-10 19:03:25,353 INFO [Listener at localhost/38427] snapshot.RestoreSnapshotHelper(585): clone region=3aaa3c611c77cd63177f080c34315b49 as 3aaa3c611c77cd63177f080c34315b49 in snapshot testWithMockedMapReduceSingleRegion 2023-02-10 19:03:25,354 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(7671): creating {ENCODED => 3aaa3c611c77cd63177f080c34315b49, NAME => 'testWithMockedMapReduceSingleRegion,,1676055803997.3aaa3c611c77cd63177f080c34315b49.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testWithMockedMapReduceSingleRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:46525/user/jenkins/test-data/c59aa4a0-287a-d68f-419a-c4a4b1b210b5/testWithMockedMapReduceSingleRegion/a6f14e2a-8edf-490e-8801-73a1dac69e0d 2023-02-10 19:03:25,360 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceSingleRegion,,1676055803997.3aaa3c611c77cd63177f080c34315b49.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-10 19:03:25,360 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 6863d59a4082454aa6cf61c09b836593 from cloned region in snapshot testWithMockedMapReduceSingleRegion to table=testWithMockedMapReduceSingleRegion 2023-02-10 19:03:25,362 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink f8bfb7b8bd3c446194982d4d6c1ff45d from cloned region in snapshot testWithMockedMapReduceSingleRegion to table=testWithMockedMapReduceSingleRegion 2023-02-10 19:03:25,364 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1603): Closing 3aaa3c611c77cd63177f080c34315b49, disabling compactions & flushes 2023-02-10 19:03:25,364 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceSingleRegion,,1676055803997.3aaa3c611c77cd63177f080c34315b49. 2023-02-10 19:03:25,364 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceSingleRegion,,1676055803997.3aaa3c611c77cd63177f080c34315b49. 2023-02-10 19:03:25,364 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceSingleRegion,,1676055803997.3aaa3c611c77cd63177f080c34315b49. after waiting 0 ms 2023-02-10 19:03:25,364 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceSingleRegion,,1676055803997.3aaa3c611c77cd63177f080c34315b49. 2023-02-10 19:03:25,364 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceSingleRegion,,1676055803997.3aaa3c611c77cd63177f080c34315b49. 2023-02-10 19:03:25,364 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1557): Region close journal for 3aaa3c611c77cd63177f080c34315b49: Waiting for close lock at 1676055805364Disabling compacts and flushes for region at 1676055805364Disabling writes for close at 1676055805364Writing region close event to WAL at 1676055805364Closed at 1676055805364 2023-02-10 19:03:25,364 INFO [Listener at localhost/38427] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "testWithMockedMapReduceSingleRegion" table: "testWithMockedMapReduceSingleRegion" creation_time: 1676055804736 type: FLUSH version: 2 ttl: 0 2023-02-10 19:03:25,364 DEBUG [Listener at localhost/38427] snapshot.RestoreSnapshotHelper(832): Restored table dir:hdfs://localhost:46525/user/jenkins/test-data/c59aa4a0-287a-d68f-419a-c4a4b1b210b5/testWithMockedMapReduceSingleRegion/a6f14e2a-8edf-490e-8801-73a1dac69e0d 2023-02-10 19:03:25,365 DEBUG [Listener at localhost/38427] util.CommonFSUtils(682): File system contents for path hdfs://localhost:46525/user/jenkins/test-data/c59aa4a0-287a-d68f-419a-c4a4b1b210b5/testWithMockedMapReduceSingleRegion/a6f14e2a-8edf-490e-8801-73a1dac69e0d 2023-02-10 19:03:25,365 DEBUG [Listener at localhost/38427] util.CommonFSUtils(699): |-data/ 2023-02-10 19:03:25,365 DEBUG [Listener at localhost/38427] util.CommonFSUtils(699): |----default/ 2023-02-10 19:03:25,366 DEBUG [Listener at localhost/38427] util.CommonFSUtils(699): |-------testWithMockedMapReduceSingleRegion/ 2023-02-10 19:03:25,366 DEBUG [Listener at localhost/38427] util.CommonFSUtils(699): |----------3aaa3c611c77cd63177f080c34315b49/ 2023-02-10 19:03:25,366 DEBUG [Listener at localhost/38427] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-10 19:03:25,366 DEBUG [Listener at localhost/38427] util.CommonFSUtils(699): |-------------f1/ 2023-02-10 19:03:25,367 DEBUG [Listener at localhost/38427] util.CommonFSUtils(702): |----------------testWithMockedMapReduceSingleRegion=3aaa3c611c77cd63177f080c34315b49-6863d59a4082454aa6cf61c09b836593 2023-02-10 19:03:25,367 DEBUG [Listener at localhost/38427] util.CommonFSUtils(699): |-------------f2/ 2023-02-10 19:03:25,367 DEBUG [Listener at localhost/38427] util.CommonFSUtils(702): |----------------testWithMockedMapReduceSingleRegion=3aaa3c611c77cd63177f080c34315b49-f8bfb7b8bd3c446194982d4d6c1ff45d 2023-02-10 19:03:25,370 INFO [Listener at localhost/38427] mapreduce.TableSnapshotInputFormatImpl(392): Provided Scan has DEFAULT ReadType, updating STREAM for Snapshot-based InputFormat 2023-02-10 19:03:25,374 DEBUG [Listener at localhost/38427] regionserver.HRegion(865): Instantiated testWithMockedMapReduceSingleRegion,,1676055803997.3aaa3c611c77cd63177f080c34315b49.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-10 19:03:25,374 INFO [Listener at localhost/38427] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-10 19:03:25,374 DEBUG [Listener at localhost/38427] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-10 19:03:25,376 INFO [StoreOpener-3aaa3c611c77cd63177f080c34315b49-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 3aaa3c611c77cd63177f080c34315b49 2023-02-10 19:03:25,377 DEBUG [StoreOpener-3aaa3c611c77cd63177f080c34315b49-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46525/user/jenkins/test-data/c59aa4a0-287a-d68f-419a-c4a4b1b210b5/testWithMockedMapReduceSingleRegion/a6f14e2a-8edf-490e-8801-73a1dac69e0d/data/default/testWithMockedMapReduceSingleRegion/3aaa3c611c77cd63177f080c34315b49/f1 2023-02-10 19:03:25,377 INFO [StoreOpener-3aaa3c611c77cd63177f080c34315b49-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3aaa3c611c77cd63177f080c34315b49 columnFamilyName f1 2023-02-10 19:03:25,381 DEBUG [StoreOpener-3aaa3c611c77cd63177f080c34315b49-1] regionserver.HStore(539): loaded hdfs://localhost:46525/user/jenkins/test-data/c59aa4a0-287a-d68f-419a-c4a4b1b210b5/testWithMockedMapReduceSingleRegion/a6f14e2a-8edf-490e-8801-73a1dac69e0d/data/default/testWithMockedMapReduceSingleRegion/3aaa3c611c77cd63177f080c34315b49/f1/testWithMockedMapReduceSingleRegion=3aaa3c611c77cd63177f080c34315b49-6863d59a4082454aa6cf61c09b836593 2023-02-10 19:03:25,381 INFO [StoreOpener-3aaa3c611c77cd63177f080c34315b49-1] regionserver.HStore(310): Store=3aaa3c611c77cd63177f080c34315b49/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-10 19:03:25,381 INFO [StoreOpener-3aaa3c611c77cd63177f080c34315b49-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 3aaa3c611c77cd63177f080c34315b49 2023-02-10 19:03:25,382 DEBUG [StoreOpener-3aaa3c611c77cd63177f080c34315b49-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46525/user/jenkins/test-data/c59aa4a0-287a-d68f-419a-c4a4b1b210b5/testWithMockedMapReduceSingleRegion/a6f14e2a-8edf-490e-8801-73a1dac69e0d/data/default/testWithMockedMapReduceSingleRegion/3aaa3c611c77cd63177f080c34315b49/f2 2023-02-10 19:03:25,382 INFO [StoreOpener-3aaa3c611c77cd63177f080c34315b49-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3aaa3c611c77cd63177f080c34315b49 columnFamilyName f2 2023-02-10 19:03:25,386 DEBUG [StoreOpener-3aaa3c611c77cd63177f080c34315b49-1] regionserver.HStore(539): loaded hdfs://localhost:46525/user/jenkins/test-data/c59aa4a0-287a-d68f-419a-c4a4b1b210b5/testWithMockedMapReduceSingleRegion/a6f14e2a-8edf-490e-8801-73a1dac69e0d/data/default/testWithMockedMapReduceSingleRegion/3aaa3c611c77cd63177f080c34315b49/f2/testWithMockedMapReduceSingleRegion=3aaa3c611c77cd63177f080c34315b49-f8bfb7b8bd3c446194982d4d6c1ff45d 2023-02-10 19:03:25,386 INFO [StoreOpener-3aaa3c611c77cd63177f080c34315b49-1] regionserver.HStore(310): Store=3aaa3c611c77cd63177f080c34315b49/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-10 19:03:25,386 DEBUG [Listener at localhost/38427] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceSingleRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-10 19:03:25,386 INFO [Listener at localhost/38427] regionserver.HRegion(1071): Opened 3aaa3c611c77cd63177f080c34315b49; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=75380980, jitterRate=0.1232641339302063}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-10 19:03:25,386 DEBUG [Listener at localhost/38427] regionserver.HRegion(964): Region open journal for 3aaa3c611c77cd63177f080c34315b49: Writing region info on filesystem at 1676055805375Initializing all the Stores at 1676055805375Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676055805375Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676055805375Region opened successfully at 1676055805386 (+11 ms) 2023-02-10 19:03:25,431 DEBUG [Listener at localhost/38427] regionserver.HRegion(1603): Closing 3aaa3c611c77cd63177f080c34315b49, disabling compactions & flushes 2023-02-10 19:03:25,431 INFO [Listener at localhost/38427] regionserver.HRegion(1625): Closing region testWithMockedMapReduceSingleRegion,,1676055803997.3aaa3c611c77cd63177f080c34315b49. 2023-02-10 19:03:25,431 DEBUG [Listener at localhost/38427] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceSingleRegion,,1676055803997.3aaa3c611c77cd63177f080c34315b49. 2023-02-10 19:03:25,431 DEBUG [Listener at localhost/38427] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceSingleRegion,,1676055803997.3aaa3c611c77cd63177f080c34315b49. after waiting 0 ms 2023-02-10 19:03:25,432 DEBUG [Listener at localhost/38427] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceSingleRegion,,1676055803997.3aaa3c611c77cd63177f080c34315b49. 2023-02-10 19:03:25,432 INFO [Listener at localhost/38427] regionserver.HRegion(1837): Closed testWithMockedMapReduceSingleRegion,,1676055803997.3aaa3c611c77cd63177f080c34315b49. 2023-02-10 19:03:25,432 DEBUG [Listener at localhost/38427] regionserver.HRegion(1557): Region close journal for 3aaa3c611c77cd63177f080c34315b49: Waiting for close lock at 1676055805431Disabling compacts and flushes for region at 1676055805431Disabling writes for close at 1676055805431Writing region close event to WAL at 1676055805432 (+1 ms)Closed at 1676055805432 2023-02-10 19:03:25,437 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37641] master.MasterRpcServices(748): Client=jenkins//172.31.14.131 delete name: "testWithMockedMapReduceSingleRegion" 2023-02-10 19:03:25,439 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37641] snapshot.SnapshotManager(333): Deleting snapshot: testWithMockedMapReduceSingleRegion 2023-02-10 19:03:25,440 INFO [Listener at localhost/38427] client.HBaseAdmin$15(890): Started disable of testWithMockedMapReduceSingleRegion 2023-02-10 19:03:25,440 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37641] master.HMaster$11(2405): Client=jenkins//172.31.14.131 disable testWithMockedMapReduceSingleRegion 2023-02-10 19:03:25,441 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37641] procedure2.ProcedureExecutor(1029): Stored pid=15, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testWithMockedMapReduceSingleRegion 2023-02-10 19:03:25,443 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37641] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-10 19:03:25,443 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMockedMapReduceSingleRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676055805443"}]},"ts":"1676055805443"} 2023-02-10 19:03:25,444 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testWithMockedMapReduceSingleRegion, state=DISABLING in hbase:meta 2023-02-10 19:03:25,446 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testWithMockedMapReduceSingleRegion to state=DISABLING 2023-02-10 19:03:25,446 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceSingleRegion, region=3aaa3c611c77cd63177f080c34315b49, UNASSIGN}] 2023-02-10 19:03:25,448 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceSingleRegion, region=3aaa3c611c77cd63177f080c34315b49, UNASSIGN 2023-02-10 19:03:25,448 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=3aaa3c611c77cd63177f080c34315b49, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,37167,1676055802941 2023-02-10 19:03:25,448 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceSingleRegion,,1676055803997.3aaa3c611c77cd63177f080c34315b49.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1676055805448"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676055805448"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676055805448"}]},"ts":"1676055805448"} 2023-02-10 19:03:25,449 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=17, ppid=16, state=RUNNABLE; CloseRegionProcedure 3aaa3c611c77cd63177f080c34315b49, server=jenkins-hbase4.apache.org,37167,1676055802941}] 2023-02-10 19:03:25,545 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37641] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-10 19:03:25,601 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 3aaa3c611c77cd63177f080c34315b49 2023-02-10 19:03:25,601 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 3aaa3c611c77cd63177f080c34315b49, disabling compactions & flushes 2023-02-10 19:03:25,601 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceSingleRegion,,1676055803997.3aaa3c611c77cd63177f080c34315b49. 2023-02-10 19:03:25,601 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceSingleRegion,,1676055803997.3aaa3c611c77cd63177f080c34315b49. 2023-02-10 19:03:25,601 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceSingleRegion,,1676055803997.3aaa3c611c77cd63177f080c34315b49. after waiting 0 ms 2023-02-10 19:03:25,601 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceSingleRegion,,1676055803997.3aaa3c611c77cd63177f080c34315b49. 2023-02-10 19:03:25,605 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46525/user/jenkins/test-data/f68bbe99-417e-4fda-4301-36f56a4b6e73/data/default/testWithMockedMapReduceSingleRegion/3aaa3c611c77cd63177f080c34315b49/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-10 19:03:25,606 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceSingleRegion,,1676055803997.3aaa3c611c77cd63177f080c34315b49. 2023-02-10 19:03:25,606 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 3aaa3c611c77cd63177f080c34315b49: Waiting for close lock at 1676055805601Running coprocessor pre-close hooks at 1676055805601Disabling compacts and flushes for region at 1676055805601Disabling writes for close at 1676055805601Writing region close event to WAL at 1676055805602 (+1 ms)Running coprocessor post-close hooks at 1676055805606 (+4 ms)Closed at 1676055805606 2023-02-10 19:03:25,607 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 3aaa3c611c77cd63177f080c34315b49 2023-02-10 19:03:25,607 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=3aaa3c611c77cd63177f080c34315b49, regionState=CLOSED 2023-02-10 19:03:25,608 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceSingleRegion,,1676055803997.3aaa3c611c77cd63177f080c34315b49.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1676055805607"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676055805607"}]},"ts":"1676055805607"} 2023-02-10 19:03:25,610 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=17, resume processing ppid=16 2023-02-10 19:03:25,610 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=16, state=SUCCESS; CloseRegionProcedure 3aaa3c611c77cd63177f080c34315b49, server=jenkins-hbase4.apache.org,37167,1676055802941 in 160 msec 2023-02-10 19:03:25,611 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=16, resume processing ppid=15 2023-02-10 19:03:25,611 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=15, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceSingleRegion, region=3aaa3c611c77cd63177f080c34315b49, UNASSIGN in 164 msec 2023-02-10 19:03:25,612 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMockedMapReduceSingleRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676055805611"}]},"ts":"1676055805611"} 2023-02-10 19:03:25,612 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testWithMockedMapReduceSingleRegion, state=DISABLED in hbase:meta 2023-02-10 19:03:25,615 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testWithMockedMapReduceSingleRegion to state=DISABLED 2023-02-10 19:03:25,616 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=15, state=SUCCESS; DisableTableProcedure table=testWithMockedMapReduceSingleRegion in 176 msec 2023-02-10 19:03:25,746 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37641] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-10 19:03:25,746 INFO [Listener at localhost/38427] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testWithMockedMapReduceSingleRegion, procId: 15 completed 2023-02-10 19:03:25,747 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37641] master.HMaster$5(2215): Client=jenkins//172.31.14.131 delete testWithMockedMapReduceSingleRegion 2023-02-10 19:03:25,748 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37641] procedure2.ProcedureExecutor(1029): Stored pid=18, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testWithMockedMapReduceSingleRegion 2023-02-10 19:03:25,750 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=18, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testWithMockedMapReduceSingleRegion 2023-02-10 19:03:25,750 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=18, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testWithMockedMapReduceSingleRegion 2023-02-10 19:03:25,750 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37641] master.MasterRpcServices(1227): Checking to see if procedure is done pid=18 2023-02-10 19:03:25,753 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46525/user/jenkins/test-data/f68bbe99-417e-4fda-4301-36f56a4b6e73/.tmp/data/default/testWithMockedMapReduceSingleRegion/3aaa3c611c77cd63177f080c34315b49 2023-02-10 19:03:25,754 DEBUG [HFileArchiver-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:46525/user/jenkins/test-data/f68bbe99-417e-4fda-4301-36f56a4b6e73/.tmp/data/default/testWithMockedMapReduceSingleRegion/3aaa3c611c77cd63177f080c34315b49/f1, FileablePath, hdfs://localhost:46525/user/jenkins/test-data/f68bbe99-417e-4fda-4301-36f56a4b6e73/.tmp/data/default/testWithMockedMapReduceSingleRegion/3aaa3c611c77cd63177f080c34315b49/f2, FileablePath, hdfs://localhost:46525/user/jenkins/test-data/f68bbe99-417e-4fda-4301-36f56a4b6e73/.tmp/data/default/testWithMockedMapReduceSingleRegion/3aaa3c611c77cd63177f080c34315b49/recovered.edits] 2023-02-10 19:03:25,757 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46525/user/jenkins/test-data/f68bbe99-417e-4fda-4301-36f56a4b6e73/.tmp/data/default/testWithMockedMapReduceSingleRegion/3aaa3c611c77cd63177f080c34315b49/f1/6863d59a4082454aa6cf61c09b836593 to hdfs://localhost:46525/user/jenkins/test-data/f68bbe99-417e-4fda-4301-36f56a4b6e73/archive/data/default/testWithMockedMapReduceSingleRegion/3aaa3c611c77cd63177f080c34315b49/f1/6863d59a4082454aa6cf61c09b836593 2023-02-10 19:03:25,758 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46525/user/jenkins/test-data/f68bbe99-417e-4fda-4301-36f56a4b6e73/.tmp/data/default/testWithMockedMapReduceSingleRegion/3aaa3c611c77cd63177f080c34315b49/f1/d9c0762d33914d72b3a8aee00424f9ef to hdfs://localhost:46525/user/jenkins/test-data/f68bbe99-417e-4fda-4301-36f56a4b6e73/archive/data/default/testWithMockedMapReduceSingleRegion/3aaa3c611c77cd63177f080c34315b49/f1/d9c0762d33914d72b3a8aee00424f9ef 2023-02-10 19:03:25,760 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46525/user/jenkins/test-data/f68bbe99-417e-4fda-4301-36f56a4b6e73/.tmp/data/default/testWithMockedMapReduceSingleRegion/3aaa3c611c77cd63177f080c34315b49/f2/f8bfb7b8bd3c446194982d4d6c1ff45d to hdfs://localhost:46525/user/jenkins/test-data/f68bbe99-417e-4fda-4301-36f56a4b6e73/archive/data/default/testWithMockedMapReduceSingleRegion/3aaa3c611c77cd63177f080c34315b49/f2/f8bfb7b8bd3c446194982d4d6c1ff45d 2023-02-10 19:03:25,761 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46525/user/jenkins/test-data/f68bbe99-417e-4fda-4301-36f56a4b6e73/.tmp/data/default/testWithMockedMapReduceSingleRegion/3aaa3c611c77cd63177f080c34315b49/f2/f8e441ee8c6b460c8ac894fa33095812 to hdfs://localhost:46525/user/jenkins/test-data/f68bbe99-417e-4fda-4301-36f56a4b6e73/archive/data/default/testWithMockedMapReduceSingleRegion/3aaa3c611c77cd63177f080c34315b49/f2/f8e441ee8c6b460c8ac894fa33095812 2023-02-10 19:03:25,763 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46525/user/jenkins/test-data/f68bbe99-417e-4fda-4301-36f56a4b6e73/.tmp/data/default/testWithMockedMapReduceSingleRegion/3aaa3c611c77cd63177f080c34315b49/recovered.edits/12.seqid to hdfs://localhost:46525/user/jenkins/test-data/f68bbe99-417e-4fda-4301-36f56a4b6e73/archive/data/default/testWithMockedMapReduceSingleRegion/3aaa3c611c77cd63177f080c34315b49/recovered.edits/12.seqid 2023-02-10 19:03:25,764 DEBUG [HFileArchiver-5] backup.HFileArchiver(596): Deleted hdfs://localhost:46525/user/jenkins/test-data/f68bbe99-417e-4fda-4301-36f56a4b6e73/.tmp/data/default/testWithMockedMapReduceSingleRegion/3aaa3c611c77cd63177f080c34315b49 2023-02-10 19:03:25,764 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testWithMockedMapReduceSingleRegion regions 2023-02-10 19:03:25,766 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=18, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testWithMockedMapReduceSingleRegion 2023-02-10 19:03:25,767 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testWithMockedMapReduceSingleRegion from hbase:meta 2023-02-10 19:03:25,768 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testWithMockedMapReduceSingleRegion' descriptor. 2023-02-10 19:03:25,769 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=18, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testWithMockedMapReduceSingleRegion 2023-02-10 19:03:25,769 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testWithMockedMapReduceSingleRegion' from region states. 2023-02-10 19:03:25,769 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceSingleRegion,,1676055803997.3aaa3c611c77cd63177f080c34315b49.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676055805769"}]},"ts":"9223372036854775807"} 2023-02-10 19:03:25,770 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-02-10 19:03:25,770 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 3aaa3c611c77cd63177f080c34315b49, NAME => 'testWithMockedMapReduceSingleRegion,,1676055803997.3aaa3c611c77cd63177f080c34315b49.', STARTKEY => '', ENDKEY => ''}] 2023-02-10 19:03:25,770 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testWithMockedMapReduceSingleRegion' as deleted. 2023-02-10 19:03:25,770 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceSingleRegion","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1676055805770"}]},"ts":"9223372036854775807"} 2023-02-10 19:03:25,771 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testWithMockedMapReduceSingleRegion state from META 2023-02-10 19:03:25,773 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=18, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testWithMockedMapReduceSingleRegion 2023-02-10 19:03:25,774 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=18, state=SUCCESS; DeleteTableProcedure table=testWithMockedMapReduceSingleRegion in 26 msec 2023-02-10 19:03:25,852 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37641] master.MasterRpcServices(1227): Checking to see if procedure is done pid=18 2023-02-10 19:03:25,852 INFO [Listener at localhost/38427] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testWithMockedMapReduceSingleRegion, procId: 18 completed 2023-02-10 19:03:25,852 INFO [Listener at localhost/38427] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-02-10 19:03:25,852 INFO [Listener at localhost/38427] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-10 19:03:25,852 DEBUG [Listener at localhost/38427] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4d07ea0d to 127.0.0.1:58765 2023-02-10 19:03:25,852 DEBUG [Listener at localhost/38427] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-10 19:03:25,853 DEBUG [Listener at localhost/38427] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-02-10 19:03:25,853 DEBUG [Listener at localhost/38427] util.JVMClusterUtil(257): Found active master hash=1744695223, stopped=false 2023-02-10 19:03:25,853 INFO [Listener at localhost/38427] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,37641,1676055802845 2023-02-10 19:03:25,854 DEBUG [Listener at localhost/38427-EventThread] zookeeper.ZKWatcher(600): regionserver:37167-0x1003f9ddd8d0002, quorum=127.0.0.1:58765, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-10 19:03:25,854 DEBUG [Listener at localhost/38427-EventThread] zookeeper.ZKWatcher(600): master:37641-0x1003f9ddd8d0000, quorum=127.0.0.1:58765, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-10 19:03:25,854 INFO [Listener at localhost/38427] procedure2.ProcedureExecutor(629): Stopping 2023-02-10 19:03:25,854 DEBUG [Listener at localhost/38427-EventThread] zookeeper.ZKWatcher(600): master:37641-0x1003f9ddd8d0000, quorum=127.0.0.1:58765, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-10 19:03:25,854 DEBUG [Listener at localhost/38427-EventThread] zookeeper.ZKWatcher(600): regionserver:43705-0x1003f9ddd8d0001, quorum=127.0.0.1:58765, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-10 19:03:25,855 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37167-0x1003f9ddd8d0002, quorum=127.0.0.1:58765, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-10 19:03:25,856 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:37641-0x1003f9ddd8d0000, quorum=127.0.0.1:58765, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-10 19:03:25,856 DEBUG [Listener at localhost/38427] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x211a09ca to 127.0.0.1:58765 2023-02-10 19:03:25,856 DEBUG [Listener at localhost/38427] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-10 19:03:25,856 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43705-0x1003f9ddd8d0001, quorum=127.0.0.1:58765, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-10 19:03:25,856 INFO [Listener at localhost/38427] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,43705,1676055802900' ***** 2023-02-10 19:03:25,856 INFO [Listener at localhost/38427] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-10 19:03:25,856 INFO [Listener at localhost/38427] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,37167,1676055802941' ***** 2023-02-10 19:03:25,857 INFO [Listener at localhost/38427] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-10 19:03:25,857 INFO [RS:0;jenkins-hbase4:43705] regionserver.HeapMemoryManager(220): Stopping 2023-02-10 19:03:25,857 INFO [RS:1;jenkins-hbase4:37167] regionserver.HeapMemoryManager(220): Stopping 2023-02-10 19:03:25,857 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-10 19:03:25,857 INFO [RS:1;jenkins-hbase4:37167] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-10 19:03:25,857 INFO [RS:0;jenkins-hbase4:43705] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-10 19:03:25,858 INFO [RS:1;jenkins-hbase4:37167] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-10 19:03:25,858 INFO [RS:0;jenkins-hbase4:43705] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-10 19:03:25,858 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-10 19:03:25,858 INFO [RS:0;jenkins-hbase4:43705] regionserver.HRegionServer(3304): Received CLOSE for e051548d5a5fc2886c739ac60a76688f 2023-02-10 19:03:25,858 INFO [RS:1;jenkins-hbase4:37167] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,37167,1676055802941 2023-02-10 19:03:25,859 DEBUG [RS:1;jenkins-hbase4:37167] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3bf28e10 to 127.0.0.1:58765 2023-02-10 19:03:25,859 DEBUG [RS:1;jenkins-hbase4:37167] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-10 19:03:25,859 INFO [RS:1;jenkins-hbase4:37167] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-10 19:03:25,859 INFO [RS:0;jenkins-hbase4:43705] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,43705,1676055802900 2023-02-10 19:03:25,859 INFO [RS:1;jenkins-hbase4:37167] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-10 19:03:25,859 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing e051548d5a5fc2886c739ac60a76688f, disabling compactions & flushes 2023-02-10 19:03:25,859 DEBUG [RS:0;jenkins-hbase4:43705] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7d46cf12 to 127.0.0.1:58765 2023-02-10 19:03:25,859 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676055803515.e051548d5a5fc2886c739ac60a76688f. 2023-02-10 19:03:25,859 INFO [RS:1;jenkins-hbase4:37167] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-10 19:03:25,859 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676055803515.e051548d5a5fc2886c739ac60a76688f. 2023-02-10 19:03:25,859 DEBUG [RS:0;jenkins-hbase4:43705] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-10 19:03:25,859 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676055803515.e051548d5a5fc2886c739ac60a76688f. after waiting 0 ms 2023-02-10 19:03:25,859 INFO [RS:1;jenkins-hbase4:37167] regionserver.HRegionServer(3304): Received CLOSE for 1588230740 2023-02-10 19:03:25,859 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676055803515.e051548d5a5fc2886c739ac60a76688f. 2023-02-10 19:03:25,859 INFO [RS:0;jenkins-hbase4:43705] regionserver.HRegionServer(1475): Waiting on 1 regions to close 2023-02-10 19:03:25,860 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing e051548d5a5fc2886c739ac60a76688f 1/1 column families, dataSize=78 B heapSize=488 B 2023-02-10 19:03:25,860 DEBUG [RS:0;jenkins-hbase4:43705] regionserver.HRegionServer(1479): Online Regions={e051548d5a5fc2886c739ac60a76688f=hbase:namespace,,1676055803515.e051548d5a5fc2886c739ac60a76688f.} 2023-02-10 19:03:25,860 INFO [RS:1;jenkins-hbase4:37167] regionserver.HRegionServer(1475): Waiting on 1 regions to close 2023-02-10 19:03:25,860 DEBUG [RS:0;jenkins-hbase4:43705] regionserver.HRegionServer(1505): Waiting on e051548d5a5fc2886c739ac60a76688f 2023-02-10 19:03:25,860 DEBUG [RS:1;jenkins-hbase4:37167] regionserver.HRegionServer(1479): Online Regions={1588230740=hbase:meta,,1.1588230740} 2023-02-10 19:03:25,860 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-10 19:03:25,860 DEBUG [RS:1;jenkins-hbase4:37167] regionserver.HRegionServer(1505): Waiting on 1588230740 2023-02-10 19:03:25,860 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-10 19:03:25,860 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-10 19:03:25,860 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-10 19:03:25,860 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-10 19:03:25,860 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 1588230740 3/3 column families, dataSize=4.21 KB heapSize=7.63 KB 2023-02-10 19:03:25,872 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:46525/user/jenkins/test-data/f68bbe99-417e-4fda-4301-36f56a4b6e73/data/hbase/namespace/e051548d5a5fc2886c739ac60a76688f/.tmp/info/a87cc3dde21542068040d2c828e85a9c 2023-02-10 19:03:25,874 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.57 KB at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:46525/user/jenkins/test-data/f68bbe99-417e-4fda-4301-36f56a4b6e73/data/hbase/meta/1588230740/.tmp/info/320a225faef84e8cac22bcc114ab96df 2023-02-10 19:03:25,876 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46525/user/jenkins/test-data/f68bbe99-417e-4fda-4301-36f56a4b6e73/data/hbase/namespace/e051548d5a5fc2886c739ac60a76688f/.tmp/info/a87cc3dde21542068040d2c828e85a9c as hdfs://localhost:46525/user/jenkins/test-data/f68bbe99-417e-4fda-4301-36f56a4b6e73/data/hbase/namespace/e051548d5a5fc2886c739ac60a76688f/info/a87cc3dde21542068040d2c828e85a9c 2023-02-10 19:03:25,877 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 320a225faef84e8cac22bcc114ab96df 2023-02-10 19:03:25,880 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:46525/user/jenkins/test-data/f68bbe99-417e-4fda-4301-36f56a4b6e73/data/hbase/namespace/e051548d5a5fc2886c739ac60a76688f/info/a87cc3dde21542068040d2c828e85a9c, entries=2, sequenceid=6, filesize=4.8 K 2023-02-10 19:03:25,881 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for e051548d5a5fc2886c739ac60a76688f in 21ms, sequenceid=6, compaction requested=false 2023-02-10 19:03:25,884 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46525/user/jenkins/test-data/f68bbe99-417e-4fda-4301-36f56a4b6e73/data/hbase/namespace/e051548d5a5fc2886c739ac60a76688f/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-02-10 19:03:25,884 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=115 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:46525/user/jenkins/test-data/f68bbe99-417e-4fda-4301-36f56a4b6e73/data/hbase/meta/1588230740/.tmp/rep_barrier/21cbd20e5cfe465c9246a6c6bed4835d 2023-02-10 19:03:25,884 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676055803515.e051548d5a5fc2886c739ac60a76688f. 2023-02-10 19:03:25,884 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for e051548d5a5fc2886c739ac60a76688f: Waiting for close lock at 1676055805859Running coprocessor pre-close hooks at 1676055805859Disabling compacts and flushes for region at 1676055805859Disabling writes for close at 1676055805859Obtaining lock to block concurrent updates at 1676055805860 (+1 ms)Preparing flush snapshotting stores in e051548d5a5fc2886c739ac60a76688f at 1676055805860Finished memstore snapshotting hbase:namespace,,1676055803515.e051548d5a5fc2886c739ac60a76688f., syncing WAL and waiting on mvcc, flushsize=dataSize=78, getHeapSize=472, getOffHeapSize=0, getCellsCount=2 at 1676055805860Flushing stores of hbase:namespace,,1676055803515.e051548d5a5fc2886c739ac60a76688f. at 1676055805860Flushing e051548d5a5fc2886c739ac60a76688f/info: creating writer at 1676055805860Flushing e051548d5a5fc2886c739ac60a76688f/info: appending metadata at 1676055805862 (+2 ms)Flushing e051548d5a5fc2886c739ac60a76688f/info: closing flushed file at 1676055805863 (+1 ms)Flushing e051548d5a5fc2886c739ac60a76688f/info: reopening flushed file at 1676055805877 (+14 ms)Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for e051548d5a5fc2886c739ac60a76688f in 21ms, sequenceid=6, compaction requested=false at 1676055805881 (+4 ms)Writing region close event to WAL at 1676055805881Running coprocessor post-close hooks at 1676055805884 (+3 ms)Closed at 1676055805884 2023-02-10 19:03:25,885 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1676055803515.e051548d5a5fc2886c739ac60a76688f. 2023-02-10 19:03:25,887 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 21cbd20e5cfe465c9246a6c6bed4835d 2023-02-10 19:03:25,893 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=536 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:46525/user/jenkins/test-data/f68bbe99-417e-4fda-4301-36f56a4b6e73/data/hbase/meta/1588230740/.tmp/table/24e68dae20be439d8e99fe7907ad950f 2023-02-10 19:03:25,897 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 24e68dae20be439d8e99fe7907ad950f 2023-02-10 19:03:25,897 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46525/user/jenkins/test-data/f68bbe99-417e-4fda-4301-36f56a4b6e73/data/hbase/meta/1588230740/.tmp/info/320a225faef84e8cac22bcc114ab96df as hdfs://localhost:46525/user/jenkins/test-data/f68bbe99-417e-4fda-4301-36f56a4b6e73/data/hbase/meta/1588230740/info/320a225faef84e8cac22bcc114ab96df 2023-02-10 19:03:25,901 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 320a225faef84e8cac22bcc114ab96df 2023-02-10 19:03:25,901 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:46525/user/jenkins/test-data/f68bbe99-417e-4fda-4301-36f56a4b6e73/data/hbase/meta/1588230740/info/320a225faef84e8cac22bcc114ab96df, entries=12, sequenceid=21, filesize=6.3 K 2023-02-10 19:03:25,902 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46525/user/jenkins/test-data/f68bbe99-417e-4fda-4301-36f56a4b6e73/data/hbase/meta/1588230740/.tmp/rep_barrier/21cbd20e5cfe465c9246a6c6bed4835d as hdfs://localhost:46525/user/jenkins/test-data/f68bbe99-417e-4fda-4301-36f56a4b6e73/data/hbase/meta/1588230740/rep_barrier/21cbd20e5cfe465c9246a6c6bed4835d 2023-02-10 19:03:25,905 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 21cbd20e5cfe465c9246a6c6bed4835d 2023-02-10 19:03:25,905 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:46525/user/jenkins/test-data/f68bbe99-417e-4fda-4301-36f56a4b6e73/data/hbase/meta/1588230740/rep_barrier/21cbd20e5cfe465c9246a6c6bed4835d, entries=1, sequenceid=21, filesize=5.0 K 2023-02-10 19:03:25,905 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46525/user/jenkins/test-data/f68bbe99-417e-4fda-4301-36f56a4b6e73/data/hbase/meta/1588230740/.tmp/table/24e68dae20be439d8e99fe7907ad950f as hdfs://localhost:46525/user/jenkins/test-data/f68bbe99-417e-4fda-4301-36f56a4b6e73/data/hbase/meta/1588230740/table/24e68dae20be439d8e99fe7907ad950f 2023-02-10 19:03:25,909 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 24e68dae20be439d8e99fe7907ad950f 2023-02-10 19:03:25,909 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:46525/user/jenkins/test-data/f68bbe99-417e-4fda-4301-36f56a4b6e73/data/hbase/meta/1588230740/table/24e68dae20be439d8e99fe7907ad950f, entries=4, sequenceid=21, filesize=5.1 K 2023-02-10 19:03:25,915 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-10 19:03:25,915 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~4.21 KB/4311, heapSize ~7.58 KB/7760, currentSize=0 B/0 for 1588230740 in 55ms, sequenceid=21, compaction requested=false 2023-02-10 19:03:25,919 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46525/user/jenkins/test-data/f68bbe99-417e-4fda-4301-36f56a4b6e73/data/hbase/meta/1588230740/recovered.edits/24.seqid, newMaxSeqId=24, maxSeqId=1 2023-02-10 19:03:25,920 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-10 19:03:25,920 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-10 19:03:25,920 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1676055805860Running coprocessor pre-close hooks at 1676055805860Disabling compacts and flushes for region at 1676055805860Disabling writes for close at 1676055805860Obtaining lock to block concurrent updates at 1676055805860Preparing flush snapshotting stores in 1588230740 at 1676055805860Finished memstore snapshotting hbase:meta,,1.1588230740, syncing WAL and waiting on mvcc, flushsize=dataSize=4311, getHeapSize=7760, getOffHeapSize=0, getCellsCount=36 at 1676055805860Flushing stores of hbase:meta,,1.1588230740 at 1676055805861 (+1 ms)Flushing 1588230740/info: creating writer at 1676055805861Flushing 1588230740/info: appending metadata at 1676055805863 (+2 ms)Flushing 1588230740/info: closing flushed file at 1676055805863Flushing 1588230740/rep_barrier: creating writer at 1676055805877 (+14 ms)Flushing 1588230740/rep_barrier: appending metadata at 1676055805879 (+2 ms)Flushing 1588230740/rep_barrier: closing flushed file at 1676055805879Flushing 1588230740/table: creating writer at 1676055805887 (+8 ms)Flushing 1588230740/table: appending metadata at 1676055805889 (+2 ms)Flushing 1588230740/table: closing flushed file at 1676055805889Flushing 1588230740/info: reopening flushed file at 1676055805898 (+9 ms)Flushing 1588230740/rep_barrier: reopening flushed file at 1676055805902 (+4 ms)Flushing 1588230740/table: reopening flushed file at 1676055805906 (+4 ms)Finished flush of dataSize ~4.21 KB/4311, heapSize ~7.58 KB/7760, currentSize=0 B/0 for 1588230740 in 55ms, sequenceid=21, compaction requested=false at 1676055805916 (+10 ms)Writing region close event to WAL at 1676055805917 (+1 ms)Running coprocessor post-close hooks at 1676055805920 (+3 ms)Closed at 1676055805920 2023-02-10 19:03:25,920 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-02-10 19:03:25,927 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-10 19:03:26,006 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-datanode.properties,hadoop-metrics2.properties 2023-02-10 19:03:26,060 INFO [RS:0;jenkins-hbase4:43705] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,43705,1676055802900; all regions closed. 2023-02-10 19:03:26,060 INFO [RS:1;jenkins-hbase4:37167] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,37167,1676055802941; all regions closed. 2023-02-10 19:03:26,068 DEBUG [RS:0;jenkins-hbase4:43705] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/f68bbe99-417e-4fda-4301-36f56a4b6e73/oldWALs 2023-02-10 19:03:26,068 INFO [RS:0;jenkins-hbase4:43705] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C43705%2C1676055802900:(num 1676055803862) 2023-02-10 19:03:26,068 DEBUG [RS:0;jenkins-hbase4:43705] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-10 19:03:26,068 INFO [RS:0;jenkins-hbase4:43705] regionserver.LeaseManager(133): Closed leases 2023-02-10 19:03:26,069 DEBUG [RS:1;jenkins-hbase4:37167] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/f68bbe99-417e-4fda-4301-36f56a4b6e73/oldWALs 2023-02-10 19:03:26,069 INFO [RS:1;jenkins-hbase4:37167] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C37167%2C1676055802941.meta:.meta(num 1676055803461) 2023-02-10 19:03:26,069 INFO [RS:0;jenkins-hbase4:43705] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-02-10 19:03:26,071 INFO [RS:0;jenkins-hbase4:43705] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-10 19:03:26,071 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-10 19:03:26,071 INFO [RS:0;jenkins-hbase4:43705] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-10 19:03:26,071 INFO [RS:0;jenkins-hbase4:43705] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-10 19:03:26,072 INFO [RS:0;jenkins-hbase4:43705] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:43705 2023-02-10 19:03:26,074 DEBUG [Listener at localhost/38427-EventThread] zookeeper.ZKWatcher(600): regionserver:37167-0x1003f9ddd8d0002, quorum=127.0.0.1:58765, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,43705,1676055802900 2023-02-10 19:03:26,074 DEBUG [Listener at localhost/38427-EventThread] zookeeper.ZKWatcher(600): master:37641-0x1003f9ddd8d0000, quorum=127.0.0.1:58765, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-10 19:03:26,074 DEBUG [Listener at localhost/38427-EventThread] zookeeper.ZKWatcher(600): regionserver:37167-0x1003f9ddd8d0002, quorum=127.0.0.1:58765, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-10 19:03:26,075 DEBUG [Listener at localhost/38427-EventThread] zookeeper.ZKWatcher(600): regionserver:43705-0x1003f9ddd8d0001, quorum=127.0.0.1:58765, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,43705,1676055802900 2023-02-10 19:03:26,075 DEBUG [Listener at localhost/38427-EventThread] zookeeper.ZKWatcher(600): regionserver:43705-0x1003f9ddd8d0001, quorum=127.0.0.1:58765, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-10 19:03:26,075 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,43705,1676055802900] 2023-02-10 19:03:26,075 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,43705,1676055802900; numProcessing=1 2023-02-10 19:03:26,078 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,43705,1676055802900 already deleted, retry=false 2023-02-10 19:03:26,079 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,43705,1676055802900 expired; onlineServers=1 2023-02-10 19:03:26,079 DEBUG [RS:1;jenkins-hbase4:37167] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/f68bbe99-417e-4fda-4301-36f56a4b6e73/oldWALs 2023-02-10 19:03:26,079 INFO [RS:1;jenkins-hbase4:37167] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C37167%2C1676055802941:(num 1676055804239) 2023-02-10 19:03:26,079 DEBUG [RS:1;jenkins-hbase4:37167] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-10 19:03:26,079 INFO [RS:1;jenkins-hbase4:37167] regionserver.LeaseManager(133): Closed leases 2023-02-10 19:03:26,079 INFO [RS:1;jenkins-hbase4:37167] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-02-10 19:03:26,079 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-10 19:03:26,080 INFO [RS:1;jenkins-hbase4:37167] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:37167 2023-02-10 19:03:26,082 DEBUG [Listener at localhost/38427-EventThread] zookeeper.ZKWatcher(600): regionserver:37167-0x1003f9ddd8d0002, quorum=127.0.0.1:58765, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,37167,1676055802941 2023-02-10 19:03:26,082 DEBUG [Listener at localhost/38427-EventThread] zookeeper.ZKWatcher(600): master:37641-0x1003f9ddd8d0000, quorum=127.0.0.1:58765, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-10 19:03:26,082 ERROR [Listener at localhost/38427-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@73ec4ec2 rejected from java.util.concurrent.ThreadPoolExecutor@77d3d467[Shutting down, pool size = 1, active threads = 0, queued tasks = 0, completed tasks = 19] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-10 19:03:26,085 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,37167,1676055802941] 2023-02-10 19:03:26,085 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,37167,1676055802941; numProcessing=2 2023-02-10 19:03:26,087 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,37167,1676055802941 already deleted, retry=false 2023-02-10 19:03:26,087 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,37167,1676055802941 expired; onlineServers=0 2023-02-10 19:03:26,087 INFO [RegionServerTracker-0] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,37641,1676055802845' ***** 2023-02-10 19:03:26,087 INFO [RegionServerTracker-0] regionserver.HRegionServer(2310): STOPPED: Cluster shutdown set; onlineServer=0 2023-02-10 19:03:26,088 DEBUG [M:0;jenkins-hbase4:37641] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@63c26790, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-10 19:03:26,088 INFO [M:0;jenkins-hbase4:37641] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,37641,1676055802845 2023-02-10 19:03:26,088 INFO [M:0;jenkins-hbase4:37641] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,37641,1676055802845; all regions closed. 2023-02-10 19:03:26,088 DEBUG [M:0;jenkins-hbase4:37641] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-10 19:03:26,088 DEBUG [M:0;jenkins-hbase4:37641] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-02-10 19:03:26,088 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-02-10 19:03:26,088 DEBUG [M:0;jenkins-hbase4:37641] cleaner.HFileCleaner(317): Stopping file delete threads 2023-02-10 19:03:26,088 INFO [M:0;jenkins-hbase4:37641] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-02-10 19:03:26,088 INFO [M:0;jenkins-hbase4:37641] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-02-10 19:03:26,089 INFO [M:0;jenkins-hbase4:37641] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-02-10 19:03:26,089 DEBUG [M:0;jenkins-hbase4:37641] master.HMaster(1502): Stopping service threads 2023-02-10 19:03:26,089 INFO [M:0;jenkins-hbase4:37641] procedure2.RemoteProcedureDispatcher(118): Stopping procedure remote dispatcher 2023-02-10 19:03:26,088 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676055803108] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676055803108,5,FailOnTimeoutGroup] 2023-02-10 19:03:26,088 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676055803108] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676055803108,5,FailOnTimeoutGroup] 2023-02-10 19:03:26,090 ERROR [M:0;jenkins-hbase4:37641] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-02-10 19:03:26,090 INFO [M:0;jenkins-hbase4:37641] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-02-10 19:03:26,091 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-02-10 19:03:26,091 DEBUG [Listener at localhost/38427-EventThread] zookeeper.ZKWatcher(600): master:37641-0x1003f9ddd8d0000, quorum=127.0.0.1:58765, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-02-10 19:03:26,091 DEBUG [Listener at localhost/38427-EventThread] zookeeper.ZKWatcher(600): master:37641-0x1003f9ddd8d0000, quorum=127.0.0.1:58765, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-10 19:03:26,091 DEBUG [M:0;jenkins-hbase4:37641] zookeeper.ZKUtil(398): master:37641-0x1003f9ddd8d0000, quorum=127.0.0.1:58765, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-02-10 19:03:26,091 WARN [M:0;jenkins-hbase4:37641] master.ActiveMasterManager(323): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-02-10 19:03:26,091 INFO [M:0;jenkins-hbase4:37641] assignment.AssignmentManager(315): Stopping assignment manager 2023-02-10 19:03:26,092 INFO [M:0;jenkins-hbase4:37641] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-02-10 19:03:26,092 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:37641-0x1003f9ddd8d0000, quorum=127.0.0.1:58765, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-10 19:03:26,092 DEBUG [M:0;jenkins-hbase4:37641] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-10 19:03:26,092 INFO [M:0;jenkins-hbase4:37641] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-10 19:03:26,092 DEBUG [M:0;jenkins-hbase4:37641] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-10 19:03:26,092 DEBUG [M:0;jenkins-hbase4:37641] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-10 19:03:26,092 DEBUG [M:0;jenkins-hbase4:37641] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-10 19:03:26,092 INFO [M:0;jenkins-hbase4:37641] regionserver.HRegion(2744): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=56.11 KB heapSize=67.06 KB 2023-02-10 19:03:26,107 INFO [M:0;jenkins-hbase4:37641] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=56.11 KB at sequenceid=132 (bloomFilter=true), to=hdfs://localhost:46525/user/jenkins/test-data/f68bbe99-417e-4fda-4301-36f56a4b6e73/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/6f61286af9cd4d9d97562ea101c51ba1 2023-02-10 19:03:26,111 DEBUG [M:0;jenkins-hbase4:37641] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46525/user/jenkins/test-data/f68bbe99-417e-4fda-4301-36f56a4b6e73/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/6f61286af9cd4d9d97562ea101c51ba1 as hdfs://localhost:46525/user/jenkins/test-data/f68bbe99-417e-4fda-4301-36f56a4b6e73/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/6f61286af9cd4d9d97562ea101c51ba1 2023-02-10 19:03:26,115 INFO [M:0;jenkins-hbase4:37641] regionserver.HStore(1080): Added hdfs://localhost:46525/user/jenkins/test-data/f68bbe99-417e-4fda-4301-36f56a4b6e73/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/6f61286af9cd4d9d97562ea101c51ba1, entries=17, sequenceid=132, filesize=8.7 K 2023-02-10 19:03:26,115 INFO [M:0;jenkins-hbase4:37641] regionserver.HRegion(2947): Finished flush of dataSize ~56.11 KB/57455, heapSize ~67.05 KB/68656, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 23ms, sequenceid=132, compaction requested=false 2023-02-10 19:03:26,116 INFO [M:0;jenkins-hbase4:37641] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-10 19:03:26,116 DEBUG [M:0;jenkins-hbase4:37641] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1676055806092Disabling compacts and flushes for region at 1676055806092Disabling writes for close at 1676055806092Obtaining lock to block concurrent updates at 1676055806092Preparing flush snapshotting stores in 1595e783b53d99cd5eef43b6debb2682 at 1676055806092Finished memstore snapshotting master:store,,1.1595e783b53d99cd5eef43b6debb2682., syncing WAL and waiting on mvcc, flushsize=dataSize=57455, getHeapSize=68656, getOffHeapSize=0, getCellsCount=145 at 1676055806093 (+1 ms)Flushing stores of master:store,,1.1595e783b53d99cd5eef43b6debb2682. at 1676055806094 (+1 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: creating writer at 1676055806094Flushing 1595e783b53d99cd5eef43b6debb2682/proc: appending metadata at 1676055806099 (+5 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: closing flushed file at 1676055806100 (+1 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: reopening flushed file at 1676055806112 (+12 ms)Finished flush of dataSize ~56.11 KB/57455, heapSize ~67.05 KB/68656, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 23ms, sequenceid=132, compaction requested=false at 1676055806116 (+4 ms)Writing region close event to WAL at 1676055806116Closed at 1676055806116 2023-02-10 19:03:26,118 WARN [Close-WAL-Writer-0] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(641): complete file /user/jenkins/test-data/f68bbe99-417e-4fda-4301-36f56a4b6e73/MasterData/WALs/jenkins-hbase4.apache.org,37641,1676055802845/jenkins-hbase4.apache.org%2C37641%2C1676055802845.1676055803033 not finished, retry = 0 2023-02-10 19:03:26,219 INFO [M:0;jenkins-hbase4:37641] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-02-10 19:03:26,219 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-10 19:03:26,220 INFO [M:0;jenkins-hbase4:37641] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:37641 2023-02-10 19:03:26,222 DEBUG [M:0;jenkins-hbase4:37641] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,37641,1676055802845 already deleted, retry=false 2023-02-10 19:03:26,356 DEBUG [Listener at localhost/38427-EventThread] zookeeper.ZKWatcher(600): master:37641-0x1003f9ddd8d0000, quorum=127.0.0.1:58765, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-10 19:03:26,356 INFO [M:0;jenkins-hbase4:37641] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,37641,1676055802845; zookeeper connection closed. 2023-02-10 19:03:26,356 ERROR [Listener at localhost/38427-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@794612ef rejected from java.util.concurrent.ThreadPoolExecutor@7d79891f[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 52] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-10 19:03:26,357 DEBUG [Listener at localhost/38427-EventThread] zookeeper.ZKWatcher(600): master:37641-0x1003f9ddd8d0000, quorum=127.0.0.1:58765, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-10 19:03:26,357 ERROR [Listener at localhost/38427-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@4091072e rejected from java.util.concurrent.ThreadPoolExecutor@7d79891f[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 52] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-10 19:03:26,457 DEBUG [Listener at localhost/38427-EventThread] zookeeper.ZKWatcher(600): regionserver:37167-0x1003f9ddd8d0002, quorum=127.0.0.1:58765, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-10 19:03:26,457 INFO [RS:1;jenkins-hbase4:37167] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,37167,1676055802941; zookeeper connection closed. 2023-02-10 19:03:26,457 ERROR [Listener at localhost/38427-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@122286b3 rejected from java.util.concurrent.ThreadPoolExecutor@77d3d467[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 19] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-10 19:03:26,457 DEBUG [Listener at localhost/38427-EventThread] zookeeper.ZKWatcher(600): regionserver:37167-0x1003f9ddd8d0002, quorum=127.0.0.1:58765, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-10 19:03:26,457 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@42e0b145] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@42e0b145 2023-02-10 19:03:26,457 ERROR [Listener at localhost/38427-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@6a30cc85 rejected from java.util.concurrent.ThreadPoolExecutor@77d3d467[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 19] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-10 19:03:26,557 DEBUG [Listener at localhost/38427-EventThread] zookeeper.ZKWatcher(600): regionserver:43705-0x1003f9ddd8d0001, quorum=127.0.0.1:58765, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-10 19:03:26,557 INFO [RS:0;jenkins-hbase4:43705] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,43705,1676055802900; zookeeper connection closed. 2023-02-10 19:03:26,557 ERROR [Listener at localhost/38427-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@5a230f3a rejected from java.util.concurrent.ThreadPoolExecutor@5e1c80a6[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-10 19:03:26,557 DEBUG [Listener at localhost/38427-EventThread] zookeeper.ZKWatcher(600): regionserver:43705-0x1003f9ddd8d0001, quorum=127.0.0.1:58765, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-10 19:03:26,557 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@296359ec] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@296359ec 2023-02-10 19:03:26,557 ERROR [Listener at localhost/38427-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@6857e7ef rejected from java.util.concurrent.ThreadPoolExecutor@5e1c80a6[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-10 19:03:26,559 INFO [Listener at localhost/38427] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 2 regionserver(s) complete 2023-02-10 19:03:26,560 WARN [Listener at localhost/38427] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-10 19:03:26,563 INFO [Listener at localhost/38427] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-10 19:03:26,670 WARN [BP-1863550039-172.31.14.131-1676055802273 heartbeating to localhost/127.0.0.1:46525] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-10 19:03:26,670 WARN [BP-1863550039-172.31.14.131-1676055802273 heartbeating to localhost/127.0.0.1:46525] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1863550039-172.31.14.131-1676055802273 (Datanode Uuid 5b87d203-1109-457e-b1b7-724b583b90e4) service to localhost/127.0.0.1:46525 2023-02-10 19:03:26,670 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5f701de7-b9db-7a79-7062-8ee81962e145/cluster_ac1c84d9-60af-e122-da76-032408a561af/dfs/data/data3/current/BP-1863550039-172.31.14.131-1676055802273] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-10 19:03:26,671 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5f701de7-b9db-7a79-7062-8ee81962e145/cluster_ac1c84d9-60af-e122-da76-032408a561af/dfs/data/data4/current/BP-1863550039-172.31.14.131-1676055802273] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-10 19:03:26,672 WARN [Listener at localhost/38427] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-10 19:03:26,678 INFO [Listener at localhost/38427] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-10 19:03:26,782 WARN [BP-1863550039-172.31.14.131-1676055802273 heartbeating to localhost/127.0.0.1:46525] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-10 19:03:26,782 WARN [BP-1863550039-172.31.14.131-1676055802273 heartbeating to localhost/127.0.0.1:46525] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1863550039-172.31.14.131-1676055802273 (Datanode Uuid 095232dc-35e9-403e-9149-fa5529e78e51) service to localhost/127.0.0.1:46525 2023-02-10 19:03:26,782 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5f701de7-b9db-7a79-7062-8ee81962e145/cluster_ac1c84d9-60af-e122-da76-032408a561af/dfs/data/data1/current/BP-1863550039-172.31.14.131-1676055802273] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-10 19:03:26,783 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5f701de7-b9db-7a79-7062-8ee81962e145/cluster_ac1c84d9-60af-e122-da76-032408a561af/dfs/data/data2/current/BP-1863550039-172.31.14.131-1676055802273] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-10 19:03:26,794 INFO [Listener at localhost/38427] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-10 19:03:26,910 INFO [Listener at localhost/38427] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-02-10 19:03:26,928 INFO [Listener at localhost/38427] hbase.HBaseTestingUtility(1293): Minicluster is down 2023-02-10 19:03:26,939 INFO [Listener at localhost/38427] hbase.ResourceChecker(175): after: mapred.TestTableSnapshotInputFormat#testWithMockedMapReduceSingleRegion Thread=252 (was 229) Potentially hanging thread: RS-EventLoopGroup-17-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-21-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase4.apache.org,37641,1676055802845)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-15-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/38427 java.lang.Thread.dumpThreads(Native Method) java.lang.Thread.getAllStackTraces(Thread.java:1615) org.apache.hadoop.hbase.ResourceCheckerJUnitListener$ThreadResourceAnalyzer.getVal(ResourceCheckerJUnitListener.java:49) org.apache.hadoop.hbase.ResourceChecker.fill(ResourceChecker.java:110) org.apache.hadoop.hbase.ResourceChecker.fillEndings(ResourceChecker.java:104) org.apache.hadoop.hbase.ResourceChecker.end(ResourceChecker.java:206) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.end(ResourceCheckerJUnitListener.java:165) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.testFinished(ResourceCheckerJUnitListener.java:185) org.junit.runner.notification.SynchronizedRunListener.testFinished(SynchronizedRunListener.java:87) org.junit.runner.notification.RunNotifier$9.notifyListener(RunNotifier.java:225) org.junit.runner.notification.RunNotifier$SafeNotifier.run(RunNotifier.java:72) org.junit.runner.notification.RunNotifier.fireTestFinished(RunNotifier.java:222) org.junit.internal.runners.model.EachTestNotifier.fireTestFinished(EachTestNotifier.java:38) org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:372) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) org.apache.hadoop.hbase.SystemExitRule$1.evaluate(SystemExitRule.java:39) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-18-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-19-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1688088802) connection to localhost/127.0.0.1:46525 from jenkins.hfs.9 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS-EventLoopGroup-15-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-13 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-14 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-21-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1688088802) connection to localhost/127.0.0.1:46525 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: LeaseRenewer:jenkins.hfs.9@localhost:46525 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-16-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-20-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-20-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-16-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1688088802) connection to localhost/127.0.0.1:46525 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: LeaseRenewer:jenkins.hfs.8@localhost:46525 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-17-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-20-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-18-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-17-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1688088802) connection to localhost/127.0.0.1:46525 from jenkins.hfs.8 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-21-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-15-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins@localhost:46525 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/38427.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: RS-EventLoopGroup-16-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-18-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-19-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-19-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=661 (was 634) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=338 (was 359), ProcessCount=167 (was 167), AvailableMemoryMB=3381 (was 3414) 2023-02-10 19:03:26,950 INFO [Listener at localhost/38427] hbase.ResourceChecker(147): before: mapred.TestTableSnapshotInputFormat#testRestoreSnapshotDoesNotCreateBackRefLinks Thread=252, OpenFileDescriptor=661, MaxFileDescriptor=60000, SystemLoadAverage=338, ProcessCount=167, AvailableMemoryMB=3381 2023-02-10 19:03:26,960 INFO [Listener at localhost/38427] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.log.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5f701de7-b9db-7a79-7062-8ee81962e145/hadoop.log.dir so I do NOT create it in target/test-data/28680927-81f3-7a5f-7d41-92c2bdf9d0e7 2023-02-10 19:03:26,960 WARN [Listener at localhost/38427] hbase.HBaseTestingUtility(449): hadoop.log.dir property value differs in configuration and system: Configuration=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/../logs while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5f701de7-b9db-7a79-7062-8ee81962e145/hadoop.log.dir Erasing configuration value by system value. 2023-02-10 19:03:26,960 INFO [Listener at localhost/38427] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.tmp.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5f701de7-b9db-7a79-7062-8ee81962e145/hadoop.tmp.dir so I do NOT create it in target/test-data/28680927-81f3-7a5f-7d41-92c2bdf9d0e7 2023-02-10 19:03:26,960 WARN [Listener at localhost/38427] hbase.HBaseTestingUtility(449): hadoop.tmp.dir property value differs in configuration and system: Configuration=/tmp/hadoop-jenkins while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5f701de7-b9db-7a79-7062-8ee81962e145/hadoop.tmp.dir Erasing configuration value by system value. 2023-02-10 19:03:26,960 DEBUG [Listener at localhost/38427] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/28680927-81f3-7a5f-7d41-92c2bdf9d0e7 2023-02-10 19:03:26,960 INFO [Listener at localhost/38427] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=2, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=true, createWALDir=false} 2023-02-10 19:03:26,960 INFO [Listener at localhost/38427] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/28680927-81f3-7a5f-7d41-92c2bdf9d0e7/cluster_fff7820c-d868-c12f-2712-33948defcaf2, deleteOnExit=true 2023-02-10 19:03:26,960 INFO [Listener at localhost/38427] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-02-10 19:03:26,961 INFO [Listener at localhost/38427] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/28680927-81f3-7a5f-7d41-92c2bdf9d0e7/test.cache.data in system properties and HBase conf 2023-02-10 19:03:26,961 INFO [Listener at localhost/38427] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/28680927-81f3-7a5f-7d41-92c2bdf9d0e7/hadoop.tmp.dir in system properties and HBase conf 2023-02-10 19:03:26,961 INFO [Listener at localhost/38427] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/28680927-81f3-7a5f-7d41-92c2bdf9d0e7/hadoop.log.dir in system properties and HBase conf 2023-02-10 19:03:26,961 INFO [Listener at localhost/38427] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/28680927-81f3-7a5f-7d41-92c2bdf9d0e7/mapreduce.cluster.local.dir in system properties and HBase conf 2023-02-10 19:03:26,961 INFO [Listener at localhost/38427] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/28680927-81f3-7a5f-7d41-92c2bdf9d0e7/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-02-10 19:03:26,961 INFO [Listener at localhost/38427] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-02-10 19:03:26,961 DEBUG [Listener at localhost/38427] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-02-10 19:03:26,961 INFO [Listener at localhost/38427] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/28680927-81f3-7a5f-7d41-92c2bdf9d0e7/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-02-10 19:03:26,961 INFO [Listener at localhost/38427] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/28680927-81f3-7a5f-7d41-92c2bdf9d0e7/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-02-10 19:03:26,961 INFO [Listener at localhost/38427] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/28680927-81f3-7a5f-7d41-92c2bdf9d0e7/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-02-10 19:03:26,962 INFO [Listener at localhost/38427] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/28680927-81f3-7a5f-7d41-92c2bdf9d0e7/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-10 19:03:26,962 INFO [Listener at localhost/38427] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/28680927-81f3-7a5f-7d41-92c2bdf9d0e7/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-02-10 19:03:26,962 INFO [Listener at localhost/38427] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/28680927-81f3-7a5f-7d41-92c2bdf9d0e7/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-02-10 19:03:26,962 INFO [Listener at localhost/38427] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/28680927-81f3-7a5f-7d41-92c2bdf9d0e7/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-10 19:03:26,962 INFO [Listener at localhost/38427] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/28680927-81f3-7a5f-7d41-92c2bdf9d0e7/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-10 19:03:26,962 INFO [Listener at localhost/38427] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/28680927-81f3-7a5f-7d41-92c2bdf9d0e7/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-02-10 19:03:26,962 INFO [Listener at localhost/38427] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/28680927-81f3-7a5f-7d41-92c2bdf9d0e7/nfs.dump.dir in system properties and HBase conf 2023-02-10 19:03:26,962 INFO [Listener at localhost/38427] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/28680927-81f3-7a5f-7d41-92c2bdf9d0e7/java.io.tmpdir in system properties and HBase conf 2023-02-10 19:03:26,962 INFO [Listener at localhost/38427] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/28680927-81f3-7a5f-7d41-92c2bdf9d0e7/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-10 19:03:26,962 INFO [Listener at localhost/38427] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/28680927-81f3-7a5f-7d41-92c2bdf9d0e7/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-02-10 19:03:26,962 INFO [Listener at localhost/38427] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/28680927-81f3-7a5f-7d41-92c2bdf9d0e7/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-02-10 19:03:26,967 WARN [Listener at localhost/38427] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-10 19:03:26,967 WARN [Listener at localhost/38427] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-10 19:03:27,007 WARN [Listener at localhost/38427] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-10 19:03:27,009 INFO [Listener at localhost/38427] log.Slf4jLog(67): jetty-6.1.26 2023-02-10 19:03:27,013 INFO [Listener at localhost/38427] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/28680927-81f3-7a5f-7d41-92c2bdf9d0e7/java.io.tmpdir/Jetty_localhost_41377_hdfs____9nwpy8/webapp 2023-02-10 19:03:27,105 INFO [Listener at localhost/38427] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:41377 2023-02-10 19:03:27,149 WARN [Listener at localhost/38427] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-10 19:03:27,149 WARN [Listener at localhost/38427] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-10 19:03:27,188 WARN [Listener at localhost/46481] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-10 19:03:27,203 WARN [Listener at localhost/46481] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-10 19:03:27,205 WARN [Listener at localhost/46481] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-10 19:03:27,206 INFO [Listener at localhost/46481] log.Slf4jLog(67): jetty-6.1.26 2023-02-10 19:03:27,210 INFO [Listener at localhost/46481] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/28680927-81f3-7a5f-7d41-92c2bdf9d0e7/java.io.tmpdir/Jetty_localhost_43501_datanode____.yfz0qq/webapp 2023-02-10 19:03:27,302 INFO [Listener at localhost/46481] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:43501 2023-02-10 19:03:27,311 WARN [Listener at localhost/37827] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-10 19:03:27,328 WARN [Listener at localhost/37827] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-10 19:03:27,330 WARN [Listener at localhost/37827] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-10 19:03:27,331 INFO [Listener at localhost/37827] log.Slf4jLog(67): jetty-6.1.26 2023-02-10 19:03:27,335 INFO [Listener at localhost/37827] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/28680927-81f3-7a5f-7d41-92c2bdf9d0e7/java.io.tmpdir/Jetty_localhost_42751_datanode____.hxvqv8/webapp 2023-02-10 19:03:27,422 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xd1fa57e21e75a3c2: Processing first storage report for DS-cc58ca82-c069-4a61-9e34-ae9013539b3e from datanode cc416288-29cd-4827-a5fc-04e801d59691 2023-02-10 19:03:27,422 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xd1fa57e21e75a3c2: from storage DS-cc58ca82-c069-4a61-9e34-ae9013539b3e node DatanodeRegistration(127.0.0.1:44479, datanodeUuid=cc416288-29cd-4827-a5fc-04e801d59691, infoPort=36229, infoSecurePort=0, ipcPort=37827, storageInfo=lv=-57;cid=testClusterID;nsid=2004470804;c=1676055806969), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-10 19:03:27,422 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xd1fa57e21e75a3c2: Processing first storage report for DS-195902b3-140e-449a-9d35-020e76126653 from datanode cc416288-29cd-4827-a5fc-04e801d59691 2023-02-10 19:03:27,422 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xd1fa57e21e75a3c2: from storage DS-195902b3-140e-449a-9d35-020e76126653 node DatanodeRegistration(127.0.0.1:44479, datanodeUuid=cc416288-29cd-4827-a5fc-04e801d59691, infoPort=36229, infoSecurePort=0, ipcPort=37827, storageInfo=lv=-57;cid=testClusterID;nsid=2004470804;c=1676055806969), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-10 19:03:27,441 INFO [Listener at localhost/37827] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:42751 2023-02-10 19:03:27,448 WARN [Listener at localhost/43333] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-10 19:03:27,532 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xf8df591f7e2e4236: Processing first storage report for DS-4c3cfa07-988f-4a59-9efb-cc1fc1fc4dc2 from datanode 16595f6c-a896-4a2c-a79f-342c8c4176c1 2023-02-10 19:03:27,532 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xf8df591f7e2e4236: from storage DS-4c3cfa07-988f-4a59-9efb-cc1fc1fc4dc2 node DatanodeRegistration(127.0.0.1:41459, datanodeUuid=16595f6c-a896-4a2c-a79f-342c8c4176c1, infoPort=36189, infoSecurePort=0, ipcPort=43333, storageInfo=lv=-57;cid=testClusterID;nsid=2004470804;c=1676055806969), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-10 19:03:27,532 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xf8df591f7e2e4236: Processing first storage report for DS-e044a309-69dd-4913-b1b0-41a155e8d693 from datanode 16595f6c-a896-4a2c-a79f-342c8c4176c1 2023-02-10 19:03:27,532 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xf8df591f7e2e4236: from storage DS-e044a309-69dd-4913-b1b0-41a155e8d693 node DatanodeRegistration(127.0.0.1:41459, datanodeUuid=16595f6c-a896-4a2c-a79f-342c8c4176c1, infoPort=36189, infoSecurePort=0, ipcPort=43333, storageInfo=lv=-57;cid=testClusterID;nsid=2004470804;c=1676055806969), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-10 19:03:27,553 DEBUG [Listener at localhost/43333] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/28680927-81f3-7a5f-7d41-92c2bdf9d0e7 2023-02-10 19:03:27,556 INFO [Listener at localhost/43333] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/28680927-81f3-7a5f-7d41-92c2bdf9d0e7/cluster_fff7820c-d868-c12f-2712-33948defcaf2/zookeeper_0, clientPort=63275, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/28680927-81f3-7a5f-7d41-92c2bdf9d0e7/cluster_fff7820c-d868-c12f-2712-33948defcaf2/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/28680927-81f3-7a5f-7d41-92c2bdf9d0e7/cluster_fff7820c-d868-c12f-2712-33948defcaf2/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-02-10 19:03:27,557 INFO [Listener at localhost/43333] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=63275 2023-02-10 19:03:27,557 INFO [Listener at localhost/43333] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-10 19:03:27,558 INFO [Listener at localhost/43333] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-10 19:03:27,574 INFO [Listener at localhost/43333] util.FSUtils(479): Created version file at hdfs://localhost:46481/user/jenkins/test-data/63e201f6-29e3-8f69-97e1-6c13b3c652db with version=8 2023-02-10 19:03:27,575 INFO [Listener at localhost/43333] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-10 19:03:27,575 INFO [Listener at localhost/43333] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-10 19:03:27,576 INFO [Listener at localhost/43333] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:46481/user/jenkins/test-data/93e3558d-ad6f-9653-de92-8c8ff3bfbbad/hbase-staging 2023-02-10 19:03:27,578 INFO [Listener at localhost/43333] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-02-10 19:03:27,578 INFO [Listener at localhost/43333] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-10 19:03:27,578 INFO [Listener at localhost/43333] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-10 19:03:27,578 INFO [Listener at localhost/43333] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-10 19:03:27,578 INFO [Listener at localhost/43333] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-10 19:03:27,579 INFO [Listener at localhost/43333] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-10 19:03:27,579 INFO [Listener at localhost/43333] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-02-10 19:03:27,580 INFO [Listener at localhost/43333] ipc.NettyRpcServer(120): Bind to /172.31.14.131:37893 2023-02-10 19:03:27,580 INFO [Listener at localhost/43333] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-10 19:03:27,581 INFO [Listener at localhost/43333] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-10 19:03:27,582 INFO [Listener at localhost/43333] zookeeper.RecoverableZooKeeper(93): Process identifier=master:37893 connecting to ZooKeeper ensemble=127.0.0.1:63275 2023-02-10 19:03:27,592 DEBUG [Listener at localhost/43333-EventThread] zookeeper.ZKWatcher(600): master:378930x0, quorum=127.0.0.1:63275, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-10 19:03:27,594 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): master:37893-0x1003f9df0080000 connected 2023-02-10 19:03:27,616 DEBUG [Listener at localhost/43333] zookeeper.ZKUtil(164): master:37893-0x1003f9df0080000, quorum=127.0.0.1:63275, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-10 19:03:27,617 DEBUG [Listener at localhost/43333] zookeeper.ZKUtil(164): master:37893-0x1003f9df0080000, quorum=127.0.0.1:63275, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-10 19:03:27,617 DEBUG [Listener at localhost/43333] zookeeper.ZKUtil(164): master:37893-0x1003f9df0080000, quorum=127.0.0.1:63275, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-10 19:03:27,617 DEBUG [Listener at localhost/43333] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=37893 2023-02-10 19:03:27,620 DEBUG [Listener at localhost/43333] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=37893 2023-02-10 19:03:27,620 DEBUG [Listener at localhost/43333] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=37893 2023-02-10 19:03:27,624 DEBUG [Listener at localhost/43333] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=37893 2023-02-10 19:03:27,624 DEBUG [Listener at localhost/43333] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=37893 2023-02-10 19:03:27,624 INFO [Listener at localhost/43333] master.HMaster(439): hbase.rootdir=hdfs://localhost:46481/user/jenkins/test-data/63e201f6-29e3-8f69-97e1-6c13b3c652db, hbase.cluster.distributed=false 2023-02-10 19:03:27,636 INFO [Listener at localhost/43333] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-10 19:03:27,636 INFO [Listener at localhost/43333] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-10 19:03:27,636 INFO [Listener at localhost/43333] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-10 19:03:27,636 INFO [Listener at localhost/43333] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-10 19:03:27,636 INFO [Listener at localhost/43333] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-10 19:03:27,636 INFO [Listener at localhost/43333] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-10 19:03:27,636 INFO [Listener at localhost/43333] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-10 19:03:27,639 INFO [Listener at localhost/43333] ipc.NettyRpcServer(120): Bind to /172.31.14.131:45207 2023-02-10 19:03:27,639 INFO [Listener at localhost/43333] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-10 19:03:27,640 DEBUG [Listener at localhost/43333] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-10 19:03:27,640 INFO [Listener at localhost/43333] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-10 19:03:27,641 INFO [Listener at localhost/43333] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-10 19:03:27,642 INFO [Listener at localhost/43333] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:45207 connecting to ZooKeeper ensemble=127.0.0.1:63275 2023-02-10 19:03:27,647 DEBUG [Listener at localhost/43333-EventThread] zookeeper.ZKWatcher(600): regionserver:452070x0, quorum=127.0.0.1:63275, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-10 19:03:27,648 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:45207-0x1003f9df0080001 connected 2023-02-10 19:03:27,648 DEBUG [Listener at localhost/43333] zookeeper.ZKUtil(164): regionserver:45207-0x1003f9df0080001, quorum=127.0.0.1:63275, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-10 19:03:27,648 DEBUG [Listener at localhost/43333] zookeeper.ZKUtil(164): regionserver:45207-0x1003f9df0080001, quorum=127.0.0.1:63275, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-10 19:03:27,649 DEBUG [Listener at localhost/43333] zookeeper.ZKUtil(164): regionserver:45207-0x1003f9df0080001, quorum=127.0.0.1:63275, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-10 19:03:27,650 DEBUG [Listener at localhost/43333] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=45207 2023-02-10 19:03:27,652 DEBUG [Listener at localhost/43333] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=45207 2023-02-10 19:03:27,652 DEBUG [Listener at localhost/43333] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=45207 2023-02-10 19:03:27,652 DEBUG [Listener at localhost/43333] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=45207 2023-02-10 19:03:27,654 DEBUG [Listener at localhost/43333] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=45207 2023-02-10 19:03:27,665 INFO [Listener at localhost/43333] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-10 19:03:27,665 INFO [Listener at localhost/43333] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-10 19:03:27,665 INFO [Listener at localhost/43333] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-10 19:03:27,665 INFO [Listener at localhost/43333] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-10 19:03:27,665 INFO [Listener at localhost/43333] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-10 19:03:27,665 INFO [Listener at localhost/43333] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-10 19:03:27,665 INFO [Listener at localhost/43333] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-10 19:03:27,668 INFO [Listener at localhost/43333] ipc.NettyRpcServer(120): Bind to /172.31.14.131:34041 2023-02-10 19:03:27,668 INFO [Listener at localhost/43333] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-10 19:03:27,669 DEBUG [Listener at localhost/43333] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-10 19:03:27,669 INFO [Listener at localhost/43333] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-10 19:03:27,670 INFO [Listener at localhost/43333] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-10 19:03:27,671 INFO [Listener at localhost/43333] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:34041 connecting to ZooKeeper ensemble=127.0.0.1:63275 2023-02-10 19:03:27,673 DEBUG [Listener at localhost/43333-EventThread] zookeeper.ZKWatcher(600): regionserver:340410x0, quorum=127.0.0.1:63275, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-10 19:03:27,674 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:34041-0x1003f9df0080002 connected 2023-02-10 19:03:27,674 DEBUG [Listener at localhost/43333] zookeeper.ZKUtil(164): regionserver:34041-0x1003f9df0080002, quorum=127.0.0.1:63275, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-10 19:03:27,675 DEBUG [Listener at localhost/43333] zookeeper.ZKUtil(164): regionserver:34041-0x1003f9df0080002, quorum=127.0.0.1:63275, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-10 19:03:27,675 DEBUG [Listener at localhost/43333] zookeeper.ZKUtil(164): regionserver:34041-0x1003f9df0080002, quorum=127.0.0.1:63275, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-10 19:03:27,676 DEBUG [Listener at localhost/43333] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=34041 2023-02-10 19:03:27,677 DEBUG [Listener at localhost/43333] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=34041 2023-02-10 19:03:27,680 DEBUG [Listener at localhost/43333] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=34041 2023-02-10 19:03:27,680 DEBUG [Listener at localhost/43333] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=34041 2023-02-10 19:03:27,684 DEBUG [Listener at localhost/43333] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=34041 2023-02-10 19:03:27,690 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2158): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,37893,1676055807577 2023-02-10 19:03:27,691 DEBUG [Listener at localhost/43333-EventThread] zookeeper.ZKWatcher(600): master:37893-0x1003f9df0080000, quorum=127.0.0.1:63275, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-10 19:03:27,691 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:37893-0x1003f9df0080000, quorum=127.0.0.1:63275, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,37893,1676055807577 2023-02-10 19:03:27,693 DEBUG [Listener at localhost/43333-EventThread] zookeeper.ZKWatcher(600): master:37893-0x1003f9df0080000, quorum=127.0.0.1:63275, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-10 19:03:27,693 DEBUG [Listener at localhost/43333-EventThread] zookeeper.ZKWatcher(600): regionserver:45207-0x1003f9df0080001, quorum=127.0.0.1:63275, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-10 19:03:27,693 DEBUG [Listener at localhost/43333-EventThread] zookeeper.ZKWatcher(600): master:37893-0x1003f9df0080000, quorum=127.0.0.1:63275, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-10 19:03:27,693 DEBUG [Listener at localhost/43333-EventThread] zookeeper.ZKWatcher(600): regionserver:34041-0x1003f9df0080002, quorum=127.0.0.1:63275, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-10 19:03:27,695 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:37893-0x1003f9df0080000, quorum=127.0.0.1:63275, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-10 19:03:27,695 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(224): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,37893,1676055807577 from backup master directory 2023-02-10 19:03:27,695 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:37893-0x1003f9df0080000, quorum=127.0.0.1:63275, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-10 19:03:27,697 DEBUG [Listener at localhost/43333-EventThread] zookeeper.ZKWatcher(600): master:37893-0x1003f9df0080000, quorum=127.0.0.1:63275, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,37893,1676055807577 2023-02-10 19:03:27,697 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-10 19:03:27,698 DEBUG [Listener at localhost/43333-EventThread] zookeeper.ZKWatcher(600): master:37893-0x1003f9df0080000, quorum=127.0.0.1:63275, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-10 19:03:27,698 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(234): Registered as active master=jenkins-hbase4.apache.org,37893,1676055807577 2023-02-10 19:03:27,711 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(628): Created cluster ID file at hdfs://localhost:46481/user/jenkins/test-data/63e201f6-29e3-8f69-97e1-6c13b3c652db/hbase.id with ID: ffb5fee9-4e69-4e28-b5d7-e1ba64d780b8 2023-02-10 19:03:27,720 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-10 19:03:27,722 DEBUG [Listener at localhost/43333-EventThread] zookeeper.ZKWatcher(600): master:37893-0x1003f9df0080000, quorum=127.0.0.1:63275, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-10 19:03:27,737 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x23d3e5f1 to 127.0.0.1:63275 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-10 19:03:27,741 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@236442c1, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-10 19:03:27,741 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-10 19:03:27,741 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-02-10 19:03:27,742 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-10 19:03:27,743 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7689): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:46481/user/jenkins/test-data/63e201f6-29e3-8f69-97e1-6c13b3c652db/MasterData/data/master/store-tmp 2023-02-10 19:03:27,749 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-10 19:03:27,749 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-10 19:03:27,749 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-10 19:03:27,749 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-10 19:03:27,749 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-10 19:03:27,749 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-10 19:03:27,749 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-10 19:03:27,749 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1676055807749Disabling compacts and flushes for region at 1676055807749Disabling writes for close at 1676055807749Writing region close event to WAL at 1676055807749Closed at 1676055807749 2023-02-10 19:03:27,750 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:46481/user/jenkins/test-data/63e201f6-29e3-8f69-97e1-6c13b3c652db/MasterData/WALs/jenkins-hbase4.apache.org,37893,1676055807577 2023-02-10 19:03:27,752 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C37893%2C1676055807577, suffix=, logDir=hdfs://localhost:46481/user/jenkins/test-data/63e201f6-29e3-8f69-97e1-6c13b3c652db/MasterData/WALs/jenkins-hbase4.apache.org,37893,1676055807577, archiveDir=hdfs://localhost:46481/user/jenkins/test-data/63e201f6-29e3-8f69-97e1-6c13b3c652db/MasterData/oldWALs, maxLogs=10 2023-02-10 19:03:27,763 DEBUG [RS-EventLoopGroup-20-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41459,DS-4c3cfa07-988f-4a59-9efb-cc1fc1fc4dc2,DISK] 2023-02-10 19:03:27,764 DEBUG [RS-EventLoopGroup-20-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44479,DS-cc58ca82-c069-4a61-9e34-ae9013539b3e,DISK] 2023-02-10 19:03:27,765 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/63e201f6-29e3-8f69-97e1-6c13b3c652db/MasterData/WALs/jenkins-hbase4.apache.org,37893,1676055807577/jenkins-hbase4.apache.org%2C37893%2C1676055807577.1676055807752 2023-02-10 19:03:27,765 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:41459,DS-4c3cfa07-988f-4a59-9efb-cc1fc1fc4dc2,DISK], DatanodeInfoWithStorage[127.0.0.1:44479,DS-cc58ca82-c069-4a61-9e34-ae9013539b3e,DISK]] 2023-02-10 19:03:27,765 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7850): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-02-10 19:03:27,766 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-10 19:03:27,766 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7890): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-02-10 19:03:27,766 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7893): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-02-10 19:03:27,767 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-02-10 19:03:27,768 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46481/user/jenkins/test-data/63e201f6-29e3-8f69-97e1-6c13b3c652db/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-02-10 19:03:27,768 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-02-10 19:03:27,768 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-10 19:03:27,769 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46481/user/jenkins/test-data/63e201f6-29e3-8f69-97e1-6c13b3c652db/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-10 19:03:27,769 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46481/user/jenkins/test-data/63e201f6-29e3-8f69-97e1-6c13b3c652db/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-10 19:03:27,771 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1054): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-02-10 19:03:27,772 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46481/user/jenkins/test-data/63e201f6-29e3-8f69-97e1-6c13b3c652db/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-10 19:03:27,772 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1071): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65833941, jitterRate=-0.018997833132743835}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-10 19:03:27,773 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(964): Region open journal for 1595e783b53d99cd5eef43b6debb2682: Writing region info on filesystem at 1676055807766Initializing all the Stores at 1676055807766Instantiating store for column family {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676055807766Cleaning up temporary data from old regions at 1676055807769 (+3 ms)Cleaning up detritus from prior splits at 1676055807770 (+1 ms)Region opened successfully at 1676055807773 (+3 ms) 2023-02-10 19:03:27,773 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-02-10 19:03:27,774 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-02-10 19:03:27,774 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-02-10 19:03:27,774 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-02-10 19:03:27,775 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 0 msec 2023-02-10 19:03:27,775 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 0 msec 2023-02-10 19:03:27,775 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(95): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-02-10 19:03:27,776 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-02-10 19:03:27,776 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-02-10 19:03:27,786 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-02-10 19:03:27,786 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-02-10 19:03:27,786 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:37893-0x1003f9df0080000, quorum=127.0.0.1:63275, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-02-10 19:03:27,786 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-02-10 19:03:27,787 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:37893-0x1003f9df0080000, quorum=127.0.0.1:63275, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-02-10 19:03:27,788 DEBUG [Listener at localhost/43333-EventThread] zookeeper.ZKWatcher(600): master:37893-0x1003f9df0080000, quorum=127.0.0.1:63275, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-10 19:03:27,788 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:37893-0x1003f9df0080000, quorum=127.0.0.1:63275, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-02-10 19:03:27,789 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:37893-0x1003f9df0080000, quorum=127.0.0.1:63275, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-02-10 19:03:27,789 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:37893-0x1003f9df0080000, quorum=127.0.0.1:63275, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-02-10 19:03:27,792 DEBUG [Listener at localhost/43333-EventThread] zookeeper.ZKWatcher(600): master:37893-0x1003f9df0080000, quorum=127.0.0.1:63275, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-10 19:03:27,792 DEBUG [Listener at localhost/43333-EventThread] zookeeper.ZKWatcher(600): regionserver:45207-0x1003f9df0080001, quorum=127.0.0.1:63275, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-10 19:03:27,792 DEBUG [Listener at localhost/43333-EventThread] zookeeper.ZKWatcher(600): master:37893-0x1003f9df0080000, quorum=127.0.0.1:63275, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-10 19:03:27,792 DEBUG [Listener at localhost/43333-EventThread] zookeeper.ZKWatcher(600): regionserver:34041-0x1003f9df0080002, quorum=127.0.0.1:63275, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-10 19:03:27,792 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(739): Active/primary master=jenkins-hbase4.apache.org,37893,1676055807577, sessionid=0x1003f9df0080000, setting cluster-up flag (Was=false) 2023-02-10 19:03:27,797 DEBUG [Listener at localhost/43333-EventThread] zookeeper.ZKWatcher(600): master:37893-0x1003f9df0080000, quorum=127.0.0.1:63275, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-10 19:03:27,801 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-02-10 19:03:27,802 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,37893,1676055807577 2023-02-10 19:03:27,804 DEBUG [Listener at localhost/43333-EventThread] zookeeper.ZKWatcher(600): master:37893-0x1003f9df0080000, quorum=127.0.0.1:63275, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-10 19:03:27,808 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-02-10 19:03:27,808 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,37893,1676055807577 2023-02-10 19:03:27,809 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:46481/user/jenkins/test-data/63e201f6-29e3-8f69-97e1-6c13b3c652db/.hbase-snapshot/.tmp 2023-02-10 19:03:27,810 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-02-10 19:03:27,810 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-10 19:03:27,810 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-10 19:03:27,810 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-10 19:03:27,810 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-10 19:03:27,810 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-02-10 19:03:27,810 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-10 19:03:27,810 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-10 19:03:27,810 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-10 19:03:27,816 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1676055837816 2023-02-10 19:03:27,817 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-02-10 19:03:27,817 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-02-10 19:03:27,817 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-02-10 19:03:27,817 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-02-10 19:03:27,817 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-02-10 19:03:27,817 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-02-10 19:03:27,817 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-02-10 19:03:27,817 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-10 19:03:27,817 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-02-10 19:03:27,818 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-02-10 19:03:27,818 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-02-10 19:03:27,818 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-02-10 19:03:27,818 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-02-10 19:03:27,818 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-02-10 19:03:27,818 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676055807818,5,FailOnTimeoutGroup] 2023-02-10 19:03:27,818 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676055807818,5,FailOnTimeoutGroup] 2023-02-10 19:03:27,818 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-10 19:03:27,818 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-10 19:03:27,818 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1451): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-02-10 19:03:27,819 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-02-10 19:03:27,819 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-02-10 19:03:27,832 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:46481/user/jenkins/test-data/63e201f6-29e3-8f69-97e1-6c13b3c652db/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-10 19:03:27,832 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:46481/user/jenkins/test-data/63e201f6-29e3-8f69-97e1-6c13b3c652db/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-10 19:03:27,832 INFO [PEWorker-1] regionserver.HRegion(7671): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:46481/user/jenkins/test-data/63e201f6-29e3-8f69-97e1-6c13b3c652db 2023-02-10 19:03:27,840 DEBUG [PEWorker-1] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-10 19:03:27,841 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-10 19:03:27,841 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46481/user/jenkins/test-data/63e201f6-29e3-8f69-97e1-6c13b3c652db/data/hbase/meta/1588230740/info 2023-02-10 19:03:27,842 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-10 19:03:27,842 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-10 19:03:27,842 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-10 19:03:27,843 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46481/user/jenkins/test-data/63e201f6-29e3-8f69-97e1-6c13b3c652db/data/hbase/meta/1588230740/rep_barrier 2023-02-10 19:03:27,843 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-10 19:03:27,843 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-10 19:03:27,843 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-10 19:03:27,844 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46481/user/jenkins/test-data/63e201f6-29e3-8f69-97e1-6c13b3c652db/data/hbase/meta/1588230740/table 2023-02-10 19:03:27,844 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-10 19:03:27,845 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-10 19:03:27,845 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46481/user/jenkins/test-data/63e201f6-29e3-8f69-97e1-6c13b3c652db/data/hbase/meta/1588230740 2023-02-10 19:03:27,845 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46481/user/jenkins/test-data/63e201f6-29e3-8f69-97e1-6c13b3c652db/data/hbase/meta/1588230740 2023-02-10 19:03:27,846 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-10 19:03:27,847 DEBUG [PEWorker-1] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-10 19:03:27,850 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46481/user/jenkins/test-data/63e201f6-29e3-8f69-97e1-6c13b3c652db/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-10 19:03:27,850 INFO [PEWorker-1] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63201713, jitterRate=-0.058221086859703064}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-10 19:03:27,850 DEBUG [PEWorker-1] regionserver.HRegion(964): Region open journal for 1588230740: Writing region info on filesystem at 1676055807840Initializing all the Stores at 1676055807840Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676055807840Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676055807840Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676055807840Cleaning up temporary data from old regions at 1676055807846 (+6 ms)Cleaning up detritus from prior splits at 1676055807846Region opened successfully at 1676055807850 (+4 ms) 2023-02-10 19:03:27,850 DEBUG [PEWorker-1] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-10 19:03:27,850 INFO [PEWorker-1] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-10 19:03:27,850 DEBUG [PEWorker-1] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-10 19:03:27,850 DEBUG [PEWorker-1] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-10 19:03:27,850 DEBUG [PEWorker-1] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-10 19:03:27,850 INFO [PEWorker-1] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-10 19:03:27,851 DEBUG [PEWorker-1] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1676055807850Disabling compacts and flushes for region at 1676055807850Disabling writes for close at 1676055807850Writing region close event to WAL at 1676055807850Closed at 1676055807850 2023-02-10 19:03:27,851 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-02-10 19:03:27,851 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-02-10 19:03:27,851 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-02-10 19:03:27,853 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-02-10 19:03:27,854 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-02-10 19:03:27,890 INFO [RS:0;jenkins-hbase4:45207] regionserver.HRegionServer(952): ClusterId : ffb5fee9-4e69-4e28-b5d7-e1ba64d780b8 2023-02-10 19:03:27,890 INFO [RS:1;jenkins-hbase4:34041] regionserver.HRegionServer(952): ClusterId : ffb5fee9-4e69-4e28-b5d7-e1ba64d780b8 2023-02-10 19:03:27,890 DEBUG [RS:0;jenkins-hbase4:45207] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-10 19:03:27,890 DEBUG [RS:1;jenkins-hbase4:34041] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-10 19:03:27,896 DEBUG [RS:0;jenkins-hbase4:45207] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-10 19:03:27,896 DEBUG [RS:0;jenkins-hbase4:45207] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-10 19:03:27,896 DEBUG [RS:1;jenkins-hbase4:34041] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-10 19:03:27,896 DEBUG [RS:1;jenkins-hbase4:34041] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-10 19:03:27,898 DEBUG [RS:0;jenkins-hbase4:45207] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-10 19:03:27,899 DEBUG [RS:1;jenkins-hbase4:34041] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-10 19:03:27,899 DEBUG [RS:0;jenkins-hbase4:45207] zookeeper.ReadOnlyZKClient(139): Connect 0x473de215 to 127.0.0.1:63275 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-10 19:03:27,900 DEBUG [RS:1;jenkins-hbase4:34041] zookeeper.ReadOnlyZKClient(139): Connect 0x2ce49632 to 127.0.0.1:63275 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-10 19:03:27,904 DEBUG [RS:0;jenkins-hbase4:45207] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@49fa1482, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-10 19:03:27,904 DEBUG [RS:0;jenkins-hbase4:45207] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4dc58965, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-10 19:03:27,904 DEBUG [RS:1;jenkins-hbase4:34041] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@22236dde, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-10 19:03:27,904 DEBUG [RS:1;jenkins-hbase4:34041] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@261cfd42, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-10 19:03:27,912 DEBUG [RS:1;jenkins-hbase4:34041] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:34041 2023-02-10 19:03:27,912 DEBUG [RS:0;jenkins-hbase4:45207] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:45207 2023-02-10 19:03:27,912 INFO [RS:1;jenkins-hbase4:34041] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-10 19:03:27,913 INFO [RS:1;jenkins-hbase4:34041] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-10 19:03:27,913 INFO [RS:0;jenkins-hbase4:45207] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-10 19:03:27,913 INFO [RS:0;jenkins-hbase4:45207] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-10 19:03:27,913 DEBUG [RS:1;jenkins-hbase4:34041] regionserver.HRegionServer(1023): About to register with Master. 2023-02-10 19:03:27,913 DEBUG [RS:0;jenkins-hbase4:45207] regionserver.HRegionServer(1023): About to register with Master. 2023-02-10 19:03:27,913 INFO [RS:0;jenkins-hbase4:45207] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,37893,1676055807577 with isa=jenkins-hbase4.apache.org/172.31.14.131:45207, startcode=1676055807635 2023-02-10 19:03:27,913 INFO [RS:1;jenkins-hbase4:34041] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,37893,1676055807577 with isa=jenkins-hbase4.apache.org/172.31.14.131:34041, startcode=1676055807665 2023-02-10 19:03:27,913 DEBUG [RS:0;jenkins-hbase4:45207] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-10 19:03:27,913 DEBUG [RS:1;jenkins-hbase4:34041] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-10 19:03:27,915 INFO [RS-EventLoopGroup-18-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59171, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.11 (auth:SIMPLE), service=RegionServerStatusService 2023-02-10 19:03:27,915 INFO [RS-EventLoopGroup-18-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58131, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.10 (auth:SIMPLE), service=RegionServerStatusService 2023-02-10 19:03:27,916 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37893] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,34041,1676055807665 2023-02-10 19:03:27,917 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37893] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,45207,1676055807635 2023-02-10 19:03:27,917 DEBUG [RS:1;jenkins-hbase4:34041] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:46481/user/jenkins/test-data/63e201f6-29e3-8f69-97e1-6c13b3c652db 2023-02-10 19:03:27,917 DEBUG [RS:1;jenkins-hbase4:34041] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:46481 2023-02-10 19:03:27,917 DEBUG [RS:1;jenkins-hbase4:34041] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-10 19:03:27,918 DEBUG [RS:0;jenkins-hbase4:45207] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:46481/user/jenkins/test-data/63e201f6-29e3-8f69-97e1-6c13b3c652db 2023-02-10 19:03:27,918 DEBUG [RS:0;jenkins-hbase4:45207] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:46481 2023-02-10 19:03:27,918 DEBUG [RS:0;jenkins-hbase4:45207] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-10 19:03:27,919 DEBUG [Listener at localhost/43333-EventThread] zookeeper.ZKWatcher(600): master:37893-0x1003f9df0080000, quorum=127.0.0.1:63275, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-10 19:03:27,922 DEBUG [RS:1;jenkins-hbase4:34041] zookeeper.ZKUtil(162): regionserver:34041-0x1003f9df0080002, quorum=127.0.0.1:63275, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,34041,1676055807665 2023-02-10 19:03:27,922 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,34041,1676055807665] 2023-02-10 19:03:27,922 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,45207,1676055807635] 2023-02-10 19:03:27,922 WARN [RS:1;jenkins-hbase4:34041] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-10 19:03:27,922 DEBUG [RS:0;jenkins-hbase4:45207] zookeeper.ZKUtil(162): regionserver:45207-0x1003f9df0080001, quorum=127.0.0.1:63275, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,45207,1676055807635 2023-02-10 19:03:27,922 INFO [RS:1;jenkins-hbase4:34041] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-10 19:03:27,923 WARN [RS:0;jenkins-hbase4:45207] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-10 19:03:27,923 DEBUG [RS:1;jenkins-hbase4:34041] regionserver.HRegionServer(1947): logDir=hdfs://localhost:46481/user/jenkins/test-data/63e201f6-29e3-8f69-97e1-6c13b3c652db/WALs/jenkins-hbase4.apache.org,34041,1676055807665 2023-02-10 19:03:27,923 INFO [RS:0;jenkins-hbase4:45207] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-10 19:03:27,923 DEBUG [RS:0;jenkins-hbase4:45207] regionserver.HRegionServer(1947): logDir=hdfs://localhost:46481/user/jenkins/test-data/63e201f6-29e3-8f69-97e1-6c13b3c652db/WALs/jenkins-hbase4.apache.org,45207,1676055807635 2023-02-10 19:03:27,927 DEBUG [RS:0;jenkins-hbase4:45207] zookeeper.ZKUtil(162): regionserver:45207-0x1003f9df0080001, quorum=127.0.0.1:63275, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,34041,1676055807665 2023-02-10 19:03:27,927 DEBUG [RS:1;jenkins-hbase4:34041] zookeeper.ZKUtil(162): regionserver:34041-0x1003f9df0080002, quorum=127.0.0.1:63275, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,34041,1676055807665 2023-02-10 19:03:27,927 DEBUG [RS:0;jenkins-hbase4:45207] zookeeper.ZKUtil(162): regionserver:45207-0x1003f9df0080001, quorum=127.0.0.1:63275, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,45207,1676055807635 2023-02-10 19:03:27,927 DEBUG [RS:1;jenkins-hbase4:34041] zookeeper.ZKUtil(162): regionserver:34041-0x1003f9df0080002, quorum=127.0.0.1:63275, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,45207,1676055807635 2023-02-10 19:03:27,928 DEBUG [RS:0;jenkins-hbase4:45207] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-10 19:03:27,928 DEBUG [RS:1;jenkins-hbase4:34041] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-10 19:03:27,928 INFO [RS:0;jenkins-hbase4:45207] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-10 19:03:27,928 INFO [RS:1;jenkins-hbase4:34041] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-10 19:03:27,929 INFO [RS:0;jenkins-hbase4:45207] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-10 19:03:27,929 INFO [RS:0;jenkins-hbase4:45207] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-10 19:03:27,929 INFO [RS:0;jenkins-hbase4:45207] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-10 19:03:27,934 INFO [RS:0;jenkins-hbase4:45207] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-10 19:03:27,934 INFO [RS:1;jenkins-hbase4:34041] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-10 19:03:27,935 INFO [RS:1;jenkins-hbase4:34041] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-10 19:03:27,935 INFO [RS:1;jenkins-hbase4:34041] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-10 19:03:27,935 INFO [RS:1;jenkins-hbase4:34041] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-10 19:03:27,935 INFO [RS:0;jenkins-hbase4:45207] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-10 19:03:27,936 DEBUG [RS:0;jenkins-hbase4:45207] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-10 19:03:27,937 DEBUG [RS:0;jenkins-hbase4:45207] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-10 19:03:27,937 DEBUG [RS:0;jenkins-hbase4:45207] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-10 19:03:27,937 DEBUG [RS:0;jenkins-hbase4:45207] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-10 19:03:27,937 DEBUG [RS:0;jenkins-hbase4:45207] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-10 19:03:27,937 DEBUG [RS:0;jenkins-hbase4:45207] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-10 19:03:27,937 DEBUG [RS:0;jenkins-hbase4:45207] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-10 19:03:27,937 DEBUG [RS:0;jenkins-hbase4:45207] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-10 19:03:27,937 DEBUG [RS:0;jenkins-hbase4:45207] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-10 19:03:27,937 DEBUG [RS:0;jenkins-hbase4:45207] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-10 19:03:27,937 INFO [RS:1;jenkins-hbase4:34041] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-10 19:03:27,938 DEBUG [RS:1;jenkins-hbase4:34041] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-10 19:03:27,938 DEBUG [RS:1;jenkins-hbase4:34041] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-10 19:03:27,938 DEBUG [RS:1;jenkins-hbase4:34041] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-10 19:03:27,938 INFO [RS:0;jenkins-hbase4:45207] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-10 19:03:27,938 DEBUG [RS:1;jenkins-hbase4:34041] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-10 19:03:27,938 INFO [RS:0;jenkins-hbase4:45207] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-10 19:03:27,939 DEBUG [RS:1;jenkins-hbase4:34041] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-10 19:03:27,939 INFO [RS:0;jenkins-hbase4:45207] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-10 19:03:27,939 DEBUG [RS:1;jenkins-hbase4:34041] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-10 19:03:27,939 DEBUG [RS:1;jenkins-hbase4:34041] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-10 19:03:27,939 DEBUG [RS:1;jenkins-hbase4:34041] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-10 19:03:27,939 DEBUG [RS:1;jenkins-hbase4:34041] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-10 19:03:27,939 DEBUG [RS:1;jenkins-hbase4:34041] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-10 19:03:27,940 INFO [RS:1;jenkins-hbase4:34041] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-10 19:03:27,940 INFO [RS:1;jenkins-hbase4:34041] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-10 19:03:27,940 INFO [RS:1;jenkins-hbase4:34041] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-10 19:03:27,950 INFO [RS:0;jenkins-hbase4:45207] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-10 19:03:27,950 INFO [RS:0;jenkins-hbase4:45207] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,45207,1676055807635-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-10 19:03:27,950 INFO [RS:1;jenkins-hbase4:34041] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-10 19:03:27,950 INFO [RS:1;jenkins-hbase4:34041] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,34041,1676055807665-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-10 19:03:27,961 INFO [RS:0;jenkins-hbase4:45207] regionserver.Replication(203): jenkins-hbase4.apache.org,45207,1676055807635 started 2023-02-10 19:03:27,961 INFO [RS:0;jenkins-hbase4:45207] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,45207,1676055807635, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:45207, sessionid=0x1003f9df0080001 2023-02-10 19:03:27,961 INFO [RS:1;jenkins-hbase4:34041] regionserver.Replication(203): jenkins-hbase4.apache.org,34041,1676055807665 started 2023-02-10 19:03:27,961 DEBUG [RS:0;jenkins-hbase4:45207] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-10 19:03:27,961 INFO [RS:1;jenkins-hbase4:34041] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,34041,1676055807665, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:34041, sessionid=0x1003f9df0080002 2023-02-10 19:03:27,961 DEBUG [RS:0;jenkins-hbase4:45207] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,45207,1676055807635 2023-02-10 19:03:27,961 DEBUG [RS:1;jenkins-hbase4:34041] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-10 19:03:27,961 DEBUG [RS:1;jenkins-hbase4:34041] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,34041,1676055807665 2023-02-10 19:03:27,961 DEBUG [RS:1;jenkins-hbase4:34041] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,34041,1676055807665' 2023-02-10 19:03:27,961 DEBUG [RS:1;jenkins-hbase4:34041] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-10 19:03:27,961 DEBUG [RS:0;jenkins-hbase4:45207] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,45207,1676055807635' 2023-02-10 19:03:27,961 DEBUG [RS:0;jenkins-hbase4:45207] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-10 19:03:27,961 DEBUG [RS:0;jenkins-hbase4:45207] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-10 19:03:27,961 DEBUG [RS:1;jenkins-hbase4:34041] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-10 19:03:27,962 DEBUG [RS:0;jenkins-hbase4:45207] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-10 19:03:27,962 DEBUG [RS:0;jenkins-hbase4:45207] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-10 19:03:27,962 DEBUG [RS:0;jenkins-hbase4:45207] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,45207,1676055807635 2023-02-10 19:03:27,962 DEBUG [RS:0;jenkins-hbase4:45207] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,45207,1676055807635' 2023-02-10 19:03:27,962 DEBUG [RS:0;jenkins-hbase4:45207] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-10 19:03:27,962 DEBUG [RS:1;jenkins-hbase4:34041] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-10 19:03:27,962 DEBUG [RS:1;jenkins-hbase4:34041] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-10 19:03:27,962 DEBUG [RS:1;jenkins-hbase4:34041] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,34041,1676055807665 2023-02-10 19:03:27,962 DEBUG [RS:1;jenkins-hbase4:34041] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,34041,1676055807665' 2023-02-10 19:03:27,962 DEBUG [RS:1;jenkins-hbase4:34041] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-10 19:03:27,962 DEBUG [RS:0;jenkins-hbase4:45207] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-10 19:03:27,962 DEBUG [RS:1;jenkins-hbase4:34041] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-10 19:03:27,962 DEBUG [RS:0;jenkins-hbase4:45207] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-10 19:03:27,962 INFO [RS:0;jenkins-hbase4:45207] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-10 19:03:27,962 INFO [RS:0;jenkins-hbase4:45207] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-10 19:03:27,962 DEBUG [RS:1;jenkins-hbase4:34041] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-10 19:03:27,962 INFO [RS:1;jenkins-hbase4:34041] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-10 19:03:27,962 INFO [RS:1;jenkins-hbase4:34041] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-10 19:03:28,004 DEBUG [jenkins-hbase4:37893] assignment.AssignmentManager(2178): Processing assignQueue; systemServersCount=2, allServersCount=2 2023-02-10 19:03:28,004 DEBUG [jenkins-hbase4:37893] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-10 19:03:28,006 DEBUG [jenkins-hbase4:37893] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-10 19:03:28,006 DEBUG [jenkins-hbase4:37893] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-10 19:03:28,006 DEBUG [jenkins-hbase4:37893] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-10 19:03:28,006 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,34041,1676055807665, state=OPENING 2023-02-10 19:03:28,008 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-02-10 19:03:28,009 DEBUG [Listener at localhost/43333-EventThread] zookeeper.ZKWatcher(600): master:37893-0x1003f9df0080000, quorum=127.0.0.1:63275, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-10 19:03:28,009 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-10 19:03:28,009 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,34041,1676055807665}] 2023-02-10 19:03:28,164 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,34041,1676055807665 2023-02-10 19:03:28,164 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-10 19:03:28,166 INFO [RS-EventLoopGroup-20-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38000, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-10 19:03:28,170 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:meta,,1.1588230740 2023-02-10 19:03:28,170 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-10 19:03:28,171 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C34041%2C1676055807665.meta, suffix=.meta, logDir=hdfs://localhost:46481/user/jenkins/test-data/63e201f6-29e3-8f69-97e1-6c13b3c652db/WALs/jenkins-hbase4.apache.org,34041,1676055807665, archiveDir=hdfs://localhost:46481/user/jenkins/test-data/63e201f6-29e3-8f69-97e1-6c13b3c652db/oldWALs, maxLogs=32 2023-02-10 19:03:28,184 DEBUG [RS-EventLoopGroup-20-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44479,DS-cc58ca82-c069-4a61-9e34-ae9013539b3e,DISK] 2023-02-10 19:03:28,184 DEBUG [RS-EventLoopGroup-20-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41459,DS-4c3cfa07-988f-4a59-9efb-cc1fc1fc4dc2,DISK] 2023-02-10 19:03:28,185 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/63e201f6-29e3-8f69-97e1-6c13b3c652db/WALs/jenkins-hbase4.apache.org,34041,1676055807665/jenkins-hbase4.apache.org%2C34041%2C1676055807665.meta.1676055808171.meta 2023-02-10 19:03:28,185 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:44479,DS-cc58ca82-c069-4a61-9e34-ae9013539b3e,DISK], DatanodeInfoWithStorage[127.0.0.1:41459,DS-4c3cfa07-988f-4a59-9efb-cc1fc1fc4dc2,DISK]] 2023-02-10 19:03:28,185 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-02-10 19:03:28,185 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-02-10 19:03:28,186 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8546): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-02-10 19:03:28,186 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-02-10 19:03:28,186 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-02-10 19:03:28,186 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-10 19:03:28,186 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 1588230740 2023-02-10 19:03:28,186 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 1588230740 2023-02-10 19:03:28,187 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-10 19:03:28,188 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46481/user/jenkins/test-data/63e201f6-29e3-8f69-97e1-6c13b3c652db/data/hbase/meta/1588230740/info 2023-02-10 19:03:28,188 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46481/user/jenkins/test-data/63e201f6-29e3-8f69-97e1-6c13b3c652db/data/hbase/meta/1588230740/info 2023-02-10 19:03:28,188 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-10 19:03:28,188 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-10 19:03:28,188 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-10 19:03:28,189 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46481/user/jenkins/test-data/63e201f6-29e3-8f69-97e1-6c13b3c652db/data/hbase/meta/1588230740/rep_barrier 2023-02-10 19:03:28,189 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46481/user/jenkins/test-data/63e201f6-29e3-8f69-97e1-6c13b3c652db/data/hbase/meta/1588230740/rep_barrier 2023-02-10 19:03:28,189 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-10 19:03:28,190 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-10 19:03:28,190 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-10 19:03:28,190 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46481/user/jenkins/test-data/63e201f6-29e3-8f69-97e1-6c13b3c652db/data/hbase/meta/1588230740/table 2023-02-10 19:03:28,190 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46481/user/jenkins/test-data/63e201f6-29e3-8f69-97e1-6c13b3c652db/data/hbase/meta/1588230740/table 2023-02-10 19:03:28,191 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-10 19:03:28,191 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-10 19:03:28,192 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46481/user/jenkins/test-data/63e201f6-29e3-8f69-97e1-6c13b3c652db/data/hbase/meta/1588230740 2023-02-10 19:03:28,192 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46481/user/jenkins/test-data/63e201f6-29e3-8f69-97e1-6c13b3c652db/data/hbase/meta/1588230740 2023-02-10 19:03:28,194 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-10 19:03:28,195 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-10 19:03:28,196 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74809111, jitterRate=0.11474262177944183}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-10 19:03:28,196 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 1588230740: Running coprocessor pre-open hook at 1676055808186Writing region info on filesystem at 1676055808186Initializing all the Stores at 1676055808187 (+1 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676055808187Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676055808187Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676055808187Cleaning up temporary data from old regions at 1676055808193 (+6 ms)Cleaning up detritus from prior splits at 1676055808193Running coprocessor post-open hooks at 1676055808196 (+3 ms)Region opened successfully at 1676055808196 2023-02-10 19:03:28,196 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1676055808164 2023-02-10 19:03:28,200 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:meta,,1.1588230740 2023-02-10 19:03:28,200 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:meta,,1.1588230740 2023-02-10 19:03:28,201 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,34041,1676055807665, state=OPEN 2023-02-10 19:03:28,202 DEBUG [Listener at localhost/43333-EventThread] zookeeper.ZKWatcher(600): master:37893-0x1003f9df0080000, quorum=127.0.0.1:63275, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-02-10 19:03:28,202 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-10 19:03:28,203 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-02-10 19:03:28,203 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,34041,1676055807665 in 193 msec 2023-02-10 19:03:28,204 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-02-10 19:03:28,205 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 352 msec 2023-02-10 19:03:28,206 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 396 msec 2023-02-10 19:03:28,206 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(946): Master startup: status=Wait for region servers to report in, state=RUNNING, startTime=1676055807692, completionTime=-1 2023-02-10 19:03:28,206 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=2; waited=0ms, expected min=2 server(s), max=2 server(s), master is running 2023-02-10 19:03:28,206 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1519): Joining cluster... 2023-02-10 19:03:28,213 DEBUG [hconnection-0x296386b4-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-10 19:03:28,214 INFO [RS-EventLoopGroup-20-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38004, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-10 19:03:28,216 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1531): Number of RegionServers=2 2023-02-10 19:03:28,216 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1676055868216 2023-02-10 19:03:28,216 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1676055928216 2023-02-10 19:03:28,216 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1538): Joined the cluster in 10 msec 2023-02-10 19:03:28,227 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,37893,1676055807577-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-10 19:03:28,227 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,37893,1676055807577-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-10 19:03:28,227 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,37893,1676055807577-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-10 19:03:28,227 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:37893, period=300000, unit=MILLISECONDS is enabled. 2023-02-10 19:03:28,227 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-02-10 19:03:28,227 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-02-10 19:03:28,227 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2138): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-10 19:03:28,228 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-02-10 19:03:28,229 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-02-10 19:03:28,229 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-02-10 19:03:28,230 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-10 19:03:28,231 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46481/user/jenkins/test-data/63e201f6-29e3-8f69-97e1-6c13b3c652db/.tmp/data/hbase/namespace/e5b95c90e9670cbeb3b400623aa28a39 2023-02-10 19:03:28,232 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:46481/user/jenkins/test-data/63e201f6-29e3-8f69-97e1-6c13b3c652db/.tmp/data/hbase/namespace/e5b95c90e9670cbeb3b400623aa28a39 empty. 2023-02-10 19:03:28,232 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:46481/user/jenkins/test-data/63e201f6-29e3-8f69-97e1-6c13b3c652db/.tmp/data/hbase/namespace/e5b95c90e9670cbeb3b400623aa28a39 2023-02-10 19:03:28,232 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-02-10 19:03:28,245 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:46481/user/jenkins/test-data/63e201f6-29e3-8f69-97e1-6c13b3c652db/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-02-10 19:03:28,248 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7671): creating {ENCODED => e5b95c90e9670cbeb3b400623aa28a39, NAME => 'hbase:namespace,,1676055808227.e5b95c90e9670cbeb3b400623aa28a39.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:46481/user/jenkins/test-data/63e201f6-29e3-8f69-97e1-6c13b3c652db/.tmp 2023-02-10 19:03:28,258 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676055808227.e5b95c90e9670cbeb3b400623aa28a39.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-10 19:03:28,258 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1603): Closing e5b95c90e9670cbeb3b400623aa28a39, disabling compactions & flushes 2023-02-10 19:03:28,258 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676055808227.e5b95c90e9670cbeb3b400623aa28a39. 2023-02-10 19:03:28,258 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676055808227.e5b95c90e9670cbeb3b400623aa28a39. 2023-02-10 19:03:28,258 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676055808227.e5b95c90e9670cbeb3b400623aa28a39. after waiting 0 ms 2023-02-10 19:03:28,258 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676055808227.e5b95c90e9670cbeb3b400623aa28a39. 2023-02-10 19:03:28,258 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676055808227.e5b95c90e9670cbeb3b400623aa28a39. 2023-02-10 19:03:28,258 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1557): Region close journal for e5b95c90e9670cbeb3b400623aa28a39: Waiting for close lock at 1676055808258Disabling compacts and flushes for region at 1676055808258Disabling writes for close at 1676055808258Writing region close event to WAL at 1676055808258Closed at 1676055808258 2023-02-10 19:03:28,260 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-02-10 19:03:28,260 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1676055808227.e5b95c90e9670cbeb3b400623aa28a39.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676055808260"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676055808260"}]},"ts":"1676055808260"} 2023-02-10 19:03:28,262 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-10 19:03:28,262 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-10 19:03:28,263 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676055808262"}]},"ts":"1676055808262"} 2023-02-10 19:03:28,264 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-02-10 19:03:28,266 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-10 19:03:28,267 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-10 19:03:28,267 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-10 19:03:28,267 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-10 19:03:28,267 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=e5b95c90e9670cbeb3b400623aa28a39, ASSIGN}] 2023-02-10 19:03:28,269 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=e5b95c90e9670cbeb3b400623aa28a39, ASSIGN 2023-02-10 19:03:28,270 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=e5b95c90e9670cbeb3b400623aa28a39, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,45207,1676055807635; forceNewPlan=false, retain=false 2023-02-10 19:03:28,420 INFO [jenkins-hbase4:37893] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-10 19:03:28,420 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=e5b95c90e9670cbeb3b400623aa28a39, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,45207,1676055807635 2023-02-10 19:03:28,421 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1676055808227.e5b95c90e9670cbeb3b400623aa28a39.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676055808420"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676055808420"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676055808420"}]},"ts":"1676055808420"} 2023-02-10 19:03:28,422 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure e5b95c90e9670cbeb3b400623aa28a39, server=jenkins-hbase4.apache.org,45207,1676055807635}] 2023-02-10 19:03:28,574 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,45207,1676055807635 2023-02-10 19:03:28,575 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-10 19:03:28,576 INFO [RS-EventLoopGroup-19-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47052, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-10 19:03:28,579 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:namespace,,1676055808227.e5b95c90e9670cbeb3b400623aa28a39. 2023-02-10 19:03:28,580 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C45207%2C1676055807635, suffix=, logDir=hdfs://localhost:46481/user/jenkins/test-data/63e201f6-29e3-8f69-97e1-6c13b3c652db/WALs/jenkins-hbase4.apache.org,45207,1676055807635, archiveDir=hdfs://localhost:46481/user/jenkins/test-data/63e201f6-29e3-8f69-97e1-6c13b3c652db/oldWALs, maxLogs=32 2023-02-10 19:03:28,594 DEBUG [RS-EventLoopGroup-20-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41459,DS-4c3cfa07-988f-4a59-9efb-cc1fc1fc4dc2,DISK] 2023-02-10 19:03:28,594 DEBUG [RS-EventLoopGroup-20-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44479,DS-cc58ca82-c069-4a61-9e34-ae9013539b3e,DISK] 2023-02-10 19:03:28,595 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/63e201f6-29e3-8f69-97e1-6c13b3c652db/WALs/jenkins-hbase4.apache.org,45207,1676055807635/jenkins-hbase4.apache.org%2C45207%2C1676055807635.1676055808581 2023-02-10 19:03:28,595 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:44479,DS-cc58ca82-c069-4a61-9e34-ae9013539b3e,DISK], DatanodeInfoWithStorage[127.0.0.1:41459,DS-4c3cfa07-988f-4a59-9efb-cc1fc1fc4dc2,DISK]] 2023-02-10 19:03:28,595 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => e5b95c90e9670cbeb3b400623aa28a39, NAME => 'hbase:namespace,,1676055808227.e5b95c90e9670cbeb3b400623aa28a39.', STARTKEY => '', ENDKEY => ''} 2023-02-10 19:03:28,596 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace e5b95c90e9670cbeb3b400623aa28a39 2023-02-10 19:03:28,596 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676055808227.e5b95c90e9670cbeb3b400623aa28a39.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-10 19:03:28,596 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for e5b95c90e9670cbeb3b400623aa28a39 2023-02-10 19:03:28,596 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for e5b95c90e9670cbeb3b400623aa28a39 2023-02-10 19:03:28,600 INFO [StoreOpener-e5b95c90e9670cbeb3b400623aa28a39-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region e5b95c90e9670cbeb3b400623aa28a39 2023-02-10 19:03:28,601 DEBUG [StoreOpener-e5b95c90e9670cbeb3b400623aa28a39-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46481/user/jenkins/test-data/63e201f6-29e3-8f69-97e1-6c13b3c652db/data/hbase/namespace/e5b95c90e9670cbeb3b400623aa28a39/info 2023-02-10 19:03:28,601 DEBUG [StoreOpener-e5b95c90e9670cbeb3b400623aa28a39-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46481/user/jenkins/test-data/63e201f6-29e3-8f69-97e1-6c13b3c652db/data/hbase/namespace/e5b95c90e9670cbeb3b400623aa28a39/info 2023-02-10 19:03:28,601 INFO [StoreOpener-e5b95c90e9670cbeb3b400623aa28a39-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e5b95c90e9670cbeb3b400623aa28a39 columnFamilyName info 2023-02-10 19:03:28,602 INFO [StoreOpener-e5b95c90e9670cbeb3b400623aa28a39-1] regionserver.HStore(310): Store=e5b95c90e9670cbeb3b400623aa28a39/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-10 19:03:28,602 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46481/user/jenkins/test-data/63e201f6-29e3-8f69-97e1-6c13b3c652db/data/hbase/namespace/e5b95c90e9670cbeb3b400623aa28a39 2023-02-10 19:03:28,602 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46481/user/jenkins/test-data/63e201f6-29e3-8f69-97e1-6c13b3c652db/data/hbase/namespace/e5b95c90e9670cbeb3b400623aa28a39 2023-02-10 19:03:28,604 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for e5b95c90e9670cbeb3b400623aa28a39 2023-02-10 19:03:28,605 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46481/user/jenkins/test-data/63e201f6-29e3-8f69-97e1-6c13b3c652db/data/hbase/namespace/e5b95c90e9670cbeb3b400623aa28a39/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-10 19:03:28,606 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened e5b95c90e9670cbeb3b400623aa28a39; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68275263, jitterRate=0.017380699515342712}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-10 19:03:28,606 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for e5b95c90e9670cbeb3b400623aa28a39: Running coprocessor pre-open hook at 1676055808596Writing region info on filesystem at 1676055808596Initializing all the Stores at 1676055808597 (+1 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676055808597Cleaning up temporary data from old regions at 1676055808603 (+6 ms)Cleaning up detritus from prior splits at 1676055808603Running coprocessor post-open hooks at 1676055808606 (+3 ms)Region opened successfully at 1676055808606 2023-02-10 19:03:28,606 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:namespace,,1676055808227.e5b95c90e9670cbeb3b400623aa28a39., pid=6, masterSystemTime=1676055808574 2023-02-10 19:03:28,609 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:namespace,,1676055808227.e5b95c90e9670cbeb3b400623aa28a39. 2023-02-10 19:03:28,610 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:namespace,,1676055808227.e5b95c90e9670cbeb3b400623aa28a39. 2023-02-10 19:03:28,610 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=e5b95c90e9670cbeb3b400623aa28a39, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,45207,1676055807635 2023-02-10 19:03:28,610 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1676055808227.e5b95c90e9670cbeb3b400623aa28a39.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676055808610"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676055808610"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676055808610"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676055808610"}]},"ts":"1676055808610"} 2023-02-10 19:03:28,612 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-02-10 19:03:28,613 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure e5b95c90e9670cbeb3b400623aa28a39, server=jenkins-hbase4.apache.org,45207,1676055807635 in 189 msec 2023-02-10 19:03:28,614 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-02-10 19:03:28,614 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=e5b95c90e9670cbeb3b400623aa28a39, ASSIGN in 346 msec 2023-02-10 19:03:28,614 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-10 19:03:28,614 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676055808614"}]},"ts":"1676055808614"} 2023-02-10 19:03:28,615 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-02-10 19:03:28,617 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-02-10 19:03:28,618 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 390 msec 2023-02-10 19:03:28,629 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:37893-0x1003f9df0080000, quorum=127.0.0.1:63275, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-02-10 19:03:28,631 DEBUG [Listener at localhost/43333-EventThread] zookeeper.ZKWatcher(600): master:37893-0x1003f9df0080000, quorum=127.0.0.1:63275, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-02-10 19:03:28,631 DEBUG [Listener at localhost/43333-EventThread] zookeeper.ZKWatcher(600): master:37893-0x1003f9df0080000, quorum=127.0.0.1:63275, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-10 19:03:28,633 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-10 19:03:28,634 INFO [RS-EventLoopGroup-19-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47064, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-10 19:03:28,635 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-02-10 19:03:28,642 DEBUG [Listener at localhost/43333-EventThread] zookeeper.ZKWatcher(600): master:37893-0x1003f9df0080000, quorum=127.0.0.1:63275, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-10 19:03:28,644 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 8 msec 2023-02-10 19:03:28,646 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-02-10 19:03:28,652 DEBUG [Listener at localhost/43333-EventThread] zookeeper.ZKWatcher(600): master:37893-0x1003f9df0080000, quorum=127.0.0.1:63275, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-10 19:03:28,655 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 9 msec 2023-02-10 19:03:28,659 DEBUG [Listener at localhost/43333-EventThread] zookeeper.ZKWatcher(600): master:37893-0x1003f9df0080000, quorum=127.0.0.1:63275, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-02-10 19:03:28,662 DEBUG [Listener at localhost/43333-EventThread] zookeeper.ZKWatcher(600): master:37893-0x1003f9df0080000, quorum=127.0.0.1:63275, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-02-10 19:03:28,663 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1077): Master has completed initialization 0.964sec 2023-02-10 19:03:28,663 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-02-10 19:03:28,663 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-02-10 19:03:28,663 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-02-10 19:03:28,663 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,37893,1676055807577-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-02-10 19:03:28,663 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,37893,1676055807577-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-02-10 19:03:28,664 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1166): Balancer post startup initialization complete, took 0 seconds 2023-02-10 19:03:28,690 DEBUG [Listener at localhost/43333] zookeeper.ReadOnlyZKClient(139): Connect 0x44581b4c to 127.0.0.1:63275 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-10 19:03:28,692 DEBUG [Listener at localhost/43333] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@30b6968, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-10 19:03:28,694 DEBUG [hconnection-0x5c294143-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-10 19:03:28,695 INFO [RS-EventLoopGroup-20-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38018, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-10 19:03:28,696 INFO [Listener at localhost/43333] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,37893,1676055807577 2023-02-10 19:03:28,696 DEBUG [Listener at localhost/43333] mapreduce.TableSnapshotInputFormatTestBase(193): Ensuring table doesn't exist. 2023-02-10 19:03:28,698 DEBUG [Listener at localhost/43333] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-10 19:03:28,700 INFO [RS-EventLoopGroup-18-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52702, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-10 19:03:28,701 INFO [Listener at localhost/43333] client.HBaseAdmin$15(890): Started disable of testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-10 19:03:28,701 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37893] master.HMaster$11(2405): Client=jenkins//172.31.14.131 disable testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-10 19:03:28,701 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37893] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.TableNotFoundException: testRestoreSnapshotDoesNotCreateBackRefLinks at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.checkTableModifiable(AbstractStateMachineTableProcedure.java:125) at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.preflightChecks(AbstractStateMachineTableProcedure.java:157) at org.apache.hadoop.hbase.master.procedure.DisableTableProcedure.(DisableTableProcedure.java:78) at org.apache.hadoop.hbase.master.HMaster$11.run(HMaster.java:2416) at org.apache.hadoop.hbase.master.procedure.MasterProcedureUtil.submitProcedure(MasterProcedureUtil.java:132) at org.apache.hadoop.hbase.master.HMaster.disableTable(HMaster.java:2400) at org.apache.hadoop.hbase.master.MasterRpcServices.disableTable(MasterRpcServices.java:784) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-02-10 19:03:28,701 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37893] ipc.CallRunner(144): callId: 2 service: MasterService methodName: DisableTable size: 104 connection: 172.31.14.131:52702 deadline: 1676055868701, exception=org.apache.hadoop.hbase.TableNotFoundException: testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-10 19:03:28,702 INFO [Listener at localhost/43333] mapreduce.TableSnapshotInputFormatTestBase(199): creating table 'testRestoreSnapshotDoesNotCreateBackRefLinks' 2023-02-10 19:03:28,704 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37893] master.HMaster$4(2102): Client=jenkins//172.31.14.131 create 'testRestoreSnapshotDoesNotCreateBackRefLinks', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-10 19:03:28,704 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37893] procedure2.ProcedureExecutor(1029): Stored pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-10 19:03:28,706 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks execute state=CREATE_TABLE_PRE_OPERATION 2023-02-10 19:03:28,706 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37893] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testRestoreSnapshotDoesNotCreateBackRefLinks" procId is: 10 2023-02-10 19:03:28,707 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-10 19:03:28,707 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37893] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-10 19:03:28,709 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46481/user/jenkins/test-data/63e201f6-29e3-8f69-97e1-6c13b3c652db/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/9c356df832f83d5f6950ac25cf1e150f 2023-02-10 19:03:28,709 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:46481/user/jenkins/test-data/63e201f6-29e3-8f69-97e1-6c13b3c652db/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/9c356df832f83d5f6950ac25cf1e150f empty. 2023-02-10 19:03:28,710 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:46481/user/jenkins/test-data/63e201f6-29e3-8f69-97e1-6c13b3c652db/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/9c356df832f83d5f6950ac25cf1e150f 2023-02-10 19:03:28,710 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testRestoreSnapshotDoesNotCreateBackRefLinks regions 2023-02-10 19:03:28,724 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:46481/user/jenkins/test-data/63e201f6-29e3-8f69-97e1-6c13b3c652db/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/.tabledesc/.tableinfo.0000000001 2023-02-10 19:03:28,725 INFO [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(7671): creating {ENCODED => 9c356df832f83d5f6950ac25cf1e150f, NAME => 'testRestoreSnapshotDoesNotCreateBackRefLinks,,1676055808703.9c356df832f83d5f6950ac25cf1e150f.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testRestoreSnapshotDoesNotCreateBackRefLinks', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:46481/user/jenkins/test-data/63e201f6-29e3-8f69-97e1-6c13b3c652db/.tmp 2023-02-10 19:03:28,733 DEBUG [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(865): Instantiated testRestoreSnapshotDoesNotCreateBackRefLinks,,1676055808703.9c356df832f83d5f6950ac25cf1e150f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-10 19:03:28,734 DEBUG [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(1603): Closing 9c356df832f83d5f6950ac25cf1e150f, disabling compactions & flushes 2023-02-10 19:03:28,734 INFO [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(1625): Closing region testRestoreSnapshotDoesNotCreateBackRefLinks,,1676055808703.9c356df832f83d5f6950ac25cf1e150f. 2023-02-10 19:03:28,734 DEBUG [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testRestoreSnapshotDoesNotCreateBackRefLinks,,1676055808703.9c356df832f83d5f6950ac25cf1e150f. 2023-02-10 19:03:28,734 DEBUG [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(1713): Acquired close lock on testRestoreSnapshotDoesNotCreateBackRefLinks,,1676055808703.9c356df832f83d5f6950ac25cf1e150f. after waiting 0 ms 2023-02-10 19:03:28,734 DEBUG [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(1723): Updates disabled for region testRestoreSnapshotDoesNotCreateBackRefLinks,,1676055808703.9c356df832f83d5f6950ac25cf1e150f. 2023-02-10 19:03:28,734 INFO [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(1837): Closed testRestoreSnapshotDoesNotCreateBackRefLinks,,1676055808703.9c356df832f83d5f6950ac25cf1e150f. 2023-02-10 19:03:28,734 DEBUG [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(1557): Region close journal for 9c356df832f83d5f6950ac25cf1e150f: Waiting for close lock at 1676055808734Disabling compacts and flushes for region at 1676055808734Disabling writes for close at 1676055808734Writing region close event to WAL at 1676055808734Closed at 1676055808734 2023-02-10 19:03:28,735 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks execute state=CREATE_TABLE_ADD_TO_META 2023-02-10 19:03:28,736 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks,,1676055808703.9c356df832f83d5f6950ac25cf1e150f.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1676055808736"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676055808736"}]},"ts":"1676055808736"} 2023-02-10 19:03:28,737 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-10 19:03:28,738 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-10 19:03:28,738 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676055808738"}]},"ts":"1676055808738"} 2023-02-10 19:03:28,739 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, state=ENABLING in hbase:meta 2023-02-10 19:03:28,742 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-10 19:03:28,742 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-10 19:03:28,742 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-10 19:03:28,742 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-10 19:03:28,743 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks, region=9c356df832f83d5f6950ac25cf1e150f, ASSIGN}] 2023-02-10 19:03:28,744 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks, region=9c356df832f83d5f6950ac25cf1e150f, ASSIGN 2023-02-10 19:03:28,745 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks, region=9c356df832f83d5f6950ac25cf1e150f, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,45207,1676055807635; forceNewPlan=false, retain=false 2023-02-10 19:03:28,808 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37893] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-10 19:03:28,895 INFO [jenkins-hbase4:37893] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-10 19:03:28,895 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=9c356df832f83d5f6950ac25cf1e150f, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,45207,1676055807635 2023-02-10 19:03:28,896 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks,,1676055808703.9c356df832f83d5f6950ac25cf1e150f.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1676055808895"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676055808895"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676055808895"}]},"ts":"1676055808895"} 2023-02-10 19:03:28,898 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=12, ppid=11, state=RUNNABLE; OpenRegionProcedure 9c356df832f83d5f6950ac25cf1e150f, server=jenkins-hbase4.apache.org,45207,1676055807635}] 2023-02-10 19:03:28,964 INFO [RS:1;jenkins-hbase4:34041] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C34041%2C1676055807665, suffix=, logDir=hdfs://localhost:46481/user/jenkins/test-data/63e201f6-29e3-8f69-97e1-6c13b3c652db/WALs/jenkins-hbase4.apache.org,34041,1676055807665, archiveDir=hdfs://localhost:46481/user/jenkins/test-data/63e201f6-29e3-8f69-97e1-6c13b3c652db/oldWALs, maxLogs=32 2023-02-10 19:03:28,976 DEBUG [RS-EventLoopGroup-20-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41459,DS-4c3cfa07-988f-4a59-9efb-cc1fc1fc4dc2,DISK] 2023-02-10 19:03:28,976 DEBUG [RS-EventLoopGroup-20-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44479,DS-cc58ca82-c069-4a61-9e34-ae9013539b3e,DISK] 2023-02-10 19:03:28,978 INFO [RS:1;jenkins-hbase4:34041] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/63e201f6-29e3-8f69-97e1-6c13b3c652db/WALs/jenkins-hbase4.apache.org,34041,1676055807665/jenkins-hbase4.apache.org%2C34041%2C1676055807665.1676055808965 2023-02-10 19:03:28,978 DEBUG [RS:1;jenkins-hbase4:34041] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:41459,DS-4c3cfa07-988f-4a59-9efb-cc1fc1fc4dc2,DISK], DatanodeInfoWithStorage[127.0.0.1:44479,DS-cc58ca82-c069-4a61-9e34-ae9013539b3e,DISK]] 2023-02-10 19:03:29,010 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37893] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-10 19:03:29,052 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testRestoreSnapshotDoesNotCreateBackRefLinks,,1676055808703.9c356df832f83d5f6950ac25cf1e150f. 2023-02-10 19:03:29,052 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 9c356df832f83d5f6950ac25cf1e150f, NAME => 'testRestoreSnapshotDoesNotCreateBackRefLinks,,1676055808703.9c356df832f83d5f6950ac25cf1e150f.', STARTKEY => '', ENDKEY => ''} 2023-02-10 19:03:29,052 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testRestoreSnapshotDoesNotCreateBackRefLinks 9c356df832f83d5f6950ac25cf1e150f 2023-02-10 19:03:29,052 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testRestoreSnapshotDoesNotCreateBackRefLinks,,1676055808703.9c356df832f83d5f6950ac25cf1e150f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-10 19:03:29,053 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 9c356df832f83d5f6950ac25cf1e150f 2023-02-10 19:03:29,053 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 9c356df832f83d5f6950ac25cf1e150f 2023-02-10 19:03:29,054 INFO [StoreOpener-9c356df832f83d5f6950ac25cf1e150f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 9c356df832f83d5f6950ac25cf1e150f 2023-02-10 19:03:29,055 DEBUG [StoreOpener-9c356df832f83d5f6950ac25cf1e150f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46481/user/jenkins/test-data/63e201f6-29e3-8f69-97e1-6c13b3c652db/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/9c356df832f83d5f6950ac25cf1e150f/f1 2023-02-10 19:03:29,055 DEBUG [StoreOpener-9c356df832f83d5f6950ac25cf1e150f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46481/user/jenkins/test-data/63e201f6-29e3-8f69-97e1-6c13b3c652db/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/9c356df832f83d5f6950ac25cf1e150f/f1 2023-02-10 19:03:29,055 INFO [StoreOpener-9c356df832f83d5f6950ac25cf1e150f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9c356df832f83d5f6950ac25cf1e150f columnFamilyName f1 2023-02-10 19:03:29,055 INFO [StoreOpener-9c356df832f83d5f6950ac25cf1e150f-1] regionserver.HStore(310): Store=9c356df832f83d5f6950ac25cf1e150f/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-10 19:03:29,056 INFO [StoreOpener-9c356df832f83d5f6950ac25cf1e150f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 9c356df832f83d5f6950ac25cf1e150f 2023-02-10 19:03:29,057 DEBUG [StoreOpener-9c356df832f83d5f6950ac25cf1e150f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46481/user/jenkins/test-data/63e201f6-29e3-8f69-97e1-6c13b3c652db/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/9c356df832f83d5f6950ac25cf1e150f/f2 2023-02-10 19:03:29,057 DEBUG [StoreOpener-9c356df832f83d5f6950ac25cf1e150f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46481/user/jenkins/test-data/63e201f6-29e3-8f69-97e1-6c13b3c652db/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/9c356df832f83d5f6950ac25cf1e150f/f2 2023-02-10 19:03:29,057 INFO [StoreOpener-9c356df832f83d5f6950ac25cf1e150f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9c356df832f83d5f6950ac25cf1e150f columnFamilyName f2 2023-02-10 19:03:29,057 INFO [StoreOpener-9c356df832f83d5f6950ac25cf1e150f-1] regionserver.HStore(310): Store=9c356df832f83d5f6950ac25cf1e150f/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-10 19:03:29,058 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46481/user/jenkins/test-data/63e201f6-29e3-8f69-97e1-6c13b3c652db/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/9c356df832f83d5f6950ac25cf1e150f 2023-02-10 19:03:29,058 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46481/user/jenkins/test-data/63e201f6-29e3-8f69-97e1-6c13b3c652db/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/9c356df832f83d5f6950ac25cf1e150f 2023-02-10 19:03:29,060 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testRestoreSnapshotDoesNotCreateBackRefLinks descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-10 19:03:29,060 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 9c356df832f83d5f6950ac25cf1e150f 2023-02-10 19:03:29,062 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46481/user/jenkins/test-data/63e201f6-29e3-8f69-97e1-6c13b3c652db/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/9c356df832f83d5f6950ac25cf1e150f/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-10 19:03:29,062 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 9c356df832f83d5f6950ac25cf1e150f; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64994950, jitterRate=-0.031499773263931274}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-10 19:03:29,063 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 9c356df832f83d5f6950ac25cf1e150f: Running coprocessor pre-open hook at 1676055809053Writing region info on filesystem at 1676055809053Initializing all the Stores at 1676055809053Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676055809053Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676055809053Cleaning up temporary data from old regions at 1676055809059 (+6 ms)Cleaning up detritus from prior splits at 1676055809059Running coprocessor post-open hooks at 1676055809063 (+4 ms)Region opened successfully at 1676055809063 2023-02-10 19:03:29,063 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testRestoreSnapshotDoesNotCreateBackRefLinks,,1676055808703.9c356df832f83d5f6950ac25cf1e150f., pid=12, masterSystemTime=1676055809049 2023-02-10 19:03:29,065 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testRestoreSnapshotDoesNotCreateBackRefLinks,,1676055808703.9c356df832f83d5f6950ac25cf1e150f. 2023-02-10 19:03:29,065 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testRestoreSnapshotDoesNotCreateBackRefLinks,,1676055808703.9c356df832f83d5f6950ac25cf1e150f. 2023-02-10 19:03:29,065 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=9c356df832f83d5f6950ac25cf1e150f, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,45207,1676055807635 2023-02-10 19:03:29,065 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks,,1676055808703.9c356df832f83d5f6950ac25cf1e150f.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1676055809065"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676055809065"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676055809065"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676055809065"}]},"ts":"1676055809065"} 2023-02-10 19:03:29,068 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=12, resume processing ppid=11 2023-02-10 19:03:29,068 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=12, ppid=11, state=SUCCESS; OpenRegionProcedure 9c356df832f83d5f6950ac25cf1e150f, server=jenkins-hbase4.apache.org,45207,1676055807635 in 168 msec 2023-02-10 19:03:29,069 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-02-10 19:03:29,069 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks, region=9c356df832f83d5f6950ac25cf1e150f, ASSIGN in 325 msec 2023-02-10 19:03:29,070 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-10 19:03:29,070 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676055809070"}]},"ts":"1676055809070"} 2023-02-10 19:03:29,071 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, state=ENABLED in hbase:meta 2023-02-10 19:03:29,074 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks execute state=CREATE_TABLE_POST_OPERATION 2023-02-10 19:03:29,075 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=10, state=SUCCESS; CreateTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks in 370 msec 2023-02-10 19:03:29,311 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37893] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-10 19:03:29,312 INFO [Listener at localhost/43333] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testRestoreSnapshotDoesNotCreateBackRefLinks, procId: 10 completed 2023-02-10 19:03:29,312 DEBUG [Listener at localhost/43333] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testRestoreSnapshotDoesNotCreateBackRefLinks get assigned. Timeout = 60000ms 2023-02-10 19:03:29,312 INFO [Listener at localhost/43333] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-10 19:03:29,314 INFO [Listener at localhost/43333] hbase.HBaseTestingUtility(3484): All regions for table testRestoreSnapshotDoesNotCreateBackRefLinks assigned to meta. Checking AM states. 2023-02-10 19:03:29,314 INFO [Listener at localhost/43333] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-10 19:03:29,314 INFO [Listener at localhost/43333] hbase.HBaseTestingUtility(3504): All regions for table testRestoreSnapshotDoesNotCreateBackRefLinks assigned. 2023-02-10 19:03:29,314 INFO [Listener at localhost/43333] mapreduce.TableSnapshotInputFormatTestBase(207): put some stuff in the table 2023-02-10 19:03:29,326 DEBUG [hconnection-0x5c294143-shared-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-10 19:03:29,337 INFO [RS-EventLoopGroup-19-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47072, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-10 19:03:29,344 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45207] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 17576 Client: jenkins//172.31.14.131 first region in multi=testRestoreSnapshotDoesNotCreateBackRefLinks,,1676055808703.9c356df832f83d5f6950ac25cf1e150f. 2023-02-10 19:03:29,427 INFO [Listener at localhost/43333] mapreduce.TableSnapshotInputFormatTestBase(214): snapshot 2023-02-10 19:03:29,427 INFO [Listener at localhost/43333] snapshot.SnapshotTestingUtils(396): taking snapshot. 2023-02-10 19:03:29,428 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37893] master.MasterRpcServices(1580): Client=jenkins//172.31.14.131 snapshot request for:{ ss=foo table=testRestoreSnapshotDoesNotCreateBackRefLinks type=FLUSH ttl=0 } 2023-02-10 19:03:29,428 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37893] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1676055809428 (current time:1676055809428). 2023-02-10 19:03:29,428 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37893] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-02-10 19:03:29,428 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37893] zookeeper.ReadOnlyZKClient(139): Connect 0x3f352aee to 127.0.0.1:63275 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-10 19:03:29,431 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37893] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@69bdfe32, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-10 19:03:29,432 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37893] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-10 19:03:29,433 INFO [RS-EventLoopGroup-20-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38034, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-10 19:03:29,434 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37893] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3f352aee to 127.0.0.1:63275 2023-02-10 19:03:29,434 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37893] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-10 19:03:29,434 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37893] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-02-10 19:03:29,435 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37893] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=foo table=testRestoreSnapshotDoesNotCreateBackRefLinks type=FLUSH ttl=0 } 2023-02-10 19:03:29,436 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37893] procedure2.ProcedureExecutor(1029): Stored pid=13, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=EXCLUSIVE 2023-02-10 19:03:29,437 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=13, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=EXCLUSIVE 2023-02-10 19:03:29,438 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=13, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=EXCLUSIVE; timeout=600000, timestamp=1676056409438 2023-02-10 19:03:29,438 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37893] snapshot.SnapshotManager(653): Started snapshot: { ss=foo table=testRestoreSnapshotDoesNotCreateBackRefLinks type=FLUSH ttl=0 } 2023-02-10 19:03:29,438 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot foo C_M_SNAPSHOT_TABLE on table testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-10 19:03:29,439 DEBUG [Listener at localhost/43333] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=foo table=testRestoreSnapshotDoesNotCreateBackRefLinks type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-02-10 19:03:29,440 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=13, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=EXCLUSIVE 2023-02-10 19:03:29,440 DEBUG [Listener at localhost/43333] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-02-10 19:03:29,440 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=14, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=SHARED 2023-02-10 19:03:29,441 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=13, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=EXCLUSIVE in 4 msec 2023-02-10 19:03:29,442 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=14, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=SHARED 2023-02-10 19:03:29,442 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=14, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=SHARED; timeout=600000, timestamp=1676056409442 2023-02-10 19:03:29,449 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure foo 2023-02-10 19:03:29,449 INFO [(jenkins-hbase4.apache.org,37893,1676055807577)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'foo' 2023-02-10 19:03:29,449 DEBUG [(jenkins-hbase4.apache.org,37893,1676055807577)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-10 19:03:29,450 DEBUG [(jenkins-hbase4.apache.org,37893,1676055807577)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'foo' starting 'acquire' 2023-02-10 19:03:29,450 DEBUG [(jenkins-hbase4.apache.org,37893,1676055807577)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'foo', kicking off acquire phase on members. 2023-02-10 19:03:29,450 DEBUG [(jenkins-hbase4.apache.org,37893,1676055807577)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37893-0x1003f9df0080000, quorum=127.0.0.1:63275, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/foo 2023-02-10 19:03:29,450 DEBUG [(jenkins-hbase4.apache.org,37893,1676055807577)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/foo 2023-02-10 19:03:29,451 DEBUG [Listener at localhost/43333-EventThread] zookeeper.ZKWatcher(600): regionserver:34041-0x1003f9df0080002, quorum=127.0.0.1:63275, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-10 19:03:29,451 DEBUG [Listener at localhost/43333-EventThread] zookeeper.ZKWatcher(600): regionserver:45207-0x1003f9df0080001, quorum=127.0.0.1:63275, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-10 19:03:29,451 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-10 19:03:29,451 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-10 19:03:29,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-10 19:03:29,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-10 19:03:29,451 DEBUG [(jenkins-hbase4.apache.org,37893,1676055807577)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,45207,1676055807635 2023-02-10 19:03:29,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/foo 2023-02-10 19:03:29,451 DEBUG [(jenkins-hbase4.apache.org,37893,1676055807577)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37893-0x1003f9df0080000, quorum=127.0.0.1:63275, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,45207,1676055807635 2023-02-10 19:03:29,451 DEBUG [(jenkins-hbase4.apache.org,37893,1676055807577)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-10 19:03:29,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/foo 2023-02-10 19:03:29,452 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34041-0x1003f9df0080002, quorum=127.0.0.1:63275, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/foo 2023-02-10 19:03:29,452 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45207-0x1003f9df0080001, quorum=127.0.0.1:63275, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/foo 2023-02-10 19:03:29,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 68 2023-02-10 19:03:29,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/foo 2023-02-10 19:03:29,452 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot foo from table testRestoreSnapshotDoesNotCreateBackRefLinks type FLUSH 2023-02-10 19:03:29,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 68 2023-02-10 19:03:29,452 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:foo 2023-02-10 19:03:29,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/foo 2023-02-10 19:03:29,452 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot foo from table testRestoreSnapshotDoesNotCreateBackRefLinks type FLUSH 2023-02-10 19:03:29,452 DEBUG [member: 'jenkins-hbase4.apache.org,34041,1676055807665' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'foo' with timeout 300000ms 2023-02-10 19:03:29,452 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:foo 2023-02-10 19:03:29,453 DEBUG [member: 'jenkins-hbase4.apache.org,34041,1676055807665' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-10 19:03:29,453 DEBUG [member: 'jenkins-hbase4.apache.org,34041,1676055807665' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'foo' starting 'acquire' stage 2023-02-10 19:03:29,453 DEBUG [member: 'jenkins-hbase4.apache.org,34041,1676055807665' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'foo' locally acquired 2023-02-10 19:03:29,453 DEBUG [member: 'jenkins-hbase4.apache.org,34041,1676055807665' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34041,1676055807665' joining acquired barrier for procedure (foo) in zk 2023-02-10 19:03:29,453 DEBUG [member: 'jenkins-hbase4.apache.org,45207,1676055807635' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'foo' with timeout 300000ms 2023-02-10 19:03:29,453 DEBUG [member: 'jenkins-hbase4.apache.org,45207,1676055807635' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-10 19:03:29,454 DEBUG [member: 'jenkins-hbase4.apache.org,45207,1676055807635' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'foo' starting 'acquire' stage 2023-02-10 19:03:29,454 DEBUG [member: 'jenkins-hbase4.apache.org,45207,1676055807635' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'foo' locally acquired 2023-02-10 19:03:29,454 DEBUG [member: 'jenkins-hbase4.apache.org,45207,1676055807635' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45207,1676055807635' joining acquired barrier for procedure (foo) in zk 2023-02-10 19:03:29,456 DEBUG [member: 'jenkins-hbase4.apache.org,34041,1676055807665' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/foo 2023-02-10 19:03:29,457 DEBUG [Listener at localhost/43333-EventThread] zookeeper.ZKWatcher(600): master:37893-0x1003f9df0080000, quorum=127.0.0.1:63275, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,45207,1676055807635 2023-02-10 19:03:29,457 DEBUG [member: 'jenkins-hbase4.apache.org,34041,1676055807665' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34041-0x1003f9df0080002, quorum=127.0.0.1:63275, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/foo 2023-02-10 19:03:29,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,45207,1676055807635 2023-02-10 19:03:29,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-10 19:03:29,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-10 19:03:29,457 DEBUG [member: 'jenkins-hbase4.apache.org,34041,1676055807665' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'foo' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-10 19:03:29,457 DEBUG [member: 'jenkins-hbase4.apache.org,45207,1676055807635' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/foo 2023-02-10 19:03:29,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-10 19:03:29,458 DEBUG [member: 'jenkins-hbase4.apache.org,45207,1676055807635' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45207-0x1003f9df0080001, quorum=127.0.0.1:63275, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/foo 2023-02-10 19:03:29,458 DEBUG [member: 'jenkins-hbase4.apache.org,45207,1676055807635' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'foo' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-10 19:03:29,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-10 19:03:29,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-10 19:03:29,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34041,1676055807665 2023-02-10 19:03:29,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45207,1676055807635 2023-02-10 19:03:29,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-10 19:03:29,459 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45207,1676055807635' joining acquired barrier for procedure 'foo' on coordinator 2023-02-10 19:03:29,459 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@43c4bf0c[Count = 0] remaining members to acquire global barrier 2023-02-10 19:03:29,459 DEBUG [(jenkins-hbase4.apache.org,37893,1676055807577)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'foo' starting 'in-barrier' execution. 2023-02-10 19:03:29,459 DEBUG [(jenkins-hbase4.apache.org,37893,1676055807577)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/foo 2023-02-10 19:03:29,460 DEBUG [Listener at localhost/43333-EventThread] zookeeper.ZKWatcher(600): regionserver:34041-0x1003f9df0080002, quorum=127.0.0.1:63275, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/foo 2023-02-10 19:03:29,460 DEBUG [Listener at localhost/43333-EventThread] zookeeper.ZKWatcher(600): regionserver:45207-0x1003f9df0080001, quorum=127.0.0.1:63275, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/foo 2023-02-10 19:03:29,460 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/foo 2023-02-10 19:03:29,460 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/foo 2023-02-10 19:03:29,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/foo 2023-02-10 19:03:29,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/foo 2023-02-10 19:03:29,460 DEBUG [member: 'jenkins-hbase4.apache.org,34041,1676055807665' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'foo' received 'reached' from coordinator. 2023-02-10 19:03:29,460 DEBUG [member: 'jenkins-hbase4.apache.org,45207,1676055807635' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'foo' received 'reached' from coordinator. 2023-02-10 19:03:29,460 DEBUG [member: 'jenkins-hbase4.apache.org,34041,1676055807665' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'foo' locally completed 2023-02-10 19:03:29,460 DEBUG [member: 'jenkins-hbase4.apache.org,34041,1676055807665' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'foo' completed for member 'jenkins-hbase4.apache.org,34041,1676055807665' in zk 2023-02-10 19:03:29,460 DEBUG [(jenkins-hbase4.apache.org,37893,1676055807577)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37893-0x1003f9df0080000, quorum=127.0.0.1:63275, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,45207,1676055807635 2023-02-10 19:03:29,460 DEBUG [(jenkins-hbase4.apache.org,37893,1676055807577)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-10 19:03:29,460 DEBUG [member: 'jenkins-hbase4.apache.org,45207,1676055807635' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-02-10 19:03:29,460 DEBUG [member: 'jenkins-hbase4.apache.org,45207,1676055807635' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-10 19:03:29,460 DEBUG [rs(jenkins-hbase4.apache.org,45207,1676055807635)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testRestoreSnapshotDoesNotCreateBackRefLinks,,1676055808703.9c356df832f83d5f6950ac25cf1e150f. 2023-02-10 19:03:29,460 DEBUG [rs(jenkins-hbase4.apache.org,45207,1676055807635)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testRestoreSnapshotDoesNotCreateBackRefLinks,,1676055808703.9c356df832f83d5f6950ac25cf1e150f. started... 2023-02-10 19:03:29,460 INFO [rs(jenkins-hbase4.apache.org,45207,1676055807635)-snapshot-pool-0] regionserver.HRegion(2744): Flushing 9c356df832f83d5f6950ac25cf1e150f 2/2 column families, dataSize=1.01 MB heapSize=3.49 MB 2023-02-10 19:03:29,461 DEBUG [member: 'jenkins-hbase4.apache.org,34041,1676055807665' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'foo' has notified controller of completion 2023-02-10 19:03:29,461 DEBUG [member: 'jenkins-hbase4.apache.org,34041,1676055807665' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-10 19:03:29,461 DEBUG [member: 'jenkins-hbase4.apache.org,34041,1676055807665' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'foo' completed. 2023-02-10 19:03:29,474 INFO [rs(jenkins-hbase4.apache.org,45207,1676055807635)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=514.92 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:46481/user/jenkins/test-data/63e201f6-29e3-8f69-97e1-6c13b3c652db/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/9c356df832f83d5f6950ac25cf1e150f/.tmp/f1/6cc180e9b5f9451b8e887a60e530ac33 2023-02-10 19:03:29,490 INFO [rs(jenkins-hbase4.apache.org,45207,1676055807635)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=514.92 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:46481/user/jenkins/test-data/63e201f6-29e3-8f69-97e1-6c13b3c652db/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/9c356df832f83d5f6950ac25cf1e150f/.tmp/f2/d7e603c93d674dd6bbaac9eddab581e1 2023-02-10 19:03:29,493 DEBUG [rs(jenkins-hbase4.apache.org,45207,1676055807635)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46481/user/jenkins/test-data/63e201f6-29e3-8f69-97e1-6c13b3c652db/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/9c356df832f83d5f6950ac25cf1e150f/.tmp/f1/6cc180e9b5f9451b8e887a60e530ac33 as hdfs://localhost:46481/user/jenkins/test-data/63e201f6-29e3-8f69-97e1-6c13b3c652db/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/9c356df832f83d5f6950ac25cf1e150f/f1/6cc180e9b5f9451b8e887a60e530ac33 2023-02-10 19:03:29,498 INFO [rs(jenkins-hbase4.apache.org,45207,1676055807635)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46481/user/jenkins/test-data/63e201f6-29e3-8f69-97e1-6c13b3c652db/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/9c356df832f83d5f6950ac25cf1e150f/f1/6cc180e9b5f9451b8e887a60e530ac33, entries=17576, sequenceid=5, filesize=537.3 K 2023-02-10 19:03:29,499 DEBUG [rs(jenkins-hbase4.apache.org,45207,1676055807635)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46481/user/jenkins/test-data/63e201f6-29e3-8f69-97e1-6c13b3c652db/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/9c356df832f83d5f6950ac25cf1e150f/.tmp/f2/d7e603c93d674dd6bbaac9eddab581e1 as hdfs://localhost:46481/user/jenkins/test-data/63e201f6-29e3-8f69-97e1-6c13b3c652db/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/9c356df832f83d5f6950ac25cf1e150f/f2/d7e603c93d674dd6bbaac9eddab581e1 2023-02-10 19:03:29,503 INFO [rs(jenkins-hbase4.apache.org,45207,1676055807635)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46481/user/jenkins/test-data/63e201f6-29e3-8f69-97e1-6c13b3c652db/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/9c356df832f83d5f6950ac25cf1e150f/f2/d7e603c93d674dd6bbaac9eddab581e1, entries=17576, sequenceid=5, filesize=537.3 K 2023-02-10 19:03:29,503 INFO [rs(jenkins-hbase4.apache.org,45207,1676055807635)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~1.01 MB/1054560, heapSize ~3.49 MB/3656288, currentSize=0 B/0 for 9c356df832f83d5f6950ac25cf1e150f in 43ms, sequenceid=5, compaction requested=false 2023-02-10 19:03:29,504 DEBUG [rs(jenkins-hbase4.apache.org,45207,1676055807635)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testRestoreSnapshotDoesNotCreateBackRefLinks' 2023-02-10 19:03:29,504 DEBUG [rs(jenkins-hbase4.apache.org,45207,1676055807635)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 9c356df832f83d5f6950ac25cf1e150f: 2023-02-10 19:03:29,504 DEBUG [rs(jenkins-hbase4.apache.org,45207,1676055807635)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testRestoreSnapshotDoesNotCreateBackRefLinks,,1676055808703.9c356df832f83d5f6950ac25cf1e150f.' region-info for snapshot=foo 2023-02-10 19:03:29,504 DEBUG [rs(jenkins-hbase4.apache.org,45207,1676055807635)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-10 19:03:29,504 DEBUG [rs(jenkins-hbase4.apache.org,45207,1676055807635)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:46481/user/jenkins/test-data/63e201f6-29e3-8f69-97e1-6c13b3c652db/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/9c356df832f83d5f6950ac25cf1e150f/f1/6cc180e9b5f9451b8e887a60e530ac33] hfiles 2023-02-10 19:03:29,504 DEBUG [rs(jenkins-hbase4.apache.org,45207,1676055807635)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:46481/user/jenkins/test-data/63e201f6-29e3-8f69-97e1-6c13b3c652db/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/9c356df832f83d5f6950ac25cf1e150f/f1/6cc180e9b5f9451b8e887a60e530ac33 for snapshot=foo 2023-02-10 19:03:29,505 DEBUG [rs(jenkins-hbase4.apache.org,45207,1676055807635)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:46481/user/jenkins/test-data/63e201f6-29e3-8f69-97e1-6c13b3c652db/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/9c356df832f83d5f6950ac25cf1e150f/f2/d7e603c93d674dd6bbaac9eddab581e1] hfiles 2023-02-10 19:03:29,505 DEBUG [rs(jenkins-hbase4.apache.org,45207,1676055807635)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:46481/user/jenkins/test-data/63e201f6-29e3-8f69-97e1-6c13b3c652db/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/9c356df832f83d5f6950ac25cf1e150f/f2/d7e603c93d674dd6bbaac9eddab581e1 for snapshot=foo 2023-02-10 19:03:29,513 DEBUG [rs(jenkins-hbase4.apache.org,45207,1676055807635)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testRestoreSnapshotDoesNotCreateBackRefLinks,,1676055808703.9c356df832f83d5f6950ac25cf1e150f. completed. 2023-02-10 19:03:29,513 DEBUG [rs(jenkins-hbase4.apache.org,45207,1676055807635)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testRestoreSnapshotDoesNotCreateBackRefLinks,,1676055808703.9c356df832f83d5f6950ac25cf1e150f. 2023-02-10 19:03:29,513 DEBUG [member: 'jenkins-hbase4.apache.org,45207,1676055807635' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-02-10 19:03:29,513 DEBUG [member: 'jenkins-hbase4.apache.org,45207,1676055807635' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-02-10 19:03:29,513 DEBUG [member: 'jenkins-hbase4.apache.org,45207,1676055807635' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,45207,1676055807635 2023-02-10 19:03:29,513 DEBUG [member: 'jenkins-hbase4.apache.org,45207,1676055807635' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'foo' locally completed 2023-02-10 19:03:29,513 DEBUG [member: 'jenkins-hbase4.apache.org,45207,1676055807635' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'foo' completed for member 'jenkins-hbase4.apache.org,45207,1676055807635' in zk 2023-02-10 19:03:29,516 DEBUG [member: 'jenkins-hbase4.apache.org,45207,1676055807635' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'foo' has notified controller of completion 2023-02-10 19:03:29,516 DEBUG [Listener at localhost/43333-EventThread] zookeeper.ZKWatcher(600): master:37893-0x1003f9df0080000, quorum=127.0.0.1:63275, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,45207,1676055807635 2023-02-10 19:03:29,516 DEBUG [member: 'jenkins-hbase4.apache.org,45207,1676055807635' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-10 19:03:29,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,45207,1676055807635 2023-02-10 19:03:29,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-10 19:03:29,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-10 19:03:29,516 DEBUG [member: 'jenkins-hbase4.apache.org,45207,1676055807635' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'foo' completed. 2023-02-10 19:03:29,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-10 19:03:29,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-10 19:03:29,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-10 19:03:29,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34041,1676055807665 2023-02-10 19:03:29,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45207,1676055807635 2023-02-10 19:03:29,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-10 19:03:29,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-10 19:03:29,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34041,1676055807665 2023-02-10 19:03:29,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45207,1676055807635 2023-02-10 19:03:29,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'foo' member 'jenkins-hbase4.apache.org,45207,1676055807635': 2023-02-10 19:03:29,520 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45207,1676055807635' released barrier for procedure'foo', counting down latch. Waiting for 0 more 2023-02-10 19:03:29,520 INFO [(jenkins-hbase4.apache.org,37893,1676055807577)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'foo' execution completed 2023-02-10 19:03:29,520 DEBUG [(jenkins-hbase4.apache.org,37893,1676055807577)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-10 19:03:29,520 DEBUG [(jenkins-hbase4.apache.org,37893,1676055807577)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-10 19:03:29,520 DEBUG [(jenkins-hbase4.apache.org,37893,1676055807577)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:foo 2023-02-10 19:03:29,520 INFO [(jenkins-hbase4.apache.org,37893,1676055807577)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure fooincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-02-10 19:03:29,521 DEBUG [Listener at localhost/43333-EventThread] zookeeper.ZKWatcher(600): regionserver:45207-0x1003f9df0080001, quorum=127.0.0.1:63275, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/foo 2023-02-10 19:03:29,521 DEBUG [Listener at localhost/43333-EventThread] zookeeper.ZKWatcher(600): master:37893-0x1003f9df0080000, quorum=127.0.0.1:63275, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/foo 2023-02-10 19:03:29,522 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/foo 2023-02-10 19:03:29,522 DEBUG [Listener at localhost/43333-EventThread] zookeeper.ZKWatcher(600): regionserver:45207-0x1003f9df0080001, quorum=127.0.0.1:63275, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-10 19:03:29,522 DEBUG [Listener at localhost/43333-EventThread] zookeeper.ZKWatcher(600): regionserver:34041-0x1003f9df0080002, quorum=127.0.0.1:63275, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/foo 2023-02-10 19:03:29,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/foo 2023-02-10 19:03:29,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/foo 2023-02-10 19:03:29,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-10 19:03:29,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-10 19:03:29,522 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/foo 2023-02-10 19:03:29,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/foo 2023-02-10 19:03:29,522 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-10 19:03:29,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-10 19:03:29,522 DEBUG [Listener at localhost/43333-EventThread] zookeeper.ZKWatcher(600): regionserver:34041-0x1003f9df0080002, quorum=127.0.0.1:63275, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-10 19:03:29,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-10 19:03:29,522 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-10 19:03:29,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/foo 2023-02-10 19:03:29,522 DEBUG [(jenkins-hbase4.apache.org,37893,1676055807577)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37893-0x1003f9df0080000, quorum=127.0.0.1:63275, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,34041,1676055807665 2023-02-10 19:03:29,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-10 19:03:29,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-10 19:03:29,523 DEBUG [(jenkins-hbase4.apache.org,37893,1676055807577)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37893-0x1003f9df0080000, quorum=127.0.0.1:63275, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,45207,1676055807635 2023-02-10 19:03:29,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/foo 2023-02-10 19:03:29,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-10 19:03:29,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-10 19:03:29,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34041,1676055807665 2023-02-10 19:03:29,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45207,1676055807635 2023-02-10 19:03:29,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-10 19:03:29,524 DEBUG [(jenkins-hbase4.apache.org,37893,1676055807577)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37893-0x1003f9df0080000, quorum=127.0.0.1:63275, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,34041,1676055807665 2023-02-10 19:03:29,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-10 19:03:29,525 DEBUG [(jenkins-hbase4.apache.org,37893,1676055807577)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37893-0x1003f9df0080000, quorum=127.0.0.1:63275, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,45207,1676055807635 2023-02-10 19:03:29,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34041,1676055807665 2023-02-10 19:03:29,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45207,1676055807635 2023-02-10 19:03:29,530 DEBUG [Listener at localhost/43333-EventThread] zookeeper.ZKWatcher(600): master:37893-0x1003f9df0080000, quorum=127.0.0.1:63275, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,45207,1676055807635 2023-02-10 19:03:29,530 DEBUG [Listener at localhost/43333-EventThread] zookeeper.ZKWatcher(600): regionserver:34041-0x1003f9df0080002, quorum=127.0.0.1:63275, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-10 19:03:29,530 DEBUG [Listener at localhost/43333-EventThread] zookeeper.ZKWatcher(600): master:37893-0x1003f9df0080000, quorum=127.0.0.1:63275, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo 2023-02-10 19:03:29,530 DEBUG [Listener at localhost/43333-EventThread] zookeeper.ZKWatcher(600): regionserver:34041-0x1003f9df0080002, quorum=127.0.0.1:63275, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-10 19:03:29,530 DEBUG [Listener at localhost/43333-EventThread] zookeeper.ZKWatcher(600): regionserver:45207-0x1003f9df0080001, quorum=127.0.0.1:63275, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-10 19:03:29,530 DEBUG [Listener at localhost/43333-EventThread] zookeeper.ZKWatcher(600): master:37893-0x1003f9df0080000, quorum=127.0.0.1:63275, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,34041,1676055807665 2023-02-10 19:03:29,530 DEBUG [(jenkins-hbase4.apache.org,37893,1676055807577)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-10 19:03:29,530 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-10 19:03:29,530 DEBUG [Listener at localhost/43333-EventThread] zookeeper.ZKWatcher(600): master:37893-0x1003f9df0080000, quorum=127.0.0.1:63275, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo 2023-02-10 19:03:29,530 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for foo 2023-02-10 19:03:29,530 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-10 19:03:29,530 DEBUG [Listener at localhost/43333-EventThread] zookeeper.ZKWatcher(600): regionserver:45207-0x1003f9df0080001, quorum=127.0.0.1:63275, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-10 19:03:29,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-10 19:03:29,530 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for foo 2023-02-10 19:03:29,530 DEBUG [Listener at localhost/43333-EventThread] zookeeper.ZKWatcher(600): master:37893-0x1003f9df0080000, quorum=127.0.0.1:63275, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,45207,1676055807635 2023-02-10 19:03:29,531 DEBUG [Listener at localhost/43333-EventThread] zookeeper.ZKWatcher(600): master:37893-0x1003f9df0080000, quorum=127.0.0.1:63275, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/foo 2023-02-10 19:03:29,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-10 19:03:29,531 DEBUG [Listener at localhost/43333-EventThread] zookeeper.ZKWatcher(600): master:37893-0x1003f9df0080000, quorum=127.0.0.1:63275, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,34041,1676055807665 2023-02-10 19:03:29,531 DEBUG [Listener at localhost/43333-EventThread] zookeeper.ZKWatcher(600): master:37893-0x1003f9df0080000, quorum=127.0.0.1:63275, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/foo 2023-02-10 19:03:29,531 DEBUG [Listener at localhost/43333-EventThread] zookeeper.ZKWatcher(600): master:37893-0x1003f9df0080000, quorum=127.0.0.1:63275, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/foo 2023-02-10 19:03:29,531 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-10 19:03:29,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-10 19:03:29,531 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:46481/user/jenkins/test-data/63e201f6-29e3-8f69-97e1-6c13b3c652db/.hbase-snapshot/.tmp/foo 2023-02-10 19:03:29,531 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-10 19:03:29,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-10 19:03:29,540 DEBUG [Listener at localhost/43333] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-10 19:03:29,541 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37893] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=foo table=testRestoreSnapshotDoesNotCreateBackRefLinks type=FLUSH ttl=0 } is done 2023-02-10 19:03:29,542 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37893] snapshot.SnapshotManager(404): Snapshoting '{ ss=foo table=testRestoreSnapshotDoesNotCreateBackRefLinks type=FLUSH ttl=0 }' is still in progress! 2023-02-10 19:03:29,542 DEBUG [Listener at localhost/43333] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-02-10 19:03:29,550 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:46481/user/jenkins/test-data/63e201f6-29e3-8f69-97e1-6c13b3c652db/.hbase-snapshot/.tmp/foo to hdfs://localhost:46481/user/jenkins/test-data/63e201f6-29e3-8f69-97e1-6c13b3c652db/.hbase-snapshot/foo 2023-02-10 19:03:29,566 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot foo of table testRestoreSnapshotDoesNotCreateBackRefLinks completed 2023-02-10 19:03:29,566 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:46481/user/jenkins/test-data/63e201f6-29e3-8f69-97e1-6c13b3c652db/.hbase-snapshot/.tmp/foo 2023-02-10 19:03:29,566 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:46481/user/jenkins/test-data/63e201f6-29e3-8f69-97e1-6c13b3c652db/.hbase-snapshot/.tmp/foo 2023-02-10 19:03:29,566 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot foo C_M_SNAPSHOT_TABLE on table testRestoreSnapshotDoesNotCreateBackRefLinks at 1676055809438Consolidate snapshot: foo at 1676055809530 (+92 ms)Loading Region manifests for foo at 1676055809531 (+1 ms)Writing data manifest for foo at 1676055809534 (+3 ms)Verifying snapshot: foo at 1676055809545 (+11 ms)Snapshot foo of table testRestoreSnapshotDoesNotCreateBackRefLinks completed at 1676055809566 (+21 ms) 2023-02-10 19:03:29,568 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=14, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=SHARED 2023-02-10 19:03:29,570 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=14, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=SHARED in 130 msec 2023-02-10 19:03:29,742 DEBUG [Listener at localhost/43333] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-10 19:03:29,743 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37893] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=foo table=testRestoreSnapshotDoesNotCreateBackRefLinks type=FLUSH ttl=0 } is done 2023-02-10 19:03:29,743 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37893] snapshot.SnapshotManager(401): Snapshot '{ ss=foo table=testRestoreSnapshotDoesNotCreateBackRefLinks type=FLUSH ttl=0 }' has completed, notifying client. 2023-02-10 19:03:29,744 INFO [Listener at localhost/43333] snapshot.SnapshotTestingUtils(399): Confirming snapshot exists. 2023-02-10 19:03:29,747 INFO [Listener at localhost/43333] snapshot.SnapshotTestingUtils(406): validating snapshot. 2023-02-10 19:03:29,751 INFO [Listener at localhost/43333] mapreduce.TableSnapshotInputFormatTestBase(218): load different values 2023-02-10 19:03:29,781 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45207] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 17576 Client: jenkins//172.31.14.131 first region in multi=testRestoreSnapshotDoesNotCreateBackRefLinks,,1676055808703.9c356df832f83d5f6950ac25cf1e150f. 2023-02-10 19:03:29,861 INFO [Listener at localhost/43333] mapreduce.TableSnapshotInputFormatTestBase(222): cause flush to create new files in the region 2023-02-10 19:03:29,866 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37893] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-10 19:03:29,867 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37893] procedure.ProcedureCoordinator(165): Submitting procedure testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-10 19:03:29,868 INFO [(jenkins-hbase4.apache.org,37893,1676055807577)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' 2023-02-10 19:03:29,868 DEBUG [(jenkins-hbase4.apache.org,37893,1676055807577)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-10 19:03:29,868 DEBUG [(jenkins-hbase4.apache.org,37893,1676055807577)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' starting 'acquire' 2023-02-10 19:03:29,869 DEBUG [(jenkins-hbase4.apache.org,37893,1676055807577)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks', kicking off acquire phase on members. 2023-02-10 19:03:29,869 DEBUG [(jenkins-hbase4.apache.org,37893,1676055807577)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37893-0x1003f9df0080000, quorum=127.0.0.1:63275, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-10 19:03:29,869 DEBUG [(jenkins-hbase4.apache.org,37893,1676055807577)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-10 19:03:29,871 DEBUG [Listener at localhost/43333-EventThread] zookeeper.ZKWatcher(600): regionserver:45207-0x1003f9df0080001, quorum=127.0.0.1:63275, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-10 19:03:29,871 DEBUG [Listener at localhost/43333-EventThread] zookeeper.ZKWatcher(600): regionserver:34041-0x1003f9df0080002, quorum=127.0.0.1:63275, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-10 19:03:29,871 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-10 19:03:29,871 DEBUG [(jenkins-hbase4.apache.org,37893,1676055807577)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,45207,1676055807635 2023-02-10 19:03:29,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-10 19:03:29,872 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-10 19:03:29,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-10 19:03:29,872 DEBUG [(jenkins-hbase4.apache.org,37893,1676055807577)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37893-0x1003f9df0080000, quorum=127.0.0.1:63275, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,45207,1676055807635 2023-02-10 19:03:29,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-10 19:03:29,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-10 19:03:29,872 DEBUG [(jenkins-hbase4.apache.org,37893,1676055807577)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-10 19:03:29,872 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34041-0x1003f9df0080002, quorum=127.0.0.1:63275, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-10 19:03:29,872 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45207-0x1003f9df0080001, quorum=127.0.0.1:63275, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-10 19:03:29,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-10 19:03:29,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-10 19:03:29,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-10 19:03:29,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-10 19:03:29,873 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-10 19:03:29,873 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-10 19:03:29,873 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-10 19:03:29,873 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-10 19:03:29,873 DEBUG [member: 'jenkins-hbase4.apache.org,45207,1676055807635' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' with timeout 60000ms 2023-02-10 19:03:29,873 DEBUG [member: 'jenkins-hbase4.apache.org,45207,1676055807635' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-10 19:03:29,873 DEBUG [member: 'jenkins-hbase4.apache.org,34041,1676055807665' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' with timeout 60000ms 2023-02-10 19:03:29,873 DEBUG [member: 'jenkins-hbase4.apache.org,34041,1676055807665' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-10 19:03:29,874 DEBUG [member: 'jenkins-hbase4.apache.org,45207,1676055807635' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' starting 'acquire' stage 2023-02-10 19:03:29,875 DEBUG [member: 'jenkins-hbase4.apache.org,34041,1676055807665' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' starting 'acquire' stage 2023-02-10 19:03:29,875 DEBUG [member: 'jenkins-hbase4.apache.org,34041,1676055807665' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' locally acquired 2023-02-10 19:03:29,875 DEBUG [member: 'jenkins-hbase4.apache.org,34041,1676055807665' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34041,1676055807665' joining acquired barrier for procedure (testRestoreSnapshotDoesNotCreateBackRefLinks) in zk 2023-02-10 19:03:29,875 DEBUG [member: 'jenkins-hbase4.apache.org,45207,1676055807635' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-10 19:03:29,875 DEBUG [member: 'jenkins-hbase4.apache.org,45207,1676055807635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-10 19:03:29,875 DEBUG [rs(jenkins-hbase4.apache.org,45207,1676055807635)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testRestoreSnapshotDoesNotCreateBackRefLinks,,1676055808703.9c356df832f83d5f6950ac25cf1e150f. 2023-02-10 19:03:29,875 DEBUG [rs(jenkins-hbase4.apache.org,45207,1676055807635)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testRestoreSnapshotDoesNotCreateBackRefLinks,,1676055808703.9c356df832f83d5f6950ac25cf1e150f. started... 2023-02-10 19:03:29,875 INFO [rs(jenkins-hbase4.apache.org,45207,1676055807635)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 9c356df832f83d5f6950ac25cf1e150f 2/2 column families, dataSize=1.58 MB heapSize=4.02 MB 2023-02-10 19:03:29,876 DEBUG [member: 'jenkins-hbase4.apache.org,34041,1676055807665' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-10 19:03:29,876 DEBUG [member: 'jenkins-hbase4.apache.org,34041,1676055807665' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34041-0x1003f9df0080002, quorum=127.0.0.1:63275, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-10 19:03:29,876 DEBUG [member: 'jenkins-hbase4.apache.org,34041,1676055807665' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-10 19:03:29,890 INFO [rs(jenkins-hbase4.apache.org,45207,1676055807635)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=806.71 KB at sequenceid=9 (bloomFilter=false), to=hdfs://localhost:46481/user/jenkins/test-data/63e201f6-29e3-8f69-97e1-6c13b3c652db/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/9c356df832f83d5f6950ac25cf1e150f/.tmp/f1/ca23db74a0c24879bac9c8cd1b37f9eb 2023-02-10 19:03:29,906 INFO [rs(jenkins-hbase4.apache.org,45207,1676055807635)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=806.71 KB at sequenceid=9 (bloomFilter=false), to=hdfs://localhost:46481/user/jenkins/test-data/63e201f6-29e3-8f69-97e1-6c13b3c652db/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/9c356df832f83d5f6950ac25cf1e150f/.tmp/f2/4b71baaf475f44c7a51dcdd7d7b5bd21 2023-02-10 19:03:29,910 DEBUG [rs(jenkins-hbase4.apache.org,45207,1676055807635)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46481/user/jenkins/test-data/63e201f6-29e3-8f69-97e1-6c13b3c652db/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/9c356df832f83d5f6950ac25cf1e150f/.tmp/f1/ca23db74a0c24879bac9c8cd1b37f9eb as hdfs://localhost:46481/user/jenkins/test-data/63e201f6-29e3-8f69-97e1-6c13b3c652db/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/9c356df832f83d5f6950ac25cf1e150f/f1/ca23db74a0c24879bac9c8cd1b37f9eb 2023-02-10 19:03:29,913 INFO [rs(jenkins-hbase4.apache.org,45207,1676055807635)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46481/user/jenkins/test-data/63e201f6-29e3-8f69-97e1-6c13b3c652db/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/9c356df832f83d5f6950ac25cf1e150f/f1/ca23db74a0c24879bac9c8cd1b37f9eb, entries=17576, sequenceid=9, filesize=829.4 K 2023-02-10 19:03:29,914 DEBUG [rs(jenkins-hbase4.apache.org,45207,1676055807635)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46481/user/jenkins/test-data/63e201f6-29e3-8f69-97e1-6c13b3c652db/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/9c356df832f83d5f6950ac25cf1e150f/.tmp/f2/4b71baaf475f44c7a51dcdd7d7b5bd21 as hdfs://localhost:46481/user/jenkins/test-data/63e201f6-29e3-8f69-97e1-6c13b3c652db/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/9c356df832f83d5f6950ac25cf1e150f/f2/4b71baaf475f44c7a51dcdd7d7b5bd21 2023-02-10 19:03:29,917 INFO [rs(jenkins-hbase4.apache.org,45207,1676055807635)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46481/user/jenkins/test-data/63e201f6-29e3-8f69-97e1-6c13b3c652db/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/9c356df832f83d5f6950ac25cf1e150f/f2/4b71baaf475f44c7a51dcdd7d7b5bd21, entries=17576, sequenceid=9, filesize=829.4 K 2023-02-10 19:03:29,918 INFO [rs(jenkins-hbase4.apache.org,45207,1676055807635)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~1.58 MB/1652144, heapSize ~4.02 MB/4218720, currentSize=0 B/0 for 9c356df832f83d5f6950ac25cf1e150f in 43ms, sequenceid=9, compaction requested=false 2023-02-10 19:03:29,919 DEBUG [rs(jenkins-hbase4.apache.org,45207,1676055807635)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 9c356df832f83d5f6950ac25cf1e150f: 2023-02-10 19:03:29,919 DEBUG [rs(jenkins-hbase4.apache.org,45207,1676055807635)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testRestoreSnapshotDoesNotCreateBackRefLinks,,1676055808703.9c356df832f83d5f6950ac25cf1e150f. 2023-02-10 19:03:29,919 DEBUG [member: 'jenkins-hbase4.apache.org,45207,1676055807635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-10 19:03:29,919 DEBUG [member: 'jenkins-hbase4.apache.org,45207,1676055807635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-10 19:03:29,919 DEBUG [member: 'jenkins-hbase4.apache.org,45207,1676055807635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,45207,1676055807635 2023-02-10 19:03:29,919 DEBUG [member: 'jenkins-hbase4.apache.org,45207,1676055807635' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' locally acquired 2023-02-10 19:03:29,919 DEBUG [member: 'jenkins-hbase4.apache.org,45207,1676055807635' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45207,1676055807635' joining acquired barrier for procedure (testRestoreSnapshotDoesNotCreateBackRefLinks) in zk 2023-02-10 19:03:29,921 DEBUG [Listener at localhost/43333-EventThread] zookeeper.ZKWatcher(600): master:37893-0x1003f9df0080000, quorum=127.0.0.1:63275, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,45207,1676055807635 2023-02-10 19:03:29,921 DEBUG [member: 'jenkins-hbase4.apache.org,45207,1676055807635' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-10 19:03:29,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,45207,1676055807635 2023-02-10 19:03:29,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-10 19:03:29,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-10 19:03:29,921 DEBUG [member: 'jenkins-hbase4.apache.org,45207,1676055807635' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45207-0x1003f9df0080001, quorum=127.0.0.1:63275, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-10 19:03:29,921 DEBUG [member: 'jenkins-hbase4.apache.org,45207,1676055807635' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-10 19:03:29,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-10 19:03:29,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-10 19:03:29,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-10 19:03:29,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34041,1676055807665 2023-02-10 19:03:29,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45207,1676055807635 2023-02-10 19:03:29,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-10 19:03:29,923 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45207,1676055807635' joining acquired barrier for procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' on coordinator 2023-02-10 19:03:29,923 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@47fb23ac[Count = 0] remaining members to acquire global barrier 2023-02-10 19:03:29,923 DEBUG [(jenkins-hbase4.apache.org,37893,1676055807577)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' starting 'in-barrier' execution. 2023-02-10 19:03:29,923 DEBUG [(jenkins-hbase4.apache.org,37893,1676055807577)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-10 19:03:29,924 DEBUG [Listener at localhost/43333-EventThread] zookeeper.ZKWatcher(600): regionserver:45207-0x1003f9df0080001, quorum=127.0.0.1:63275, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-10 19:03:29,924 DEBUG [Listener at localhost/43333-EventThread] zookeeper.ZKWatcher(600): regionserver:34041-0x1003f9df0080002, quorum=127.0.0.1:63275, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-10 19:03:29,924 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-10 19:03:29,924 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-10 19:03:29,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-10 19:03:29,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-10 19:03:29,924 DEBUG [member: 'jenkins-hbase4.apache.org,34041,1676055807665' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' received 'reached' from coordinator. 2023-02-10 19:03:29,924 DEBUG [member: 'jenkins-hbase4.apache.org,45207,1676055807635' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' received 'reached' from coordinator. 2023-02-10 19:03:29,924 DEBUG [member: 'jenkins-hbase4.apache.org,45207,1676055807635' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' locally completed 2023-02-10 19:03:29,924 DEBUG [(jenkins-hbase4.apache.org,37893,1676055807577)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37893-0x1003f9df0080000, quorum=127.0.0.1:63275, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,45207,1676055807635 2023-02-10 19:03:29,924 DEBUG [(jenkins-hbase4.apache.org,37893,1676055807577)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-10 19:03:29,924 DEBUG [member: 'jenkins-hbase4.apache.org,34041,1676055807665' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' locally completed 2023-02-10 19:03:29,924 DEBUG [member: 'jenkins-hbase4.apache.org,45207,1676055807635' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' completed for member 'jenkins-hbase4.apache.org,45207,1676055807635' in zk 2023-02-10 19:03:29,924 DEBUG [member: 'jenkins-hbase4.apache.org,34041,1676055807665' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' completed for member 'jenkins-hbase4.apache.org,34041,1676055807665' in zk 2023-02-10 19:03:29,927 DEBUG [Listener at localhost/43333-EventThread] zookeeper.ZKWatcher(600): master:37893-0x1003f9df0080000, quorum=127.0.0.1:63275, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,45207,1676055807635 2023-02-10 19:03:29,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,45207,1676055807635 2023-02-10 19:03:29,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-10 19:03:29,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-10 19:03:29,927 DEBUG [member: 'jenkins-hbase4.apache.org,45207,1676055807635' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' has notified controller of completion 2023-02-10 19:03:29,927 DEBUG [member: 'jenkins-hbase4.apache.org,45207,1676055807635' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-10 19:03:29,927 DEBUG [member: 'jenkins-hbase4.apache.org,45207,1676055807635' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' completed. 2023-02-10 19:03:29,928 DEBUG [member: 'jenkins-hbase4.apache.org,34041,1676055807665' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' has notified controller of completion 2023-02-10 19:03:29,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-10 19:03:29,928 DEBUG [member: 'jenkins-hbase4.apache.org,34041,1676055807665' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-10 19:03:29,928 DEBUG [member: 'jenkins-hbase4.apache.org,34041,1676055807665' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' completed. 2023-02-10 19:03:29,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-10 19:03:29,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-10 19:03:29,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34041,1676055807665 2023-02-10 19:03:29,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45207,1676055807635 2023-02-10 19:03:29,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-10 19:03:29,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-10 19:03:29,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34041,1676055807665 2023-02-10 19:03:29,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45207,1676055807635 2023-02-10 19:03:29,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' member 'jenkins-hbase4.apache.org,45207,1676055807635': 2023-02-10 19:03:29,930 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45207,1676055807635' released barrier for procedure'testRestoreSnapshotDoesNotCreateBackRefLinks', counting down latch. Waiting for 0 more 2023-02-10 19:03:29,930 INFO [(jenkins-hbase4.apache.org,37893,1676055807577)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' execution completed 2023-02-10 19:03:29,930 DEBUG [(jenkins-hbase4.apache.org,37893,1676055807577)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-10 19:03:29,930 DEBUG [(jenkins-hbase4.apache.org,37893,1676055807577)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-10 19:03:29,930 DEBUG [(jenkins-hbase4.apache.org,37893,1676055807577)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-10 19:03:29,930 INFO [(jenkins-hbase4.apache.org,37893,1676055807577)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testRestoreSnapshotDoesNotCreateBackRefLinksincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-10 19:03:29,932 DEBUG [Listener at localhost/43333-EventThread] zookeeper.ZKWatcher(600): master:37893-0x1003f9df0080000, quorum=127.0.0.1:63275, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-10 19:03:29,932 DEBUG [Listener at localhost/43333-EventThread] zookeeper.ZKWatcher(600): regionserver:45207-0x1003f9df0080001, quorum=127.0.0.1:63275, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-10 19:03:29,932 DEBUG [Listener at localhost/43333-EventThread] zookeeper.ZKWatcher(600): regionserver:34041-0x1003f9df0080002, quorum=127.0.0.1:63275, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-10 19:03:29,932 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-10 19:03:29,932 DEBUG [Listener at localhost/43333-EventThread] zookeeper.ZKWatcher(600): regionserver:45207-0x1003f9df0080001, quorum=127.0.0.1:63275, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-10 19:03:29,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-10 19:03:29,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-10 19:03:29,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-10 19:03:29,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-10 19:03:29,932 DEBUG [Listener at localhost/43333-EventThread] zookeeper.ZKWatcher(600): regionserver:34041-0x1003f9df0080002, quorum=127.0.0.1:63275, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-10 19:03:29,932 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-10 19:03:29,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-10 19:03:29,932 DEBUG [(jenkins-hbase4.apache.org,37893,1676055807577)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37893-0x1003f9df0080000, quorum=127.0.0.1:63275, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,34041,1676055807665 2023-02-10 19:03:29,932 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-10 19:03:29,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-10 19:03:29,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-10 19:03:29,932 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-10 19:03:29,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-10 19:03:29,933 DEBUG [(jenkins-hbase4.apache.org,37893,1676055807577)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37893-0x1003f9df0080000, quorum=127.0.0.1:63275, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,45207,1676055807635 2023-02-10 19:03:29,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-10 19:03:29,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-10 19:03:29,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-10 19:03:29,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-10 19:03:29,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-10 19:03:29,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34041,1676055807665 2023-02-10 19:03:29,934 DEBUG [(jenkins-hbase4.apache.org,37893,1676055807577)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37893-0x1003f9df0080000, quorum=127.0.0.1:63275, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,34041,1676055807665 2023-02-10 19:03:29,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45207,1676055807635 2023-02-10 19:03:29,934 DEBUG [(jenkins-hbase4.apache.org,37893,1676055807577)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37893-0x1003f9df0080000, quorum=127.0.0.1:63275, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,45207,1676055807635 2023-02-10 19:03:29,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-10 19:03:29,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-10 19:03:29,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34041,1676055807665 2023-02-10 19:03:29,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45207,1676055807635 2023-02-10 19:03:29,936 DEBUG [Listener at localhost/43333-EventThread] zookeeper.ZKWatcher(600): regionserver:34041-0x1003f9df0080002, quorum=127.0.0.1:63275, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-10 19:03:29,936 DEBUG [Listener at localhost/43333-EventThread] zookeeper.ZKWatcher(600): regionserver:45207-0x1003f9df0080001, quorum=127.0.0.1:63275, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-10 19:03:29,936 DEBUG [Listener at localhost/43333-EventThread] zookeeper.ZKWatcher(600): regionserver:45207-0x1003f9df0080001, quorum=127.0.0.1:63275, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-10 19:03:29,936 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-10 19:03:29,936 DEBUG [Listener at localhost/43333-EventThread] zookeeper.ZKWatcher(600): regionserver:34041-0x1003f9df0080002, quorum=127.0.0.1:63275, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-10 19:03:29,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-10 19:03:29,937 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-10 19:03:29,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-10 19:03:29,937 DEBUG [(jenkins-hbase4.apache.org,37893,1676055807577)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-10 19:03:29,937 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37893] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testRestoreSnapshotDoesNotCreateBackRefLinks' 2023-02-10 19:03:29,937 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37893] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-10 19:03:29,937 DEBUG [Listener at localhost/43333] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testRestoreSnapshotDoesNotCreateBackRefLinks'' to complete. (max 20000 ms per retry) 2023-02-10 19:03:29,938 DEBUG [Listener at localhost/43333] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-10 19:03:29,938 DEBUG [Listener at localhost/43333-EventThread] zookeeper.ZKWatcher(600): master:37893-0x1003f9df0080000, quorum=127.0.0.1:63275, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,45207,1676055807635 2023-02-10 19:03:29,938 DEBUG [Listener at localhost/43333-EventThread] zookeeper.ZKWatcher(600): master:37893-0x1003f9df0080000, quorum=127.0.0.1:63275, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-10 19:03:29,939 DEBUG [Listener at localhost/43333-EventThread] zookeeper.ZKWatcher(600): master:37893-0x1003f9df0080000, quorum=127.0.0.1:63275, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,34041,1676055807665 2023-02-10 19:03:29,939 DEBUG [Listener at localhost/43333-EventThread] zookeeper.ZKWatcher(600): master:37893-0x1003f9df0080000, quorum=127.0.0.1:63275, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-10 19:03:29,939 DEBUG [Listener at localhost/43333-EventThread] zookeeper.ZKWatcher(600): master:37893-0x1003f9df0080000, quorum=127.0.0.1:63275, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,45207,1676055807635 2023-02-10 19:03:29,939 DEBUG [Listener at localhost/43333-EventThread] zookeeper.ZKWatcher(600): master:37893-0x1003f9df0080000, quorum=127.0.0.1:63275, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-10 19:03:29,939 DEBUG [Listener at localhost/43333-EventThread] zookeeper.ZKWatcher(600): master:37893-0x1003f9df0080000, quorum=127.0.0.1:63275, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,34041,1676055807665 2023-02-10 19:03:29,939 DEBUG [Listener at localhost/43333-EventThread] zookeeper.ZKWatcher(600): master:37893-0x1003f9df0080000, quorum=127.0.0.1:63275, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-10 19:03:29,939 DEBUG [Listener at localhost/43333-EventThread] zookeeper.ZKWatcher(600): master:37893-0x1003f9df0080000, quorum=127.0.0.1:63275, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-10 19:03:29,939 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-10 19:03:29,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-10 19:03:29,939 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-10 19:03:29,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-10 19:03:30,038 DEBUG [Listener at localhost/43333] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-10 19:03:30,039 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37893] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-10 19:03:30,043 INFO [Listener at localhost/43333] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "foo" table: "testRestoreSnapshotDoesNotCreateBackRefLinks" creation_time: 1676055809428 type: FLUSH version: 2 ttl: 0 2023-02-10 19:03:30,043 DEBUG [Listener at localhost/43333] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost:46481/user/jenkins/test-data/93e3558d-ad6f-9653-de92-8c8ff3bfbbad/foo/294e5257-a285-4666-b2a0-055a79861f62/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-10 19:03:30,043 INFO [Listener at localhost/43333] snapshot.RestoreSnapshotHelper(239): region to add: 9c356df832f83d5f6950ac25cf1e150f 2023-02-10 19:03:30,043 INFO [Listener at localhost/43333] snapshot.RestoreSnapshotHelper(585): clone region=9c356df832f83d5f6950ac25cf1e150f as 9c356df832f83d5f6950ac25cf1e150f in snapshot foo 2023-02-10 19:03:30,044 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(7671): creating {ENCODED => 9c356df832f83d5f6950ac25cf1e150f, NAME => 'testRestoreSnapshotDoesNotCreateBackRefLinks,,1676055808703.9c356df832f83d5f6950ac25cf1e150f.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testRestoreSnapshotDoesNotCreateBackRefLinks', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:46481/user/jenkins/test-data/93e3558d-ad6f-9653-de92-8c8ff3bfbbad/foo/294e5257-a285-4666-b2a0-055a79861f62 2023-02-10 19:03:30,050 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(865): Instantiated testRestoreSnapshotDoesNotCreateBackRefLinks,,1676055808703.9c356df832f83d5f6950ac25cf1e150f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-10 19:03:30,050 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 6cc180e9b5f9451b8e887a60e530ac33 from cloned region in snapshot foo to table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-10 19:03:30,052 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink d7e603c93d674dd6bbaac9eddab581e1 from cloned region in snapshot foo to table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-10 19:03:30,053 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1603): Closing 9c356df832f83d5f6950ac25cf1e150f, disabling compactions & flushes 2023-02-10 19:03:30,053 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1625): Closing region testRestoreSnapshotDoesNotCreateBackRefLinks,,1676055808703.9c356df832f83d5f6950ac25cf1e150f. 2023-02-10 19:03:30,053 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testRestoreSnapshotDoesNotCreateBackRefLinks,,1676055808703.9c356df832f83d5f6950ac25cf1e150f. 2023-02-10 19:03:30,053 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1713): Acquired close lock on testRestoreSnapshotDoesNotCreateBackRefLinks,,1676055808703.9c356df832f83d5f6950ac25cf1e150f. after waiting 0 ms 2023-02-10 19:03:30,053 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1723): Updates disabled for region testRestoreSnapshotDoesNotCreateBackRefLinks,,1676055808703.9c356df832f83d5f6950ac25cf1e150f. 2023-02-10 19:03:30,053 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1837): Closed testRestoreSnapshotDoesNotCreateBackRefLinks,,1676055808703.9c356df832f83d5f6950ac25cf1e150f. 2023-02-10 19:03:30,053 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1557): Region close journal for 9c356df832f83d5f6950ac25cf1e150f: Waiting for close lock at 1676055810053Disabling compacts and flushes for region at 1676055810053Disabling writes for close at 1676055810053Writing region close event to WAL at 1676055810053Closed at 1676055810053 2023-02-10 19:03:30,055 INFO [Listener at localhost/43333] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "foo" table: "testRestoreSnapshotDoesNotCreateBackRefLinks" creation_time: 1676055809428 type: FLUSH version: 2 ttl: 0 2023-02-10 19:03:30,055 DEBUG [Listener at localhost/43333] snapshot.RestoreSnapshotHelper(832): Restored table dir:hdfs://localhost:46481/user/jenkins/test-data/93e3558d-ad6f-9653-de92-8c8ff3bfbbad/foo/294e5257-a285-4666-b2a0-055a79861f62 2023-02-10 19:03:30,055 DEBUG [Listener at localhost/43333] util.CommonFSUtils(682): File system contents for path hdfs://localhost:46481/user/jenkins/test-data/93e3558d-ad6f-9653-de92-8c8ff3bfbbad/foo/294e5257-a285-4666-b2a0-055a79861f62 2023-02-10 19:03:30,056 DEBUG [Listener at localhost/43333] util.CommonFSUtils(699): |-data/ 2023-02-10 19:03:30,056 DEBUG [Listener at localhost/43333] util.CommonFSUtils(699): |----default/ 2023-02-10 19:03:30,056 DEBUG [Listener at localhost/43333] util.CommonFSUtils(699): |-------testRestoreSnapshotDoesNotCreateBackRefLinks/ 2023-02-10 19:03:30,057 DEBUG [Listener at localhost/43333] util.CommonFSUtils(699): |----------9c356df832f83d5f6950ac25cf1e150f/ 2023-02-10 19:03:30,057 DEBUG [Listener at localhost/43333] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-10 19:03:30,057 DEBUG [Listener at localhost/43333] util.CommonFSUtils(699): |-------------f1/ 2023-02-10 19:03:30,057 DEBUG [Listener at localhost/43333] util.CommonFSUtils(702): |----------------testRestoreSnapshotDoesNotCreateBackRefLinks=9c356df832f83d5f6950ac25cf1e150f-6cc180e9b5f9451b8e887a60e530ac33 2023-02-10 19:03:30,057 DEBUG [Listener at localhost/43333] util.CommonFSUtils(699): |-------------f2/ 2023-02-10 19:03:30,058 DEBUG [Listener at localhost/43333] util.CommonFSUtils(702): |----------------testRestoreSnapshotDoesNotCreateBackRefLinks=9c356df832f83d5f6950ac25cf1e150f-d7e603c93d674dd6bbaac9eddab581e1 hdfs://localhost:46481/user/jenkins/test-data/63e201f6-29e3-8f69-97e1-6c13b3c652db/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/9c356df832f83d5f6950ac25cf1e150f/f1/6cc180e9b5f9451b8e887a60e530ac33 hdfs://localhost:46481/user/jenkins/test-data/63e201f6-29e3-8f69-97e1-6c13b3c652db/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/9c356df832f83d5f6950ac25cf1e150f/f1/ca23db74a0c24879bac9c8cd1b37f9eb hdfs://localhost:46481/user/jenkins/test-data/63e201f6-29e3-8f69-97e1-6c13b3c652db/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/9c356df832f83d5f6950ac25cf1e150f/f2/4b71baaf475f44c7a51dcdd7d7b5bd21 hdfs://localhost:46481/user/jenkins/test-data/63e201f6-29e3-8f69-97e1-6c13b3c652db/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/9c356df832f83d5f6950ac25cf1e150f/f2/d7e603c93d674dd6bbaac9eddab581e1 2023-02-10 19:03:30,063 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37893] master.MasterRpcServices(748): Client=jenkins//172.31.14.131 delete name: "foo" 2023-02-10 19:03:30,065 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37893] snapshot.SnapshotManager(333): Deleting snapshot: foo 2023-02-10 19:03:30,066 INFO [Listener at localhost/43333] client.HBaseAdmin$15(890): Started disable of testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-10 19:03:30,066 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37893] master.HMaster$11(2405): Client=jenkins//172.31.14.131 disable testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-10 19:03:30,067 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37893] procedure2.ProcedureExecutor(1029): Stored pid=15, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-10 19:03:30,069 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37893] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-10 19:03:30,069 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676055810069"}]},"ts":"1676055810069"} 2023-02-10 19:03:30,071 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, state=DISABLING in hbase:meta 2023-02-10 19:03:30,074 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testRestoreSnapshotDoesNotCreateBackRefLinks to state=DISABLING 2023-02-10 19:03:30,074 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks, region=9c356df832f83d5f6950ac25cf1e150f, UNASSIGN}] 2023-02-10 19:03:30,076 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks, region=9c356df832f83d5f6950ac25cf1e150f, UNASSIGN 2023-02-10 19:03:30,076 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=9c356df832f83d5f6950ac25cf1e150f, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,45207,1676055807635 2023-02-10 19:03:30,076 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks,,1676055808703.9c356df832f83d5f6950ac25cf1e150f.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1676055810076"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676055810076"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676055810076"}]},"ts":"1676055810076"} 2023-02-10 19:03:30,078 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=17, ppid=16, state=RUNNABLE; CloseRegionProcedure 9c356df832f83d5f6950ac25cf1e150f, server=jenkins-hbase4.apache.org,45207,1676055807635}] 2023-02-10 19:03:30,171 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37893] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-10 19:03:30,230 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 9c356df832f83d5f6950ac25cf1e150f 2023-02-10 19:03:30,230 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 9c356df832f83d5f6950ac25cf1e150f, disabling compactions & flushes 2023-02-10 19:03:30,230 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testRestoreSnapshotDoesNotCreateBackRefLinks,,1676055808703.9c356df832f83d5f6950ac25cf1e150f. 2023-02-10 19:03:30,230 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testRestoreSnapshotDoesNotCreateBackRefLinks,,1676055808703.9c356df832f83d5f6950ac25cf1e150f. 2023-02-10 19:03:30,230 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testRestoreSnapshotDoesNotCreateBackRefLinks,,1676055808703.9c356df832f83d5f6950ac25cf1e150f. after waiting 0 ms 2023-02-10 19:03:30,230 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testRestoreSnapshotDoesNotCreateBackRefLinks,,1676055808703.9c356df832f83d5f6950ac25cf1e150f. 2023-02-10 19:03:30,233 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46481/user/jenkins/test-data/63e201f6-29e3-8f69-97e1-6c13b3c652db/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/9c356df832f83d5f6950ac25cf1e150f/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-10 19:03:30,234 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testRestoreSnapshotDoesNotCreateBackRefLinks,,1676055808703.9c356df832f83d5f6950ac25cf1e150f. 2023-02-10 19:03:30,234 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 9c356df832f83d5f6950ac25cf1e150f: Waiting for close lock at 1676055810230Running coprocessor pre-close hooks at 1676055810230Disabling compacts and flushes for region at 1676055810230Disabling writes for close at 1676055810230Writing region close event to WAL at 1676055810231 (+1 ms)Running coprocessor post-close hooks at 1676055810234 (+3 ms)Closed at 1676055810234 2023-02-10 19:03:30,235 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 9c356df832f83d5f6950ac25cf1e150f 2023-02-10 19:03:30,236 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=9c356df832f83d5f6950ac25cf1e150f, regionState=CLOSED 2023-02-10 19:03:30,236 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks,,1676055808703.9c356df832f83d5f6950ac25cf1e150f.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1676055810236"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676055810236"}]},"ts":"1676055810236"} 2023-02-10 19:03:30,238 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=17, resume processing ppid=16 2023-02-10 19:03:30,238 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=16, state=SUCCESS; CloseRegionProcedure 9c356df832f83d5f6950ac25cf1e150f, server=jenkins-hbase4.apache.org,45207,1676055807635 in 160 msec 2023-02-10 19:03:30,239 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=16, resume processing ppid=15 2023-02-10 19:03:30,239 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=15, state=SUCCESS; TransitRegionStateProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks, region=9c356df832f83d5f6950ac25cf1e150f, UNASSIGN in 164 msec 2023-02-10 19:03:30,240 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676055810240"}]},"ts":"1676055810240"} 2023-02-10 19:03:30,241 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, state=DISABLED in hbase:meta 2023-02-10 19:03:30,242 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testRestoreSnapshotDoesNotCreateBackRefLinks to state=DISABLED 2023-02-10 19:03:30,244 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=15, state=SUCCESS; DisableTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks in 177 msec 2023-02-10 19:03:30,372 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37893] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-10 19:03:30,373 INFO [Listener at localhost/43333] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testRestoreSnapshotDoesNotCreateBackRefLinks, procId: 15 completed 2023-02-10 19:03:30,373 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37893] master.HMaster$5(2215): Client=jenkins//172.31.14.131 delete testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-10 19:03:30,374 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37893] procedure2.ProcedureExecutor(1029): Stored pid=18, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-10 19:03:30,376 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=18, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-10 19:03:30,376 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=18, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-10 19:03:30,377 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37893] master.MasterRpcServices(1227): Checking to see if procedure is done pid=18 2023-02-10 19:03:30,379 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46481/user/jenkins/test-data/63e201f6-29e3-8f69-97e1-6c13b3c652db/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/9c356df832f83d5f6950ac25cf1e150f 2023-02-10 19:03:30,381 DEBUG [HFileArchiver-7] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:46481/user/jenkins/test-data/63e201f6-29e3-8f69-97e1-6c13b3c652db/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/9c356df832f83d5f6950ac25cf1e150f/f1, FileablePath, hdfs://localhost:46481/user/jenkins/test-data/63e201f6-29e3-8f69-97e1-6c13b3c652db/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/9c356df832f83d5f6950ac25cf1e150f/f2, FileablePath, hdfs://localhost:46481/user/jenkins/test-data/63e201f6-29e3-8f69-97e1-6c13b3c652db/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/9c356df832f83d5f6950ac25cf1e150f/recovered.edits] 2023-02-10 19:03:30,384 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46481/user/jenkins/test-data/63e201f6-29e3-8f69-97e1-6c13b3c652db/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/9c356df832f83d5f6950ac25cf1e150f/f1/6cc180e9b5f9451b8e887a60e530ac33 to hdfs://localhost:46481/user/jenkins/test-data/63e201f6-29e3-8f69-97e1-6c13b3c652db/archive/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/9c356df832f83d5f6950ac25cf1e150f/f1/6cc180e9b5f9451b8e887a60e530ac33 2023-02-10 19:03:30,386 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46481/user/jenkins/test-data/63e201f6-29e3-8f69-97e1-6c13b3c652db/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/9c356df832f83d5f6950ac25cf1e150f/f1/ca23db74a0c24879bac9c8cd1b37f9eb to hdfs://localhost:46481/user/jenkins/test-data/63e201f6-29e3-8f69-97e1-6c13b3c652db/archive/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/9c356df832f83d5f6950ac25cf1e150f/f1/ca23db74a0c24879bac9c8cd1b37f9eb 2023-02-10 19:03:30,388 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46481/user/jenkins/test-data/63e201f6-29e3-8f69-97e1-6c13b3c652db/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/9c356df832f83d5f6950ac25cf1e150f/f2/4b71baaf475f44c7a51dcdd7d7b5bd21 to hdfs://localhost:46481/user/jenkins/test-data/63e201f6-29e3-8f69-97e1-6c13b3c652db/archive/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/9c356df832f83d5f6950ac25cf1e150f/f2/4b71baaf475f44c7a51dcdd7d7b5bd21 2023-02-10 19:03:30,389 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46481/user/jenkins/test-data/63e201f6-29e3-8f69-97e1-6c13b3c652db/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/9c356df832f83d5f6950ac25cf1e150f/f2/d7e603c93d674dd6bbaac9eddab581e1 to hdfs://localhost:46481/user/jenkins/test-data/63e201f6-29e3-8f69-97e1-6c13b3c652db/archive/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/9c356df832f83d5f6950ac25cf1e150f/f2/d7e603c93d674dd6bbaac9eddab581e1 2023-02-10 19:03:30,391 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46481/user/jenkins/test-data/63e201f6-29e3-8f69-97e1-6c13b3c652db/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/9c356df832f83d5f6950ac25cf1e150f/recovered.edits/12.seqid to hdfs://localhost:46481/user/jenkins/test-data/63e201f6-29e3-8f69-97e1-6c13b3c652db/archive/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/9c356df832f83d5f6950ac25cf1e150f/recovered.edits/12.seqid 2023-02-10 19:03:30,391 DEBUG [HFileArchiver-7] backup.HFileArchiver(596): Deleted hdfs://localhost:46481/user/jenkins/test-data/63e201f6-29e3-8f69-97e1-6c13b3c652db/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/9c356df832f83d5f6950ac25cf1e150f 2023-02-10 19:03:30,391 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testRestoreSnapshotDoesNotCreateBackRefLinks regions 2023-02-10 19:03:30,393 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=18, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-10 19:03:30,395 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testRestoreSnapshotDoesNotCreateBackRefLinks from hbase:meta 2023-02-10 19:03:30,397 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testRestoreSnapshotDoesNotCreateBackRefLinks' descriptor. 2023-02-10 19:03:30,400 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=18, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-10 19:03:30,400 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testRestoreSnapshotDoesNotCreateBackRefLinks' from region states. 2023-02-10 19:03:30,400 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks,,1676055808703.9c356df832f83d5f6950ac25cf1e150f.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676055810400"}]},"ts":"9223372036854775807"} 2023-02-10 19:03:30,402 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-02-10 19:03:30,402 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 9c356df832f83d5f6950ac25cf1e150f, NAME => 'testRestoreSnapshotDoesNotCreateBackRefLinks,,1676055808703.9c356df832f83d5f6950ac25cf1e150f.', STARTKEY => '', ENDKEY => ''}] 2023-02-10 19:03:30,402 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testRestoreSnapshotDoesNotCreateBackRefLinks' as deleted. 2023-02-10 19:03:30,402 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1676055810402"}]},"ts":"9223372036854775807"} 2023-02-10 19:03:30,404 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testRestoreSnapshotDoesNotCreateBackRefLinks state from META 2023-02-10 19:03:30,405 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=18, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-10 19:03:30,406 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=18, state=SUCCESS; DeleteTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks in 32 msec 2023-02-10 19:03:30,478 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37893] master.MasterRpcServices(1227): Checking to see if procedure is done pid=18 2023-02-10 19:03:30,479 INFO [Listener at localhost/43333] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testRestoreSnapshotDoesNotCreateBackRefLinks, procId: 18 completed 2023-02-10 19:03:30,479 INFO [Listener at localhost/43333] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-02-10 19:03:30,479 INFO [Listener at localhost/43333] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-10 19:03:30,479 DEBUG [Listener at localhost/43333] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x44581b4c to 127.0.0.1:63275 2023-02-10 19:03:30,479 DEBUG [Listener at localhost/43333] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-10 19:03:30,480 DEBUG [Listener at localhost/43333] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-02-10 19:03:30,480 DEBUG [Listener at localhost/43333] util.JVMClusterUtil(257): Found active master hash=1931158748, stopped=false 2023-02-10 19:03:30,480 INFO [Listener at localhost/43333] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,37893,1676055807577 2023-02-10 19:03:30,483 DEBUG [Listener at localhost/43333-EventThread] zookeeper.ZKWatcher(600): master:37893-0x1003f9df0080000, quorum=127.0.0.1:63275, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-10 19:03:30,483 DEBUG [Listener at localhost/43333-EventThread] zookeeper.ZKWatcher(600): regionserver:34041-0x1003f9df0080002, quorum=127.0.0.1:63275, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-10 19:03:30,483 DEBUG [Listener at localhost/43333-EventThread] zookeeper.ZKWatcher(600): master:37893-0x1003f9df0080000, quorum=127.0.0.1:63275, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-10 19:03:30,483 INFO [Listener at localhost/43333] procedure2.ProcedureExecutor(629): Stopping 2023-02-10 19:03:30,483 DEBUG [Listener at localhost/43333-EventThread] zookeeper.ZKWatcher(600): regionserver:45207-0x1003f9df0080001, quorum=127.0.0.1:63275, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-10 19:03:30,485 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:37893-0x1003f9df0080000, quorum=127.0.0.1:63275, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-10 19:03:30,486 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34041-0x1003f9df0080002, quorum=127.0.0.1:63275, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-10 19:03:30,486 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45207-0x1003f9df0080001, quorum=127.0.0.1:63275, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-10 19:03:30,486 DEBUG [Listener at localhost/43333] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x23d3e5f1 to 127.0.0.1:63275 2023-02-10 19:03:30,486 DEBUG [Listener at localhost/43333] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-10 19:03:30,486 INFO [Listener at localhost/43333] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,45207,1676055807635' ***** 2023-02-10 19:03:30,486 INFO [Listener at localhost/43333] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-10 19:03:30,486 INFO [Listener at localhost/43333] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,34041,1676055807665' ***** 2023-02-10 19:03:30,486 INFO [Listener at localhost/43333] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-10 19:03:30,486 INFO [RS:1;jenkins-hbase4:34041] regionserver.HeapMemoryManager(220): Stopping 2023-02-10 19:03:30,487 INFO [RS:1;jenkins-hbase4:34041] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-10 19:03:30,487 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-10 19:03:30,487 INFO [RS:0;jenkins-hbase4:45207] regionserver.HeapMemoryManager(220): Stopping 2023-02-10 19:03:30,487 INFO [RS:1;jenkins-hbase4:34041] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-10 19:03:30,488 INFO [RS:1;jenkins-hbase4:34041] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,34041,1676055807665 2023-02-10 19:03:30,488 DEBUG [RS:1;jenkins-hbase4:34041] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2ce49632 to 127.0.0.1:63275 2023-02-10 19:03:30,488 DEBUG [RS:1;jenkins-hbase4:34041] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-10 19:03:30,488 INFO [RS:1;jenkins-hbase4:34041] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-10 19:03:30,488 INFO [RS:1;jenkins-hbase4:34041] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-10 19:03:30,488 INFO [RS:1;jenkins-hbase4:34041] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-10 19:03:30,488 INFO [RS:1;jenkins-hbase4:34041] regionserver.HRegionServer(3304): Received CLOSE for 1588230740 2023-02-10 19:03:30,488 INFO [RS:1;jenkins-hbase4:34041] regionserver.HRegionServer(1475): Waiting on 1 regions to close 2023-02-10 19:03:30,488 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-10 19:03:30,488 INFO [RS:0;jenkins-hbase4:45207] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-10 19:03:30,488 DEBUG [RS:1;jenkins-hbase4:34041] regionserver.HRegionServer(1479): Online Regions={1588230740=hbase:meta,,1.1588230740} 2023-02-10 19:03:30,489 INFO [RS:0;jenkins-hbase4:45207] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-10 19:03:30,490 DEBUG [RS:1;jenkins-hbase4:34041] regionserver.HRegionServer(1505): Waiting on 1588230740 2023-02-10 19:03:30,490 INFO [RS:0;jenkins-hbase4:45207] regionserver.HRegionServer(3304): Received CLOSE for e5b95c90e9670cbeb3b400623aa28a39 2023-02-10 19:03:30,490 INFO [RS:0;jenkins-hbase4:45207] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,45207,1676055807635 2023-02-10 19:03:30,490 DEBUG [RS:0;jenkins-hbase4:45207] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x473de215 to 127.0.0.1:63275 2023-02-10 19:03:30,490 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing e5b95c90e9670cbeb3b400623aa28a39, disabling compactions & flushes 2023-02-10 19:03:30,490 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676055808227.e5b95c90e9670cbeb3b400623aa28a39. 2023-02-10 19:03:30,490 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676055808227.e5b95c90e9670cbeb3b400623aa28a39. 2023-02-10 19:03:30,490 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676055808227.e5b95c90e9670cbeb3b400623aa28a39. after waiting 0 ms 2023-02-10 19:03:30,488 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-10 19:03:30,490 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676055808227.e5b95c90e9670cbeb3b400623aa28a39. 2023-02-10 19:03:30,490 DEBUG [RS:0;jenkins-hbase4:45207] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-10 19:03:30,490 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing e5b95c90e9670cbeb3b400623aa28a39 1/1 column families, dataSize=78 B heapSize=488 B 2023-02-10 19:03:30,490 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-10 19:03:30,490 INFO [RS:0;jenkins-hbase4:45207] regionserver.HRegionServer(1475): Waiting on 1 regions to close 2023-02-10 19:03:30,490 DEBUG [RS:0;jenkins-hbase4:45207] regionserver.HRegionServer(1479): Online Regions={e5b95c90e9670cbeb3b400623aa28a39=hbase:namespace,,1676055808227.e5b95c90e9670cbeb3b400623aa28a39.} 2023-02-10 19:03:30,490 DEBUG [RS:0;jenkins-hbase4:45207] regionserver.HRegionServer(1505): Waiting on e5b95c90e9670cbeb3b400623aa28a39 2023-02-10 19:03:30,491 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-10 19:03:30,491 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-10 19:03:30,491 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-10 19:03:30,491 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 1588230740 3/3 column families, dataSize=4.46 KB heapSize=7.87 KB 2023-02-10 19:03:30,507 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:46481/user/jenkins/test-data/63e201f6-29e3-8f69-97e1-6c13b3c652db/data/hbase/namespace/e5b95c90e9670cbeb3b400623aa28a39/.tmp/info/cc65502b6e304a20b87090ba77fe5a1f 2023-02-10 19:03:30,508 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.77 KB at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:46481/user/jenkins/test-data/63e201f6-29e3-8f69-97e1-6c13b3c652db/data/hbase/meta/1588230740/.tmp/info/3963e200daaa4e51afa765d7bc81733b 2023-02-10 19:03:30,514 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46481/user/jenkins/test-data/63e201f6-29e3-8f69-97e1-6c13b3c652db/data/hbase/namespace/e5b95c90e9670cbeb3b400623aa28a39/.tmp/info/cc65502b6e304a20b87090ba77fe5a1f as hdfs://localhost:46481/user/jenkins/test-data/63e201f6-29e3-8f69-97e1-6c13b3c652db/data/hbase/namespace/e5b95c90e9670cbeb3b400623aa28a39/info/cc65502b6e304a20b87090ba77fe5a1f 2023-02-10 19:03:30,514 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 3963e200daaa4e51afa765d7bc81733b 2023-02-10 19:03:30,518 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:46481/user/jenkins/test-data/63e201f6-29e3-8f69-97e1-6c13b3c652db/data/hbase/namespace/e5b95c90e9670cbeb3b400623aa28a39/info/cc65502b6e304a20b87090ba77fe5a1f, entries=2, sequenceid=6, filesize=4.8 K 2023-02-10 19:03:30,519 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for e5b95c90e9670cbeb3b400623aa28a39 in 29ms, sequenceid=6, compaction requested=false 2023-02-10 19:03:30,523 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:46481/user/jenkins/test-data/63e201f6-29e3-8f69-97e1-6c13b3c652db/data/hbase/meta/1588230740/.tmp/rep_barrier/85eae622d2c34b3d904415754e7c384c 2023-02-10 19:03:30,523 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46481/user/jenkins/test-data/63e201f6-29e3-8f69-97e1-6c13b3c652db/data/hbase/namespace/e5b95c90e9670cbeb3b400623aa28a39/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-02-10 19:03:30,524 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676055808227.e5b95c90e9670cbeb3b400623aa28a39. 2023-02-10 19:03:30,524 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for e5b95c90e9670cbeb3b400623aa28a39: Waiting for close lock at 1676055810490Running coprocessor pre-close hooks at 1676055810490Disabling compacts and flushes for region at 1676055810490Disabling writes for close at 1676055810490Obtaining lock to block concurrent updates at 1676055810490Preparing flush snapshotting stores in e5b95c90e9670cbeb3b400623aa28a39 at 1676055810490Finished memstore snapshotting hbase:namespace,,1676055808227.e5b95c90e9670cbeb3b400623aa28a39., syncing WAL and waiting on mvcc, flushsize=dataSize=78, getHeapSize=472, getOffHeapSize=0, getCellsCount=2 at 1676055810491 (+1 ms)Flushing stores of hbase:namespace,,1676055808227.e5b95c90e9670cbeb3b400623aa28a39. at 1676055810492 (+1 ms)Flushing e5b95c90e9670cbeb3b400623aa28a39/info: creating writer at 1676055810492Flushing e5b95c90e9670cbeb3b400623aa28a39/info: appending metadata at 1676055810494 (+2 ms)Flushing e5b95c90e9670cbeb3b400623aa28a39/info: closing flushed file at 1676055810494Flushing e5b95c90e9670cbeb3b400623aa28a39/info: reopening flushed file at 1676055810514 (+20 ms)Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for e5b95c90e9670cbeb3b400623aa28a39 in 29ms, sequenceid=6, compaction requested=false at 1676055810519 (+5 ms)Writing region close event to WAL at 1676055810520 (+1 ms)Running coprocessor post-close hooks at 1676055810524 (+4 ms)Closed at 1676055810524 2023-02-10 19:03:30,525 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1676055808227.e5b95c90e9670cbeb3b400623aa28a39. 2023-02-10 19:03:30,527 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 85eae622d2c34b3d904415754e7c384c 2023-02-10 19:03:30,542 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-10 19:03:30,543 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-10 19:03:30,547 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=590 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:46481/user/jenkins/test-data/63e201f6-29e3-8f69-97e1-6c13b3c652db/data/hbase/meta/1588230740/.tmp/table/f0ef30252ece42c3bf1437558ecc05b8 2023-02-10 19:03:30,551 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for f0ef30252ece42c3bf1437558ecc05b8 2023-02-10 19:03:30,552 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46481/user/jenkins/test-data/63e201f6-29e3-8f69-97e1-6c13b3c652db/data/hbase/meta/1588230740/.tmp/info/3963e200daaa4e51afa765d7bc81733b as hdfs://localhost:46481/user/jenkins/test-data/63e201f6-29e3-8f69-97e1-6c13b3c652db/data/hbase/meta/1588230740/info/3963e200daaa4e51afa765d7bc81733b 2023-02-10 19:03:30,556 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 3963e200daaa4e51afa765d7bc81733b 2023-02-10 19:03:30,557 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:46481/user/jenkins/test-data/63e201f6-29e3-8f69-97e1-6c13b3c652db/data/hbase/meta/1588230740/info/3963e200daaa4e51afa765d7bc81733b, entries=12, sequenceid=21, filesize=6.3 K 2023-02-10 19:03:30,557 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46481/user/jenkins/test-data/63e201f6-29e3-8f69-97e1-6c13b3c652db/data/hbase/meta/1588230740/.tmp/rep_barrier/85eae622d2c34b3d904415754e7c384c as hdfs://localhost:46481/user/jenkins/test-data/63e201f6-29e3-8f69-97e1-6c13b3c652db/data/hbase/meta/1588230740/rep_barrier/85eae622d2c34b3d904415754e7c384c 2023-02-10 19:03:30,562 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 85eae622d2c34b3d904415754e7c384c 2023-02-10 19:03:30,562 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:46481/user/jenkins/test-data/63e201f6-29e3-8f69-97e1-6c13b3c652db/data/hbase/meta/1588230740/rep_barrier/85eae622d2c34b3d904415754e7c384c, entries=1, sequenceid=21, filesize=5.1 K 2023-02-10 19:03:30,562 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46481/user/jenkins/test-data/63e201f6-29e3-8f69-97e1-6c13b3c652db/data/hbase/meta/1588230740/.tmp/table/f0ef30252ece42c3bf1437558ecc05b8 as hdfs://localhost:46481/user/jenkins/test-data/63e201f6-29e3-8f69-97e1-6c13b3c652db/data/hbase/meta/1588230740/table/f0ef30252ece42c3bf1437558ecc05b8 2023-02-10 19:03:30,568 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for f0ef30252ece42c3bf1437558ecc05b8 2023-02-10 19:03:30,568 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:46481/user/jenkins/test-data/63e201f6-29e3-8f69-97e1-6c13b3c652db/data/hbase/meta/1588230740/table/f0ef30252ece42c3bf1437558ecc05b8, entries=4, sequenceid=21, filesize=5.1 K 2023-02-10 19:03:30,569 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~4.46 KB/4572, heapSize ~7.82 KB/8008, currentSize=0 B/0 for 1588230740 in 78ms, sequenceid=21, compaction requested=false 2023-02-10 19:03:30,573 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46481/user/jenkins/test-data/63e201f6-29e3-8f69-97e1-6c13b3c652db/data/hbase/meta/1588230740/recovered.edits/24.seqid, newMaxSeqId=24, maxSeqId=1 2023-02-10 19:03:30,573 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-10 19:03:30,574 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-10 19:03:30,574 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1676055810488Running coprocessor pre-close hooks at 1676055810488Disabling compacts and flushes for region at 1676055810488Disabling writes for close at 1676055810491 (+3 ms)Obtaining lock to block concurrent updates at 1676055810491Preparing flush snapshotting stores in 1588230740 at 1676055810491Finished memstore snapshotting hbase:meta,,1.1588230740, syncing WAL and waiting on mvcc, flushsize=dataSize=4572, getHeapSize=8008, getOffHeapSize=0, getCellsCount=36 at 1676055810491Flushing stores of hbase:meta,,1.1588230740 at 1676055810492 (+1 ms)Flushing 1588230740/info: creating writer at 1676055810492Flushing 1588230740/info: appending metadata at 1676055810494 (+2 ms)Flushing 1588230740/info: closing flushed file at 1676055810494Flushing 1588230740/rep_barrier: creating writer at 1676055810514 (+20 ms)Flushing 1588230740/rep_barrier: appending metadata at 1676055810516 (+2 ms)Flushing 1588230740/rep_barrier: closing flushed file at 1676055810516Flushing 1588230740/table: creating writer at 1676055810528 (+12 ms)Flushing 1588230740/table: appending metadata at 1676055810530 (+2 ms)Flushing 1588230740/table: closing flushed file at 1676055810530Flushing 1588230740/info: reopening flushed file at 1676055810553 (+23 ms)Flushing 1588230740/rep_barrier: reopening flushed file at 1676055810558 (+5 ms)Flushing 1588230740/table: reopening flushed file at 1676055810563 (+5 ms)Finished flush of dataSize ~4.46 KB/4572, heapSize ~7.82 KB/8008, currentSize=0 B/0 for 1588230740 in 78ms, sequenceid=21, compaction requested=false at 1676055810569 (+6 ms)Writing region close event to WAL at 1676055810570 (+1 ms)Running coprocessor post-close hooks at 1676055810573 (+3 ms)Closed at 1676055810574 (+1 ms) 2023-02-10 19:03:30,574 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-02-10 19:03:30,690 INFO [RS:1;jenkins-hbase4:34041] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,34041,1676055807665; all regions closed. 2023-02-10 19:03:30,691 INFO [RS:0;jenkins-hbase4:45207] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,45207,1676055807635; all regions closed. 2023-02-10 19:03:30,694 DEBUG [RS:0;jenkins-hbase4:45207] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/63e201f6-29e3-8f69-97e1-6c13b3c652db/oldWALs 2023-02-10 19:03:30,694 INFO [RS:0;jenkins-hbase4:45207] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C45207%2C1676055807635:(num 1676055808581) 2023-02-10 19:03:30,694 DEBUG [RS:1;jenkins-hbase4:34041] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/63e201f6-29e3-8f69-97e1-6c13b3c652db/oldWALs 2023-02-10 19:03:30,694 DEBUG [RS:0;jenkins-hbase4:45207] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-10 19:03:30,694 INFO [RS:1;jenkins-hbase4:34041] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C34041%2C1676055807665.meta:.meta(num 1676055808171) 2023-02-10 19:03:30,695 INFO [RS:0;jenkins-hbase4:45207] regionserver.LeaseManager(133): Closed leases 2023-02-10 19:03:30,695 INFO [RS:0;jenkins-hbase4:45207] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-02-10 19:03:30,695 INFO [RS:0;jenkins-hbase4:45207] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-10 19:03:30,695 INFO [RS:0;jenkins-hbase4:45207] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-10 19:03:30,695 INFO [RS:0;jenkins-hbase4:45207] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-10 19:03:30,695 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-10 19:03:30,696 INFO [RS:0;jenkins-hbase4:45207] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:45207 2023-02-10 19:03:30,699 DEBUG [Listener at localhost/43333-EventThread] zookeeper.ZKWatcher(600): regionserver:45207-0x1003f9df0080001, quorum=127.0.0.1:63275, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,45207,1676055807635 2023-02-10 19:03:30,700 DEBUG [Listener at localhost/43333-EventThread] zookeeper.ZKWatcher(600): regionserver:34041-0x1003f9df0080002, quorum=127.0.0.1:63275, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,45207,1676055807635 2023-02-10 19:03:30,700 ERROR [Listener at localhost/43333-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@7d6f14e4 rejected from java.util.concurrent.ThreadPoolExecutor@79509f91[Shutting down, pool size = 1, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-10 19:03:30,700 DEBUG [Listener at localhost/43333-EventThread] zookeeper.ZKWatcher(600): regionserver:34041-0x1003f9df0080002, quorum=127.0.0.1:63275, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-10 19:03:30,700 DEBUG [Listener at localhost/43333-EventThread] zookeeper.ZKWatcher(600): master:37893-0x1003f9df0080000, quorum=127.0.0.1:63275, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-10 19:03:30,700 DEBUG [Listener at localhost/43333-EventThread] zookeeper.ZKWatcher(600): regionserver:45207-0x1003f9df0080001, quorum=127.0.0.1:63275, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-10 19:03:30,700 ERROR [Listener at localhost/43333-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@8e9ea48 rejected from java.util.concurrent.ThreadPoolExecutor@79509f91[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-10 19:03:30,701 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,45207,1676055807635] 2023-02-10 19:03:30,701 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,45207,1676055807635; numProcessing=1 2023-02-10 19:03:30,701 DEBUG [RS:1;jenkins-hbase4:34041] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/63e201f6-29e3-8f69-97e1-6c13b3c652db/oldWALs 2023-02-10 19:03:30,701 INFO [RS:1;jenkins-hbase4:34041] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C34041%2C1676055807665:(num 1676055808965) 2023-02-10 19:03:30,701 DEBUG [RS:1;jenkins-hbase4:34041] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-10 19:03:30,701 INFO [RS:1;jenkins-hbase4:34041] regionserver.LeaseManager(133): Closed leases 2023-02-10 19:03:30,702 INFO [RS:1;jenkins-hbase4:34041] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-02-10 19:03:30,702 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-10 19:03:30,702 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,45207,1676055807635 already deleted, retry=false 2023-02-10 19:03:30,702 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,45207,1676055807635 expired; onlineServers=1 2023-02-10 19:03:30,702 INFO [RS:1;jenkins-hbase4:34041] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:34041 2023-02-10 19:03:30,703 DEBUG [Listener at localhost/43333-EventThread] zookeeper.ZKWatcher(600): regionserver:34041-0x1003f9df0080002, quorum=127.0.0.1:63275, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,34041,1676055807665 2023-02-10 19:03:30,703 DEBUG [Listener at localhost/43333-EventThread] zookeeper.ZKWatcher(600): master:37893-0x1003f9df0080000, quorum=127.0.0.1:63275, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-10 19:03:30,703 ERROR [Listener at localhost/43333-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@f2cce87 rejected from java.util.concurrent.ThreadPoolExecutor@b135bba[Shutting down, pool size = 1, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-10 19:03:30,705 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,34041,1676055807665] 2023-02-10 19:03:30,706 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,34041,1676055807665; numProcessing=2 2023-02-10 19:03:30,706 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,34041,1676055807665 already deleted, retry=false 2023-02-10 19:03:30,706 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,34041,1676055807665 expired; onlineServers=0 2023-02-10 19:03:30,706 INFO [RegionServerTracker-0] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,37893,1676055807577' ***** 2023-02-10 19:03:30,706 INFO [RegionServerTracker-0] regionserver.HRegionServer(2310): STOPPED: Cluster shutdown set; onlineServer=0 2023-02-10 19:03:30,707 DEBUG [M:0;jenkins-hbase4:37893] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7724ae67, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-10 19:03:30,707 INFO [M:0;jenkins-hbase4:37893] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,37893,1676055807577 2023-02-10 19:03:30,707 INFO [M:0;jenkins-hbase4:37893] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,37893,1676055807577; all regions closed. 2023-02-10 19:03:30,707 DEBUG [M:0;jenkins-hbase4:37893] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-10 19:03:30,707 DEBUG [M:0;jenkins-hbase4:37893] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-02-10 19:03:30,707 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-02-10 19:03:30,707 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676055807818] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676055807818,5,FailOnTimeoutGroup] 2023-02-10 19:03:30,707 DEBUG [M:0;jenkins-hbase4:37893] cleaner.HFileCleaner(317): Stopping file delete threads 2023-02-10 19:03:30,707 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676055807818] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676055807818,5,FailOnTimeoutGroup] 2023-02-10 19:03:30,708 INFO [M:0;jenkins-hbase4:37893] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-02-10 19:03:30,709 INFO [M:0;jenkins-hbase4:37893] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-02-10 19:03:30,709 INFO [M:0;jenkins-hbase4:37893] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-02-10 19:03:30,709 DEBUG [M:0;jenkins-hbase4:37893] master.HMaster(1502): Stopping service threads 2023-02-10 19:03:30,709 INFO [M:0;jenkins-hbase4:37893] procedure2.RemoteProcedureDispatcher(118): Stopping procedure remote dispatcher 2023-02-10 19:03:30,709 ERROR [M:0;jenkins-hbase4:37893] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-02-10 19:03:30,709 DEBUG [Listener at localhost/43333-EventThread] zookeeper.ZKWatcher(600): master:37893-0x1003f9df0080000, quorum=127.0.0.1:63275, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-02-10 19:03:30,709 DEBUG [Listener at localhost/43333-EventThread] zookeeper.ZKWatcher(600): master:37893-0x1003f9df0080000, quorum=127.0.0.1:63275, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-10 19:03:30,710 INFO [M:0;jenkins-hbase4:37893] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-02-10 19:03:30,710 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-02-10 19:03:30,710 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:37893-0x1003f9df0080000, quorum=127.0.0.1:63275, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-10 19:03:30,710 DEBUG [M:0;jenkins-hbase4:37893] zookeeper.ZKUtil(398): master:37893-0x1003f9df0080000, quorum=127.0.0.1:63275, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-02-10 19:03:30,710 WARN [M:0;jenkins-hbase4:37893] master.ActiveMasterManager(323): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-02-10 19:03:30,710 INFO [M:0;jenkins-hbase4:37893] assignment.AssignmentManager(315): Stopping assignment manager 2023-02-10 19:03:30,711 INFO [M:0;jenkins-hbase4:37893] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-02-10 19:03:30,711 DEBUG [M:0;jenkins-hbase4:37893] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-10 19:03:30,711 INFO [M:0;jenkins-hbase4:37893] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-10 19:03:30,711 DEBUG [M:0;jenkins-hbase4:37893] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-10 19:03:30,711 DEBUG [M:0;jenkins-hbase4:37893] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-10 19:03:30,711 DEBUG [M:0;jenkins-hbase4:37893] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-10 19:03:30,711 INFO [M:0;jenkins-hbase4:37893] regionserver.HRegion(2744): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=56.64 KB heapSize=67.60 KB 2023-02-10 19:03:30,720 INFO [M:0;jenkins-hbase4:37893] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=56.64 KB at sequenceid=132 (bloomFilter=true), to=hdfs://localhost:46481/user/jenkins/test-data/63e201f6-29e3-8f69-97e1-6c13b3c652db/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/8adf58bf8fdf446992a8fea714683104 2023-02-10 19:03:30,723 DEBUG [M:0;jenkins-hbase4:37893] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46481/user/jenkins/test-data/63e201f6-29e3-8f69-97e1-6c13b3c652db/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/8adf58bf8fdf446992a8fea714683104 as hdfs://localhost:46481/user/jenkins/test-data/63e201f6-29e3-8f69-97e1-6c13b3c652db/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/8adf58bf8fdf446992a8fea714683104 2023-02-10 19:03:30,726 INFO [M:0;jenkins-hbase4:37893] regionserver.HStore(1080): Added hdfs://localhost:46481/user/jenkins/test-data/63e201f6-29e3-8f69-97e1-6c13b3c652db/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/8adf58bf8fdf446992a8fea714683104, entries=17, sequenceid=132, filesize=8.7 K 2023-02-10 19:03:30,727 INFO [M:0;jenkins-hbase4:37893] regionserver.HRegion(2947): Finished flush of dataSize ~56.64 KB/58001, heapSize ~67.59 KB/69208, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 16ms, sequenceid=132, compaction requested=false 2023-02-10 19:03:30,727 INFO [M:0;jenkins-hbase4:37893] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-10 19:03:30,727 DEBUG [M:0;jenkins-hbase4:37893] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1676055810711Disabling compacts and flushes for region at 1676055810711Disabling writes for close at 1676055810711Obtaining lock to block concurrent updates at 1676055810711Preparing flush snapshotting stores in 1595e783b53d99cd5eef43b6debb2682 at 1676055810711Finished memstore snapshotting master:store,,1.1595e783b53d99cd5eef43b6debb2682., syncing WAL and waiting on mvcc, flushsize=dataSize=58001, getHeapSize=69208, getOffHeapSize=0, getCellsCount=145 at 1676055810711Flushing stores of master:store,,1.1595e783b53d99cd5eef43b6debb2682. at 1676055810712 (+1 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: creating writer at 1676055810712Flushing 1595e783b53d99cd5eef43b6debb2682/proc: appending metadata at 1676055810714 (+2 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: closing flushed file at 1676055810714Flushing 1595e783b53d99cd5eef43b6debb2682/proc: reopening flushed file at 1676055810723 (+9 ms)Finished flush of dataSize ~56.64 KB/58001, heapSize ~67.59 KB/69208, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 16ms, sequenceid=132, compaction requested=false at 1676055810727 (+4 ms)Writing region close event to WAL at 1676055810727Closed at 1676055810727 2023-02-10 19:03:30,729 INFO [M:0;jenkins-hbase4:37893] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-02-10 19:03:30,729 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-10 19:03:30,730 INFO [M:0;jenkins-hbase4:37893] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:37893 2023-02-10 19:03:30,731 DEBUG [M:0;jenkins-hbase4:37893] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,37893,1676055807577 already deleted, retry=false 2023-02-10 19:03:30,884 DEBUG [Listener at localhost/43333-EventThread] zookeeper.ZKWatcher(600): master:37893-0x1003f9df0080000, quorum=127.0.0.1:63275, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-10 19:03:30,884 INFO [M:0;jenkins-hbase4:37893] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,37893,1676055807577; zookeeper connection closed. 2023-02-10 19:03:30,884 ERROR [Listener at localhost/43333-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@312c4d1f rejected from java.util.concurrent.ThreadPoolExecutor@3513dfe2[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 51] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-10 19:03:30,885 DEBUG [Listener at localhost/43333-EventThread] zookeeper.ZKWatcher(600): master:37893-0x1003f9df0080000, quorum=127.0.0.1:63275, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-10 19:03:30,885 ERROR [Listener at localhost/43333-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@123c3290 rejected from java.util.concurrent.ThreadPoolExecutor@3513dfe2[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 51] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-10 19:03:30,984 DEBUG [Listener at localhost/43333-EventThread] zookeeper.ZKWatcher(600): regionserver:34041-0x1003f9df0080002, quorum=127.0.0.1:63275, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-10 19:03:30,984 INFO [RS:1;jenkins-hbase4:34041] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,34041,1676055807665; zookeeper connection closed. 2023-02-10 19:03:30,984 ERROR [Listener at localhost/43333-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@1624d0d4 rejected from java.util.concurrent.ThreadPoolExecutor@b135bba[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-10 19:03:30,985 DEBUG [Listener at localhost/43333-EventThread] zookeeper.ZKWatcher(600): regionserver:34041-0x1003f9df0080002, quorum=127.0.0.1:63275, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-10 19:03:30,985 ERROR [Listener at localhost/43333-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@6e4a26a2 rejected from java.util.concurrent.ThreadPoolExecutor@b135bba[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-10 19:03:30,985 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@413dab5e] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@413dab5e 2023-02-10 19:03:31,085 DEBUG [Listener at localhost/43333-EventThread] zookeeper.ZKWatcher(600): regionserver:45207-0x1003f9df0080001, quorum=127.0.0.1:63275, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-10 19:03:31,085 INFO [RS:0;jenkins-hbase4:45207] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,45207,1676055807635; zookeeper connection closed. 2023-02-10 19:03:31,085 ERROR [Listener at localhost/43333-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@7075ada7 rejected from java.util.concurrent.ThreadPoolExecutor@79509f91[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-10 19:03:31,085 DEBUG [Listener at localhost/43333-EventThread] zookeeper.ZKWatcher(600): regionserver:45207-0x1003f9df0080001, quorum=127.0.0.1:63275, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-10 19:03:31,085 ERROR [Listener at localhost/43333-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@1b01ebfd rejected from java.util.concurrent.ThreadPoolExecutor@79509f91[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-10 19:03:31,085 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@4f02caf1] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@4f02caf1 2023-02-10 19:03:31,085 INFO [Listener at localhost/43333] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 2 regionserver(s) complete 2023-02-10 19:03:31,085 WARN [Listener at localhost/43333] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-10 19:03:31,089 INFO [Listener at localhost/43333] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-10 19:03:31,108 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-datanode.properties,hadoop-metrics2.properties 2023-02-10 19:03:31,213 WARN [BP-3865108-172.31.14.131-1676055806969 heartbeating to localhost/127.0.0.1:46481] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-10 19:03:31,213 WARN [BP-3865108-172.31.14.131-1676055806969 heartbeating to localhost/127.0.0.1:46481] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-3865108-172.31.14.131-1676055806969 (Datanode Uuid 16595f6c-a896-4a2c-a79f-342c8c4176c1) service to localhost/127.0.0.1:46481 2023-02-10 19:03:31,213 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/28680927-81f3-7a5f-7d41-92c2bdf9d0e7/cluster_fff7820c-d868-c12f-2712-33948defcaf2/dfs/data/data3/current/BP-3865108-172.31.14.131-1676055806969] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-10 19:03:31,214 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/28680927-81f3-7a5f-7d41-92c2bdf9d0e7/cluster_fff7820c-d868-c12f-2712-33948defcaf2/dfs/data/data4/current/BP-3865108-172.31.14.131-1676055806969] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-10 19:03:31,215 WARN [Listener at localhost/43333] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-10 19:03:31,222 INFO [Listener at localhost/43333] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-10 19:03:31,328 WARN [BP-3865108-172.31.14.131-1676055806969 heartbeating to localhost/127.0.0.1:46481] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-10 19:03:31,328 WARN [BP-3865108-172.31.14.131-1676055806969 heartbeating to localhost/127.0.0.1:46481] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-3865108-172.31.14.131-1676055806969 (Datanode Uuid cc416288-29cd-4827-a5fc-04e801d59691) service to localhost/127.0.0.1:46481 2023-02-10 19:03:31,328 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/28680927-81f3-7a5f-7d41-92c2bdf9d0e7/cluster_fff7820c-d868-c12f-2712-33948defcaf2/dfs/data/data1/current/BP-3865108-172.31.14.131-1676055806969] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-10 19:03:31,329 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/28680927-81f3-7a5f-7d41-92c2bdf9d0e7/cluster_fff7820c-d868-c12f-2712-33948defcaf2/dfs/data/data2/current/BP-3865108-172.31.14.131-1676055806969] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-10 19:03:31,339 INFO [Listener at localhost/43333] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-10 19:03:31,457 INFO [Listener at localhost/43333] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-02-10 19:03:31,475 INFO [Listener at localhost/43333] hbase.HBaseTestingUtility(1293): Minicluster is down 2023-02-10 19:03:31,488 INFO [Listener at localhost/43333] hbase.ResourceChecker(175): after: mapred.TestTableSnapshotInputFormat#testRestoreSnapshotDoesNotCreateBackRefLinks Thread=274 (was 252) Potentially hanging thread: IPC Client (1688088802) connection to localhost/127.0.0.1:46481 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-16 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-19-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.11@localhost:46481 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-25-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/43333 java.lang.Thread.dumpThreads(Native Method) java.lang.Thread.getAllStackTraces(Thread.java:1615) org.apache.hadoop.hbase.ResourceCheckerJUnitListener$ThreadResourceAnalyzer.getVal(ResourceCheckerJUnitListener.java:49) org.apache.hadoop.hbase.ResourceChecker.fill(ResourceChecker.java:110) org.apache.hadoop.hbase.ResourceChecker.fillEndings(ResourceChecker.java:104) org.apache.hadoop.hbase.ResourceChecker.end(ResourceChecker.java:206) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.end(ResourceCheckerJUnitListener.java:165) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.testFinished(ResourceCheckerJUnitListener.java:185) org.junit.runner.notification.SynchronizedRunListener.testFinished(SynchronizedRunListener.java:87) org.junit.runner.notification.RunNotifier$9.notifyListener(RunNotifier.java:225) org.junit.runner.notification.RunNotifier$SafeNotifier.run(RunNotifier.java:72) org.junit.runner.notification.RunNotifier.fireTestFinished(RunNotifier.java:222) org.junit.internal.runners.model.EachTestNotifier.fireTestFinished(EachTestNotifier.java:38) org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:372) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) org.apache.hadoop.hbase.SystemExitRule$1.evaluate(SystemExitRule.java:39) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-22-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-24-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-18-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-24-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1688088802) connection to localhost/127.0.0.1:46481 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-23-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-22-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-20-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-25-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1688088802) connection to localhost/127.0.0.1:46481 from jenkins.hfs.10 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-15 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-20-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-19-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-19-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.10@localhost:46481 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-20-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-24-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-18-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-25-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-22-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase4.apache.org,37893,1676055807577)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-23-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ForkJoinPool-2-worker-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.ForkJoinPool.awaitWork(ForkJoinPool.java:1824) java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1693) java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175) Potentially hanging thread: RS-EventLoopGroup-18-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-23-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1688088802) connection to localhost/127.0.0.1:46481 from jenkins.hfs.11 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: LeaseRenewer:jenkins@localhost:46481 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=584 (was 661), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=335 (was 338), ProcessCount=167 (was 167), AvailableMemoryMB=3328 (was 3381) 2023-02-10 19:03:31,498 INFO [Listener at localhost/43333] hbase.ResourceChecker(147): before: mapred.TestTableSnapshotInputFormat#testWithMapReduceSingleRegion Thread=274, OpenFileDescriptor=584, MaxFileDescriptor=60000, SystemLoadAverage=335, ProcessCount=167, AvailableMemoryMB=3328 2023-02-10 19:03:31,508 INFO [Listener at localhost/43333] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.log.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/28680927-81f3-7a5f-7d41-92c2bdf9d0e7/hadoop.log.dir so I do NOT create it in target/test-data/a17aec85-f465-d9de-1a14-2563d6e642af 2023-02-10 19:03:31,508 WARN [Listener at localhost/43333] hbase.HBaseTestingUtility(449): hadoop.log.dir property value differs in configuration and system: Configuration=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/../logs while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/28680927-81f3-7a5f-7d41-92c2bdf9d0e7/hadoop.log.dir Erasing configuration value by system value. 2023-02-10 19:03:31,508 INFO [Listener at localhost/43333] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.tmp.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/28680927-81f3-7a5f-7d41-92c2bdf9d0e7/hadoop.tmp.dir so I do NOT create it in target/test-data/a17aec85-f465-d9de-1a14-2563d6e642af 2023-02-10 19:03:31,508 WARN [Listener at localhost/43333] hbase.HBaseTestingUtility(449): hadoop.tmp.dir property value differs in configuration and system: Configuration=/tmp/hadoop-jenkins while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/28680927-81f3-7a5f-7d41-92c2bdf9d0e7/hadoop.tmp.dir Erasing configuration value by system value. 2023-02-10 19:03:31,509 DEBUG [Listener at localhost/43333] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a17aec85-f465-d9de-1a14-2563d6e642af 2023-02-10 19:03:31,509 INFO [Listener at localhost/43333] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=2, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=true, createWALDir=false} 2023-02-10 19:03:31,509 INFO [Listener at localhost/43333] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a17aec85-f465-d9de-1a14-2563d6e642af/cluster_75e09c65-3c85-ba5b-ad18-d4dc1de3eb7a, deleteOnExit=true 2023-02-10 19:03:31,509 INFO [Listener at localhost/43333] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-02-10 19:03:31,509 INFO [Listener at localhost/43333] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a17aec85-f465-d9de-1a14-2563d6e642af/test.cache.data in system properties and HBase conf 2023-02-10 19:03:31,509 INFO [Listener at localhost/43333] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a17aec85-f465-d9de-1a14-2563d6e642af/hadoop.tmp.dir in system properties and HBase conf 2023-02-10 19:03:31,509 INFO [Listener at localhost/43333] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a17aec85-f465-d9de-1a14-2563d6e642af/hadoop.log.dir in system properties and HBase conf 2023-02-10 19:03:31,509 INFO [Listener at localhost/43333] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a17aec85-f465-d9de-1a14-2563d6e642af/mapreduce.cluster.local.dir in system properties and HBase conf 2023-02-10 19:03:31,509 INFO [Listener at localhost/43333] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a17aec85-f465-d9de-1a14-2563d6e642af/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-02-10 19:03:31,509 INFO [Listener at localhost/43333] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-02-10 19:03:31,509 DEBUG [Listener at localhost/43333] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-02-10 19:03:31,510 INFO [Listener at localhost/43333] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a17aec85-f465-d9de-1a14-2563d6e642af/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-02-10 19:03:31,510 INFO [Listener at localhost/43333] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a17aec85-f465-d9de-1a14-2563d6e642af/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-02-10 19:03:31,510 INFO [Listener at localhost/43333] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a17aec85-f465-d9de-1a14-2563d6e642af/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-02-10 19:03:31,510 INFO [Listener at localhost/43333] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a17aec85-f465-d9de-1a14-2563d6e642af/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-10 19:03:31,510 INFO [Listener at localhost/43333] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a17aec85-f465-d9de-1a14-2563d6e642af/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-02-10 19:03:31,510 INFO [Listener at localhost/43333] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a17aec85-f465-d9de-1a14-2563d6e642af/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-02-10 19:03:31,510 INFO [Listener at localhost/43333] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a17aec85-f465-d9de-1a14-2563d6e642af/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-10 19:03:31,510 INFO [Listener at localhost/43333] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a17aec85-f465-d9de-1a14-2563d6e642af/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-10 19:03:31,510 INFO [Listener at localhost/43333] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a17aec85-f465-d9de-1a14-2563d6e642af/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-02-10 19:03:31,511 INFO [Listener at localhost/43333] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a17aec85-f465-d9de-1a14-2563d6e642af/nfs.dump.dir in system properties and HBase conf 2023-02-10 19:03:31,511 INFO [Listener at localhost/43333] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a17aec85-f465-d9de-1a14-2563d6e642af/java.io.tmpdir in system properties and HBase conf 2023-02-10 19:03:31,511 INFO [Listener at localhost/43333] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a17aec85-f465-d9de-1a14-2563d6e642af/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-10 19:03:31,511 INFO [Listener at localhost/43333] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a17aec85-f465-d9de-1a14-2563d6e642af/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-02-10 19:03:31,511 INFO [Listener at localhost/43333] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a17aec85-f465-d9de-1a14-2563d6e642af/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-02-10 19:03:31,515 WARN [Listener at localhost/43333] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-10 19:03:31,515 WARN [Listener at localhost/43333] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-10 19:03:31,553 WARN [Listener at localhost/43333] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-10 19:03:31,555 INFO [Listener at localhost/43333] log.Slf4jLog(67): jetty-6.1.26 2023-02-10 19:03:31,558 INFO [Listener at localhost/43333] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a17aec85-f465-d9de-1a14-2563d6e642af/java.io.tmpdir/Jetty_localhost_35021_hdfs____nosl13/webapp 2023-02-10 19:03:31,650 INFO [Listener at localhost/43333] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:35021 2023-02-10 19:03:31,654 WARN [Listener at localhost/43333] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-10 19:03:31,655 WARN [Listener at localhost/43333] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-10 19:03:31,694 WARN [Listener at localhost/41503] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-10 19:03:31,707 WARN [Listener at localhost/41503] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-10 19:03:31,709 WARN [Listener at localhost/41503] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-10 19:03:31,710 INFO [Listener at localhost/41503] log.Slf4jLog(67): jetty-6.1.26 2023-02-10 19:03:31,714 INFO [Listener at localhost/41503] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a17aec85-f465-d9de-1a14-2563d6e642af/java.io.tmpdir/Jetty_localhost_46221_datanode____.98af6y/webapp 2023-02-10 19:03:31,805 INFO [Listener at localhost/41503] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:46221 2023-02-10 19:03:31,816 WARN [Listener at localhost/34929] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-10 19:03:31,832 WARN [Listener at localhost/34929] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-10 19:03:31,834 WARN [Listener at localhost/34929] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-10 19:03:31,836 INFO [Listener at localhost/34929] log.Slf4jLog(67): jetty-6.1.26 2023-02-10 19:03:31,841 INFO [Listener at localhost/34929] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a17aec85-f465-d9de-1a14-2563d6e642af/java.io.tmpdir/Jetty_localhost_41391_datanode____.lww17/webapp 2023-02-10 19:03:31,981 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x478234dcd30a680e: Processing first storage report for DS-4b65027e-6cae-4387-b8a3-5ad3d9cdee8b from datanode 5e44e594-8365-4b10-9621-dfec9396142e 2023-02-10 19:03:31,981 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x478234dcd30a680e: from storage DS-4b65027e-6cae-4387-b8a3-5ad3d9cdee8b node DatanodeRegistration(127.0.0.1:39979, datanodeUuid=5e44e594-8365-4b10-9621-dfec9396142e, infoPort=40339, infoSecurePort=0, ipcPort=34929, storageInfo=lv=-57;cid=testClusterID;nsid=1840493049;c=1676055811517), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-10 19:03:31,981 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x478234dcd30a680e: Processing first storage report for DS-c0096399-9c32-414e-8e32-b8582e93ad22 from datanode 5e44e594-8365-4b10-9621-dfec9396142e 2023-02-10 19:03:31,981 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x478234dcd30a680e: from storage DS-c0096399-9c32-414e-8e32-b8582e93ad22 node DatanodeRegistration(127.0.0.1:39979, datanodeUuid=5e44e594-8365-4b10-9621-dfec9396142e, infoPort=40339, infoSecurePort=0, ipcPort=34929, storageInfo=lv=-57;cid=testClusterID;nsid=1840493049;c=1676055811517), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-10 19:03:31,989 INFO [Listener at localhost/34929] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:41391 2023-02-10 19:03:31,999 WARN [Listener at localhost/41565] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-10 19:03:32,093 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x1efe124784019c2a: Processing first storage report for DS-382a8945-a56a-457d-b65e-5cd96de2120a from datanode 6e1aa396-4d1a-43ea-9e93-0a5e15f5865f 2023-02-10 19:03:32,093 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x1efe124784019c2a: from storage DS-382a8945-a56a-457d-b65e-5cd96de2120a node DatanodeRegistration(127.0.0.1:38779, datanodeUuid=6e1aa396-4d1a-43ea-9e93-0a5e15f5865f, infoPort=40245, infoSecurePort=0, ipcPort=41565, storageInfo=lv=-57;cid=testClusterID;nsid=1840493049;c=1676055811517), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-10 19:03:32,093 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x1efe124784019c2a: Processing first storage report for DS-033f69d5-2995-43ec-b203-48606de1dc22 from datanode 6e1aa396-4d1a-43ea-9e93-0a5e15f5865f 2023-02-10 19:03:32,093 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x1efe124784019c2a: from storage DS-033f69d5-2995-43ec-b203-48606de1dc22 node DatanodeRegistration(127.0.0.1:38779, datanodeUuid=6e1aa396-4d1a-43ea-9e93-0a5e15f5865f, infoPort=40245, infoSecurePort=0, ipcPort=41565, storageInfo=lv=-57;cid=testClusterID;nsid=1840493049;c=1676055811517), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-10 19:03:32,109 DEBUG [Listener at localhost/41565] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a17aec85-f465-d9de-1a14-2563d6e642af 2023-02-10 19:03:32,111 INFO [Listener at localhost/41565] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a17aec85-f465-d9de-1a14-2563d6e642af/cluster_75e09c65-3c85-ba5b-ad18-d4dc1de3eb7a/zookeeper_0, clientPort=50994, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a17aec85-f465-d9de-1a14-2563d6e642af/cluster_75e09c65-3c85-ba5b-ad18-d4dc1de3eb7a/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a17aec85-f465-d9de-1a14-2563d6e642af/cluster_75e09c65-3c85-ba5b-ad18-d4dc1de3eb7a/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-02-10 19:03:32,112 INFO [Listener at localhost/41565] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=50994 2023-02-10 19:03:32,112 INFO [Listener at localhost/41565] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-10 19:03:32,113 INFO [Listener at localhost/41565] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-10 19:03:32,125 INFO [Listener at localhost/41565] util.FSUtils(479): Created version file at hdfs://localhost:41503/user/jenkins/test-data/ecd450e8-f1d8-69b3-568c-ca4b807752e7 with version=8 2023-02-10 19:03:32,125 INFO [Listener at localhost/41565] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-10 19:03:32,125 INFO [Listener at localhost/41565] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-10 19:03:32,126 INFO [Listener at localhost/41565] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:41503/user/jenkins/test-data/abc58f6a-5f84-d220-f63f-ce670deedaf7/hbase-staging 2023-02-10 19:03:32,128 INFO [Listener at localhost/41565] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-02-10 19:03:32,128 INFO [Listener at localhost/41565] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-10 19:03:32,128 INFO [Listener at localhost/41565] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-10 19:03:32,128 INFO [Listener at localhost/41565] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-10 19:03:32,128 INFO [Listener at localhost/41565] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-10 19:03:32,128 INFO [Listener at localhost/41565] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-10 19:03:32,128 INFO [Listener at localhost/41565] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-02-10 19:03:32,129 INFO [Listener at localhost/41565] ipc.NettyRpcServer(120): Bind to /172.31.14.131:45659 2023-02-10 19:03:32,129 INFO [Listener at localhost/41565] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-10 19:03:32,130 INFO [Listener at localhost/41565] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-10 19:03:32,130 INFO [Listener at localhost/41565] zookeeper.RecoverableZooKeeper(93): Process identifier=master:45659 connecting to ZooKeeper ensemble=127.0.0.1:50994 2023-02-10 19:03:32,138 DEBUG [Listener at localhost/41565-EventThread] zookeeper.ZKWatcher(600): master:456590x0, quorum=127.0.0.1:50994, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-10 19:03:32,139 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): master:45659-0x1003f9e01d30000 connected 2023-02-10 19:03:32,157 DEBUG [Listener at localhost/41565] zookeeper.ZKUtil(164): master:45659-0x1003f9e01d30000, quorum=127.0.0.1:50994, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-10 19:03:32,157 DEBUG [Listener at localhost/41565] zookeeper.ZKUtil(164): master:45659-0x1003f9e01d30000, quorum=127.0.0.1:50994, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-10 19:03:32,158 DEBUG [Listener at localhost/41565] zookeeper.ZKUtil(164): master:45659-0x1003f9e01d30000, quorum=127.0.0.1:50994, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-10 19:03:32,161 DEBUG [Listener at localhost/41565] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=45659 2023-02-10 19:03:32,161 DEBUG [Listener at localhost/41565] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=45659 2023-02-10 19:03:32,162 DEBUG [Listener at localhost/41565] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=45659 2023-02-10 19:03:32,163 DEBUG [Listener at localhost/41565] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=45659 2023-02-10 19:03:32,164 DEBUG [Listener at localhost/41565] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=45659 2023-02-10 19:03:32,164 INFO [Listener at localhost/41565] master.HMaster(439): hbase.rootdir=hdfs://localhost:41503/user/jenkins/test-data/ecd450e8-f1d8-69b3-568c-ca4b807752e7, hbase.cluster.distributed=false 2023-02-10 19:03:32,179 INFO [Listener at localhost/41565] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-10 19:03:32,179 INFO [Listener at localhost/41565] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-10 19:03:32,179 INFO [Listener at localhost/41565] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-10 19:03:32,179 INFO [Listener at localhost/41565] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-10 19:03:32,179 INFO [Listener at localhost/41565] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-10 19:03:32,179 INFO [Listener at localhost/41565] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-10 19:03:32,180 INFO [Listener at localhost/41565] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-10 19:03:32,180 INFO [Listener at localhost/41565] ipc.NettyRpcServer(120): Bind to /172.31.14.131:36579 2023-02-10 19:03:32,181 INFO [Listener at localhost/41565] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-10 19:03:32,181 DEBUG [Listener at localhost/41565] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-10 19:03:32,181 INFO [Listener at localhost/41565] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-10 19:03:32,182 INFO [Listener at localhost/41565] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-10 19:03:32,183 INFO [Listener at localhost/41565] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:36579 connecting to ZooKeeper ensemble=127.0.0.1:50994 2023-02-10 19:03:32,185 DEBUG [Listener at localhost/41565-EventThread] zookeeper.ZKWatcher(600): regionserver:365790x0, quorum=127.0.0.1:50994, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-10 19:03:32,187 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:36579-0x1003f9e01d30001 connected 2023-02-10 19:03:32,187 DEBUG [Listener at localhost/41565] zookeeper.ZKUtil(164): regionserver:36579-0x1003f9e01d30001, quorum=127.0.0.1:50994, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-10 19:03:32,188 DEBUG [Listener at localhost/41565] zookeeper.ZKUtil(164): regionserver:36579-0x1003f9e01d30001, quorum=127.0.0.1:50994, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-10 19:03:32,189 DEBUG [Listener at localhost/41565] zookeeper.ZKUtil(164): regionserver:36579-0x1003f9e01d30001, quorum=127.0.0.1:50994, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-10 19:03:32,189 DEBUG [Listener at localhost/41565] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=36579 2023-02-10 19:03:32,189 DEBUG [Listener at localhost/41565] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=36579 2023-02-10 19:03:32,190 DEBUG [Listener at localhost/41565] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=36579 2023-02-10 19:03:32,192 DEBUG [Listener at localhost/41565] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=36579 2023-02-10 19:03:32,192 DEBUG [Listener at localhost/41565] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=36579 2023-02-10 19:03:32,202 INFO [Listener at localhost/41565] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-10 19:03:32,202 INFO [Listener at localhost/41565] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-10 19:03:32,202 INFO [Listener at localhost/41565] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-10 19:03:32,202 INFO [Listener at localhost/41565] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-10 19:03:32,202 INFO [Listener at localhost/41565] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-10 19:03:32,203 INFO [Listener at localhost/41565] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-10 19:03:32,203 INFO [Listener at localhost/41565] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-10 19:03:32,204 INFO [Listener at localhost/41565] ipc.NettyRpcServer(120): Bind to /172.31.14.131:46597 2023-02-10 19:03:32,204 INFO [Listener at localhost/41565] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-10 19:03:32,205 DEBUG [Listener at localhost/41565] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-10 19:03:32,205 INFO [Listener at localhost/41565] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-10 19:03:32,206 INFO [Listener at localhost/41565] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-10 19:03:32,207 INFO [Listener at localhost/41565] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:46597 connecting to ZooKeeper ensemble=127.0.0.1:50994 2023-02-10 19:03:32,209 DEBUG [Listener at localhost/41565-EventThread] zookeeper.ZKWatcher(600): regionserver:465970x0, quorum=127.0.0.1:50994, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-10 19:03:32,210 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:46597-0x1003f9e01d30002 connected 2023-02-10 19:03:32,210 DEBUG [Listener at localhost/41565] zookeeper.ZKUtil(164): regionserver:46597-0x1003f9e01d30002, quorum=127.0.0.1:50994, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-10 19:03:32,211 DEBUG [Listener at localhost/41565] zookeeper.ZKUtil(164): regionserver:46597-0x1003f9e01d30002, quorum=127.0.0.1:50994, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-10 19:03:32,211 DEBUG [Listener at localhost/41565] zookeeper.ZKUtil(164): regionserver:46597-0x1003f9e01d30002, quorum=127.0.0.1:50994, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-10 19:03:32,211 DEBUG [Listener at localhost/41565] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=46597 2023-02-10 19:03:32,212 DEBUG [Listener at localhost/41565] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=46597 2023-02-10 19:03:32,216 DEBUG [Listener at localhost/41565] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=46597 2023-02-10 19:03:32,218 DEBUG [Listener at localhost/41565] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=46597 2023-02-10 19:03:32,218 DEBUG [Listener at localhost/41565] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=46597 2023-02-10 19:03:32,219 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2158): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,45659,1676055812127 2023-02-10 19:03:32,221 DEBUG [Listener at localhost/41565-EventThread] zookeeper.ZKWatcher(600): master:45659-0x1003f9e01d30000, quorum=127.0.0.1:50994, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-10 19:03:32,222 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:45659-0x1003f9e01d30000, quorum=127.0.0.1:50994, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,45659,1676055812127 2023-02-10 19:03:32,223 DEBUG [Listener at localhost/41565-EventThread] zookeeper.ZKWatcher(600): master:45659-0x1003f9e01d30000, quorum=127.0.0.1:50994, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-10 19:03:32,223 DEBUG [Listener at localhost/41565-EventThread] zookeeper.ZKWatcher(600): master:45659-0x1003f9e01d30000, quorum=127.0.0.1:50994, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-10 19:03:32,223 DEBUG [Listener at localhost/41565-EventThread] zookeeper.ZKWatcher(600): regionserver:46597-0x1003f9e01d30002, quorum=127.0.0.1:50994, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-10 19:03:32,223 DEBUG [Listener at localhost/41565-EventThread] zookeeper.ZKWatcher(600): regionserver:36579-0x1003f9e01d30001, quorum=127.0.0.1:50994, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-10 19:03:32,225 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:45659-0x1003f9e01d30000, quorum=127.0.0.1:50994, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-10 19:03:32,226 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(224): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,45659,1676055812127 from backup master directory 2023-02-10 19:03:32,226 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:45659-0x1003f9e01d30000, quorum=127.0.0.1:50994, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-10 19:03:32,227 DEBUG [Listener at localhost/41565-EventThread] zookeeper.ZKWatcher(600): master:45659-0x1003f9e01d30000, quorum=127.0.0.1:50994, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,45659,1676055812127 2023-02-10 19:03:32,227 DEBUG [Listener at localhost/41565-EventThread] zookeeper.ZKWatcher(600): master:45659-0x1003f9e01d30000, quorum=127.0.0.1:50994, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-10 19:03:32,227 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-10 19:03:32,227 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(234): Registered as active master=jenkins-hbase4.apache.org,45659,1676055812127 2023-02-10 19:03:32,242 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(628): Created cluster ID file at hdfs://localhost:41503/user/jenkins/test-data/ecd450e8-f1d8-69b3-568c-ca4b807752e7/hbase.id with ID: 8ebc57eb-7fe7-4a58-b2d5-7924d1bb9996 2023-02-10 19:03:32,248 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-10 19:03:32,250 DEBUG [Listener at localhost/41565-EventThread] zookeeper.ZKWatcher(600): master:45659-0x1003f9e01d30000, quorum=127.0.0.1:50994, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-10 19:03:32,258 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x7971a826 to 127.0.0.1:50994 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-10 19:03:32,267 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4158475c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-10 19:03:32,267 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-10 19:03:32,267 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-02-10 19:03:32,267 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-10 19:03:32,269 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7689): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:41503/user/jenkins/test-data/ecd450e8-f1d8-69b3-568c-ca4b807752e7/MasterData/data/master/store-tmp 2023-02-10 19:03:32,274 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-10 19:03:32,274 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-10 19:03:32,274 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-10 19:03:32,274 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-10 19:03:32,274 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-10 19:03:32,274 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-10 19:03:32,274 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-10 19:03:32,274 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1676055812274Disabling compacts and flushes for region at 1676055812274Disabling writes for close at 1676055812274Writing region close event to WAL at 1676055812274Closed at 1676055812274 2023-02-10 19:03:32,275 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:41503/user/jenkins/test-data/ecd450e8-f1d8-69b3-568c-ca4b807752e7/MasterData/WALs/jenkins-hbase4.apache.org,45659,1676055812127 2023-02-10 19:03:32,276 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C45659%2C1676055812127, suffix=, logDir=hdfs://localhost:41503/user/jenkins/test-data/ecd450e8-f1d8-69b3-568c-ca4b807752e7/MasterData/WALs/jenkins-hbase4.apache.org,45659,1676055812127, archiveDir=hdfs://localhost:41503/user/jenkins/test-data/ecd450e8-f1d8-69b3-568c-ca4b807752e7/MasterData/oldWALs, maxLogs=10 2023-02-10 19:03:32,288 DEBUG [RS-EventLoopGroup-23-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38779,DS-382a8945-a56a-457d-b65e-5cd96de2120a,DISK] 2023-02-10 19:03:32,289 DEBUG [RS-EventLoopGroup-23-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39979,DS-4b65027e-6cae-4387-b8a3-5ad3d9cdee8b,DISK] 2023-02-10 19:03:32,290 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/ecd450e8-f1d8-69b3-568c-ca4b807752e7/MasterData/WALs/jenkins-hbase4.apache.org,45659,1676055812127/jenkins-hbase4.apache.org%2C45659%2C1676055812127.1676055812277 2023-02-10 19:03:32,290 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:38779,DS-382a8945-a56a-457d-b65e-5cd96de2120a,DISK], DatanodeInfoWithStorage[127.0.0.1:39979,DS-4b65027e-6cae-4387-b8a3-5ad3d9cdee8b,DISK]] 2023-02-10 19:03:32,291 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7850): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-02-10 19:03:32,291 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-10 19:03:32,291 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7890): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-02-10 19:03:32,291 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7893): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-02-10 19:03:32,292 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-02-10 19:03:32,293 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41503/user/jenkins/test-data/ecd450e8-f1d8-69b3-568c-ca4b807752e7/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-02-10 19:03:32,293 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-02-10 19:03:32,294 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-10 19:03:32,294 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:41503/user/jenkins/test-data/ecd450e8-f1d8-69b3-568c-ca4b807752e7/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-10 19:03:32,294 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:41503/user/jenkins/test-data/ecd450e8-f1d8-69b3-568c-ca4b807752e7/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-10 19:03:32,296 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1054): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-02-10 19:03:32,298 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41503/user/jenkins/test-data/ecd450e8-f1d8-69b3-568c-ca4b807752e7/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-10 19:03:32,298 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1071): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71936356, jitterRate=0.07193523645401001}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-10 19:03:32,299 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(964): Region open journal for 1595e783b53d99cd5eef43b6debb2682: Writing region info on filesystem at 1676055812291Initializing all the Stores at 1676055812292 (+1 ms)Instantiating store for column family {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676055812292Cleaning up temporary data from old regions at 1676055812295 (+3 ms)Cleaning up detritus from prior splits at 1676055812295Region opened successfully at 1676055812299 (+4 ms) 2023-02-10 19:03:32,300 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-02-10 19:03:32,302 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-02-10 19:03:32,302 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-02-10 19:03:32,302 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-02-10 19:03:32,302 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 0 msec 2023-02-10 19:03:32,303 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 0 msec 2023-02-10 19:03:32,303 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(95): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-02-10 19:03:32,303 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-02-10 19:03:32,304 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-02-10 19:03:32,319 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-02-10 19:03:32,319 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-02-10 19:03:32,320 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:45659-0x1003f9e01d30000, quorum=127.0.0.1:50994, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-02-10 19:03:32,320 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-02-10 19:03:32,320 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:45659-0x1003f9e01d30000, quorum=127.0.0.1:50994, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-02-10 19:03:32,322 DEBUG [Listener at localhost/41565-EventThread] zookeeper.ZKWatcher(600): master:45659-0x1003f9e01d30000, quorum=127.0.0.1:50994, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-10 19:03:32,322 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:45659-0x1003f9e01d30000, quorum=127.0.0.1:50994, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-02-10 19:03:32,322 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:45659-0x1003f9e01d30000, quorum=127.0.0.1:50994, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-02-10 19:03:32,323 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:45659-0x1003f9e01d30000, quorum=127.0.0.1:50994, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-02-10 19:03:32,324 DEBUG [Listener at localhost/41565-EventThread] zookeeper.ZKWatcher(600): master:45659-0x1003f9e01d30000, quorum=127.0.0.1:50994, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-10 19:03:32,324 DEBUG [Listener at localhost/41565-EventThread] zookeeper.ZKWatcher(600): regionserver:36579-0x1003f9e01d30001, quorum=127.0.0.1:50994, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-10 19:03:32,324 DEBUG [Listener at localhost/41565-EventThread] zookeeper.ZKWatcher(600): master:45659-0x1003f9e01d30000, quorum=127.0.0.1:50994, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-10 19:03:32,324 DEBUG [Listener at localhost/41565-EventThread] zookeeper.ZKWatcher(600): regionserver:46597-0x1003f9e01d30002, quorum=127.0.0.1:50994, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-10 19:03:32,324 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(739): Active/primary master=jenkins-hbase4.apache.org,45659,1676055812127, sessionid=0x1003f9e01d30000, setting cluster-up flag (Was=false) 2023-02-10 19:03:32,330 DEBUG [Listener at localhost/41565-EventThread] zookeeper.ZKWatcher(600): master:45659-0x1003f9e01d30000, quorum=127.0.0.1:50994, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-10 19:03:32,333 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-02-10 19:03:32,334 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,45659,1676055812127 2023-02-10 19:03:32,337 DEBUG [Listener at localhost/41565-EventThread] zookeeper.ZKWatcher(600): master:45659-0x1003f9e01d30000, quorum=127.0.0.1:50994, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-10 19:03:32,341 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-02-10 19:03:32,342 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,45659,1676055812127 2023-02-10 19:03:32,342 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:41503/user/jenkins/test-data/ecd450e8-f1d8-69b3-568c-ca4b807752e7/.hbase-snapshot/.tmp 2023-02-10 19:03:32,343 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-02-10 19:03:32,344 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-10 19:03:32,344 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-10 19:03:32,344 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-10 19:03:32,344 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-10 19:03:32,344 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-02-10 19:03:32,344 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-10 19:03:32,344 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-10 19:03:32,344 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-10 19:03:32,345 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1676055842345 2023-02-10 19:03:32,346 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-02-10 19:03:32,346 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-02-10 19:03:32,346 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-02-10 19:03:32,346 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-02-10 19:03:32,346 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-02-10 19:03:32,346 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-02-10 19:03:32,346 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-02-10 19:03:32,346 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-02-10 19:03:32,346 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-10 19:03:32,346 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-02-10 19:03:32,347 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-02-10 19:03:32,347 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-02-10 19:03:32,347 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-02-10 19:03:32,347 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-02-10 19:03:32,347 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-10 19:03:32,347 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676055812347,5,FailOnTimeoutGroup] 2023-02-10 19:03:32,348 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676055812348,5,FailOnTimeoutGroup] 2023-02-10 19:03:32,348 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-10 19:03:32,348 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1451): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-02-10 19:03:32,348 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-02-10 19:03:32,348 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-02-10 19:03:32,362 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:41503/user/jenkins/test-data/ecd450e8-f1d8-69b3-568c-ca4b807752e7/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-10 19:03:32,362 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:41503/user/jenkins/test-data/ecd450e8-f1d8-69b3-568c-ca4b807752e7/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-10 19:03:32,363 INFO [PEWorker-1] regionserver.HRegion(7671): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:41503/user/jenkins/test-data/ecd450e8-f1d8-69b3-568c-ca4b807752e7 2023-02-10 19:03:32,369 DEBUG [PEWorker-1] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-10 19:03:32,370 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-10 19:03:32,371 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41503/user/jenkins/test-data/ecd450e8-f1d8-69b3-568c-ca4b807752e7/data/hbase/meta/1588230740/info 2023-02-10 19:03:32,371 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-10 19:03:32,372 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-10 19:03:32,372 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-10 19:03:32,373 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41503/user/jenkins/test-data/ecd450e8-f1d8-69b3-568c-ca4b807752e7/data/hbase/meta/1588230740/rep_barrier 2023-02-10 19:03:32,373 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-10 19:03:32,373 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-10 19:03:32,373 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-10 19:03:32,374 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41503/user/jenkins/test-data/ecd450e8-f1d8-69b3-568c-ca4b807752e7/data/hbase/meta/1588230740/table 2023-02-10 19:03:32,374 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-10 19:03:32,375 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-10 19:03:32,375 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:41503/user/jenkins/test-data/ecd450e8-f1d8-69b3-568c-ca4b807752e7/data/hbase/meta/1588230740 2023-02-10 19:03:32,375 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:41503/user/jenkins/test-data/ecd450e8-f1d8-69b3-568c-ca4b807752e7/data/hbase/meta/1588230740 2023-02-10 19:03:32,377 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-10 19:03:32,377 DEBUG [PEWorker-1] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-10 19:03:32,379 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41503/user/jenkins/test-data/ecd450e8-f1d8-69b3-568c-ca4b807752e7/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-10 19:03:32,379 INFO [PEWorker-1] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64434746, jitterRate=-0.03984746336936951}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-10 19:03:32,379 DEBUG [PEWorker-1] regionserver.HRegion(964): Region open journal for 1588230740: Writing region info on filesystem at 1676055812370Initializing all the Stores at 1676055812370Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676055812370Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676055812370Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676055812370Cleaning up temporary data from old regions at 1676055812376 (+6 ms)Cleaning up detritus from prior splits at 1676055812376Region opened successfully at 1676055812379 (+3 ms) 2023-02-10 19:03:32,379 DEBUG [PEWorker-1] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-10 19:03:32,379 INFO [PEWorker-1] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-10 19:03:32,379 DEBUG [PEWorker-1] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-10 19:03:32,380 DEBUG [PEWorker-1] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-10 19:03:32,380 DEBUG [PEWorker-1] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-10 19:03:32,380 INFO [PEWorker-1] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-10 19:03:32,380 DEBUG [PEWorker-1] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1676055812379Disabling compacts and flushes for region at 1676055812379Disabling writes for close at 1676055812380 (+1 ms)Writing region close event to WAL at 1676055812380Closed at 1676055812380 2023-02-10 19:03:32,381 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-02-10 19:03:32,381 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-02-10 19:03:32,381 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-02-10 19:03:32,382 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-02-10 19:03:32,384 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-02-10 19:03:32,420 INFO [RS:1;jenkins-hbase4:46597] regionserver.HRegionServer(952): ClusterId : 8ebc57eb-7fe7-4a58-b2d5-7924d1bb9996 2023-02-10 19:03:32,420 INFO [RS:0;jenkins-hbase4:36579] regionserver.HRegionServer(952): ClusterId : 8ebc57eb-7fe7-4a58-b2d5-7924d1bb9996 2023-02-10 19:03:32,420 DEBUG [RS:1;jenkins-hbase4:46597] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-10 19:03:32,420 DEBUG [RS:0;jenkins-hbase4:36579] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-10 19:03:32,422 DEBUG [RS:1;jenkins-hbase4:46597] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-10 19:03:32,422 DEBUG [RS:1;jenkins-hbase4:46597] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-10 19:03:32,422 DEBUG [RS:0;jenkins-hbase4:36579] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-10 19:03:32,422 DEBUG [RS:0;jenkins-hbase4:36579] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-10 19:03:32,423 DEBUG [RS:1;jenkins-hbase4:46597] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-10 19:03:32,423 DEBUG [RS:0;jenkins-hbase4:36579] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-10 19:03:32,424 DEBUG [RS:1;jenkins-hbase4:46597] zookeeper.ReadOnlyZKClient(139): Connect 0x50fb31d7 to 127.0.0.1:50994 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-10 19:03:32,424 DEBUG [RS:0;jenkins-hbase4:36579] zookeeper.ReadOnlyZKClient(139): Connect 0x35cc2489 to 127.0.0.1:50994 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-10 19:03:32,429 DEBUG [RS:1;jenkins-hbase4:46597] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5e3cc5b8, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-10 19:03:32,429 DEBUG [RS:1;jenkins-hbase4:46597] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5a035aa7, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-10 19:03:32,429 DEBUG [RS:0;jenkins-hbase4:36579] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3b0bdc40, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-10 19:03:32,429 DEBUG [RS:0;jenkins-hbase4:36579] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3f344ff9, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-10 19:03:32,437 DEBUG [RS:1;jenkins-hbase4:46597] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:46597 2023-02-10 19:03:32,437 DEBUG [RS:0;jenkins-hbase4:36579] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:36579 2023-02-10 19:03:32,438 INFO [RS:1;jenkins-hbase4:46597] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-10 19:03:32,438 INFO [RS:0;jenkins-hbase4:36579] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-10 19:03:32,438 INFO [RS:1;jenkins-hbase4:46597] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-10 19:03:32,438 DEBUG [RS:1;jenkins-hbase4:46597] regionserver.HRegionServer(1023): About to register with Master. 2023-02-10 19:03:32,438 INFO [RS:0;jenkins-hbase4:36579] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-10 19:03:32,438 DEBUG [RS:0;jenkins-hbase4:36579] regionserver.HRegionServer(1023): About to register with Master. 2023-02-10 19:03:32,438 INFO [RS:1;jenkins-hbase4:46597] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,45659,1676055812127 with isa=jenkins-hbase4.apache.org/172.31.14.131:46597, startcode=1676055812202 2023-02-10 19:03:32,438 INFO [RS:0;jenkins-hbase4:36579] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,45659,1676055812127 with isa=jenkins-hbase4.apache.org/172.31.14.131:36579, startcode=1676055812179 2023-02-10 19:03:32,438 DEBUG [RS:1;jenkins-hbase4:46597] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-10 19:03:32,438 DEBUG [RS:0;jenkins-hbase4:36579] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-10 19:03:32,440 INFO [RS-EventLoopGroup-21-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35365, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.13 (auth:SIMPLE), service=RegionServerStatusService 2023-02-10 19:03:32,440 INFO [RS-EventLoopGroup-21-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43395, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.12 (auth:SIMPLE), service=RegionServerStatusService 2023-02-10 19:03:32,441 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45659] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,46597,1676055812202 2023-02-10 19:03:32,442 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45659] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,36579,1676055812179 2023-02-10 19:03:32,442 DEBUG [RS:1;jenkins-hbase4:46597] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:41503/user/jenkins/test-data/ecd450e8-f1d8-69b3-568c-ca4b807752e7 2023-02-10 19:03:32,442 DEBUG [RS:1;jenkins-hbase4:46597] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:41503 2023-02-10 19:03:32,443 DEBUG [RS:1;jenkins-hbase4:46597] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-10 19:03:32,443 DEBUG [RS:0;jenkins-hbase4:36579] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:41503/user/jenkins/test-data/ecd450e8-f1d8-69b3-568c-ca4b807752e7 2023-02-10 19:03:32,443 DEBUG [RS:0;jenkins-hbase4:36579] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:41503 2023-02-10 19:03:32,443 DEBUG [RS:0;jenkins-hbase4:36579] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-10 19:03:32,444 DEBUG [Listener at localhost/41565-EventThread] zookeeper.ZKWatcher(600): master:45659-0x1003f9e01d30000, quorum=127.0.0.1:50994, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-10 19:03:32,447 DEBUG [RS:1;jenkins-hbase4:46597] zookeeper.ZKUtil(162): regionserver:46597-0x1003f9e01d30002, quorum=127.0.0.1:50994, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,46597,1676055812202 2023-02-10 19:03:32,447 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,36579,1676055812179] 2023-02-10 19:03:32,447 WARN [RS:1;jenkins-hbase4:46597] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-10 19:03:32,447 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,46597,1676055812202] 2023-02-10 19:03:32,447 INFO [RS:1;jenkins-hbase4:46597] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-10 19:03:32,447 DEBUG [RS:0;jenkins-hbase4:36579] zookeeper.ZKUtil(162): regionserver:36579-0x1003f9e01d30001, quorum=127.0.0.1:50994, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,36579,1676055812179 2023-02-10 19:03:32,447 DEBUG [RS:1;jenkins-hbase4:46597] regionserver.HRegionServer(1947): logDir=hdfs://localhost:41503/user/jenkins/test-data/ecd450e8-f1d8-69b3-568c-ca4b807752e7/WALs/jenkins-hbase4.apache.org,46597,1676055812202 2023-02-10 19:03:32,448 WARN [RS:0;jenkins-hbase4:36579] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-10 19:03:32,448 INFO [RS:0;jenkins-hbase4:36579] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-10 19:03:32,448 DEBUG [RS:0;jenkins-hbase4:36579] regionserver.HRegionServer(1947): logDir=hdfs://localhost:41503/user/jenkins/test-data/ecd450e8-f1d8-69b3-568c-ca4b807752e7/WALs/jenkins-hbase4.apache.org,36579,1676055812179 2023-02-10 19:03:32,454 DEBUG [RS:1;jenkins-hbase4:46597] zookeeper.ZKUtil(162): regionserver:46597-0x1003f9e01d30002, quorum=127.0.0.1:50994, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,36579,1676055812179 2023-02-10 19:03:32,454 DEBUG [RS:0;jenkins-hbase4:36579] zookeeper.ZKUtil(162): regionserver:36579-0x1003f9e01d30001, quorum=127.0.0.1:50994, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,36579,1676055812179 2023-02-10 19:03:32,455 DEBUG [RS:1;jenkins-hbase4:46597] zookeeper.ZKUtil(162): regionserver:46597-0x1003f9e01d30002, quorum=127.0.0.1:50994, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,46597,1676055812202 2023-02-10 19:03:32,455 DEBUG [RS:0;jenkins-hbase4:36579] zookeeper.ZKUtil(162): regionserver:36579-0x1003f9e01d30001, quorum=127.0.0.1:50994, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,46597,1676055812202 2023-02-10 19:03:32,455 DEBUG [RS:1;jenkins-hbase4:46597] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-10 19:03:32,455 DEBUG [RS:0;jenkins-hbase4:36579] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-10 19:03:32,455 INFO [RS:1;jenkins-hbase4:46597] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-10 19:03:32,456 INFO [RS:0;jenkins-hbase4:36579] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-10 19:03:32,457 INFO [RS:1;jenkins-hbase4:46597] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-10 19:03:32,457 INFO [RS:0;jenkins-hbase4:36579] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-10 19:03:32,458 INFO [RS:1;jenkins-hbase4:46597] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-10 19:03:32,458 INFO [RS:1;jenkins-hbase4:46597] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-10 19:03:32,459 INFO [RS:0;jenkins-hbase4:36579] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-10 19:03:32,460 INFO [RS:0;jenkins-hbase4:36579] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-10 19:03:32,460 INFO [RS:1;jenkins-hbase4:46597] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-10 19:03:32,460 INFO [RS:0;jenkins-hbase4:36579] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-10 19:03:32,463 INFO [RS:1;jenkins-hbase4:46597] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-10 19:03:32,463 INFO [RS:0;jenkins-hbase4:36579] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-10 19:03:32,464 DEBUG [RS:1;jenkins-hbase4:46597] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-10 19:03:32,466 DEBUG [RS:0;jenkins-hbase4:36579] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-10 19:03:32,466 DEBUG [RS:1;jenkins-hbase4:46597] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-10 19:03:32,466 DEBUG [RS:0;jenkins-hbase4:36579] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-10 19:03:32,466 DEBUG [RS:1;jenkins-hbase4:46597] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-10 19:03:32,466 DEBUG [RS:0;jenkins-hbase4:36579] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-10 19:03:32,466 DEBUG [RS:1;jenkins-hbase4:46597] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-10 19:03:32,466 DEBUG [RS:0;jenkins-hbase4:36579] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-10 19:03:32,466 DEBUG [RS:1;jenkins-hbase4:46597] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-10 19:03:32,466 DEBUG [RS:0;jenkins-hbase4:36579] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-10 19:03:32,466 DEBUG [RS:1;jenkins-hbase4:46597] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-10 19:03:32,466 DEBUG [RS:0;jenkins-hbase4:36579] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-10 19:03:32,466 DEBUG [RS:1;jenkins-hbase4:46597] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-10 19:03:32,466 DEBUG [RS:0;jenkins-hbase4:36579] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-10 19:03:32,466 DEBUG [RS:1;jenkins-hbase4:46597] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-10 19:03:32,466 DEBUG [RS:0;jenkins-hbase4:36579] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-10 19:03:32,466 DEBUG [RS:1;jenkins-hbase4:46597] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-10 19:03:32,466 DEBUG [RS:0;jenkins-hbase4:36579] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-10 19:03:32,466 DEBUG [RS:1;jenkins-hbase4:46597] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-10 19:03:32,466 DEBUG [RS:0;jenkins-hbase4:36579] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-10 19:03:32,468 INFO [RS:1;jenkins-hbase4:46597] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-10 19:03:32,468 INFO [RS:1;jenkins-hbase4:46597] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-10 19:03:32,469 INFO [RS:0;jenkins-hbase4:36579] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-10 19:03:32,469 INFO [RS:1;jenkins-hbase4:46597] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-10 19:03:32,469 INFO [RS:0;jenkins-hbase4:36579] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-10 19:03:32,469 INFO [RS:0;jenkins-hbase4:36579] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-10 19:03:32,481 INFO [RS:1;jenkins-hbase4:46597] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-10 19:03:32,481 INFO [RS:0;jenkins-hbase4:36579] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-10 19:03:32,481 INFO [RS:1;jenkins-hbase4:46597] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,46597,1676055812202-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-10 19:03:32,481 INFO [RS:0;jenkins-hbase4:36579] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,36579,1676055812179-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-10 19:03:32,491 INFO [RS:0;jenkins-hbase4:36579] regionserver.Replication(203): jenkins-hbase4.apache.org,36579,1676055812179 started 2023-02-10 19:03:32,491 INFO [RS:0;jenkins-hbase4:36579] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,36579,1676055812179, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:36579, sessionid=0x1003f9e01d30001 2023-02-10 19:03:32,491 INFO [RS:1;jenkins-hbase4:46597] regionserver.Replication(203): jenkins-hbase4.apache.org,46597,1676055812202 started 2023-02-10 19:03:32,492 DEBUG [RS:0;jenkins-hbase4:36579] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-10 19:03:32,492 INFO [RS:1;jenkins-hbase4:46597] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,46597,1676055812202, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:46597, sessionid=0x1003f9e01d30002 2023-02-10 19:03:32,492 DEBUG [RS:0;jenkins-hbase4:36579] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,36579,1676055812179 2023-02-10 19:03:32,492 DEBUG [RS:1;jenkins-hbase4:46597] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-10 19:03:32,492 DEBUG [RS:0;jenkins-hbase4:36579] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,36579,1676055812179' 2023-02-10 19:03:32,492 DEBUG [RS:1;jenkins-hbase4:46597] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,46597,1676055812202 2023-02-10 19:03:32,492 DEBUG [RS:0;jenkins-hbase4:36579] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-10 19:03:32,492 DEBUG [RS:1;jenkins-hbase4:46597] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,46597,1676055812202' 2023-02-10 19:03:32,492 DEBUG [RS:1;jenkins-hbase4:46597] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-10 19:03:32,492 DEBUG [RS:0;jenkins-hbase4:36579] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-10 19:03:32,492 DEBUG [RS:1;jenkins-hbase4:46597] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-10 19:03:32,492 DEBUG [RS:0;jenkins-hbase4:36579] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-10 19:03:32,492 DEBUG [RS:1;jenkins-hbase4:46597] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-10 19:03:32,492 DEBUG [RS:0;jenkins-hbase4:36579] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-10 19:03:32,492 DEBUG [RS:0;jenkins-hbase4:36579] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,36579,1676055812179 2023-02-10 19:03:32,492 DEBUG [RS:1;jenkins-hbase4:46597] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-10 19:03:32,492 DEBUG [RS:0;jenkins-hbase4:36579] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,36579,1676055812179' 2023-02-10 19:03:32,493 DEBUG [RS:1;jenkins-hbase4:46597] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,46597,1676055812202 2023-02-10 19:03:32,493 DEBUG [RS:0;jenkins-hbase4:36579] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-10 19:03:32,493 DEBUG [RS:1;jenkins-hbase4:46597] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,46597,1676055812202' 2023-02-10 19:03:32,493 DEBUG [RS:1;jenkins-hbase4:46597] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-10 19:03:32,493 DEBUG [RS:0;jenkins-hbase4:36579] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-10 19:03:32,493 DEBUG [RS:1;jenkins-hbase4:46597] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-10 19:03:32,493 DEBUG [RS:0;jenkins-hbase4:36579] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-10 19:03:32,493 INFO [RS:0;jenkins-hbase4:36579] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-10 19:03:32,493 INFO [RS:0;jenkins-hbase4:36579] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-10 19:03:32,493 DEBUG [RS:1;jenkins-hbase4:46597] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-10 19:03:32,493 INFO [RS:1;jenkins-hbase4:46597] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-10 19:03:32,493 INFO [RS:1;jenkins-hbase4:46597] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-10 19:03:32,534 DEBUG [jenkins-hbase4:45659] assignment.AssignmentManager(2178): Processing assignQueue; systemServersCount=2, allServersCount=2 2023-02-10 19:03:32,534 DEBUG [jenkins-hbase4:45659] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-10 19:03:32,535 DEBUG [jenkins-hbase4:45659] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-10 19:03:32,535 DEBUG [jenkins-hbase4:45659] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-10 19:03:32,535 DEBUG [jenkins-hbase4:45659] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-10 19:03:32,536 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,36579,1676055812179, state=OPENING 2023-02-10 19:03:32,538 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-02-10 19:03:32,539 DEBUG [Listener at localhost/41565-EventThread] zookeeper.ZKWatcher(600): master:45659-0x1003f9e01d30000, quorum=127.0.0.1:50994, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-10 19:03:32,539 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-10 19:03:32,539 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,36579,1676055812179}] 2023-02-10 19:03:32,694 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,36579,1676055812179 2023-02-10 19:03:32,694 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-10 19:03:32,696 INFO [RS-EventLoopGroup-22-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51470, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-10 19:03:32,699 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:meta,,1.1588230740 2023-02-10 19:03:32,700 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-10 19:03:32,701 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C36579%2C1676055812179.meta, suffix=.meta, logDir=hdfs://localhost:41503/user/jenkins/test-data/ecd450e8-f1d8-69b3-568c-ca4b807752e7/WALs/jenkins-hbase4.apache.org,36579,1676055812179, archiveDir=hdfs://localhost:41503/user/jenkins/test-data/ecd450e8-f1d8-69b3-568c-ca4b807752e7/oldWALs, maxLogs=32 2023-02-10 19:03:32,715 DEBUG [RS-EventLoopGroup-23-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39979,DS-4b65027e-6cae-4387-b8a3-5ad3d9cdee8b,DISK] 2023-02-10 19:03:32,715 DEBUG [RS-EventLoopGroup-23-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38779,DS-382a8945-a56a-457d-b65e-5cd96de2120a,DISK] 2023-02-10 19:03:32,716 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/ecd450e8-f1d8-69b3-568c-ca4b807752e7/WALs/jenkins-hbase4.apache.org,36579,1676055812179/jenkins-hbase4.apache.org%2C36579%2C1676055812179.meta.1676055812701.meta 2023-02-10 19:03:32,716 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:39979,DS-4b65027e-6cae-4387-b8a3-5ad3d9cdee8b,DISK], DatanodeInfoWithStorage[127.0.0.1:38779,DS-382a8945-a56a-457d-b65e-5cd96de2120a,DISK]] 2023-02-10 19:03:32,717 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-02-10 19:03:32,717 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-02-10 19:03:32,717 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8546): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-02-10 19:03:32,717 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-02-10 19:03:32,717 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-02-10 19:03:32,717 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-10 19:03:32,717 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 1588230740 2023-02-10 19:03:32,717 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 1588230740 2023-02-10 19:03:32,718 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-10 19:03:32,719 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41503/user/jenkins/test-data/ecd450e8-f1d8-69b3-568c-ca4b807752e7/data/hbase/meta/1588230740/info 2023-02-10 19:03:32,719 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41503/user/jenkins/test-data/ecd450e8-f1d8-69b3-568c-ca4b807752e7/data/hbase/meta/1588230740/info 2023-02-10 19:03:32,719 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-10 19:03:32,720 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-10 19:03:32,720 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-10 19:03:32,720 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41503/user/jenkins/test-data/ecd450e8-f1d8-69b3-568c-ca4b807752e7/data/hbase/meta/1588230740/rep_barrier 2023-02-10 19:03:32,720 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41503/user/jenkins/test-data/ecd450e8-f1d8-69b3-568c-ca4b807752e7/data/hbase/meta/1588230740/rep_barrier 2023-02-10 19:03:32,721 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-10 19:03:32,721 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-10 19:03:32,721 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-10 19:03:32,722 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41503/user/jenkins/test-data/ecd450e8-f1d8-69b3-568c-ca4b807752e7/data/hbase/meta/1588230740/table 2023-02-10 19:03:32,722 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41503/user/jenkins/test-data/ecd450e8-f1d8-69b3-568c-ca4b807752e7/data/hbase/meta/1588230740/table 2023-02-10 19:03:32,722 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-10 19:03:32,722 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-10 19:03:32,723 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:41503/user/jenkins/test-data/ecd450e8-f1d8-69b3-568c-ca4b807752e7/data/hbase/meta/1588230740 2023-02-10 19:03:32,723 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:41503/user/jenkins/test-data/ecd450e8-f1d8-69b3-568c-ca4b807752e7/data/hbase/meta/1588230740 2023-02-10 19:03:32,725 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-10 19:03:32,725 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-10 19:03:32,726 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60627467, jitterRate=-0.09658034145832062}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-10 19:03:32,726 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 1588230740: Running coprocessor pre-open hook at 1676055812717Writing region info on filesystem at 1676055812717Initializing all the Stores at 1676055812718 (+1 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676055812718Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676055812718Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676055812718Cleaning up temporary data from old regions at 1676055812724 (+6 ms)Cleaning up detritus from prior splits at 1676055812724Running coprocessor post-open hooks at 1676055812726 (+2 ms)Region opened successfully at 1676055812726 2023-02-10 19:03:32,727 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1676055812694 2023-02-10 19:03:32,730 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:meta,,1.1588230740 2023-02-10 19:03:32,732 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:meta,,1.1588230740 2023-02-10 19:03:32,732 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,36579,1676055812179, state=OPEN 2023-02-10 19:03:32,733 DEBUG [Listener at localhost/41565-EventThread] zookeeper.ZKWatcher(600): master:45659-0x1003f9e01d30000, quorum=127.0.0.1:50994, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-02-10 19:03:32,733 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-10 19:03:32,734 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-02-10 19:03:32,734 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,36579,1676055812179 in 194 msec 2023-02-10 19:03:32,735 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-02-10 19:03:32,736 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 353 msec 2023-02-10 19:03:32,737 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 393 msec 2023-02-10 19:03:32,737 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(946): Master startup: status=Wait for region servers to report in, state=RUNNING, startTime=1676055812222, completionTime=-1 2023-02-10 19:03:32,737 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=2; waited=0ms, expected min=2 server(s), max=2 server(s), master is running 2023-02-10 19:03:32,737 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1519): Joining cluster... 2023-02-10 19:03:32,739 DEBUG [hconnection-0x752e5e36-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-10 19:03:32,740 INFO [RS-EventLoopGroup-22-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51478, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-10 19:03:32,741 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1531): Number of RegionServers=2 2023-02-10 19:03:32,741 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1676055872741 2023-02-10 19:03:32,741 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1676055932741 2023-02-10 19:03:32,741 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1538): Joined the cluster in 4 msec 2023-02-10 19:03:32,747 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,45659,1676055812127-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-10 19:03:32,747 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,45659,1676055812127-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-10 19:03:32,747 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,45659,1676055812127-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-10 19:03:32,747 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:45659, period=300000, unit=MILLISECONDS is enabled. 2023-02-10 19:03:32,747 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-02-10 19:03:32,747 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-02-10 19:03:32,747 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2138): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-10 19:03:32,748 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-02-10 19:03:32,749 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-02-10 19:03:32,749 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-02-10 19:03:32,750 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-10 19:03:32,751 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41503/user/jenkins/test-data/ecd450e8-f1d8-69b3-568c-ca4b807752e7/.tmp/data/hbase/namespace/c8f276a7b00fb2a9606d0b639031611e 2023-02-10 19:03:32,751 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:41503/user/jenkins/test-data/ecd450e8-f1d8-69b3-568c-ca4b807752e7/.tmp/data/hbase/namespace/c8f276a7b00fb2a9606d0b639031611e empty. 2023-02-10 19:03:32,751 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:41503/user/jenkins/test-data/ecd450e8-f1d8-69b3-568c-ca4b807752e7/.tmp/data/hbase/namespace/c8f276a7b00fb2a9606d0b639031611e 2023-02-10 19:03:32,751 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-02-10 19:03:32,762 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:41503/user/jenkins/test-data/ecd450e8-f1d8-69b3-568c-ca4b807752e7/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-02-10 19:03:32,763 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7671): creating {ENCODED => c8f276a7b00fb2a9606d0b639031611e, NAME => 'hbase:namespace,,1676055812747.c8f276a7b00fb2a9606d0b639031611e.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:41503/user/jenkins/test-data/ecd450e8-f1d8-69b3-568c-ca4b807752e7/.tmp 2023-02-10 19:03:32,768 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676055812747.c8f276a7b00fb2a9606d0b639031611e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-10 19:03:32,768 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1603): Closing c8f276a7b00fb2a9606d0b639031611e, disabling compactions & flushes 2023-02-10 19:03:32,768 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676055812747.c8f276a7b00fb2a9606d0b639031611e. 2023-02-10 19:03:32,768 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676055812747.c8f276a7b00fb2a9606d0b639031611e. 2023-02-10 19:03:32,768 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676055812747.c8f276a7b00fb2a9606d0b639031611e. after waiting 0 ms 2023-02-10 19:03:32,768 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676055812747.c8f276a7b00fb2a9606d0b639031611e. 2023-02-10 19:03:32,768 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676055812747.c8f276a7b00fb2a9606d0b639031611e. 2023-02-10 19:03:32,768 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1557): Region close journal for c8f276a7b00fb2a9606d0b639031611e: Waiting for close lock at 1676055812768Disabling compacts and flushes for region at 1676055812768Disabling writes for close at 1676055812768Writing region close event to WAL at 1676055812768Closed at 1676055812768 2023-02-10 19:03:32,770 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-02-10 19:03:32,770 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1676055812747.c8f276a7b00fb2a9606d0b639031611e.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676055812770"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676055812770"}]},"ts":"1676055812770"} 2023-02-10 19:03:32,772 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-10 19:03:32,772 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-10 19:03:32,772 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676055812772"}]},"ts":"1676055812772"} 2023-02-10 19:03:32,773 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-02-10 19:03:32,776 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-10 19:03:32,776 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-10 19:03:32,776 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-10 19:03:32,776 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-10 19:03:32,776 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=c8f276a7b00fb2a9606d0b639031611e, ASSIGN}] 2023-02-10 19:03:32,780 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=c8f276a7b00fb2a9606d0b639031611e, ASSIGN 2023-02-10 19:03:32,781 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=c8f276a7b00fb2a9606d0b639031611e, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,36579,1676055812179; forceNewPlan=false, retain=false 2023-02-10 19:03:32,931 INFO [jenkins-hbase4:45659] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-10 19:03:32,931 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=c8f276a7b00fb2a9606d0b639031611e, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,36579,1676055812179 2023-02-10 19:03:32,931 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1676055812747.c8f276a7b00fb2a9606d0b639031611e.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676055812931"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676055812931"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676055812931"}]},"ts":"1676055812931"} 2023-02-10 19:03:32,933 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure c8f276a7b00fb2a9606d0b639031611e, server=jenkins-hbase4.apache.org,36579,1676055812179}] 2023-02-10 19:03:33,088 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:namespace,,1676055812747.c8f276a7b00fb2a9606d0b639031611e. 2023-02-10 19:03:33,089 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C36579%2C1676055812179, suffix=, logDir=hdfs://localhost:41503/user/jenkins/test-data/ecd450e8-f1d8-69b3-568c-ca4b807752e7/WALs/jenkins-hbase4.apache.org,36579,1676055812179, archiveDir=hdfs://localhost:41503/user/jenkins/test-data/ecd450e8-f1d8-69b3-568c-ca4b807752e7/oldWALs, maxLogs=32 2023-02-10 19:03:33,107 DEBUG [RS-EventLoopGroup-23-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39979,DS-4b65027e-6cae-4387-b8a3-5ad3d9cdee8b,DISK] 2023-02-10 19:03:33,107 DEBUG [RS-EventLoopGroup-23-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38779,DS-382a8945-a56a-457d-b65e-5cd96de2120a,DISK] 2023-02-10 19:03:33,109 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/ecd450e8-f1d8-69b3-568c-ca4b807752e7/WALs/jenkins-hbase4.apache.org,36579,1676055812179/jenkins-hbase4.apache.org%2C36579%2C1676055812179.1676055813089 2023-02-10 19:03:33,109 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:38779,DS-382a8945-a56a-457d-b65e-5cd96de2120a,DISK], DatanodeInfoWithStorage[127.0.0.1:39979,DS-4b65027e-6cae-4387-b8a3-5ad3d9cdee8b,DISK]] 2023-02-10 19:03:33,109 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => c8f276a7b00fb2a9606d0b639031611e, NAME => 'hbase:namespace,,1676055812747.c8f276a7b00fb2a9606d0b639031611e.', STARTKEY => '', ENDKEY => ''} 2023-02-10 19:03:33,109 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace c8f276a7b00fb2a9606d0b639031611e 2023-02-10 19:03:33,109 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676055812747.c8f276a7b00fb2a9606d0b639031611e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-10 19:03:33,110 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for c8f276a7b00fb2a9606d0b639031611e 2023-02-10 19:03:33,110 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for c8f276a7b00fb2a9606d0b639031611e 2023-02-10 19:03:33,110 INFO [StoreOpener-c8f276a7b00fb2a9606d0b639031611e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region c8f276a7b00fb2a9606d0b639031611e 2023-02-10 19:03:33,111 DEBUG [StoreOpener-c8f276a7b00fb2a9606d0b639031611e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41503/user/jenkins/test-data/ecd450e8-f1d8-69b3-568c-ca4b807752e7/data/hbase/namespace/c8f276a7b00fb2a9606d0b639031611e/info 2023-02-10 19:03:33,111 DEBUG [StoreOpener-c8f276a7b00fb2a9606d0b639031611e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41503/user/jenkins/test-data/ecd450e8-f1d8-69b3-568c-ca4b807752e7/data/hbase/namespace/c8f276a7b00fb2a9606d0b639031611e/info 2023-02-10 19:03:33,112 INFO [StoreOpener-c8f276a7b00fb2a9606d0b639031611e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c8f276a7b00fb2a9606d0b639031611e columnFamilyName info 2023-02-10 19:03:33,112 INFO [StoreOpener-c8f276a7b00fb2a9606d0b639031611e-1] regionserver.HStore(310): Store=c8f276a7b00fb2a9606d0b639031611e/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-10 19:03:33,113 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:41503/user/jenkins/test-data/ecd450e8-f1d8-69b3-568c-ca4b807752e7/data/hbase/namespace/c8f276a7b00fb2a9606d0b639031611e 2023-02-10 19:03:33,113 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:41503/user/jenkins/test-data/ecd450e8-f1d8-69b3-568c-ca4b807752e7/data/hbase/namespace/c8f276a7b00fb2a9606d0b639031611e 2023-02-10 19:03:33,115 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for c8f276a7b00fb2a9606d0b639031611e 2023-02-10 19:03:33,116 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41503/user/jenkins/test-data/ecd450e8-f1d8-69b3-568c-ca4b807752e7/data/hbase/namespace/c8f276a7b00fb2a9606d0b639031611e/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-10 19:03:33,116 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened c8f276a7b00fb2a9606d0b639031611e; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64899238, jitterRate=-0.03292599320411682}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-10 19:03:33,116 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for c8f276a7b00fb2a9606d0b639031611e: Running coprocessor pre-open hook at 1676055813110Writing region info on filesystem at 1676055813110Initializing all the Stores at 1676055813110Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676055813110Cleaning up temporary data from old regions at 1676055813113 (+3 ms)Cleaning up detritus from prior splits at 1676055813113Running coprocessor post-open hooks at 1676055813116 (+3 ms)Region opened successfully at 1676055813116 2023-02-10 19:03:33,117 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:namespace,,1676055812747.c8f276a7b00fb2a9606d0b639031611e., pid=6, masterSystemTime=1676055813085 2023-02-10 19:03:33,118 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:namespace,,1676055812747.c8f276a7b00fb2a9606d0b639031611e. 2023-02-10 19:03:33,120 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:namespace,,1676055812747.c8f276a7b00fb2a9606d0b639031611e. 2023-02-10 19:03:33,120 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=c8f276a7b00fb2a9606d0b639031611e, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,36579,1676055812179 2023-02-10 19:03:33,120 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1676055812747.c8f276a7b00fb2a9606d0b639031611e.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676055813120"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676055813120"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676055813120"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676055813120"}]},"ts":"1676055813120"} 2023-02-10 19:03:33,122 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-02-10 19:03:33,123 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure c8f276a7b00fb2a9606d0b639031611e, server=jenkins-hbase4.apache.org,36579,1676055812179 in 188 msec 2023-02-10 19:03:33,124 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-02-10 19:03:33,124 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=c8f276a7b00fb2a9606d0b639031611e, ASSIGN in 347 msec 2023-02-10 19:03:33,125 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-10 19:03:33,125 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676055813125"}]},"ts":"1676055813125"} 2023-02-10 19:03:33,126 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-02-10 19:03:33,128 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-02-10 19:03:33,129 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 381 msec 2023-02-10 19:03:33,149 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:45659-0x1003f9e01d30000, quorum=127.0.0.1:50994, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-02-10 19:03:33,150 DEBUG [Listener at localhost/41565-EventThread] zookeeper.ZKWatcher(600): master:45659-0x1003f9e01d30000, quorum=127.0.0.1:50994, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-02-10 19:03:33,150 DEBUG [Listener at localhost/41565-EventThread] zookeeper.ZKWatcher(600): master:45659-0x1003f9e01d30000, quorum=127.0.0.1:50994, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-10 19:03:33,153 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-02-10 19:03:33,159 DEBUG [Listener at localhost/41565-EventThread] zookeeper.ZKWatcher(600): master:45659-0x1003f9e01d30000, quorum=127.0.0.1:50994, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-10 19:03:33,162 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 8 msec 2023-02-10 19:03:33,165 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-02-10 19:03:33,171 DEBUG [Listener at localhost/41565-EventThread] zookeeper.ZKWatcher(600): master:45659-0x1003f9e01d30000, quorum=127.0.0.1:50994, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-10 19:03:33,174 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 9 msec 2023-02-10 19:03:33,178 DEBUG [Listener at localhost/41565-EventThread] zookeeper.ZKWatcher(600): master:45659-0x1003f9e01d30000, quorum=127.0.0.1:50994, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-02-10 19:03:33,181 DEBUG [Listener at localhost/41565-EventThread] zookeeper.ZKWatcher(600): master:45659-0x1003f9e01d30000, quorum=127.0.0.1:50994, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-02-10 19:03:33,181 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1077): Master has completed initialization 0.954sec 2023-02-10 19:03:33,181 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-02-10 19:03:33,181 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-02-10 19:03:33,181 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-02-10 19:03:33,181 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,45659,1676055812127-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-02-10 19:03:33,181 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,45659,1676055812127-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-02-10 19:03:33,182 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1166): Balancer post startup initialization complete, took 0 seconds 2023-02-10 19:03:33,220 DEBUG [Listener at localhost/41565] zookeeper.ReadOnlyZKClient(139): Connect 0x7043de30 to 127.0.0.1:50994 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-10 19:03:33,223 DEBUG [Listener at localhost/41565] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@73bab176, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-10 19:03:33,224 DEBUG [hconnection-0x12517e50-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-10 19:03:33,225 INFO [RS-EventLoopGroup-22-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51486, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-10 19:03:33,227 INFO [Listener at localhost/41565] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,45659,1676055812127 2023-02-10 19:03:33,227 DEBUG [Listener at localhost/41565] mapreduce.TableSnapshotInputFormatTestBase(193): Ensuring table doesn't exist. 2023-02-10 19:03:33,229 DEBUG [Listener at localhost/41565] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-10 19:03:33,230 INFO [RS-EventLoopGroup-21-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54088, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-10 19:03:33,230 INFO [Listener at localhost/41565] client.HBaseAdmin$15(890): Started disable of testWithMapReduce 2023-02-10 19:03:33,231 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45659] master.HMaster$11(2405): Client=jenkins//172.31.14.131 disable testWithMapReduce 2023-02-10 19:03:33,231 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45659] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.TableNotFoundException: testWithMapReduce at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.checkTableModifiable(AbstractStateMachineTableProcedure.java:125) at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.preflightChecks(AbstractStateMachineTableProcedure.java:157) at org.apache.hadoop.hbase.master.procedure.DisableTableProcedure.(DisableTableProcedure.java:78) at org.apache.hadoop.hbase.master.HMaster$11.run(HMaster.java:2416) at org.apache.hadoop.hbase.master.procedure.MasterProcedureUtil.submitProcedure(MasterProcedureUtil.java:132) at org.apache.hadoop.hbase.master.HMaster.disableTable(HMaster.java:2400) at org.apache.hadoop.hbase.master.MasterRpcServices.disableTable(MasterRpcServices.java:784) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-02-10 19:03:33,231 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45659] ipc.CallRunner(144): callId: 2 service: MasterService methodName: DisableTable size: 76 connection: 172.31.14.131:54088 deadline: 1676055873231, exception=org.apache.hadoop.hbase.TableNotFoundException: testWithMapReduce 2023-02-10 19:03:33,231 INFO [Listener at localhost/41565] mapreduce.TableSnapshotInputFormatTestBase(199): creating table 'testWithMapReduce' 2023-02-10 19:03:33,233 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45659] master.HMaster$4(2102): Client=jenkins//172.31.14.131 create 'testWithMapReduce', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-10 19:03:33,234 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45659] procedure2.ProcedureExecutor(1029): Stored pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testWithMapReduce 2023-02-10 19:03:33,235 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_PRE_OPERATION 2023-02-10 19:03:33,235 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45659] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testWithMapReduce" procId is: 10 2023-02-10 19:03:33,236 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-10 19:03:33,236 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45659] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-10 19:03:33,237 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41503/user/jenkins/test-data/ecd450e8-f1d8-69b3-568c-ca4b807752e7/.tmp/data/default/testWithMapReduce/7aadae6dc5bfd4413e9b24af3e4bcb95 2023-02-10 19:03:33,238 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:41503/user/jenkins/test-data/ecd450e8-f1d8-69b3-568c-ca4b807752e7/.tmp/data/default/testWithMapReduce/7aadae6dc5bfd4413e9b24af3e4bcb95 empty. 2023-02-10 19:03:33,238 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:41503/user/jenkins/test-data/ecd450e8-f1d8-69b3-568c-ca4b807752e7/.tmp/data/default/testWithMapReduce/7aadae6dc5bfd4413e9b24af3e4bcb95 2023-02-10 19:03:33,238 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testWithMapReduce regions 2023-02-10 19:03:33,253 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:41503/user/jenkins/test-data/ecd450e8-f1d8-69b3-568c-ca4b807752e7/.tmp/data/default/testWithMapReduce/.tabledesc/.tableinfo.0000000001 2023-02-10 19:03:33,256 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(7671): creating {ENCODED => 7aadae6dc5bfd4413e9b24af3e4bcb95, NAME => 'testWithMapReduce,,1676055813233.7aadae6dc5bfd4413e9b24af3e4bcb95.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testWithMapReduce', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:41503/user/jenkins/test-data/ecd450e8-f1d8-69b3-568c-ca4b807752e7/.tmp 2023-02-10 19:03:33,262 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676055813233.7aadae6dc5bfd4413e9b24af3e4bcb95.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-10 19:03:33,262 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1603): Closing 7aadae6dc5bfd4413e9b24af3e4bcb95, disabling compactions & flushes 2023-02-10 19:03:33,262 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676055813233.7aadae6dc5bfd4413e9b24af3e4bcb95. 2023-02-10 19:03:33,262 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676055813233.7aadae6dc5bfd4413e9b24af3e4bcb95. 2023-02-10 19:03:33,262 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676055813233.7aadae6dc5bfd4413e9b24af3e4bcb95. after waiting 0 ms 2023-02-10 19:03:33,262 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676055813233.7aadae6dc5bfd4413e9b24af3e4bcb95. 2023-02-10 19:03:33,262 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,,1676055813233.7aadae6dc5bfd4413e9b24af3e4bcb95. 2023-02-10 19:03:33,263 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1557): Region close journal for 7aadae6dc5bfd4413e9b24af3e4bcb95: Waiting for close lock at 1676055813262Disabling compacts and flushes for region at 1676055813262Disabling writes for close at 1676055813262Writing region close event to WAL at 1676055813262Closed at 1676055813262 2023-02-10 19:03:33,264 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_ADD_TO_META 2023-02-10 19:03:33,265 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,,1676055813233.7aadae6dc5bfd4413e9b24af3e4bcb95.","families":{"info":[{"qualifier":"regioninfo","vlen":51,"tag":[],"timestamp":"1676055813265"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676055813265"}]},"ts":"1676055813265"} 2023-02-10 19:03:33,266 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-10 19:03:33,267 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-10 19:03:33,267 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676055813267"}]},"ts":"1676055813267"} 2023-02-10 19:03:33,268 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=ENABLING in hbase:meta 2023-02-10 19:03:33,271 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-10 19:03:33,271 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-10 19:03:33,272 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-10 19:03:33,272 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-10 19:03:33,272 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=7aadae6dc5bfd4413e9b24af3e4bcb95, ASSIGN}] 2023-02-10 19:03:33,272 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=7aadae6dc5bfd4413e9b24af3e4bcb95, ASSIGN 2023-02-10 19:03:33,273 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=7aadae6dc5bfd4413e9b24af3e4bcb95, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,46597,1676055812202; forceNewPlan=false, retain=false 2023-02-10 19:03:33,338 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45659] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-10 19:03:33,423 INFO [jenkins-hbase4:45659] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-10 19:03:33,423 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=7aadae6dc5bfd4413e9b24af3e4bcb95, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,46597,1676055812202 2023-02-10 19:03:33,423 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,,1676055813233.7aadae6dc5bfd4413e9b24af3e4bcb95.","families":{"info":[{"qualifier":"regioninfo","vlen":51,"tag":[],"timestamp":"1676055813423"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676055813423"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676055813423"}]},"ts":"1676055813423"} 2023-02-10 19:03:33,425 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=12, ppid=11, state=RUNNABLE; OpenRegionProcedure 7aadae6dc5bfd4413e9b24af3e4bcb95, server=jenkins-hbase4.apache.org,46597,1676055812202}] 2023-02-10 19:03:33,495 INFO [RS:1;jenkins-hbase4:46597] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C46597%2C1676055812202, suffix=, logDir=hdfs://localhost:41503/user/jenkins/test-data/ecd450e8-f1d8-69b3-568c-ca4b807752e7/WALs/jenkins-hbase4.apache.org,46597,1676055812202, archiveDir=hdfs://localhost:41503/user/jenkins/test-data/ecd450e8-f1d8-69b3-568c-ca4b807752e7/oldWALs, maxLogs=32 2023-02-10 19:03:33,509 DEBUG [RS-EventLoopGroup-23-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39979,DS-4b65027e-6cae-4387-b8a3-5ad3d9cdee8b,DISK] 2023-02-10 19:03:33,509 DEBUG [RS-EventLoopGroup-23-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38779,DS-382a8945-a56a-457d-b65e-5cd96de2120a,DISK] 2023-02-10 19:03:33,512 INFO [RS:1;jenkins-hbase4:46597] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/ecd450e8-f1d8-69b3-568c-ca4b807752e7/WALs/jenkins-hbase4.apache.org,46597,1676055812202/jenkins-hbase4.apache.org%2C46597%2C1676055812202.1676055813495 2023-02-10 19:03:33,512 DEBUG [RS:1;jenkins-hbase4:46597] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:39979,DS-4b65027e-6cae-4387-b8a3-5ad3d9cdee8b,DISK], DatanodeInfoWithStorage[127.0.0.1:38779,DS-382a8945-a56a-457d-b65e-5cd96de2120a,DISK]] 2023-02-10 19:03:33,539 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45659] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-10 19:03:33,577 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,46597,1676055812202 2023-02-10 19:03:33,578 DEBUG [RSProcedureDispatcher-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-10 19:03:33,579 INFO [RS-EventLoopGroup-23-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49112, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-10 19:03:33,582 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,,1676055813233.7aadae6dc5bfd4413e9b24af3e4bcb95. 2023-02-10 19:03:33,582 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 7aadae6dc5bfd4413e9b24af3e4bcb95, NAME => 'testWithMapReduce,,1676055813233.7aadae6dc5bfd4413e9b24af3e4bcb95.', STARTKEY => '', ENDKEY => ''} 2023-02-10 19:03:33,582 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 7aadae6dc5bfd4413e9b24af3e4bcb95 2023-02-10 19:03:33,582 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676055813233.7aadae6dc5bfd4413e9b24af3e4bcb95.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-10 19:03:33,582 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 7aadae6dc5bfd4413e9b24af3e4bcb95 2023-02-10 19:03:33,582 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 7aadae6dc5bfd4413e9b24af3e4bcb95 2023-02-10 19:03:33,583 INFO [StoreOpener-7aadae6dc5bfd4413e9b24af3e4bcb95-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 7aadae6dc5bfd4413e9b24af3e4bcb95 2023-02-10 19:03:33,584 DEBUG [StoreOpener-7aadae6dc5bfd4413e9b24af3e4bcb95-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41503/user/jenkins/test-data/ecd450e8-f1d8-69b3-568c-ca4b807752e7/data/default/testWithMapReduce/7aadae6dc5bfd4413e9b24af3e4bcb95/f1 2023-02-10 19:03:33,585 DEBUG [StoreOpener-7aadae6dc5bfd4413e9b24af3e4bcb95-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41503/user/jenkins/test-data/ecd450e8-f1d8-69b3-568c-ca4b807752e7/data/default/testWithMapReduce/7aadae6dc5bfd4413e9b24af3e4bcb95/f1 2023-02-10 19:03:33,585 INFO [StoreOpener-7aadae6dc5bfd4413e9b24af3e4bcb95-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7aadae6dc5bfd4413e9b24af3e4bcb95 columnFamilyName f1 2023-02-10 19:03:33,585 INFO [StoreOpener-7aadae6dc5bfd4413e9b24af3e4bcb95-1] regionserver.HStore(310): Store=7aadae6dc5bfd4413e9b24af3e4bcb95/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-10 19:03:33,585 INFO [StoreOpener-7aadae6dc5bfd4413e9b24af3e4bcb95-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 7aadae6dc5bfd4413e9b24af3e4bcb95 2023-02-10 19:03:33,586 DEBUG [StoreOpener-7aadae6dc5bfd4413e9b24af3e4bcb95-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41503/user/jenkins/test-data/ecd450e8-f1d8-69b3-568c-ca4b807752e7/data/default/testWithMapReduce/7aadae6dc5bfd4413e9b24af3e4bcb95/f2 2023-02-10 19:03:33,586 DEBUG [StoreOpener-7aadae6dc5bfd4413e9b24af3e4bcb95-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41503/user/jenkins/test-data/ecd450e8-f1d8-69b3-568c-ca4b807752e7/data/default/testWithMapReduce/7aadae6dc5bfd4413e9b24af3e4bcb95/f2 2023-02-10 19:03:33,586 INFO [StoreOpener-7aadae6dc5bfd4413e9b24af3e4bcb95-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7aadae6dc5bfd4413e9b24af3e4bcb95 columnFamilyName f2 2023-02-10 19:03:33,587 INFO [StoreOpener-7aadae6dc5bfd4413e9b24af3e4bcb95-1] regionserver.HStore(310): Store=7aadae6dc5bfd4413e9b24af3e4bcb95/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-10 19:03:33,587 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:41503/user/jenkins/test-data/ecd450e8-f1d8-69b3-568c-ca4b807752e7/data/default/testWithMapReduce/7aadae6dc5bfd4413e9b24af3e4bcb95 2023-02-10 19:03:33,587 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:41503/user/jenkins/test-data/ecd450e8-f1d8-69b3-568c-ca4b807752e7/data/default/testWithMapReduce/7aadae6dc5bfd4413e9b24af3e4bcb95 2023-02-10 19:03:33,589 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-10 19:03:33,589 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 7aadae6dc5bfd4413e9b24af3e4bcb95 2023-02-10 19:03:33,591 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41503/user/jenkins/test-data/ecd450e8-f1d8-69b3-568c-ca4b807752e7/data/default/testWithMapReduce/7aadae6dc5bfd4413e9b24af3e4bcb95/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-10 19:03:33,591 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 7aadae6dc5bfd4413e9b24af3e4bcb95; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71300782, jitterRate=0.06246444582939148}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-10 19:03:33,591 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 7aadae6dc5bfd4413e9b24af3e4bcb95: Running coprocessor pre-open hook at 1676055813583Writing region info on filesystem at 1676055813583Initializing all the Stores at 1676055813583Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676055813583Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676055813583Cleaning up temporary data from old regions at 1676055813588 (+5 ms)Cleaning up detritus from prior splits at 1676055813588Running coprocessor post-open hooks at 1676055813591 (+3 ms)Region opened successfully at 1676055813591 2023-02-10 19:03:33,592 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,,1676055813233.7aadae6dc5bfd4413e9b24af3e4bcb95., pid=12, masterSystemTime=1676055813577 2023-02-10 19:03:33,594 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,,1676055813233.7aadae6dc5bfd4413e9b24af3e4bcb95. 2023-02-10 19:03:33,595 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,,1676055813233.7aadae6dc5bfd4413e9b24af3e4bcb95. 2023-02-10 19:03:33,595 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=7aadae6dc5bfd4413e9b24af3e4bcb95, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,46597,1676055812202 2023-02-10 19:03:33,595 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,,1676055813233.7aadae6dc5bfd4413e9b24af3e4bcb95.","families":{"info":[{"qualifier":"regioninfo","vlen":51,"tag":[],"timestamp":"1676055813595"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676055813595"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676055813595"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676055813595"}]},"ts":"1676055813595"} 2023-02-10 19:03:33,597 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=12, resume processing ppid=11 2023-02-10 19:03:33,597 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=12, ppid=11, state=SUCCESS; OpenRegionProcedure 7aadae6dc5bfd4413e9b24af3e4bcb95, server=jenkins-hbase4.apache.org,46597,1676055812202 in 171 msec 2023-02-10 19:03:33,599 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-02-10 19:03:33,599 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=7aadae6dc5bfd4413e9b24af3e4bcb95, ASSIGN in 325 msec 2023-02-10 19:03:33,599 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-10 19:03:33,599 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676055813599"}]},"ts":"1676055813599"} 2023-02-10 19:03:33,600 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=ENABLED in hbase:meta 2023-02-10 19:03:33,603 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_POST_OPERATION 2023-02-10 19:03:33,604 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=10, state=SUCCESS; CreateTableProcedure table=testWithMapReduce in 370 msec 2023-02-10 19:03:33,840 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45659] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-10 19:03:33,840 INFO [Listener at localhost/41565] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testWithMapReduce, procId: 10 completed 2023-02-10 19:03:33,841 DEBUG [Listener at localhost/41565] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testWithMapReduce get assigned. Timeout = 60000ms 2023-02-10 19:03:33,841 INFO [Listener at localhost/41565] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-10 19:03:33,842 INFO [Listener at localhost/41565] hbase.HBaseTestingUtility(3484): All regions for table testWithMapReduce assigned to meta. Checking AM states. 2023-02-10 19:03:33,843 INFO [Listener at localhost/41565] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-10 19:03:33,843 INFO [Listener at localhost/41565] hbase.HBaseTestingUtility(3504): All regions for table testWithMapReduce assigned. 2023-02-10 19:03:33,843 INFO [Listener at localhost/41565] mapreduce.TableSnapshotInputFormatTestBase(207): put some stuff in the table 2023-02-10 19:03:33,855 DEBUG [hconnection-0x12517e50-shared-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-10 19:03:33,866 INFO [RS-EventLoopGroup-23-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49116, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-10 19:03:33,872 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46597] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 17576 Client: jenkins//172.31.14.131 first region in multi=testWithMapReduce,,1676055813233.7aadae6dc5bfd4413e9b24af3e4bcb95. 2023-02-10 19:03:33,951 INFO [Listener at localhost/41565] mapreduce.TableSnapshotInputFormatTestBase(214): snapshot 2023-02-10 19:03:33,951 INFO [Listener at localhost/41565] snapshot.SnapshotTestingUtils(396): taking snapshot. 2023-02-10 19:03:33,952 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45659] master.MasterRpcServices(1580): Client=jenkins//172.31.14.131 snapshot request for:{ ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-10 19:03:33,952 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45659] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1676055813952 (current time:1676055813952). 2023-02-10 19:03:33,952 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45659] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-02-10 19:03:33,952 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45659] zookeeper.ReadOnlyZKClient(139): Connect 0x0b3d856e to 127.0.0.1:50994 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-10 19:03:33,955 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45659] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@c94cec0, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-10 19:03:33,956 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45659] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-10 19:03:33,957 INFO [RS-EventLoopGroup-22-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56524, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-10 19:03:33,958 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45659] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0b3d856e to 127.0.0.1:50994 2023-02-10 19:03:33,958 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45659] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-10 19:03:33,958 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45659] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-02-10 19:03:33,958 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45659] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-10 19:03:33,960 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45659] procedure2.ProcedureExecutor(1029): Stored pid=13, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-10 19:03:33,961 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=13, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-10 19:03:33,962 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=13, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE; timeout=600000, timestamp=1676056413962 2023-02-10 19:03:33,962 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45659] snapshot.SnapshotManager(653): Started snapshot: { ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-10 19:03:33,962 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot testWithMapReduceSingleRegion C_M_SNAPSHOT_TABLE on table testWithMapReduce 2023-02-10 19:03:33,963 DEBUG [Listener at localhost/41565] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-02-10 19:03:33,963 DEBUG [Listener at localhost/41565] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-02-10 19:03:33,964 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=14, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-10 19:03:33,964 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=13, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-10 19:03:33,965 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=13, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE in 5 msec 2023-02-10 19:03:33,966 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=14, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-10 19:03:33,966 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=14, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED; timeout=600000, timestamp=1676056413966 2023-02-10 19:03:33,973 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure testWithMapReduceSingleRegion 2023-02-10 19:03:33,973 INFO [(jenkins-hbase4.apache.org,45659,1676055812127)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMapReduceSingleRegion' 2023-02-10 19:03:33,973 DEBUG [(jenkins-hbase4.apache.org,45659,1676055812127)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-10 19:03:33,974 DEBUG [(jenkins-hbase4.apache.org,45659,1676055812127)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMapReduceSingleRegion' starting 'acquire' 2023-02-10 19:03:33,974 DEBUG [(jenkins-hbase4.apache.org,45659,1676055812127)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMapReduceSingleRegion', kicking off acquire phase on members. 2023-02-10 19:03:33,975 DEBUG [(jenkins-hbase4.apache.org,45659,1676055812127)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45659-0x1003f9e01d30000, quorum=127.0.0.1:50994, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-10 19:03:33,975 DEBUG [(jenkins-hbase4.apache.org,45659,1676055812127)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion 2023-02-10 19:03:33,976 DEBUG [Listener at localhost/41565-EventThread] zookeeper.ZKWatcher(600): regionserver:36579-0x1003f9e01d30001, quorum=127.0.0.1:50994, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-10 19:03:33,976 DEBUG [Listener at localhost/41565-EventThread] zookeeper.ZKWatcher(600): regionserver:46597-0x1003f9e01d30002, quorum=127.0.0.1:50994, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-10 19:03:33,976 DEBUG [(jenkins-hbase4.apache.org,45659,1676055812127)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,46597,1676055812202 2023-02-10 19:03:33,976 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-10 19:03:33,976 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-10 19:03:33,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-10 19:03:33,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-10 19:03:33,976 DEBUG [(jenkins-hbase4.apache.org,45659,1676055812127)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45659-0x1003f9e01d30000, quorum=127.0.0.1:50994, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,46597,1676055812202 2023-02-10 19:03:33,976 DEBUG [(jenkins-hbase4.apache.org,45659,1676055812127)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-10 19:03:33,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMapReduceSingleRegion 2023-02-10 19:03:33,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMapReduceSingleRegion 2023-02-10 19:03:33,977 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36579-0x1003f9e01d30001, quorum=127.0.0.1:50994, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-10 19:03:33,977 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46597-0x1003f9e01d30002, quorum=127.0.0.1:50994, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-10 19:03:33,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 67 2023-02-10 19:03:33,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 67 2023-02-10 19:03:33,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion 2023-02-10 19:03:33,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion 2023-02-10 19:03:33,977 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMapReduceSingleRegion from table testWithMapReduce type FLUSH 2023-02-10 19:03:33,977 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMapReduceSingleRegion from table testWithMapReduce type FLUSH 2023-02-10 19:03:33,977 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduceSingleRegion 2023-02-10 19:03:33,977 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduceSingleRegion 2023-02-10 19:03:33,977 DEBUG [member: 'jenkins-hbase4.apache.org,36579,1676055812179' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduceSingleRegion' with timeout 300000ms 2023-02-10 19:03:33,977 DEBUG [member: 'jenkins-hbase4.apache.org,46597,1676055812202' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduceSingleRegion' with timeout 300000ms 2023-02-10 19:03:33,977 DEBUG [member: 'jenkins-hbase4.apache.org,46597,1676055812202' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-10 19:03:33,977 DEBUG [member: 'jenkins-hbase4.apache.org,36579,1676055812179' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-10 19:03:33,978 DEBUG [member: 'jenkins-hbase4.apache.org,46597,1676055812202' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduceSingleRegion' starting 'acquire' stage 2023-02-10 19:03:33,980 DEBUG [member: 'jenkins-hbase4.apache.org,46597,1676055812202' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduceSingleRegion' locally acquired 2023-02-10 19:03:33,980 DEBUG [member: 'jenkins-hbase4.apache.org,46597,1676055812202' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46597,1676055812202' joining acquired barrier for procedure (testWithMapReduceSingleRegion) in zk 2023-02-10 19:03:33,980 DEBUG [member: 'jenkins-hbase4.apache.org,36579,1676055812179' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduceSingleRegion' starting 'acquire' stage 2023-02-10 19:03:33,980 DEBUG [member: 'jenkins-hbase4.apache.org,36579,1676055812179' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduceSingleRegion' locally acquired 2023-02-10 19:03:33,981 DEBUG [member: 'jenkins-hbase4.apache.org,36579,1676055812179' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36579,1676055812179' joining acquired barrier for procedure (testWithMapReduceSingleRegion) in zk 2023-02-10 19:03:33,983 DEBUG [Listener at localhost/41565-EventThread] zookeeper.ZKWatcher(600): master:45659-0x1003f9e01d30000, quorum=127.0.0.1:50994, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,46597,1676055812202 2023-02-10 19:03:33,983 DEBUG [member: 'jenkins-hbase4.apache.org,46597,1676055812202' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-10 19:03:33,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,46597,1676055812202 2023-02-10 19:03:33,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-10 19:03:33,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-10 19:03:33,984 DEBUG [member: 'jenkins-hbase4.apache.org,36579,1676055812179' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-10 19:03:33,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-10 19:03:33,984 DEBUG [member: 'jenkins-hbase4.apache.org,46597,1676055812202' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46597-0x1003f9e01d30002, quorum=127.0.0.1:50994, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-10 19:03:33,984 DEBUG [member: 'jenkins-hbase4.apache.org,46597,1676055812202' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduceSingleRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-10 19:03:33,984 DEBUG [member: 'jenkins-hbase4.apache.org,36579,1676055812179' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36579-0x1003f9e01d30001, quorum=127.0.0.1:50994, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-10 19:03:33,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-10 19:03:33,984 DEBUG [member: 'jenkins-hbase4.apache.org,36579,1676055812179' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduceSingleRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-10 19:03:33,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceSingleRegion 2023-02-10 19:03:33,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36579,1676055812179 2023-02-10 19:03:33,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46597,1676055812202 2023-02-10 19:03:33,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-10 19:03:33,985 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46597,1676055812202' joining acquired barrier for procedure 'testWithMapReduceSingleRegion' on coordinator 2023-02-10 19:03:33,985 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@174159d9[Count = 0] remaining members to acquire global barrier 2023-02-10 19:03:33,985 DEBUG [(jenkins-hbase4.apache.org,45659,1676055812127)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMapReduceSingleRegion' starting 'in-barrier' execution. 2023-02-10 19:03:33,985 DEBUG [(jenkins-hbase4.apache.org,45659,1676055812127)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-10 19:03:33,986 DEBUG [Listener at localhost/41565-EventThread] zookeeper.ZKWatcher(600): regionserver:36579-0x1003f9e01d30001, quorum=127.0.0.1:50994, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-10 19:03:33,986 DEBUG [Listener at localhost/41565-EventThread] zookeeper.ZKWatcher(600): regionserver:46597-0x1003f9e01d30002, quorum=127.0.0.1:50994, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-10 19:03:33,986 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-10 19:03:33,986 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-10 19:03:33,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-10 19:03:33,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-10 19:03:33,986 DEBUG [member: 'jenkins-hbase4.apache.org,46597,1676055812202' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduceSingleRegion' received 'reached' from coordinator. 2023-02-10 19:03:33,986 DEBUG [member: 'jenkins-hbase4.apache.org,36579,1676055812179' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduceSingleRegion' received 'reached' from coordinator. 2023-02-10 19:03:33,987 DEBUG [member: 'jenkins-hbase4.apache.org,36579,1676055812179' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduceSingleRegion' locally completed 2023-02-10 19:03:33,986 DEBUG [(jenkins-hbase4.apache.org,45659,1676055812127)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45659-0x1003f9e01d30000, quorum=127.0.0.1:50994, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,46597,1676055812202 2023-02-10 19:03:33,987 DEBUG [member: 'jenkins-hbase4.apache.org,36579,1676055812179' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduceSingleRegion' completed for member 'jenkins-hbase4.apache.org,36579,1676055812179' in zk 2023-02-10 19:03:33,987 DEBUG [member: 'jenkins-hbase4.apache.org,46597,1676055812202' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-02-10 19:03:33,987 DEBUG [member: 'jenkins-hbase4.apache.org,46597,1676055812202' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-10 19:03:33,987 DEBUG [(jenkins-hbase4.apache.org,45659,1676055812127)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-10 19:03:33,987 DEBUG [rs(jenkins-hbase4.apache.org,46597,1676055812202)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,,1676055813233.7aadae6dc5bfd4413e9b24af3e4bcb95. 2023-02-10 19:03:33,987 DEBUG [rs(jenkins-hbase4.apache.org,46597,1676055812202)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,,1676055813233.7aadae6dc5bfd4413e9b24af3e4bcb95. started... 2023-02-10 19:03:33,987 INFO [rs(jenkins-hbase4.apache.org,46597,1676055812202)-snapshot-pool-0] regionserver.HRegion(2744): Flushing 7aadae6dc5bfd4413e9b24af3e4bcb95 2/2 column families, dataSize=1.01 MB heapSize=3.49 MB 2023-02-10 19:03:33,988 DEBUG [member: 'jenkins-hbase4.apache.org,36579,1676055812179' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduceSingleRegion' has notified controller of completion 2023-02-10 19:03:33,988 DEBUG [member: 'jenkins-hbase4.apache.org,36579,1676055812179' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-10 19:03:33,988 DEBUG [member: 'jenkins-hbase4.apache.org,36579,1676055812179' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduceSingleRegion' completed. 2023-02-10 19:03:34,000 INFO [rs(jenkins-hbase4.apache.org,46597,1676055812202)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=514.92 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:41503/user/jenkins/test-data/ecd450e8-f1d8-69b3-568c-ca4b807752e7/data/default/testWithMapReduce/7aadae6dc5bfd4413e9b24af3e4bcb95/.tmp/f1/69ebbe0812df4cfb81b363cd59cb949f 2023-02-10 19:03:34,016 INFO [rs(jenkins-hbase4.apache.org,46597,1676055812202)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=514.92 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:41503/user/jenkins/test-data/ecd450e8-f1d8-69b3-568c-ca4b807752e7/data/default/testWithMapReduce/7aadae6dc5bfd4413e9b24af3e4bcb95/.tmp/f2/91b88f0c9b9444bda0a79af644659bed 2023-02-10 19:03:34,020 DEBUG [rs(jenkins-hbase4.apache.org,46597,1676055812202)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41503/user/jenkins/test-data/ecd450e8-f1d8-69b3-568c-ca4b807752e7/data/default/testWithMapReduce/7aadae6dc5bfd4413e9b24af3e4bcb95/.tmp/f1/69ebbe0812df4cfb81b363cd59cb949f as hdfs://localhost:41503/user/jenkins/test-data/ecd450e8-f1d8-69b3-568c-ca4b807752e7/data/default/testWithMapReduce/7aadae6dc5bfd4413e9b24af3e4bcb95/f1/69ebbe0812df4cfb81b363cd59cb949f 2023-02-10 19:03:34,023 INFO [rs(jenkins-hbase4.apache.org,46597,1676055812202)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41503/user/jenkins/test-data/ecd450e8-f1d8-69b3-568c-ca4b807752e7/data/default/testWithMapReduce/7aadae6dc5bfd4413e9b24af3e4bcb95/f1/69ebbe0812df4cfb81b363cd59cb949f, entries=17576, sequenceid=5, filesize=537.3 K 2023-02-10 19:03:34,023 DEBUG [rs(jenkins-hbase4.apache.org,46597,1676055812202)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41503/user/jenkins/test-data/ecd450e8-f1d8-69b3-568c-ca4b807752e7/data/default/testWithMapReduce/7aadae6dc5bfd4413e9b24af3e4bcb95/.tmp/f2/91b88f0c9b9444bda0a79af644659bed as hdfs://localhost:41503/user/jenkins/test-data/ecd450e8-f1d8-69b3-568c-ca4b807752e7/data/default/testWithMapReduce/7aadae6dc5bfd4413e9b24af3e4bcb95/f2/91b88f0c9b9444bda0a79af644659bed 2023-02-10 19:03:34,027 INFO [rs(jenkins-hbase4.apache.org,46597,1676055812202)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41503/user/jenkins/test-data/ecd450e8-f1d8-69b3-568c-ca4b807752e7/data/default/testWithMapReduce/7aadae6dc5bfd4413e9b24af3e4bcb95/f2/91b88f0c9b9444bda0a79af644659bed, entries=17576, sequenceid=5, filesize=537.3 K 2023-02-10 19:03:34,027 INFO [rs(jenkins-hbase4.apache.org,46597,1676055812202)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~1.01 MB/1054560, heapSize ~3.49 MB/3656288, currentSize=0 B/0 for 7aadae6dc5bfd4413e9b24af3e4bcb95 in 40ms, sequenceid=5, compaction requested=false 2023-02-10 19:03:34,027 DEBUG [rs(jenkins-hbase4.apache.org,46597,1676055812202)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 7aadae6dc5bfd4413e9b24af3e4bcb95: 2023-02-10 19:03:34,027 DEBUG [rs(jenkins-hbase4.apache.org,46597,1676055812202)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,,1676055813233.7aadae6dc5bfd4413e9b24af3e4bcb95.' region-info for snapshot=testWithMapReduceSingleRegion 2023-02-10 19:03:34,027 DEBUG [rs(jenkins-hbase4.apache.org,46597,1676055812202)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-10 19:03:34,027 DEBUG [rs(jenkins-hbase4.apache.org,46597,1676055812202)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:41503/user/jenkins/test-data/ecd450e8-f1d8-69b3-568c-ca4b807752e7/data/default/testWithMapReduce/7aadae6dc5bfd4413e9b24af3e4bcb95/f1/69ebbe0812df4cfb81b363cd59cb949f] hfiles 2023-02-10 19:03:34,027 DEBUG [rs(jenkins-hbase4.apache.org,46597,1676055812202)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:41503/user/jenkins/test-data/ecd450e8-f1d8-69b3-568c-ca4b807752e7/data/default/testWithMapReduce/7aadae6dc5bfd4413e9b24af3e4bcb95/f1/69ebbe0812df4cfb81b363cd59cb949f for snapshot=testWithMapReduceSingleRegion 2023-02-10 19:03:34,028 DEBUG [rs(jenkins-hbase4.apache.org,46597,1676055812202)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:41503/user/jenkins/test-data/ecd450e8-f1d8-69b3-568c-ca4b807752e7/data/default/testWithMapReduce/7aadae6dc5bfd4413e9b24af3e4bcb95/f2/91b88f0c9b9444bda0a79af644659bed] hfiles 2023-02-10 19:03:34,028 DEBUG [rs(jenkins-hbase4.apache.org,46597,1676055812202)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:41503/user/jenkins/test-data/ecd450e8-f1d8-69b3-568c-ca4b807752e7/data/default/testWithMapReduce/7aadae6dc5bfd4413e9b24af3e4bcb95/f2/91b88f0c9b9444bda0a79af644659bed for snapshot=testWithMapReduceSingleRegion 2023-02-10 19:03:34,033 DEBUG [rs(jenkins-hbase4.apache.org,46597,1676055812202)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,,1676055813233.7aadae6dc5bfd4413e9b24af3e4bcb95. completed. 2023-02-10 19:03:34,033 DEBUG [rs(jenkins-hbase4.apache.org,46597,1676055812202)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,,1676055813233.7aadae6dc5bfd4413e9b24af3e4bcb95. 2023-02-10 19:03:34,033 DEBUG [member: 'jenkins-hbase4.apache.org,46597,1676055812202' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-02-10 19:03:34,033 DEBUG [member: 'jenkins-hbase4.apache.org,46597,1676055812202' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-02-10 19:03:34,033 DEBUG [member: 'jenkins-hbase4.apache.org,46597,1676055812202' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,46597,1676055812202 2023-02-10 19:03:34,033 DEBUG [member: 'jenkins-hbase4.apache.org,46597,1676055812202' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduceSingleRegion' locally completed 2023-02-10 19:03:34,033 DEBUG [member: 'jenkins-hbase4.apache.org,46597,1676055812202' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduceSingleRegion' completed for member 'jenkins-hbase4.apache.org,46597,1676055812202' in zk 2023-02-10 19:03:34,035 DEBUG [Listener at localhost/41565-EventThread] zookeeper.ZKWatcher(600): master:45659-0x1003f9e01d30000, quorum=127.0.0.1:50994, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,46597,1676055812202 2023-02-10 19:03:34,035 DEBUG [member: 'jenkins-hbase4.apache.org,46597,1676055812202' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduceSingleRegion' has notified controller of completion 2023-02-10 19:03:34,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,46597,1676055812202 2023-02-10 19:03:34,035 DEBUG [member: 'jenkins-hbase4.apache.org,46597,1676055812202' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-10 19:03:34,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-10 19:03:34,035 DEBUG [member: 'jenkins-hbase4.apache.org,46597,1676055812202' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduceSingleRegion' completed. 2023-02-10 19:03:34,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-10 19:03:34,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-10 19:03:34,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-10 19:03:34,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceSingleRegion 2023-02-10 19:03:34,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36579,1676055812179 2023-02-10 19:03:34,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46597,1676055812202 2023-02-10 19:03:34,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-10 19:03:34,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceSingleRegion 2023-02-10 19:03:34,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36579,1676055812179 2023-02-10 19:03:34,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46597,1676055812202 2023-02-10 19:03:34,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduceSingleRegion' member 'jenkins-hbase4.apache.org,46597,1676055812202': 2023-02-10 19:03:34,038 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46597,1676055812202' released barrier for procedure'testWithMapReduceSingleRegion', counting down latch. Waiting for 0 more 2023-02-10 19:03:34,038 INFO [(jenkins-hbase4.apache.org,45659,1676055812127)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMapReduceSingleRegion' execution completed 2023-02-10 19:03:34,038 DEBUG [(jenkins-hbase4.apache.org,45659,1676055812127)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-10 19:03:34,038 DEBUG [(jenkins-hbase4.apache.org,45659,1676055812127)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-10 19:03:34,038 DEBUG [(jenkins-hbase4.apache.org,45659,1676055812127)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMapReduceSingleRegion 2023-02-10 19:03:34,038 INFO [(jenkins-hbase4.apache.org,45659,1676055812127)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMapReduceSingleRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-02-10 19:03:34,040 DEBUG [Listener at localhost/41565-EventThread] zookeeper.ZKWatcher(600): master:45659-0x1003f9e01d30000, quorum=127.0.0.1:50994, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-10 19:03:34,040 DEBUG [Listener at localhost/41565-EventThread] zookeeper.ZKWatcher(600): regionserver:46597-0x1003f9e01d30002, quorum=127.0.0.1:50994, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-10 19:03:34,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-10 19:03:34,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-10 19:03:34,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-10 19:03:34,040 DEBUG [Listener at localhost/41565-EventThread] zookeeper.ZKWatcher(600): regionserver:36579-0x1003f9e01d30001, quorum=127.0.0.1:50994, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-10 19:03:34,040 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-10 19:03:34,040 DEBUG [Listener at localhost/41565-EventThread] zookeeper.ZKWatcher(600): regionserver:46597-0x1003f9e01d30002, quorum=127.0.0.1:50994, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-10 19:03:34,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-10 19:03:34,040 DEBUG [Listener at localhost/41565-EventThread] zookeeper.ZKWatcher(600): regionserver:36579-0x1003f9e01d30001, quorum=127.0.0.1:50994, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-10 19:03:34,040 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-10 19:03:34,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-10 19:03:34,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-10 19:03:34,040 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-10 19:03:34,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-10 19:03:34,040 DEBUG [(jenkins-hbase4.apache.org,45659,1676055812127)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45659-0x1003f9e01d30000, quorum=127.0.0.1:50994, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,36579,1676055812179 2023-02-10 19:03:34,040 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-10 19:03:34,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-10 19:03:34,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-10 19:03:34,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceSingleRegion 2023-02-10 19:03:34,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-10 19:03:34,041 DEBUG [(jenkins-hbase4.apache.org,45659,1676055812127)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45659-0x1003f9e01d30000, quorum=127.0.0.1:50994, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,46597,1676055812202 2023-02-10 19:03:34,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-10 19:03:34,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceSingleRegion 2023-02-10 19:03:34,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36579,1676055812179 2023-02-10 19:03:34,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46597,1676055812202 2023-02-10 19:03:34,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-10 19:03:34,042 DEBUG [(jenkins-hbase4.apache.org,45659,1676055812127)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45659-0x1003f9e01d30000, quorum=127.0.0.1:50994, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,36579,1676055812179 2023-02-10 19:03:34,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceSingleRegion 2023-02-10 19:03:34,043 DEBUG [(jenkins-hbase4.apache.org,45659,1676055812127)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45659-0x1003f9e01d30000, quorum=127.0.0.1:50994, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,46597,1676055812202 2023-02-10 19:03:34,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36579,1676055812179 2023-02-10 19:03:34,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46597,1676055812202 2023-02-10 19:03:34,047 DEBUG [Listener at localhost/41565-EventThread] zookeeper.ZKWatcher(600): regionserver:36579-0x1003f9e01d30001, quorum=127.0.0.1:50994, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-10 19:03:34,047 DEBUG [Listener at localhost/41565-EventThread] zookeeper.ZKWatcher(600): regionserver:46597-0x1003f9e01d30002, quorum=127.0.0.1:50994, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-10 19:03:34,047 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-10 19:03:34,047 DEBUG [(jenkins-hbase4.apache.org,45659,1676055812127)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-10 19:03:34,047 DEBUG [Listener at localhost/41565-EventThread] zookeeper.ZKWatcher(600): master:45659-0x1003f9e01d30000, quorum=127.0.0.1:50994, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,46597,1676055812202 2023-02-10 19:03:34,047 DEBUG [Listener at localhost/41565-EventThread] zookeeper.ZKWatcher(600): regionserver:36579-0x1003f9e01d30001, quorum=127.0.0.1:50994, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-10 19:03:34,047 DEBUG [Listener at localhost/41565-EventThread] zookeeper.ZKWatcher(600): master:45659-0x1003f9e01d30000, quorum=127.0.0.1:50994, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion 2023-02-10 19:03:34,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-10 19:03:34,047 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for testWithMapReduceSingleRegion 2023-02-10 19:03:34,047 DEBUG [Listener at localhost/41565-EventThread] zookeeper.ZKWatcher(600): regionserver:46597-0x1003f9e01d30002, quorum=127.0.0.1:50994, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-10 19:03:34,048 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for testWithMapReduceSingleRegion 2023-02-10 19:03:34,047 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-10 19:03:34,047 DEBUG [Listener at localhost/41565-EventThread] zookeeper.ZKWatcher(600): master:45659-0x1003f9e01d30000, quorum=127.0.0.1:50994, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,36579,1676055812179 2023-02-10 19:03:34,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-10 19:03:34,048 DEBUG [Listener at localhost/41565-EventThread] zookeeper.ZKWatcher(600): master:45659-0x1003f9e01d30000, quorum=127.0.0.1:50994, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion 2023-02-10 19:03:34,048 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-10 19:03:34,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-10 19:03:34,048 DEBUG [Listener at localhost/41565-EventThread] zookeeper.ZKWatcher(600): master:45659-0x1003f9e01d30000, quorum=127.0.0.1:50994, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,46597,1676055812202 2023-02-10 19:03:34,048 DEBUG [Listener at localhost/41565-EventThread] zookeeper.ZKWatcher(600): master:45659-0x1003f9e01d30000, quorum=127.0.0.1:50994, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-10 19:03:34,048 DEBUG [Listener at localhost/41565-EventThread] zookeeper.ZKWatcher(600): master:45659-0x1003f9e01d30000, quorum=127.0.0.1:50994, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,36579,1676055812179 2023-02-10 19:03:34,048 DEBUG [Listener at localhost/41565-EventThread] zookeeper.ZKWatcher(600): master:45659-0x1003f9e01d30000, quorum=127.0.0.1:50994, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-10 19:03:34,048 DEBUG [Listener at localhost/41565-EventThread] zookeeper.ZKWatcher(600): master:45659-0x1003f9e01d30000, quorum=127.0.0.1:50994, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-10 19:03:34,048 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:41503/user/jenkins/test-data/ecd450e8-f1d8-69b3-568c-ca4b807752e7/.hbase-snapshot/.tmp/testWithMapReduceSingleRegion 2023-02-10 19:03:34,048 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-10 19:03:34,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-10 19:03:34,063 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:41503/user/jenkins/test-data/ecd450e8-f1d8-69b3-568c-ca4b807752e7/.hbase-snapshot/.tmp/testWithMapReduceSingleRegion to hdfs://localhost:41503/user/jenkins/test-data/ecd450e8-f1d8-69b3-568c-ca4b807752e7/.hbase-snapshot/testWithMapReduceSingleRegion 2023-02-10 19:03:34,063 DEBUG [Listener at localhost/41565] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-10 19:03:34,064 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45659] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-10 19:03:34,064 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45659] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-10 19:03:34,065 DEBUG [Listener at localhost/41565] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-02-10 19:03:34,077 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot testWithMapReduceSingleRegion of table testWithMapReduce completed 2023-02-10 19:03:34,077 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:41503/user/jenkins/test-data/ecd450e8-f1d8-69b3-568c-ca4b807752e7/.hbase-snapshot/.tmp/testWithMapReduceSingleRegion 2023-02-10 19:03:34,078 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:41503/user/jenkins/test-data/ecd450e8-f1d8-69b3-568c-ca4b807752e7/.hbase-snapshot/.tmp/testWithMapReduceSingleRegion 2023-02-10 19:03:34,078 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot testWithMapReduceSingleRegion C_M_SNAPSHOT_TABLE on table testWithMapReduce at 1676055813962Consolidate snapshot: testWithMapReduceSingleRegion at 1676055814048 (+86 ms)Loading Region manifests for testWithMapReduceSingleRegion at 1676055814048Writing data manifest for testWithMapReduceSingleRegion at 1676055814050 (+2 ms)Verifying snapshot: testWithMapReduceSingleRegion at 1676055814058 (+8 ms)Snapshot testWithMapReduceSingleRegion of table testWithMapReduce completed at 1676055814077 (+19 ms) 2023-02-10 19:03:34,079 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=14, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-10 19:03:34,080 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=14, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED in 116 msec 2023-02-10 19:03:34,265 DEBUG [Listener at localhost/41565] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-10 19:03:34,266 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45659] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-10 19:03:34,266 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45659] snapshot.SnapshotManager(401): Snapshot '{ ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 }' has completed, notifying client. 2023-02-10 19:03:34,266 INFO [Listener at localhost/41565] snapshot.SnapshotTestingUtils(399): Confirming snapshot exists. 2023-02-10 19:03:34,270 INFO [Listener at localhost/41565] snapshot.SnapshotTestingUtils(406): validating snapshot. 2023-02-10 19:03:34,274 INFO [Listener at localhost/41565] mapreduce.TableSnapshotInputFormatTestBase(218): load different values 2023-02-10 19:03:34,300 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46597] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 17576 Client: jenkins//172.31.14.131 first region in multi=testWithMapReduce,,1676055813233.7aadae6dc5bfd4413e9b24af3e4bcb95. 2023-02-10 19:03:34,380 INFO [Listener at localhost/41565] mapreduce.TableSnapshotInputFormatTestBase(222): cause flush to create new files in the region 2023-02-10 19:03:34,385 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45659] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-10 19:03:34,386 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45659] procedure.ProcedureCoordinator(165): Submitting procedure testWithMapReduce 2023-02-10 19:03:34,386 INFO [(jenkins-hbase4.apache.org,45659,1676055812127)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMapReduce' 2023-02-10 19:03:34,386 DEBUG [(jenkins-hbase4.apache.org,45659,1676055812127)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-10 19:03:34,386 DEBUG [(jenkins-hbase4.apache.org,45659,1676055812127)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMapReduce' starting 'acquire' 2023-02-10 19:03:34,386 DEBUG [(jenkins-hbase4.apache.org,45659,1676055812127)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMapReduce', kicking off acquire phase on members. 2023-02-10 19:03:34,387 DEBUG [(jenkins-hbase4.apache.org,45659,1676055812127)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45659-0x1003f9e01d30000, quorum=127.0.0.1:50994, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-10 19:03:34,387 DEBUG [(jenkins-hbase4.apache.org,45659,1676055812127)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-10 19:03:34,393 DEBUG [Listener at localhost/41565-EventThread] zookeeper.ZKWatcher(600): regionserver:46597-0x1003f9e01d30002, quorum=127.0.0.1:50994, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-10 19:03:34,393 DEBUG [(jenkins-hbase4.apache.org,45659,1676055812127)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,46597,1676055812202 2023-02-10 19:03:34,394 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-10 19:03:34,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-10 19:03:34,393 DEBUG [Listener at localhost/41565-EventThread] zookeeper.ZKWatcher(600): regionserver:36579-0x1003f9e01d30001, quorum=127.0.0.1:50994, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-10 19:03:34,394 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-10 19:03:34,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-10 19:03:34,394 DEBUG [(jenkins-hbase4.apache.org,45659,1676055812127)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45659-0x1003f9e01d30000, quorum=127.0.0.1:50994, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,46597,1676055812202 2023-02-10 19:03:34,394 DEBUG [(jenkins-hbase4.apache.org,45659,1676055812127)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-10 19:03:34,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-10 19:03:34,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-10 19:03:34,394 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36579-0x1003f9e01d30001, quorum=127.0.0.1:50994, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-10 19:03:34,394 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46597-0x1003f9e01d30002, quorum=127.0.0.1:50994, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-10 19:03:34,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-10 19:03:34,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-10 19:03:34,395 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMapReduce 2023-02-10 19:03:34,395 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduce 2023-02-10 19:03:34,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-10 19:03:34,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-10 19:03:34,395 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMapReduce 2023-02-10 19:03:34,395 DEBUG [member: 'jenkins-hbase4.apache.org,36579,1676055812179' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduce' with timeout 60000ms 2023-02-10 19:03:34,395 DEBUG [member: 'jenkins-hbase4.apache.org,36579,1676055812179' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-10 19:03:34,395 DEBUG [member: 'jenkins-hbase4.apache.org,36579,1676055812179' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduce' starting 'acquire' stage 2023-02-10 19:03:34,395 DEBUG [member: 'jenkins-hbase4.apache.org,36579,1676055812179' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduce' locally acquired 2023-02-10 19:03:34,395 DEBUG [member: 'jenkins-hbase4.apache.org,36579,1676055812179' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36579,1676055812179' joining acquired barrier for procedure (testWithMapReduce) in zk 2023-02-10 19:03:34,395 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduce 2023-02-10 19:03:34,395 DEBUG [member: 'jenkins-hbase4.apache.org,46597,1676055812202' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduce' with timeout 60000ms 2023-02-10 19:03:34,396 DEBUG [member: 'jenkins-hbase4.apache.org,46597,1676055812202' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-10 19:03:34,396 DEBUG [member: 'jenkins-hbase4.apache.org,46597,1676055812202' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduce' starting 'acquire' stage 2023-02-10 19:03:34,396 DEBUG [member: 'jenkins-hbase4.apache.org,46597,1676055812202' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-10 19:03:34,396 DEBUG [member: 'jenkins-hbase4.apache.org,46597,1676055812202' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-10 19:03:34,396 DEBUG [rs(jenkins-hbase4.apache.org,46597,1676055812202)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,,1676055813233.7aadae6dc5bfd4413e9b24af3e4bcb95. 2023-02-10 19:03:34,396 DEBUG [rs(jenkins-hbase4.apache.org,46597,1676055812202)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,,1676055813233.7aadae6dc5bfd4413e9b24af3e4bcb95. started... 2023-02-10 19:03:34,396 INFO [rs(jenkins-hbase4.apache.org,46597,1676055812202)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 7aadae6dc5bfd4413e9b24af3e4bcb95 2/2 column families, dataSize=1.58 MB heapSize=4.02 MB 2023-02-10 19:03:34,397 DEBUG [member: 'jenkins-hbase4.apache.org,36579,1676055812179' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-10 19:03:34,397 DEBUG [member: 'jenkins-hbase4.apache.org,36579,1676055812179' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36579-0x1003f9e01d30001, quorum=127.0.0.1:50994, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce 2023-02-10 19:03:34,397 DEBUG [member: 'jenkins-hbase4.apache.org,36579,1676055812179' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduce' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-10 19:03:34,411 INFO [rs(jenkins-hbase4.apache.org,46597,1676055812202)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=806.71 KB at sequenceid=9 (bloomFilter=false), to=hdfs://localhost:41503/user/jenkins/test-data/ecd450e8-f1d8-69b3-568c-ca4b807752e7/data/default/testWithMapReduce/7aadae6dc5bfd4413e9b24af3e4bcb95/.tmp/f1/24143e2d10fb43f59e49c09aad41b69b 2023-02-10 19:03:34,428 INFO [rs(jenkins-hbase4.apache.org,46597,1676055812202)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=806.71 KB at sequenceid=9 (bloomFilter=false), to=hdfs://localhost:41503/user/jenkins/test-data/ecd450e8-f1d8-69b3-568c-ca4b807752e7/data/default/testWithMapReduce/7aadae6dc5bfd4413e9b24af3e4bcb95/.tmp/f2/22bc0eae1fa643cebaa81e0c10a05a3d 2023-02-10 19:03:34,431 DEBUG [rs(jenkins-hbase4.apache.org,46597,1676055812202)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41503/user/jenkins/test-data/ecd450e8-f1d8-69b3-568c-ca4b807752e7/data/default/testWithMapReduce/7aadae6dc5bfd4413e9b24af3e4bcb95/.tmp/f1/24143e2d10fb43f59e49c09aad41b69b as hdfs://localhost:41503/user/jenkins/test-data/ecd450e8-f1d8-69b3-568c-ca4b807752e7/data/default/testWithMapReduce/7aadae6dc5bfd4413e9b24af3e4bcb95/f1/24143e2d10fb43f59e49c09aad41b69b 2023-02-10 19:03:34,435 INFO [rs(jenkins-hbase4.apache.org,46597,1676055812202)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41503/user/jenkins/test-data/ecd450e8-f1d8-69b3-568c-ca4b807752e7/data/default/testWithMapReduce/7aadae6dc5bfd4413e9b24af3e4bcb95/f1/24143e2d10fb43f59e49c09aad41b69b, entries=17576, sequenceid=9, filesize=829.4 K 2023-02-10 19:03:34,435 DEBUG [rs(jenkins-hbase4.apache.org,46597,1676055812202)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41503/user/jenkins/test-data/ecd450e8-f1d8-69b3-568c-ca4b807752e7/data/default/testWithMapReduce/7aadae6dc5bfd4413e9b24af3e4bcb95/.tmp/f2/22bc0eae1fa643cebaa81e0c10a05a3d as hdfs://localhost:41503/user/jenkins/test-data/ecd450e8-f1d8-69b3-568c-ca4b807752e7/data/default/testWithMapReduce/7aadae6dc5bfd4413e9b24af3e4bcb95/f2/22bc0eae1fa643cebaa81e0c10a05a3d 2023-02-10 19:03:34,438 INFO [rs(jenkins-hbase4.apache.org,46597,1676055812202)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41503/user/jenkins/test-data/ecd450e8-f1d8-69b3-568c-ca4b807752e7/data/default/testWithMapReduce/7aadae6dc5bfd4413e9b24af3e4bcb95/f2/22bc0eae1fa643cebaa81e0c10a05a3d, entries=17576, sequenceid=9, filesize=829.4 K 2023-02-10 19:03:34,439 INFO [rs(jenkins-hbase4.apache.org,46597,1676055812202)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~1.58 MB/1652144, heapSize ~4.02 MB/4218720, currentSize=0 B/0 for 7aadae6dc5bfd4413e9b24af3e4bcb95 in 43ms, sequenceid=9, compaction requested=false 2023-02-10 19:03:34,439 DEBUG [rs(jenkins-hbase4.apache.org,46597,1676055812202)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 7aadae6dc5bfd4413e9b24af3e4bcb95: 2023-02-10 19:03:34,439 DEBUG [rs(jenkins-hbase4.apache.org,46597,1676055812202)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,,1676055813233.7aadae6dc5bfd4413e9b24af3e4bcb95. 2023-02-10 19:03:34,439 DEBUG [member: 'jenkins-hbase4.apache.org,46597,1676055812202' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-10 19:03:34,439 DEBUG [member: 'jenkins-hbase4.apache.org,46597,1676055812202' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-10 19:03:34,439 DEBUG [member: 'jenkins-hbase4.apache.org,46597,1676055812202' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46597,1676055812202 2023-02-10 19:03:34,439 DEBUG [member: 'jenkins-hbase4.apache.org,46597,1676055812202' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduce' locally acquired 2023-02-10 19:03:34,439 DEBUG [member: 'jenkins-hbase4.apache.org,46597,1676055812202' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46597,1676055812202' joining acquired barrier for procedure (testWithMapReduce) in zk 2023-02-10 19:03:34,441 DEBUG [Listener at localhost/41565-EventThread] zookeeper.ZKWatcher(600): master:45659-0x1003f9e01d30000, quorum=127.0.0.1:50994, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,46597,1676055812202 2023-02-10 19:03:34,441 DEBUG [member: 'jenkins-hbase4.apache.org,46597,1676055812202' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-10 19:03:34,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,46597,1676055812202 2023-02-10 19:03:34,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-10 19:03:34,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-10 19:03:34,441 DEBUG [member: 'jenkins-hbase4.apache.org,46597,1676055812202' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46597-0x1003f9e01d30002, quorum=127.0.0.1:50994, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce 2023-02-10 19:03:34,441 DEBUG [member: 'jenkins-hbase4.apache.org,46597,1676055812202' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduce' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-10 19:03:34,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-10 19:03:34,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-10 19:03:34,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-10 19:03:34,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36579,1676055812179 2023-02-10 19:03:34,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46597,1676055812202 2023-02-10 19:03:34,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-10 19:03:34,443 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46597,1676055812202' joining acquired barrier for procedure 'testWithMapReduce' on coordinator 2023-02-10 19:03:34,443 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@137edfe9[Count = 0] remaining members to acquire global barrier 2023-02-10 19:03:34,443 DEBUG [(jenkins-hbase4.apache.org,45659,1676055812127)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMapReduce' starting 'in-barrier' execution. 2023-02-10 19:03:34,443 DEBUG [(jenkins-hbase4.apache.org,45659,1676055812127)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-10 19:03:34,444 DEBUG [Listener at localhost/41565-EventThread] zookeeper.ZKWatcher(600): regionserver:36579-0x1003f9e01d30001, quorum=127.0.0.1:50994, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-10 19:03:34,444 DEBUG [Listener at localhost/41565-EventThread] zookeeper.ZKWatcher(600): regionserver:46597-0x1003f9e01d30002, quorum=127.0.0.1:50994, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-10 19:03:34,444 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-10 19:03:34,444 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-10 19:03:34,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-10 19:03:34,444 DEBUG [(jenkins-hbase4.apache.org,45659,1676055812127)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45659-0x1003f9e01d30000, quorum=127.0.0.1:50994, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,46597,1676055812202 2023-02-10 19:03:34,444 DEBUG [member: 'jenkins-hbase4.apache.org,36579,1676055812179' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduce' received 'reached' from coordinator. 2023-02-10 19:03:34,444 DEBUG [member: 'jenkins-hbase4.apache.org,36579,1676055812179' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduce' locally completed 2023-02-10 19:03:34,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-10 19:03:34,444 DEBUG [member: 'jenkins-hbase4.apache.org,36579,1676055812179' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduce' completed for member 'jenkins-hbase4.apache.org,36579,1676055812179' in zk 2023-02-10 19:03:34,445 DEBUG [member: 'jenkins-hbase4.apache.org,46597,1676055812202' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduce' received 'reached' from coordinator. 2023-02-10 19:03:34,445 DEBUG [member: 'jenkins-hbase4.apache.org,46597,1676055812202' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduce' locally completed 2023-02-10 19:03:34,445 DEBUG [member: 'jenkins-hbase4.apache.org,46597,1676055812202' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduce' completed for member 'jenkins-hbase4.apache.org,46597,1676055812202' in zk 2023-02-10 19:03:34,444 DEBUG [(jenkins-hbase4.apache.org,45659,1676055812127)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-10 19:03:34,446 DEBUG [member: 'jenkins-hbase4.apache.org,36579,1676055812179' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduce' has notified controller of completion 2023-02-10 19:03:34,446 DEBUG [member: 'jenkins-hbase4.apache.org,36579,1676055812179' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-10 19:03:34,446 DEBUG [Listener at localhost/41565-EventThread] zookeeper.ZKWatcher(600): master:45659-0x1003f9e01d30000, quorum=127.0.0.1:50994, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,46597,1676055812202 2023-02-10 19:03:34,446 DEBUG [member: 'jenkins-hbase4.apache.org,46597,1676055812202' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduce' has notified controller of completion 2023-02-10 19:03:34,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,46597,1676055812202 2023-02-10 19:03:34,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-10 19:03:34,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-10 19:03:34,446 DEBUG [member: 'jenkins-hbase4.apache.org,36579,1676055812179' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduce' completed. 2023-02-10 19:03:34,447 DEBUG [member: 'jenkins-hbase4.apache.org,46597,1676055812202' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-10 19:03:34,447 DEBUG [member: 'jenkins-hbase4.apache.org,46597,1676055812202' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduce' completed. 2023-02-10 19:03:34,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-10 19:03:34,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-10 19:03:34,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-10 19:03:34,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36579,1676055812179 2023-02-10 19:03:34,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46597,1676055812202 2023-02-10 19:03:34,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-10 19:03:34,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-10 19:03:34,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36579,1676055812179 2023-02-10 19:03:34,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46597,1676055812202 2023-02-10 19:03:34,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduce' member 'jenkins-hbase4.apache.org,46597,1676055812202': 2023-02-10 19:03:34,449 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46597,1676055812202' released barrier for procedure'testWithMapReduce', counting down latch. Waiting for 0 more 2023-02-10 19:03:34,449 INFO [(jenkins-hbase4.apache.org,45659,1676055812127)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMapReduce' execution completed 2023-02-10 19:03:34,449 DEBUG [(jenkins-hbase4.apache.org,45659,1676055812127)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-10 19:03:34,449 DEBUG [(jenkins-hbase4.apache.org,45659,1676055812127)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-10 19:03:34,449 DEBUG [(jenkins-hbase4.apache.org,45659,1676055812127)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMapReduce 2023-02-10 19:03:34,449 INFO [(jenkins-hbase4.apache.org,45659,1676055812127)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMapReduceincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-10 19:03:34,451 DEBUG [Listener at localhost/41565-EventThread] zookeeper.ZKWatcher(600): master:45659-0x1003f9e01d30000, quorum=127.0.0.1:50994, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-10 19:03:34,451 DEBUG [Listener at localhost/41565-EventThread] zookeeper.ZKWatcher(600): regionserver:36579-0x1003f9e01d30001, quorum=127.0.0.1:50994, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-10 19:03:34,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-10 19:03:34,451 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-10 19:03:34,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-10 19:03:34,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-10 19:03:34,451 DEBUG [Listener at localhost/41565-EventThread] zookeeper.ZKWatcher(600): regionserver:36579-0x1003f9e01d30001, quorum=127.0.0.1:50994, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-10 19:03:34,451 DEBUG [Listener at localhost/41565-EventThread] zookeeper.ZKWatcher(600): regionserver:46597-0x1003f9e01d30002, quorum=127.0.0.1:50994, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-10 19:03:34,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-10 19:03:34,451 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-10 19:03:34,451 DEBUG [Listener at localhost/41565-EventThread] zookeeper.ZKWatcher(600): regionserver:46597-0x1003f9e01d30002, quorum=127.0.0.1:50994, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-10 19:03:34,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-10 19:03:34,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-10 19:03:34,451 DEBUG [(jenkins-hbase4.apache.org,45659,1676055812127)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45659-0x1003f9e01d30000, quorum=127.0.0.1:50994, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,36579,1676055812179 2023-02-10 19:03:34,451 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-10 19:03:34,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-10 19:03:34,451 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-10 19:03:34,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-10 19:03:34,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-10 19:03:34,451 DEBUG [(jenkins-hbase4.apache.org,45659,1676055812127)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45659-0x1003f9e01d30000, quorum=127.0.0.1:50994, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,46597,1676055812202 2023-02-10 19:03:34,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-10 19:03:34,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-10 19:03:34,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-10 19:03:34,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-10 19:03:34,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36579,1676055812179 2023-02-10 19:03:34,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46597,1676055812202 2023-02-10 19:03:34,453 DEBUG [(jenkins-hbase4.apache.org,45659,1676055812127)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45659-0x1003f9e01d30000, quorum=127.0.0.1:50994, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,36579,1676055812179 2023-02-10 19:03:34,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-10 19:03:34,453 DEBUG [(jenkins-hbase4.apache.org,45659,1676055812127)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45659-0x1003f9e01d30000, quorum=127.0.0.1:50994, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,46597,1676055812202 2023-02-10 19:03:34,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-10 19:03:34,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36579,1676055812179 2023-02-10 19:03:34,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46597,1676055812202 2023-02-10 19:03:34,455 DEBUG [Listener at localhost/41565-EventThread] zookeeper.ZKWatcher(600): master:45659-0x1003f9e01d30000, quorum=127.0.0.1:50994, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,46597,1676055812202 2023-02-10 19:03:34,455 DEBUG [Listener at localhost/41565-EventThread] zookeeper.ZKWatcher(600): master:45659-0x1003f9e01d30000, quorum=127.0.0.1:50994, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-10 19:03:34,455 DEBUG [Listener at localhost/41565-EventThread] zookeeper.ZKWatcher(600): regionserver:46597-0x1003f9e01d30002, quorum=127.0.0.1:50994, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-10 19:03:34,455 DEBUG [Listener at localhost/41565-EventThread] zookeeper.ZKWatcher(600): regionserver:36579-0x1003f9e01d30001, quorum=127.0.0.1:50994, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-10 19:03:34,455 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-10 19:03:34,455 DEBUG [Listener at localhost/41565-EventThread] zookeeper.ZKWatcher(600): regionserver:46597-0x1003f9e01d30002, quorum=127.0.0.1:50994, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-10 19:03:34,455 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45659] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testWithMapReduce' 2023-02-10 19:03:34,455 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45659] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-10 19:03:34,455 DEBUG [Listener at localhost/41565-EventThread] zookeeper.ZKWatcher(600): master:45659-0x1003f9e01d30000, quorum=127.0.0.1:50994, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,36579,1676055812179 2023-02-10 19:03:34,455 DEBUG [(jenkins-hbase4.apache.org,45659,1676055812127)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-10 19:03:34,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-10 19:03:34,455 DEBUG [Listener at localhost/41565-EventThread] zookeeper.ZKWatcher(600): regionserver:36579-0x1003f9e01d30001, quorum=127.0.0.1:50994, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-10 19:03:34,455 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-10 19:03:34,455 DEBUG [Listener at localhost/41565-EventThread] zookeeper.ZKWatcher(600): master:45659-0x1003f9e01d30000, quorum=127.0.0.1:50994, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-10 19:03:34,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-10 19:03:34,456 DEBUG [Listener at localhost/41565] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testWithMapReduce'' to complete. (max 20000 ms per retry) 2023-02-10 19:03:34,456 DEBUG [Listener at localhost/41565] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-10 19:03:34,456 DEBUG [Listener at localhost/41565-EventThread] zookeeper.ZKWatcher(600): master:45659-0x1003f9e01d30000, quorum=127.0.0.1:50994, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,46597,1676055812202 2023-02-10 19:03:34,456 DEBUG [Listener at localhost/41565-EventThread] zookeeper.ZKWatcher(600): master:45659-0x1003f9e01d30000, quorum=127.0.0.1:50994, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-10 19:03:34,456 DEBUG [Listener at localhost/41565-EventThread] zookeeper.ZKWatcher(600): master:45659-0x1003f9e01d30000, quorum=127.0.0.1:50994, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,36579,1676055812179 2023-02-10 19:03:34,456 DEBUG [Listener at localhost/41565-EventThread] zookeeper.ZKWatcher(600): master:45659-0x1003f9e01d30000, quorum=127.0.0.1:50994, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-10 19:03:34,456 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-10 19:03:34,456 DEBUG [Listener at localhost/41565-EventThread] zookeeper.ZKWatcher(600): master:45659-0x1003f9e01d30000, quorum=127.0.0.1:50994, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-10 19:03:34,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-10 19:03:34,456 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-10 19:03:34,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-10 19:03:34,556 DEBUG [Listener at localhost/41565] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-10 19:03:34,557 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45659] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-10 19:03:34,642 DEBUG [Listener at localhost/41565] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapred.TestTableSnapshotInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a17aec85-f465-d9de-1a14-2563d6e642af/hadoop-2823307263918826020.jar 2023-02-10 19:03:34,645 INFO [Listener at localhost/41565] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "testWithMapReduceSingleRegion" table: "testWithMapReduce" creation_time: 1676055813952 type: FLUSH version: 2 ttl: 0 2023-02-10 19:03:34,645 DEBUG [Listener at localhost/41565] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost:41503/user/jenkins/test-data/abc58f6a-5f84-d220-f63f-ce670deedaf7/testWithMapReduceSingleRegion/3b854e25-3052-4bca-831a-128737cd94ef/data/default/testWithMapReduce 2023-02-10 19:03:34,646 INFO [Listener at localhost/41565] snapshot.RestoreSnapshotHelper(239): region to add: 7aadae6dc5bfd4413e9b24af3e4bcb95 2023-02-10 19:03:34,646 INFO [Listener at localhost/41565] snapshot.RestoreSnapshotHelper(585): clone region=7aadae6dc5bfd4413e9b24af3e4bcb95 as 7aadae6dc5bfd4413e9b24af3e4bcb95 in snapshot testWithMapReduceSingleRegion 2023-02-10 19:03:34,647 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(7671): creating {ENCODED => 7aadae6dc5bfd4413e9b24af3e4bcb95, NAME => 'testWithMapReduce,,1676055813233.7aadae6dc5bfd4413e9b24af3e4bcb95.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testWithMapReduce', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:41503/user/jenkins/test-data/abc58f6a-5f84-d220-f63f-ce670deedaf7/testWithMapReduceSingleRegion/3b854e25-3052-4bca-831a-128737cd94ef 2023-02-10 19:03:34,670 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676055813233.7aadae6dc5bfd4413e9b24af3e4bcb95.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-10 19:03:34,670 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 69ebbe0812df4cfb81b363cd59cb949f from cloned region in snapshot testWithMapReduceSingleRegion to table=testWithMapReduce 2023-02-10 19:03:34,672 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 91b88f0c9b9444bda0a79af644659bed from cloned region in snapshot testWithMapReduceSingleRegion to table=testWithMapReduce 2023-02-10 19:03:34,673 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1603): Closing 7aadae6dc5bfd4413e9b24af3e4bcb95, disabling compactions & flushes 2023-02-10 19:03:34,673 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676055813233.7aadae6dc5bfd4413e9b24af3e4bcb95. 2023-02-10 19:03:34,673 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676055813233.7aadae6dc5bfd4413e9b24af3e4bcb95. 2023-02-10 19:03:34,673 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676055813233.7aadae6dc5bfd4413e9b24af3e4bcb95. after waiting 0 ms 2023-02-10 19:03:34,673 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676055813233.7aadae6dc5bfd4413e9b24af3e4bcb95. 2023-02-10 19:03:34,673 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,,1676055813233.7aadae6dc5bfd4413e9b24af3e4bcb95. 2023-02-10 19:03:34,673 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1557): Region close journal for 7aadae6dc5bfd4413e9b24af3e4bcb95: Waiting for close lock at 1676055814673Disabling compacts and flushes for region at 1676055814673Disabling writes for close at 1676055814673Writing region close event to WAL at 1676055814673Closed at 1676055814673 2023-02-10 19:03:34,674 INFO [Listener at localhost/41565] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "testWithMapReduceSingleRegion" table: "testWithMapReduce" creation_time: 1676055813952 type: FLUSH version: 2 ttl: 0 2023-02-10 19:03:34,674 DEBUG [Listener at localhost/41565] snapshot.RestoreSnapshotHelper(832): Restored table dir:hdfs://localhost:41503/user/jenkins/test-data/abc58f6a-5f84-d220-f63f-ce670deedaf7/testWithMapReduceSingleRegion/3b854e25-3052-4bca-831a-128737cd94ef 2023-02-10 19:03:34,674 DEBUG [Listener at localhost/41565] util.CommonFSUtils(682): File system contents for path hdfs://localhost:41503/user/jenkins/test-data/abc58f6a-5f84-d220-f63f-ce670deedaf7/testWithMapReduceSingleRegion/3b854e25-3052-4bca-831a-128737cd94ef 2023-02-10 19:03:34,674 DEBUG [Listener at localhost/41565] util.CommonFSUtils(699): |-data/ 2023-02-10 19:03:34,675 DEBUG [Listener at localhost/41565] util.CommonFSUtils(699): |----default/ 2023-02-10 19:03:34,675 DEBUG [Listener at localhost/41565] util.CommonFSUtils(699): |-------testWithMapReduce/ 2023-02-10 19:03:34,675 DEBUG [Listener at localhost/41565] util.CommonFSUtils(699): |----------7aadae6dc5bfd4413e9b24af3e4bcb95/ 2023-02-10 19:03:34,676 DEBUG [Listener at localhost/41565] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-10 19:03:34,676 DEBUG [Listener at localhost/41565] util.CommonFSUtils(699): |-------------f1/ 2023-02-10 19:03:34,676 DEBUG [Listener at localhost/41565] util.CommonFSUtils(702): |----------------testWithMapReduce=7aadae6dc5bfd4413e9b24af3e4bcb95-69ebbe0812df4cfb81b363cd59cb949f 2023-02-10 19:03:34,676 DEBUG [Listener at localhost/41565] util.CommonFSUtils(699): |-------------f2/ 2023-02-10 19:03:34,676 DEBUG [Listener at localhost/41565] util.CommonFSUtils(702): |----------------testWithMapReduce=7aadae6dc5bfd4413e9b24af3e4bcb95-91b88f0c9b9444bda0a79af644659bed 2023-02-10 19:03:34,677 DEBUG [Listener at localhost/41565] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.17-SNAPSHOT.jar 2023-02-10 19:03:34,677 DEBUG [Listener at localhost/41565] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.17-SNAPSHOT.jar 2023-02-10 19:03:34,677 DEBUG [Listener at localhost/41565] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.17-SNAPSHOT.jar 2023-02-10 19:03:34,678 DEBUG [Listener at localhost/41565] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.17-SNAPSHOT.jar 2023-02-10 19:03:34,678 DEBUG [Listener at localhost/41565] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.17-SNAPSHOT.jar 2023-02-10 19:03:34,678 DEBUG [Listener at localhost/41565] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.17-SNAPSHOT.jar 2023-02-10 19:03:34,678 DEBUG [Listener at localhost/41565] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.17-SNAPSHOT.jar 2023-02-10 19:03:34,745 DEBUG [Listener at localhost/41565] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a17aec85-f465-d9de-1a14-2563d6e642af/hadoop-111919347974493853.jar 2023-02-10 19:03:34,745 DEBUG [Listener at localhost/41565] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.17-SNAPSHOT.jar 2023-02-10 19:03:34,746 DEBUG [Listener at localhost/41565] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.17-SNAPSHOT.jar 2023-02-10 19:03:34,746 DEBUG [Listener at localhost/41565] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.17-SNAPSHOT.jar 2023-02-10 19:03:34,746 DEBUG [Listener at localhost/41565] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.17-SNAPSHOT.jar 2023-02-10 19:03:34,747 DEBUG [Listener at localhost/41565] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.17-SNAPSHOT.jar 2023-02-10 19:03:34,747 DEBUG [Listener at localhost/41565] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.17-SNAPSHOT.jar 2023-02-10 19:03:34,747 DEBUG [Listener at localhost/41565] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-02-10 19:03:34,748 DEBUG [Listener at localhost/41565] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-02-10 19:03:34,748 DEBUG [Listener at localhost/41565] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-02-10 19:03:34,748 DEBUG [Listener at localhost/41565] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-02-10 19:03:34,748 DEBUG [Listener at localhost/41565] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-02-10 19:03:34,749 DEBUG [Listener at localhost/41565] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-02-10 19:03:34,749 DEBUG [Listener at localhost/41565] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-02-10 19:03:34,749 DEBUG [Listener at localhost/41565] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-02-10 19:03:34,750 DEBUG [Listener at localhost/41565] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-02-10 19:03:34,750 DEBUG [Listener at localhost/41565] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-02-10 19:03:34,751 DEBUG [Listener at localhost/41565] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.io.ImmutableBytesWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.17-SNAPSHOT.jar 2023-02-10 19:03:34,751 DEBUG [Listener at localhost/41565] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.NullWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-10 19:03:34,751 DEBUG [Listener at localhost/41565] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-10 19:03:34,751 DEBUG [Listener at localhost/41565] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-10 19:03:34,752 DEBUG [Listener at localhost/41565] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapred.lib.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-02-10 19:03:34,817 DEBUG [Listener at localhost/41565] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapred.TableSnapshotInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a17aec85-f465-d9de-1a14-2563d6e642af/hadoop-6063843209837090958.jar 2023-02-10 19:03:34,817 DEBUG [Listener at localhost/41565] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapred.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-02-10 19:03:34,823 WARN [Listener at localhost/41565] mapreduce.JobResourceUploader(142): Hadoop command-line option parsing not performed. Implement the Tool interface and execute your application with ToolRunner to remedy this. 2023-02-10 19:03:34,853 INFO [Listener at localhost/41565] mapreduce.TableSnapshotInputFormatImpl(392): Provided Scan has DEFAULT ReadType, updating STREAM for Snapshot-based InputFormat 2023-02-10 19:03:34,931 WARN [Listener at localhost/41565] fs.FileUtil(850): Command 'ln -s /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a17aec85-f465-d9de-1a14-2563d6e642af/mapreduce.cluster.local.dir/1676055814897/libjars /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/*' failed 1 with: ln: failed to create symbolic link '/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/*': No such file or directory 2023-02-10 19:03:34,931 WARN [Listener at localhost/41565] mapred.LocalDistributedCacheManager(202): Failed to create symlink: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a17aec85-f465-d9de-1a14-2563d6e642af/mapreduce.cluster.local.dir/1676055814897/libjars <- /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/* 2023-02-10 19:03:34,962 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676055813233.7aadae6dc5bfd4413e9b24af3e4bcb95.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-10 19:03:34,962 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-10 19:03:34,963 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-10 19:03:34,965 INFO [StoreOpener-7aadae6dc5bfd4413e9b24af3e4bcb95-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 7aadae6dc5bfd4413e9b24af3e4bcb95 2023-02-10 19:03:34,965 DEBUG [StoreOpener-7aadae6dc5bfd4413e9b24af3e4bcb95-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41503/user/jenkins/test-data/abc58f6a-5f84-d220-f63f-ce670deedaf7/testWithMapReduceSingleRegion/3b854e25-3052-4bca-831a-128737cd94ef/data/default/testWithMapReduce/7aadae6dc5bfd4413e9b24af3e4bcb95/f1 2023-02-10 19:03:34,966 INFO [StoreOpener-7aadae6dc5bfd4413e9b24af3e4bcb95-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7aadae6dc5bfd4413e9b24af3e4bcb95 columnFamilyName f1 2023-02-10 19:03:34,970 DEBUG [StoreOpener-7aadae6dc5bfd4413e9b24af3e4bcb95-1] regionserver.HStore(539): loaded hdfs://localhost:41503/user/jenkins/test-data/abc58f6a-5f84-d220-f63f-ce670deedaf7/testWithMapReduceSingleRegion/3b854e25-3052-4bca-831a-128737cd94ef/data/default/testWithMapReduce/7aadae6dc5bfd4413e9b24af3e4bcb95/f1/testWithMapReduce=7aadae6dc5bfd4413e9b24af3e4bcb95-69ebbe0812df4cfb81b363cd59cb949f 2023-02-10 19:03:34,970 INFO [StoreOpener-7aadae6dc5bfd4413e9b24af3e4bcb95-1] regionserver.HStore(310): Store=7aadae6dc5bfd4413e9b24af3e4bcb95/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-10 19:03:34,970 INFO [StoreOpener-7aadae6dc5bfd4413e9b24af3e4bcb95-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 7aadae6dc5bfd4413e9b24af3e4bcb95 2023-02-10 19:03:34,971 DEBUG [StoreOpener-7aadae6dc5bfd4413e9b24af3e4bcb95-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41503/user/jenkins/test-data/abc58f6a-5f84-d220-f63f-ce670deedaf7/testWithMapReduceSingleRegion/3b854e25-3052-4bca-831a-128737cd94ef/data/default/testWithMapReduce/7aadae6dc5bfd4413e9b24af3e4bcb95/f2 2023-02-10 19:03:34,971 INFO [StoreOpener-7aadae6dc5bfd4413e9b24af3e4bcb95-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7aadae6dc5bfd4413e9b24af3e4bcb95 columnFamilyName f2 2023-02-10 19:03:34,975 DEBUG [StoreOpener-7aadae6dc5bfd4413e9b24af3e4bcb95-1] regionserver.HStore(539): loaded hdfs://localhost:41503/user/jenkins/test-data/abc58f6a-5f84-d220-f63f-ce670deedaf7/testWithMapReduceSingleRegion/3b854e25-3052-4bca-831a-128737cd94ef/data/default/testWithMapReduce/7aadae6dc5bfd4413e9b24af3e4bcb95/f2/testWithMapReduce=7aadae6dc5bfd4413e9b24af3e4bcb95-91b88f0c9b9444bda0a79af644659bed 2023-02-10 19:03:34,975 INFO [StoreOpener-7aadae6dc5bfd4413e9b24af3e4bcb95-1] regionserver.HStore(310): Store=7aadae6dc5bfd4413e9b24af3e4bcb95/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-10 19:03:34,976 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-10 19:03:34,976 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 7aadae6dc5bfd4413e9b24af3e4bcb95; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67036940, jitterRate=-0.0010717511177062988}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-10 19:03:34,976 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 7aadae6dc5bfd4413e9b24af3e4bcb95: Writing region info on filesystem at 1676055814963Initializing all the Stores at 1676055814964 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676055814964Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676055814964Region opened successfully at 1676055814976 (+12 ms) 2023-02-10 19:03:35,185 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 7aadae6dc5bfd4413e9b24af3e4bcb95, disabling compactions & flushes 2023-02-10 19:03:35,185 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676055813233.7aadae6dc5bfd4413e9b24af3e4bcb95. 2023-02-10 19:03:35,185 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676055813233.7aadae6dc5bfd4413e9b24af3e4bcb95. 2023-02-10 19:03:35,185 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676055813233.7aadae6dc5bfd4413e9b24af3e4bcb95. after waiting 0 ms 2023-02-10 19:03:35,185 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676055813233.7aadae6dc5bfd4413e9b24af3e4bcb95. 2023-02-10 19:03:35,186 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,,1676055813233.7aadae6dc5bfd4413e9b24af3e4bcb95. 2023-02-10 19:03:35,186 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 7aadae6dc5bfd4413e9b24af3e4bcb95: Waiting for close lock at 1676055815185Disabling compacts and flushes for region at 1676055815185Disabling writes for close at 1676055815185Writing region close event to WAL at 1676055815186 (+1 ms)Closed at 1676055815186 2023-02-10 19:03:35,965 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45659] master.MasterRpcServices(748): Client=jenkins//172.31.14.131 delete name: "testWithMapReduceSingleRegion" 2023-02-10 19:03:35,967 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45659] snapshot.SnapshotManager(333): Deleting snapshot: testWithMapReduceSingleRegion 2023-02-10 19:03:35,968 INFO [Listener at localhost/41565] client.HBaseAdmin$15(890): Started disable of testWithMapReduce 2023-02-10 19:03:35,969 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45659] master.HMaster$11(2405): Client=jenkins//172.31.14.131 disable testWithMapReduce 2023-02-10 19:03:35,969 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45659] procedure2.ProcedureExecutor(1029): Stored pid=15, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testWithMapReduce 2023-02-10 19:03:35,971 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45659] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-10 19:03:35,972 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676055815972"}]},"ts":"1676055815972"} 2023-02-10 19:03:35,973 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=DISABLING in hbase:meta 2023-02-10 19:03:35,974 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testWithMapReduce to state=DISABLING 2023-02-10 19:03:35,975 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=7aadae6dc5bfd4413e9b24af3e4bcb95, UNASSIGN}] 2023-02-10 19:03:35,975 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=7aadae6dc5bfd4413e9b24af3e4bcb95, UNASSIGN 2023-02-10 19:03:35,976 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=7aadae6dc5bfd4413e9b24af3e4bcb95, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,46597,1676055812202 2023-02-10 19:03:35,976 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,,1676055813233.7aadae6dc5bfd4413e9b24af3e4bcb95.","families":{"info":[{"qualifier":"regioninfo","vlen":51,"tag":[],"timestamp":"1676055815976"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676055815976"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676055815976"}]},"ts":"1676055815976"} 2023-02-10 19:03:35,977 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=17, ppid=16, state=RUNNABLE; CloseRegionProcedure 7aadae6dc5bfd4413e9b24af3e4bcb95, server=jenkins-hbase4.apache.org,46597,1676055812202}] 2023-02-10 19:03:36,027 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-datanode.properties,hadoop-metrics2.properties 2023-02-10 19:03:36,073 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45659] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-10 19:03:36,129 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 7aadae6dc5bfd4413e9b24af3e4bcb95 2023-02-10 19:03:36,129 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 7aadae6dc5bfd4413e9b24af3e4bcb95, disabling compactions & flushes 2023-02-10 19:03:36,129 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676055813233.7aadae6dc5bfd4413e9b24af3e4bcb95. 2023-02-10 19:03:36,129 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676055813233.7aadae6dc5bfd4413e9b24af3e4bcb95. 2023-02-10 19:03:36,129 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676055813233.7aadae6dc5bfd4413e9b24af3e4bcb95. after waiting 0 ms 2023-02-10 19:03:36,129 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676055813233.7aadae6dc5bfd4413e9b24af3e4bcb95. 2023-02-10 19:03:36,136 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41503/user/jenkins/test-data/ecd450e8-f1d8-69b3-568c-ca4b807752e7/data/default/testWithMapReduce/7aadae6dc5bfd4413e9b24af3e4bcb95/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-10 19:03:36,138 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,,1676055813233.7aadae6dc5bfd4413e9b24af3e4bcb95. 2023-02-10 19:03:36,138 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 7aadae6dc5bfd4413e9b24af3e4bcb95: Waiting for close lock at 1676055816129Running coprocessor pre-close hooks at 1676055816129Disabling compacts and flushes for region at 1676055816129Disabling writes for close at 1676055816129Writing region close event to WAL at 1676055816130 (+1 ms)Running coprocessor post-close hooks at 1676055816137 (+7 ms)Closed at 1676055816138 (+1 ms) 2023-02-10 19:03:36,139 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 7aadae6dc5bfd4413e9b24af3e4bcb95 2023-02-10 19:03:36,140 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=7aadae6dc5bfd4413e9b24af3e4bcb95, regionState=CLOSED 2023-02-10 19:03:36,140 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,,1676055813233.7aadae6dc5bfd4413e9b24af3e4bcb95.","families":{"info":[{"qualifier":"regioninfo","vlen":51,"tag":[],"timestamp":"1676055816140"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676055816140"}]},"ts":"1676055816140"} 2023-02-10 19:03:36,143 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=17, resume processing ppid=16 2023-02-10 19:03:36,143 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=16, state=SUCCESS; CloseRegionProcedure 7aadae6dc5bfd4413e9b24af3e4bcb95, server=jenkins-hbase4.apache.org,46597,1676055812202 in 164 msec 2023-02-10 19:03:36,144 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=16, resume processing ppid=15 2023-02-10 19:03:36,145 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=15, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=7aadae6dc5bfd4413e9b24af3e4bcb95, UNASSIGN in 168 msec 2023-02-10 19:03:36,145 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676055816145"}]},"ts":"1676055816145"} 2023-02-10 19:03:36,148 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=DISABLED in hbase:meta 2023-02-10 19:03:36,152 INFO [PEWorker-5] procedure.DisableTableProcedure(305): Set testWithMapReduce to state=DISABLED 2023-02-10 19:03:36,153 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=15, state=SUCCESS; DisableTableProcedure table=testWithMapReduce in 183 msec 2023-02-10 19:03:36,274 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45659] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-10 19:03:36,274 INFO [Listener at localhost/41565] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testWithMapReduce, procId: 15 completed 2023-02-10 19:03:36,275 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45659] master.HMaster$5(2215): Client=jenkins//172.31.14.131 delete testWithMapReduce 2023-02-10 19:03:36,276 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45659] procedure2.ProcedureExecutor(1029): Stored pid=18, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testWithMapReduce 2023-02-10 19:03:36,278 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=18, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-10 19:03:36,279 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=18, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-10 19:03:36,279 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45659] master.MasterRpcServices(1227): Checking to see if procedure is done pid=18 2023-02-10 19:03:36,282 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41503/user/jenkins/test-data/ecd450e8-f1d8-69b3-568c-ca4b807752e7/.tmp/data/default/testWithMapReduce/7aadae6dc5bfd4413e9b24af3e4bcb95 2023-02-10 19:03:36,284 DEBUG [HFileArchiver-6] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:41503/user/jenkins/test-data/ecd450e8-f1d8-69b3-568c-ca4b807752e7/.tmp/data/default/testWithMapReduce/7aadae6dc5bfd4413e9b24af3e4bcb95/f1, FileablePath, hdfs://localhost:41503/user/jenkins/test-data/ecd450e8-f1d8-69b3-568c-ca4b807752e7/.tmp/data/default/testWithMapReduce/7aadae6dc5bfd4413e9b24af3e4bcb95/f2, FileablePath, hdfs://localhost:41503/user/jenkins/test-data/ecd450e8-f1d8-69b3-568c-ca4b807752e7/.tmp/data/default/testWithMapReduce/7aadae6dc5bfd4413e9b24af3e4bcb95/recovered.edits] 2023-02-10 19:03:36,287 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41503/user/jenkins/test-data/ecd450e8-f1d8-69b3-568c-ca4b807752e7/.tmp/data/default/testWithMapReduce/7aadae6dc5bfd4413e9b24af3e4bcb95/f1/24143e2d10fb43f59e49c09aad41b69b to hdfs://localhost:41503/user/jenkins/test-data/ecd450e8-f1d8-69b3-568c-ca4b807752e7/archive/data/default/testWithMapReduce/7aadae6dc5bfd4413e9b24af3e4bcb95/f1/24143e2d10fb43f59e49c09aad41b69b 2023-02-10 19:03:36,288 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41503/user/jenkins/test-data/ecd450e8-f1d8-69b3-568c-ca4b807752e7/.tmp/data/default/testWithMapReduce/7aadae6dc5bfd4413e9b24af3e4bcb95/f1/69ebbe0812df4cfb81b363cd59cb949f to hdfs://localhost:41503/user/jenkins/test-data/ecd450e8-f1d8-69b3-568c-ca4b807752e7/archive/data/default/testWithMapReduce/7aadae6dc5bfd4413e9b24af3e4bcb95/f1/69ebbe0812df4cfb81b363cd59cb949f 2023-02-10 19:03:36,290 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41503/user/jenkins/test-data/ecd450e8-f1d8-69b3-568c-ca4b807752e7/.tmp/data/default/testWithMapReduce/7aadae6dc5bfd4413e9b24af3e4bcb95/f2/22bc0eae1fa643cebaa81e0c10a05a3d to hdfs://localhost:41503/user/jenkins/test-data/ecd450e8-f1d8-69b3-568c-ca4b807752e7/archive/data/default/testWithMapReduce/7aadae6dc5bfd4413e9b24af3e4bcb95/f2/22bc0eae1fa643cebaa81e0c10a05a3d 2023-02-10 19:03:36,291 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41503/user/jenkins/test-data/ecd450e8-f1d8-69b3-568c-ca4b807752e7/.tmp/data/default/testWithMapReduce/7aadae6dc5bfd4413e9b24af3e4bcb95/f2/91b88f0c9b9444bda0a79af644659bed to hdfs://localhost:41503/user/jenkins/test-data/ecd450e8-f1d8-69b3-568c-ca4b807752e7/archive/data/default/testWithMapReduce/7aadae6dc5bfd4413e9b24af3e4bcb95/f2/91b88f0c9b9444bda0a79af644659bed 2023-02-10 19:03:36,293 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41503/user/jenkins/test-data/ecd450e8-f1d8-69b3-568c-ca4b807752e7/.tmp/data/default/testWithMapReduce/7aadae6dc5bfd4413e9b24af3e4bcb95/recovered.edits/12.seqid to hdfs://localhost:41503/user/jenkins/test-data/ecd450e8-f1d8-69b3-568c-ca4b807752e7/archive/data/default/testWithMapReduce/7aadae6dc5bfd4413e9b24af3e4bcb95/recovered.edits/12.seqid 2023-02-10 19:03:36,293 DEBUG [HFileArchiver-6] backup.HFileArchiver(596): Deleted hdfs://localhost:41503/user/jenkins/test-data/ecd450e8-f1d8-69b3-568c-ca4b807752e7/.tmp/data/default/testWithMapReduce/7aadae6dc5bfd4413e9b24af3e4bcb95 2023-02-10 19:03:36,293 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testWithMapReduce regions 2023-02-10 19:03:36,295 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=18, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-10 19:03:36,297 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testWithMapReduce from hbase:meta 2023-02-10 19:03:36,298 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testWithMapReduce' descriptor. 2023-02-10 19:03:36,299 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=18, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-10 19:03:36,299 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testWithMapReduce' from region states. 2023-02-10 19:03:36,299 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,,1676055813233.7aadae6dc5bfd4413e9b24af3e4bcb95.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676055816299"}]},"ts":"9223372036854775807"} 2023-02-10 19:03:36,300 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-02-10 19:03:36,300 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 7aadae6dc5bfd4413e9b24af3e4bcb95, NAME => 'testWithMapReduce,,1676055813233.7aadae6dc5bfd4413e9b24af3e4bcb95.', STARTKEY => '', ENDKEY => ''}] 2023-02-10 19:03:36,300 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testWithMapReduce' as deleted. 2023-02-10 19:03:36,300 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1676055816300"}]},"ts":"9223372036854775807"} 2023-02-10 19:03:36,302 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testWithMapReduce state from META 2023-02-10 19:03:36,303 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=18, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-10 19:03:36,304 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=18, state=SUCCESS; DeleteTableProcedure table=testWithMapReduce in 28 msec 2023-02-10 19:03:36,380 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45659] master.MasterRpcServices(1227): Checking to see if procedure is done pid=18 2023-02-10 19:03:36,380 INFO [Listener at localhost/41565] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testWithMapReduce, procId: 18 completed 2023-02-10 19:03:36,381 INFO [Listener at localhost/41565] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-02-10 19:03:36,381 INFO [Listener at localhost/41565] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-10 19:03:36,381 DEBUG [Listener at localhost/41565] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7043de30 to 127.0.0.1:50994 2023-02-10 19:03:36,381 DEBUG [Listener at localhost/41565] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-10 19:03:36,381 DEBUG [Listener at localhost/41565] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-02-10 19:03:36,381 DEBUG [Listener at localhost/41565] util.JVMClusterUtil(257): Found active master hash=1721614572, stopped=false 2023-02-10 19:03:36,381 INFO [Listener at localhost/41565] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,45659,1676055812127 2023-02-10 19:03:36,383 DEBUG [Listener at localhost/41565-EventThread] zookeeper.ZKWatcher(600): regionserver:36579-0x1003f9e01d30001, quorum=127.0.0.1:50994, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-10 19:03:36,383 DEBUG [Listener at localhost/41565-EventThread] zookeeper.ZKWatcher(600): regionserver:46597-0x1003f9e01d30002, quorum=127.0.0.1:50994, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-10 19:03:36,383 INFO [Listener at localhost/41565] procedure2.ProcedureExecutor(629): Stopping 2023-02-10 19:03:36,383 DEBUG [Listener at localhost/41565-EventThread] zookeeper.ZKWatcher(600): master:45659-0x1003f9e01d30000, quorum=127.0.0.1:50994, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-10 19:03:36,385 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46597-0x1003f9e01d30002, quorum=127.0.0.1:50994, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-10 19:03:36,385 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36579-0x1003f9e01d30001, quorum=127.0.0.1:50994, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-10 19:03:36,385 DEBUG [Listener at localhost/41565-EventThread] zookeeper.ZKWatcher(600): master:45659-0x1003f9e01d30000, quorum=127.0.0.1:50994, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-10 19:03:36,386 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:45659-0x1003f9e01d30000, quorum=127.0.0.1:50994, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-10 19:03:36,386 DEBUG [Listener at localhost/41565] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7971a826 to 127.0.0.1:50994 2023-02-10 19:03:36,386 DEBUG [Listener at localhost/41565] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-10 19:03:36,387 INFO [Listener at localhost/41565] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,36579,1676055812179' ***** 2023-02-10 19:03:36,387 INFO [Listener at localhost/41565] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-10 19:03:36,387 INFO [Listener at localhost/41565] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,46597,1676055812202' ***** 2023-02-10 19:03:36,387 INFO [Listener at localhost/41565] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-10 19:03:36,387 INFO [RS:0;jenkins-hbase4:36579] regionserver.HeapMemoryManager(220): Stopping 2023-02-10 19:03:36,387 INFO [RS:1;jenkins-hbase4:46597] regionserver.HeapMemoryManager(220): Stopping 2023-02-10 19:03:36,387 INFO [RS:0;jenkins-hbase4:36579] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-10 19:03:36,387 INFO [RS:1;jenkins-hbase4:46597] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-10 19:03:36,387 INFO [RS:0;jenkins-hbase4:36579] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-10 19:03:36,387 INFO [RS:1;jenkins-hbase4:46597] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-10 19:03:36,387 INFO [RS:0;jenkins-hbase4:36579] regionserver.HRegionServer(3304): Received CLOSE for c8f276a7b00fb2a9606d0b639031611e 2023-02-10 19:03:36,387 INFO [RS:1;jenkins-hbase4:46597] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,46597,1676055812202 2023-02-10 19:03:36,387 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-10 19:03:36,387 DEBUG [RS:1;jenkins-hbase4:46597] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x50fb31d7 to 127.0.0.1:50994 2023-02-10 19:03:36,389 INFO [RS:0;jenkins-hbase4:36579] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,36579,1676055812179 2023-02-10 19:03:36,389 DEBUG [RS:0;jenkins-hbase4:36579] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x35cc2489 to 127.0.0.1:50994 2023-02-10 19:03:36,389 DEBUG [RS:0;jenkins-hbase4:36579] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-10 19:03:36,389 INFO [RS:0;jenkins-hbase4:36579] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-10 19:03:36,389 INFO [RS:0;jenkins-hbase4:36579] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-10 19:03:36,389 INFO [RS:0;jenkins-hbase4:36579] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-10 19:03:36,389 INFO [RS:0;jenkins-hbase4:36579] regionserver.HRegionServer(3304): Received CLOSE for 1588230740 2023-02-10 19:03:36,389 INFO [RS:0;jenkins-hbase4:36579] regionserver.HRegionServer(1475): Waiting on 2 regions to close 2023-02-10 19:03:36,389 DEBUG [RS:0;jenkins-hbase4:36579] regionserver.HRegionServer(1479): Online Regions={1588230740=hbase:meta,,1.1588230740, c8f276a7b00fb2a9606d0b639031611e=hbase:namespace,,1676055812747.c8f276a7b00fb2a9606d0b639031611e.} 2023-02-10 19:03:36,389 DEBUG [RS:0;jenkins-hbase4:36579] regionserver.HRegionServer(1505): Waiting on 1588230740, c8f276a7b00fb2a9606d0b639031611e 2023-02-10 19:03:36,389 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-10 19:03:36,389 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-10 19:03:36,389 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-10 19:03:36,389 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-10 19:03:36,389 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-10 19:03:36,389 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 1588230740 3/3 column families, dataSize=3.70 KB heapSize=7.12 KB 2023-02-10 19:03:36,392 DEBUG [RS:1;jenkins-hbase4:46597] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-10 19:03:36,392 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-10 19:03:36,392 INFO [RS:1;jenkins-hbase4:46597] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,46597,1676055812202; all regions closed. 2023-02-10 19:03:36,392 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing c8f276a7b00fb2a9606d0b639031611e, disabling compactions & flushes 2023-02-10 19:03:36,393 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676055812747.c8f276a7b00fb2a9606d0b639031611e. 2023-02-10 19:03:36,393 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676055812747.c8f276a7b00fb2a9606d0b639031611e. 2023-02-10 19:03:36,393 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676055812747.c8f276a7b00fb2a9606d0b639031611e. after waiting 0 ms 2023-02-10 19:03:36,393 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676055812747.c8f276a7b00fb2a9606d0b639031611e. 2023-02-10 19:03:36,393 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing c8f276a7b00fb2a9606d0b639031611e 1/1 column families, dataSize=78 B heapSize=488 B 2023-02-10 19:03:36,397 DEBUG [RS:1;jenkins-hbase4:46597] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/ecd450e8-f1d8-69b3-568c-ca4b807752e7/oldWALs 2023-02-10 19:03:36,397 INFO [RS:1;jenkins-hbase4:46597] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C46597%2C1676055812202:(num 1676055813495) 2023-02-10 19:03:36,397 DEBUG [RS:1;jenkins-hbase4:46597] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-10 19:03:36,397 INFO [RS:1;jenkins-hbase4:46597] regionserver.LeaseManager(133): Closed leases 2023-02-10 19:03:36,397 INFO [RS:1;jenkins-hbase4:46597] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-02-10 19:03:36,397 INFO [RS:1;jenkins-hbase4:46597] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-10 19:03:36,397 INFO [RS:1;jenkins-hbase4:46597] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-10 19:03:36,397 INFO [RS:1;jenkins-hbase4:46597] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-10 19:03:36,397 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-10 19:03:36,399 INFO [RS:1;jenkins-hbase4:46597] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:46597 2023-02-10 19:03:36,400 DEBUG [Listener at localhost/41565-EventThread] zookeeper.ZKWatcher(600): regionserver:36579-0x1003f9e01d30001, quorum=127.0.0.1:50994, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,46597,1676055812202 2023-02-10 19:03:36,400 DEBUG [Listener at localhost/41565-EventThread] zookeeper.ZKWatcher(600): regionserver:46597-0x1003f9e01d30002, quorum=127.0.0.1:50994, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,46597,1676055812202 2023-02-10 19:03:36,400 DEBUG [Listener at localhost/41565-EventThread] zookeeper.ZKWatcher(600): regionserver:36579-0x1003f9e01d30001, quorum=127.0.0.1:50994, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-10 19:03:36,400 DEBUG [Listener at localhost/41565-EventThread] zookeeper.ZKWatcher(600): master:45659-0x1003f9e01d30000, quorum=127.0.0.1:50994, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-10 19:03:36,400 ERROR [Listener at localhost/41565-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@56ce6309 rejected from java.util.concurrent.ThreadPoolExecutor@52f1ed08[Shutting down, pool size = 1, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-10 19:03:36,400 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.19 KB at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:41503/user/jenkins/test-data/ecd450e8-f1d8-69b3-568c-ca4b807752e7/data/hbase/meta/1588230740/.tmp/info/ae9befd5888e44bebad93f239c5ac507 2023-02-10 19:03:36,401 DEBUG [Listener at localhost/41565-EventThread] zookeeper.ZKWatcher(600): regionserver:46597-0x1003f9e01d30002, quorum=127.0.0.1:50994, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-10 19:03:36,401 ERROR [Listener at localhost/41565-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@35d17f2 rejected from java.util.concurrent.ThreadPoolExecutor@52f1ed08[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-10 19:03:36,401 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,46597,1676055812202] 2023-02-10 19:03:36,401 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,46597,1676055812202; numProcessing=1 2023-02-10 19:03:36,403 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,46597,1676055812202 already deleted, retry=false 2023-02-10 19:03:36,403 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,46597,1676055812202 expired; onlineServers=1 2023-02-10 19:03:36,404 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for ae9befd5888e44bebad93f239c5ac507 2023-02-10 19:03:36,407 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:41503/user/jenkins/test-data/ecd450e8-f1d8-69b3-568c-ca4b807752e7/data/hbase/namespace/c8f276a7b00fb2a9606d0b639031611e/.tmp/info/17d4d154124f4954911ec591952f0e96 2023-02-10 19:03:36,414 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41503/user/jenkins/test-data/ecd450e8-f1d8-69b3-568c-ca4b807752e7/data/hbase/namespace/c8f276a7b00fb2a9606d0b639031611e/.tmp/info/17d4d154124f4954911ec591952f0e96 as hdfs://localhost:41503/user/jenkins/test-data/ecd450e8-f1d8-69b3-568c-ca4b807752e7/data/hbase/namespace/c8f276a7b00fb2a9606d0b639031611e/info/17d4d154124f4954911ec591952f0e96 2023-02-10 19:03:36,418 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=97 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:41503/user/jenkins/test-data/ecd450e8-f1d8-69b3-568c-ca4b807752e7/data/hbase/meta/1588230740/.tmp/rep_barrier/72fac22f6e9a4735a0f551d2911321b8 2023-02-10 19:03:36,418 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:41503/user/jenkins/test-data/ecd450e8-f1d8-69b3-568c-ca4b807752e7/data/hbase/namespace/c8f276a7b00fb2a9606d0b639031611e/info/17d4d154124f4954911ec591952f0e96, entries=2, sequenceid=6, filesize=4.8 K 2023-02-10 19:03:36,419 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for c8f276a7b00fb2a9606d0b639031611e in 26ms, sequenceid=6, compaction requested=false 2023-02-10 19:03:36,421 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41503/user/jenkins/test-data/ecd450e8-f1d8-69b3-568c-ca4b807752e7/data/hbase/namespace/c8f276a7b00fb2a9606d0b639031611e/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-02-10 19:03:36,422 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 72fac22f6e9a4735a0f551d2911321b8 2023-02-10 19:03:36,423 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676055812747.c8f276a7b00fb2a9606d0b639031611e. 2023-02-10 19:03:36,423 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for c8f276a7b00fb2a9606d0b639031611e: Waiting for close lock at 1676055816392Running coprocessor pre-close hooks at 1676055816392Disabling compacts and flushes for region at 1676055816392Disabling writes for close at 1676055816393 (+1 ms)Obtaining lock to block concurrent updates at 1676055816393Preparing flush snapshotting stores in c8f276a7b00fb2a9606d0b639031611e at 1676055816393Finished memstore snapshotting hbase:namespace,,1676055812747.c8f276a7b00fb2a9606d0b639031611e., syncing WAL and waiting on mvcc, flushsize=dataSize=78, getHeapSize=472, getOffHeapSize=0, getCellsCount=2 at 1676055816393Flushing stores of hbase:namespace,,1676055812747.c8f276a7b00fb2a9606d0b639031611e. at 1676055816394 (+1 ms)Flushing c8f276a7b00fb2a9606d0b639031611e/info: creating writer at 1676055816394Flushing c8f276a7b00fb2a9606d0b639031611e/info: appending metadata at 1676055816396 (+2 ms)Flushing c8f276a7b00fb2a9606d0b639031611e/info: closing flushed file at 1676055816396Flushing c8f276a7b00fb2a9606d0b639031611e/info: reopening flushed file at 1676055816415 (+19 ms)Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for c8f276a7b00fb2a9606d0b639031611e in 26ms, sequenceid=6, compaction requested=false at 1676055816419 (+4 ms)Writing region close event to WAL at 1676055816419Running coprocessor post-close hooks at 1676055816422 (+3 ms)Closed at 1676055816423 (+1 ms) 2023-02-10 19:03:36,423 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1676055812747.c8f276a7b00fb2a9606d0b639031611e. 2023-02-10 19:03:36,426 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-10 19:03:36,426 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-10 19:03:36,430 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=428 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:41503/user/jenkins/test-data/ecd450e8-f1d8-69b3-568c-ca4b807752e7/data/hbase/meta/1588230740/.tmp/table/f08192111ae8482db6953f2ab243de31 2023-02-10 19:03:36,433 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for f08192111ae8482db6953f2ab243de31 2023-02-10 19:03:36,433 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41503/user/jenkins/test-data/ecd450e8-f1d8-69b3-568c-ca4b807752e7/data/hbase/meta/1588230740/.tmp/info/ae9befd5888e44bebad93f239c5ac507 as hdfs://localhost:41503/user/jenkins/test-data/ecd450e8-f1d8-69b3-568c-ca4b807752e7/data/hbase/meta/1588230740/info/ae9befd5888e44bebad93f239c5ac507 2023-02-10 19:03:36,436 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for ae9befd5888e44bebad93f239c5ac507 2023-02-10 19:03:36,436 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:41503/user/jenkins/test-data/ecd450e8-f1d8-69b3-568c-ca4b807752e7/data/hbase/meta/1588230740/info/ae9befd5888e44bebad93f239c5ac507, entries=12, sequenceid=21, filesize=6.2 K 2023-02-10 19:03:36,437 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41503/user/jenkins/test-data/ecd450e8-f1d8-69b3-568c-ca4b807752e7/data/hbase/meta/1588230740/.tmp/rep_barrier/72fac22f6e9a4735a0f551d2911321b8 as hdfs://localhost:41503/user/jenkins/test-data/ecd450e8-f1d8-69b3-568c-ca4b807752e7/data/hbase/meta/1588230740/rep_barrier/72fac22f6e9a4735a0f551d2911321b8 2023-02-10 19:03:36,440 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 72fac22f6e9a4735a0f551d2911321b8 2023-02-10 19:03:36,440 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:41503/user/jenkins/test-data/ecd450e8-f1d8-69b3-568c-ca4b807752e7/data/hbase/meta/1588230740/rep_barrier/72fac22f6e9a4735a0f551d2911321b8, entries=1, sequenceid=21, filesize=5.0 K 2023-02-10 19:03:36,441 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41503/user/jenkins/test-data/ecd450e8-f1d8-69b3-568c-ca4b807752e7/data/hbase/meta/1588230740/.tmp/table/f08192111ae8482db6953f2ab243de31 as hdfs://localhost:41503/user/jenkins/test-data/ecd450e8-f1d8-69b3-568c-ca4b807752e7/data/hbase/meta/1588230740/table/f08192111ae8482db6953f2ab243de31 2023-02-10 19:03:36,444 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for f08192111ae8482db6953f2ab243de31 2023-02-10 19:03:36,444 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:41503/user/jenkins/test-data/ecd450e8-f1d8-69b3-568c-ca4b807752e7/data/hbase/meta/1588230740/table/f08192111ae8482db6953f2ab243de31, entries=4, sequenceid=21, filesize=5.0 K 2023-02-10 19:03:36,445 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~3.70 KB/3789, heapSize ~7.07 KB/7240, currentSize=0 B/0 for 1588230740 in 56ms, sequenceid=21, compaction requested=false 2023-02-10 19:03:36,448 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41503/user/jenkins/test-data/ecd450e8-f1d8-69b3-568c-ca4b807752e7/data/hbase/meta/1588230740/recovered.edits/24.seqid, newMaxSeqId=24, maxSeqId=1 2023-02-10 19:03:36,448 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-10 19:03:36,449 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-10 19:03:36,449 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1676055816389Running coprocessor pre-close hooks at 1676055816389Disabling compacts and flushes for region at 1676055816389Disabling writes for close at 1676055816389Obtaining lock to block concurrent updates at 1676055816389Preparing flush snapshotting stores in 1588230740 at 1676055816389Finished memstore snapshotting hbase:meta,,1.1588230740, syncing WAL and waiting on mvcc, flushsize=dataSize=3789, getHeapSize=7240, getOffHeapSize=0, getCellsCount=36 at 1676055816390 (+1 ms)Flushing stores of hbase:meta,,1.1588230740 at 1676055816390Flushing 1588230740/info: creating writer at 1676055816390Flushing 1588230740/info: appending metadata at 1676055816393 (+3 ms)Flushing 1588230740/info: closing flushed file at 1676055816394 (+1 ms)Flushing 1588230740/rep_barrier: creating writer at 1676055816405 (+11 ms)Flushing 1588230740/rep_barrier: appending metadata at 1676055816406 (+1 ms)Flushing 1588230740/rep_barrier: closing flushed file at 1676055816406Flushing 1588230740/table: creating writer at 1676055816422 (+16 ms)Flushing 1588230740/table: appending metadata at 1676055816424 (+2 ms)Flushing 1588230740/table: closing flushed file at 1676055816424Flushing 1588230740/info: reopening flushed file at 1676055816434 (+10 ms)Flushing 1588230740/rep_barrier: reopening flushed file at 1676055816437 (+3 ms)Flushing 1588230740/table: reopening flushed file at 1676055816441 (+4 ms)Finished flush of dataSize ~3.70 KB/3789, heapSize ~7.07 KB/7240, currentSize=0 B/0 for 1588230740 in 56ms, sequenceid=21, compaction requested=false at 1676055816445 (+4 ms)Writing region close event to WAL at 1676055816446 (+1 ms)Running coprocessor post-close hooks at 1676055816448 (+2 ms)Closed at 1676055816449 (+1 ms) 2023-02-10 19:03:36,449 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-02-10 19:03:36,469 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-02-10 19:03:36,469 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-02-10 19:03:36,583 DEBUG [Listener at localhost/41565-EventThread] zookeeper.ZKWatcher(600): regionserver:46597-0x1003f9e01d30002, quorum=127.0.0.1:50994, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-10 19:03:36,583 INFO [RS:1;jenkins-hbase4:46597] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,46597,1676055812202; zookeeper connection closed. 2023-02-10 19:03:36,583 ERROR [Listener at localhost/41565-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@7beadacb rejected from java.util.concurrent.ThreadPoolExecutor@52f1ed08[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-10 19:03:36,583 DEBUG [Listener at localhost/41565-EventThread] zookeeper.ZKWatcher(600): regionserver:46597-0x1003f9e01d30002, quorum=127.0.0.1:50994, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-10 19:03:36,583 ERROR [Listener at localhost/41565-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@1c55edf3 rejected from java.util.concurrent.ThreadPoolExecutor@52f1ed08[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-10 19:03:36,583 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@5338c97] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@5338c97 2023-02-10 19:03:36,589 INFO [RS:0;jenkins-hbase4:36579] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,36579,1676055812179; all regions closed. 2023-02-10 19:03:36,593 DEBUG [RS:0;jenkins-hbase4:36579] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/ecd450e8-f1d8-69b3-568c-ca4b807752e7/oldWALs 2023-02-10 19:03:36,593 INFO [RS:0;jenkins-hbase4:36579] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C36579%2C1676055812179.meta:.meta(num 1676055812701) 2023-02-10 19:03:36,596 DEBUG [RS:0;jenkins-hbase4:36579] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/ecd450e8-f1d8-69b3-568c-ca4b807752e7/oldWALs 2023-02-10 19:03:36,596 INFO [RS:0;jenkins-hbase4:36579] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C36579%2C1676055812179:(num 1676055813089) 2023-02-10 19:03:36,596 DEBUG [RS:0;jenkins-hbase4:36579] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-10 19:03:36,596 INFO [RS:0;jenkins-hbase4:36579] regionserver.LeaseManager(133): Closed leases 2023-02-10 19:03:36,596 INFO [RS:0;jenkins-hbase4:36579] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-02-10 19:03:36,596 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-10 19:03:36,599 INFO [RS:0;jenkins-hbase4:36579] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:36579 2023-02-10 19:03:36,600 DEBUG [Listener at localhost/41565-EventThread] zookeeper.ZKWatcher(600): regionserver:36579-0x1003f9e01d30001, quorum=127.0.0.1:50994, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,36579,1676055812179 2023-02-10 19:03:36,600 DEBUG [Listener at localhost/41565-EventThread] zookeeper.ZKWatcher(600): master:45659-0x1003f9e01d30000, quorum=127.0.0.1:50994, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-10 19:03:36,601 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,36579,1676055812179] 2023-02-10 19:03:36,601 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,36579,1676055812179; numProcessing=2 2023-02-10 19:03:36,604 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,36579,1676055812179 already deleted, retry=false 2023-02-10 19:03:36,604 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,36579,1676055812179 expired; onlineServers=0 2023-02-10 19:03:36,604 INFO [RegionServerTracker-0] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,45659,1676055812127' ***** 2023-02-10 19:03:36,604 INFO [RegionServerTracker-0] regionserver.HRegionServer(2310): STOPPED: Cluster shutdown set; onlineServer=0 2023-02-10 19:03:36,604 DEBUG [M:0;jenkins-hbase4:45659] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@62a258e7, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-10 19:03:36,604 INFO [M:0;jenkins-hbase4:45659] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,45659,1676055812127 2023-02-10 19:03:36,605 INFO [M:0;jenkins-hbase4:45659] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,45659,1676055812127; all regions closed. 2023-02-10 19:03:36,605 DEBUG [M:0;jenkins-hbase4:45659] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-10 19:03:36,605 DEBUG [M:0;jenkins-hbase4:45659] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-02-10 19:03:36,605 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-02-10 19:03:36,605 DEBUG [M:0;jenkins-hbase4:45659] cleaner.HFileCleaner(317): Stopping file delete threads 2023-02-10 19:03:36,605 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676055812348] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676055812348,5,FailOnTimeoutGroup] 2023-02-10 19:03:36,605 INFO [M:0;jenkins-hbase4:45659] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-02-10 19:03:36,605 INFO [M:0;jenkins-hbase4:45659] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-02-10 19:03:36,605 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676055812347] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676055812347,5,FailOnTimeoutGroup] 2023-02-10 19:03:36,605 INFO [M:0;jenkins-hbase4:45659] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-02-10 19:03:36,606 DEBUG [M:0;jenkins-hbase4:45659] master.HMaster(1502): Stopping service threads 2023-02-10 19:03:36,606 INFO [M:0;jenkins-hbase4:45659] procedure2.RemoteProcedureDispatcher(118): Stopping procedure remote dispatcher 2023-02-10 19:03:36,607 ERROR [M:0;jenkins-hbase4:45659] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-02-10 19:03:36,607 DEBUG [Listener at localhost/41565-EventThread] zookeeper.ZKWatcher(600): master:45659-0x1003f9e01d30000, quorum=127.0.0.1:50994, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-02-10 19:03:36,607 DEBUG [Listener at localhost/41565-EventThread] zookeeper.ZKWatcher(600): master:45659-0x1003f9e01d30000, quorum=127.0.0.1:50994, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-10 19:03:36,607 INFO [M:0;jenkins-hbase4:45659] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-02-10 19:03:36,607 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-02-10 19:03:36,607 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:45659-0x1003f9e01d30000, quorum=127.0.0.1:50994, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-10 19:03:36,607 DEBUG [M:0;jenkins-hbase4:45659] zookeeper.ZKUtil(398): master:45659-0x1003f9e01d30000, quorum=127.0.0.1:50994, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-02-10 19:03:36,607 WARN [M:0;jenkins-hbase4:45659] master.ActiveMasterManager(323): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-02-10 19:03:36,607 INFO [M:0;jenkins-hbase4:45659] assignment.AssignmentManager(315): Stopping assignment manager 2023-02-10 19:03:36,608 INFO [M:0;jenkins-hbase4:45659] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-02-10 19:03:36,608 DEBUG [M:0;jenkins-hbase4:45659] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-10 19:03:36,608 INFO [M:0;jenkins-hbase4:45659] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-10 19:03:36,608 DEBUG [M:0;jenkins-hbase4:45659] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-10 19:03:36,608 DEBUG [M:0;jenkins-hbase4:45659] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-10 19:03:36,608 DEBUG [M:0;jenkins-hbase4:45659] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-10 19:03:36,608 INFO [M:0;jenkins-hbase4:45659] regionserver.HRegion(2744): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=54.69 KB heapSize=65.66 KB 2023-02-10 19:03:36,615 INFO [M:0;jenkins-hbase4:45659] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=54.69 KB at sequenceid=132 (bloomFilter=true), to=hdfs://localhost:41503/user/jenkins/test-data/ecd450e8-f1d8-69b3-568c-ca4b807752e7/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/0fef6d896eee48d4a5ed2f2f9cabe3af 2023-02-10 19:03:36,619 DEBUG [M:0;jenkins-hbase4:45659] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41503/user/jenkins/test-data/ecd450e8-f1d8-69b3-568c-ca4b807752e7/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/0fef6d896eee48d4a5ed2f2f9cabe3af as hdfs://localhost:41503/user/jenkins/test-data/ecd450e8-f1d8-69b3-568c-ca4b807752e7/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/0fef6d896eee48d4a5ed2f2f9cabe3af 2023-02-10 19:03:36,622 INFO [M:0;jenkins-hbase4:45659] regionserver.HStore(1080): Added hdfs://localhost:41503/user/jenkins/test-data/ecd450e8-f1d8-69b3-568c-ca4b807752e7/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/0fef6d896eee48d4a5ed2f2f9cabe3af, entries=17, sequenceid=132, filesize=8.6 K 2023-02-10 19:03:36,623 INFO [M:0;jenkins-hbase4:45659] regionserver.HRegion(2947): Finished flush of dataSize ~54.69 KB/55998, heapSize ~65.64 KB/67216, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 15ms, sequenceid=132, compaction requested=false 2023-02-10 19:03:36,623 INFO [M:0;jenkins-hbase4:45659] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-10 19:03:36,623 DEBUG [M:0;jenkins-hbase4:45659] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1676055816608Disabling compacts and flushes for region at 1676055816608Disabling writes for close at 1676055816608Obtaining lock to block concurrent updates at 1676055816608Preparing flush snapshotting stores in 1595e783b53d99cd5eef43b6debb2682 at 1676055816608Finished memstore snapshotting master:store,,1.1595e783b53d99cd5eef43b6debb2682., syncing WAL and waiting on mvcc, flushsize=dataSize=55998, getHeapSize=67216, getOffHeapSize=0, getCellsCount=145 at 1676055816608Flushing stores of master:store,,1.1595e783b53d99cd5eef43b6debb2682. at 1676055816609 (+1 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: creating writer at 1676055816609Flushing 1595e783b53d99cd5eef43b6debb2682/proc: appending metadata at 1676055816611 (+2 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: closing flushed file at 1676055816611Flushing 1595e783b53d99cd5eef43b6debb2682/proc: reopening flushed file at 1676055816619 (+8 ms)Finished flush of dataSize ~54.69 KB/55998, heapSize ~65.64 KB/67216, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 15ms, sequenceid=132, compaction requested=false at 1676055816623 (+4 ms)Writing region close event to WAL at 1676055816623Closed at 1676055816623 2023-02-10 19:03:36,625 INFO [M:0;jenkins-hbase4:45659] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-02-10 19:03:36,625 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-10 19:03:36,625 INFO [M:0;jenkins-hbase4:45659] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:45659 2023-02-10 19:03:36,626 DEBUG [M:0;jenkins-hbase4:45659] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,45659,1676055812127 already deleted, retry=false 2023-02-10 19:03:36,984 DEBUG [Listener at localhost/41565-EventThread] zookeeper.ZKWatcher(600): master:45659-0x1003f9e01d30000, quorum=127.0.0.1:50994, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-10 19:03:36,984 INFO [M:0;jenkins-hbase4:45659] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,45659,1676055812127; zookeeper connection closed. 2023-02-10 19:03:36,984 ERROR [Listener at localhost/41565-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@6e8963dc rejected from java.util.concurrent.ThreadPoolExecutor@6ab6fad5[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 51] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-10 19:03:36,985 DEBUG [Listener at localhost/41565-EventThread] zookeeper.ZKWatcher(600): master:45659-0x1003f9e01d30000, quorum=127.0.0.1:50994, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-10 19:03:36,986 ERROR [Listener at localhost/41565-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@3b63060d rejected from java.util.concurrent.ThreadPoolExecutor@6ab6fad5[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 51] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-10 19:03:37,085 DEBUG [Listener at localhost/41565-EventThread] zookeeper.ZKWatcher(600): regionserver:36579-0x1003f9e01d30001, quorum=127.0.0.1:50994, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-10 19:03:37,085 INFO [RS:0;jenkins-hbase4:36579] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,36579,1676055812179; zookeeper connection closed. 2023-02-10 19:03:37,085 ERROR [Listener at localhost/41565-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@1c2ebda2 rejected from java.util.concurrent.ThreadPoolExecutor@18113aff[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 19] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-10 19:03:37,085 DEBUG [Listener at localhost/41565-EventThread] zookeeper.ZKWatcher(600): regionserver:36579-0x1003f9e01d30001, quorum=127.0.0.1:50994, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-10 19:03:37,085 ERROR [Listener at localhost/41565-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@5aef09d rejected from java.util.concurrent.ThreadPoolExecutor@18113aff[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 19] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-10 19:03:37,085 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@6ca9eeae] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@6ca9eeae 2023-02-10 19:03:37,085 INFO [Listener at localhost/41565] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 2 regionserver(s) complete 2023-02-10 19:03:37,085 WARN [Listener at localhost/41565] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-10 19:03:37,089 INFO [Listener at localhost/41565] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-10 19:03:37,190 WARN [BP-387849117-172.31.14.131-1676055811517 heartbeating to localhost/127.0.0.1:41503] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-10 19:03:37,190 WARN [BP-387849117-172.31.14.131-1676055811517 heartbeating to localhost/127.0.0.1:41503] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-387849117-172.31.14.131-1676055811517 (Datanode Uuid 6e1aa396-4d1a-43ea-9e93-0a5e15f5865f) service to localhost/127.0.0.1:41503 2023-02-10 19:03:37,191 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a17aec85-f465-d9de-1a14-2563d6e642af/cluster_75e09c65-3c85-ba5b-ad18-d4dc1de3eb7a/dfs/data/data3/current/BP-387849117-172.31.14.131-1676055811517] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-10 19:03:37,191 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a17aec85-f465-d9de-1a14-2563d6e642af/cluster_75e09c65-3c85-ba5b-ad18-d4dc1de3eb7a/dfs/data/data4/current/BP-387849117-172.31.14.131-1676055811517] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-10 19:03:37,193 WARN [Listener at localhost/41565] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-10 19:03:37,196 INFO [Listener at localhost/41565] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-10 19:03:37,297 WARN [BP-387849117-172.31.14.131-1676055811517 heartbeating to localhost/127.0.0.1:41503] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-10 19:03:37,297 WARN [BP-387849117-172.31.14.131-1676055811517 heartbeating to localhost/127.0.0.1:41503] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-387849117-172.31.14.131-1676055811517 (Datanode Uuid 5e44e594-8365-4b10-9621-dfec9396142e) service to localhost/127.0.0.1:41503 2023-02-10 19:03:37,297 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a17aec85-f465-d9de-1a14-2563d6e642af/cluster_75e09c65-3c85-ba5b-ad18-d4dc1de3eb7a/dfs/data/data1/current/BP-387849117-172.31.14.131-1676055811517] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-10 19:03:37,298 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a17aec85-f465-d9de-1a14-2563d6e642af/cluster_75e09c65-3c85-ba5b-ad18-d4dc1de3eb7a/dfs/data/data2/current/BP-387849117-172.31.14.131-1676055811517] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-10 19:03:37,308 INFO [Listener at localhost/41565] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-10 19:03:37,420 INFO [Listener at localhost/41565] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-02-10 19:03:37,441 INFO [Listener at localhost/41565] hbase.HBaseTestingUtility(1293): Minicluster is down 2023-02-10 19:03:37,453 INFO [Listener at localhost/41565] hbase.ResourceChecker(175): after: mapred.TestTableSnapshotInputFormat#testWithMapReduceSingleRegion Thread=294 (was 274) Potentially hanging thread: nioEventLoopGroup-26-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-22-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-28-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-21-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-22-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/41565 java.lang.Thread.dumpThreads(Native Method) java.lang.Thread.getAllStackTraces(Thread.java:1615) org.apache.hadoop.hbase.ResourceCheckerJUnitListener$ThreadResourceAnalyzer.getVal(ResourceCheckerJUnitListener.java:49) org.apache.hadoop.hbase.ResourceChecker.fill(ResourceChecker.java:110) org.apache.hadoop.hbase.ResourceChecker.fillEndings(ResourceChecker.java:104) org.apache.hadoop.hbase.ResourceChecker.end(ResourceChecker.java:206) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.end(ResourceCheckerJUnitListener.java:165) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.testFinished(ResourceCheckerJUnitListener.java:185) org.junit.runner.notification.SynchronizedRunListener.testFinished(SynchronizedRunListener.java:87) org.junit.runner.notification.RunNotifier$9.notifyListener(RunNotifier.java:225) org.junit.runner.notification.RunNotifier$SafeNotifier.run(RunNotifier.java:72) org.junit.runner.notification.RunNotifier.fireTestFinished(RunNotifier.java:222) org.junit.internal.runners.model.EachTestNotifier.fireTestFinished(EachTestNotifier.java:38) org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:372) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) org.apache.hadoop.hbase.SystemExitRule$1.evaluate(SystemExitRule.java:39) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-28-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-27-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase4.apache.org,45659,1676055812127)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-21-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-23-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-26-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-29-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-22-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-29-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-29-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-23-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-23-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-28-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-26-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1688088802) connection to localhost/127.0.0.1:41503 from jenkins.hfs.13 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: IPC Client (1688088802) connection to localhost/127.0.0.1:41503 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: LeaseRenewer:jenkins.hfs.13@localhost:41503 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1688088802) connection to localhost/127.0.0.1:41503 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: LeaseRenewer:jenkins@localhost:41503 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-27-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.12@localhost:41503 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-27-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-21-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1688088802) connection to localhost/127.0.0.1:41503 from jenkins.hfs.12 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) - Thread LEAK? -, OpenFileDescriptor=601 (was 584) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=316 (was 335), ProcessCount=167 (was 167), AvailableMemoryMB=3101 (was 3328)