2023-02-15 20:00:55,804 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.mapred.TestTableSnapshotInputFormat timeout: 13 mins 2023-02-15 20:00:55,844 INFO [Time-limited test] hbase.ResourceChecker(147): before: mapred.TestTableSnapshotInputFormat#testWithMapReduceMultiRegion Thread=7, OpenFileDescriptor=240, MaxFileDescriptor=60000, SystemLoadAverage=173, ProcessCount=165, AvailableMemoryMB=4105 2023-02-15 20:00:56,099 DEBUG [Time-limited test] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b60948e8-4ebf-4913-96a4-e7519f684365 2023-02-15 20:00:56,107 INFO [Time-limited test] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=2, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=true, createWALDir=false} 2023-02-15 20:00:56,107 INFO [Time-limited test] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b60948e8-4ebf-4913-96a4-e7519f684365/cluster_666e4da7-14ca-5a78-fdde-1e1c92e12186, deleteOnExit=true 2023-02-15 20:00:56,107 INFO [Time-limited test] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-02-15 20:00:56,108 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b60948e8-4ebf-4913-96a4-e7519f684365/test.cache.data in system properties and HBase conf 2023-02-15 20:00:56,108 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b60948e8-4ebf-4913-96a4-e7519f684365/hadoop.tmp.dir in system properties and HBase conf 2023-02-15 20:00:56,109 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b60948e8-4ebf-4913-96a4-e7519f684365/hadoop.log.dir in system properties and HBase conf 2023-02-15 20:00:56,109 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b60948e8-4ebf-4913-96a4-e7519f684365/mapreduce.cluster.local.dir in system properties and HBase conf 2023-02-15 20:00:56,109 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b60948e8-4ebf-4913-96a4-e7519f684365/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-02-15 20:00:56,109 INFO [Time-limited test] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-02-15 20:00:56,218 WARN [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2023-02-15 20:00:56,619 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-02-15 20:00:56,623 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b60948e8-4ebf-4913-96a4-e7519f684365/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-02-15 20:00:56,624 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b60948e8-4ebf-4913-96a4-e7519f684365/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-02-15 20:00:56,624 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b60948e8-4ebf-4913-96a4-e7519f684365/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-02-15 20:00:56,624 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b60948e8-4ebf-4913-96a4-e7519f684365/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-15 20:00:56,625 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b60948e8-4ebf-4913-96a4-e7519f684365/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-02-15 20:00:56,625 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b60948e8-4ebf-4913-96a4-e7519f684365/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-02-15 20:00:56,625 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b60948e8-4ebf-4913-96a4-e7519f684365/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-15 20:00:56,626 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b60948e8-4ebf-4913-96a4-e7519f684365/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-15 20:00:56,626 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b60948e8-4ebf-4913-96a4-e7519f684365/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-02-15 20:00:56,626 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b60948e8-4ebf-4913-96a4-e7519f684365/nfs.dump.dir in system properties and HBase conf 2023-02-15 20:00:56,626 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b60948e8-4ebf-4913-96a4-e7519f684365/java.io.tmpdir in system properties and HBase conf 2023-02-15 20:00:56,627 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b60948e8-4ebf-4913-96a4-e7519f684365/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-15 20:00:56,627 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b60948e8-4ebf-4913-96a4-e7519f684365/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-02-15 20:00:56,627 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b60948e8-4ebf-4913-96a4-e7519f684365/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-02-15 20:00:57,205 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-15 20:00:57,213 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-15 20:00:57,573 WARN [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 2023-02-15 20:00:57,791 INFO [Time-limited test] log.Slf4jLog(67): Logging to org.slf4j.impl.Reload4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2023-02-15 20:00:57,808 WARN [Time-limited test] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-15 20:00:57,852 INFO [Time-limited test] log.Slf4jLog(67): jetty-6.1.26 2023-02-15 20:00:57,892 INFO [Time-limited test] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b60948e8-4ebf-4913-96a4-e7519f684365/java.io.tmpdir/Jetty_localhost_40705_hdfs____.st5ryu/webapp 2023-02-15 20:00:58,044 INFO [Time-limited test] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:40705 2023-02-15 20:00:58,085 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-15 20:00:58,085 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-15 20:00:58,596 WARN [Listener at localhost/38891] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-15 20:00:58,685 WARN [Listener at localhost/38891] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-15 20:00:58,709 WARN [Listener at localhost/38891] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-15 20:00:58,717 INFO [Listener at localhost/38891] log.Slf4jLog(67): jetty-6.1.26 2023-02-15 20:00:58,725 INFO [Listener at localhost/38891] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b60948e8-4ebf-4913-96a4-e7519f684365/java.io.tmpdir/Jetty_localhost_39487_datanode____.fbr1cc/webapp 2023-02-15 20:00:58,876 INFO [Listener at localhost/38891] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:39487 2023-02-15 20:00:59,329 WARN [Listener at localhost/42995] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-15 20:00:59,347 WARN [Listener at localhost/42995] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-15 20:00:59,350 WARN [Listener at localhost/42995] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-15 20:00:59,353 INFO [Listener at localhost/42995] log.Slf4jLog(67): jetty-6.1.26 2023-02-15 20:00:59,363 INFO [Listener at localhost/42995] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b60948e8-4ebf-4913-96a4-e7519f684365/java.io.tmpdir/Jetty_localhost_35427_datanode____.2f1rcy/webapp 2023-02-15 20:00:59,466 INFO [Listener at localhost/42995] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:35427 2023-02-15 20:00:59,480 WARN [Listener at localhost/37547] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-15 20:00:59,874 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xa65a171c5a4f9da0: Processing first storage report for DS-cf384845-6a2a-4d92-88a8-20246f6151b8 from datanode 55ff6abd-4fd9-4214-96e2-32c1657b154f 2023-02-15 20:00:59,877 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xa65a171c5a4f9da0: from storage DS-cf384845-6a2a-4d92-88a8-20246f6151b8 node DatanodeRegistration(127.0.0.1:33337, datanodeUuid=55ff6abd-4fd9-4214-96e2-32c1657b154f, infoPort=41139, infoSecurePort=0, ipcPort=42995, storageInfo=lv=-57;cid=testClusterID;nsid=900707030;c=1676491257310), blocks: 0, hasStaleStorage: true, processing time: 3 msecs, invalidatedBlocks: 0 2023-02-15 20:00:59,877 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x15dede7a1d40ed08: Processing first storage report for DS-1bd451f1-c46d-4e8f-bd6a-d8a04ad1fd70 from datanode e766ea96-9293-4c5b-a1b4-102611d32a93 2023-02-15 20:00:59,877 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x15dede7a1d40ed08: from storage DS-1bd451f1-c46d-4e8f-bd6a-d8a04ad1fd70 node DatanodeRegistration(127.0.0.1:39201, datanodeUuid=e766ea96-9293-4c5b-a1b4-102611d32a93, infoPort=33133, infoSecurePort=0, ipcPort=37547, storageInfo=lv=-57;cid=testClusterID;nsid=900707030;c=1676491257310), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-15 20:00:59,877 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xa65a171c5a4f9da0: Processing first storage report for DS-534cbb99-ae42-4688-93a7-dcd3e829b1a2 from datanode 55ff6abd-4fd9-4214-96e2-32c1657b154f 2023-02-15 20:00:59,878 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xa65a171c5a4f9da0: from storage DS-534cbb99-ae42-4688-93a7-dcd3e829b1a2 node DatanodeRegistration(127.0.0.1:33337, datanodeUuid=55ff6abd-4fd9-4214-96e2-32c1657b154f, infoPort=41139, infoSecurePort=0, ipcPort=42995, storageInfo=lv=-57;cid=testClusterID;nsid=900707030;c=1676491257310), blocks: 0, hasStaleStorage: false, processing time: 1 msecs, invalidatedBlocks: 0 2023-02-15 20:00:59,878 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x15dede7a1d40ed08: Processing first storage report for DS-c1bb4e7a-fb05-4dd5-ada0-248344969e24 from datanode e766ea96-9293-4c5b-a1b4-102611d32a93 2023-02-15 20:00:59,878 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x15dede7a1d40ed08: from storage DS-c1bb4e7a-fb05-4dd5-ada0-248344969e24 node DatanodeRegistration(127.0.0.1:39201, datanodeUuid=e766ea96-9293-4c5b-a1b4-102611d32a93, infoPort=33133, infoSecurePort=0, ipcPort=37547, storageInfo=lv=-57;cid=testClusterID;nsid=900707030;c=1676491257310), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-15 20:00:59,975 DEBUG [Listener at localhost/37547] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b60948e8-4ebf-4913-96a4-e7519f684365 2023-02-15 20:01:00,068 INFO [Listener at localhost/37547] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b60948e8-4ebf-4913-96a4-e7519f684365/cluster_666e4da7-14ca-5a78-fdde-1e1c92e12186/zookeeper_0, clientPort=53178, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b60948e8-4ebf-4913-96a4-e7519f684365/cluster_666e4da7-14ca-5a78-fdde-1e1c92e12186/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b60948e8-4ebf-4913-96a4-e7519f684365/cluster_666e4da7-14ca-5a78-fdde-1e1c92e12186/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-02-15 20:01:00,088 INFO [Listener at localhost/37547] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=53178 2023-02-15 20:01:00,100 INFO [Listener at localhost/37547] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-15 20:01:00,103 INFO [Listener at localhost/37547] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-15 20:01:00,778 INFO [Listener at localhost/37547] util.FSUtils(479): Created version file at hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a with version=8 2023-02-15 20:01:00,778 INFO [Listener at localhost/37547] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-15 20:01:00,781 INFO [Listener at localhost/37547] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-15 20:01:00,786 INFO [Listener at localhost/37547] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:38891/user/jenkins/test-data/7cbd6db3-0023-7f08-6a1c-eea0c6f23bc1/hbase-staging 2023-02-15 20:01:01,118 INFO [Listener at localhost/37547] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2023-02-15 20:01:01,592 INFO [Listener at localhost/37547] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-02-15 20:01:01,626 INFO [Listener at localhost/37547] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-15 20:01:01,626 INFO [Listener at localhost/37547] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-15 20:01:01,627 INFO [Listener at localhost/37547] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-15 20:01:01,627 INFO [Listener at localhost/37547] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-15 20:01:01,627 INFO [Listener at localhost/37547] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-15 20:01:01,783 INFO [Listener at localhost/37547] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-02-15 20:01:01,857 DEBUG [Listener at localhost/37547] util.ClassSize(228): Using Unsafe to estimate memory layout 2023-02-15 20:01:01,950 INFO [Listener at localhost/37547] ipc.NettyRpcServer(120): Bind to /172.31.14.131:39607 2023-02-15 20:01:01,960 INFO [Listener at localhost/37547] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-15 20:01:01,963 INFO [Listener at localhost/37547] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-15 20:01:01,985 INFO [Listener at localhost/37547] zookeeper.RecoverableZooKeeper(93): Process identifier=master:39607 connecting to ZooKeeper ensemble=127.0.0.1:53178 2023-02-15 20:01:02,041 DEBUG [Listener at localhost/37547-EventThread] zookeeper.ZKWatcher(600): master:396070x0, quorum=127.0.0.1:53178, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-15 20:01:02,044 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): master:39607-0x10059926a4e0000 connected 2023-02-15 20:01:02,082 DEBUG [Listener at localhost/37547] zookeeper.ZKUtil(164): master:39607-0x10059926a4e0000, quorum=127.0.0.1:53178, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-15 20:01:02,083 DEBUG [Listener at localhost/37547] zookeeper.ZKUtil(164): master:39607-0x10059926a4e0000, quorum=127.0.0.1:53178, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-15 20:01:02,087 DEBUG [Listener at localhost/37547] zookeeper.ZKUtil(164): master:39607-0x10059926a4e0000, quorum=127.0.0.1:53178, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-15 20:01:02,095 DEBUG [Listener at localhost/37547] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=39607 2023-02-15 20:01:02,095 DEBUG [Listener at localhost/37547] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=39607 2023-02-15 20:01:02,096 DEBUG [Listener at localhost/37547] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=39607 2023-02-15 20:01:02,100 DEBUG [Listener at localhost/37547] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=39607 2023-02-15 20:01:02,100 DEBUG [Listener at localhost/37547] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=39607 2023-02-15 20:01:02,109 INFO [Listener at localhost/37547] master.HMaster(444): hbase.rootdir=hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a, hbase.cluster.distributed=false 2023-02-15 20:01:02,191 INFO [Listener at localhost/37547] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-15 20:01:02,192 INFO [Listener at localhost/37547] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-15 20:01:02,192 INFO [Listener at localhost/37547] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-15 20:01:02,192 INFO [Listener at localhost/37547] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-15 20:01:02,192 INFO [Listener at localhost/37547] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-15 20:01:02,193 INFO [Listener at localhost/37547] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-15 20:01:02,199 INFO [Listener at localhost/37547] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-15 20:01:02,201 INFO [Listener at localhost/37547] ipc.NettyRpcServer(120): Bind to /172.31.14.131:41535 2023-02-15 20:01:02,204 INFO [Listener at localhost/37547] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-15 20:01:02,211 DEBUG [Listener at localhost/37547] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-15 20:01:02,212 INFO [Listener at localhost/37547] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-15 20:01:02,214 INFO [Listener at localhost/37547] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-15 20:01:02,215 INFO [Listener at localhost/37547] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:41535 connecting to ZooKeeper ensemble=127.0.0.1:53178 2023-02-15 20:01:02,219 DEBUG [Listener at localhost/37547-EventThread] zookeeper.ZKWatcher(600): regionserver:415350x0, quorum=127.0.0.1:53178, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-15 20:01:02,221 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:41535-0x10059926a4e0001 connected 2023-02-15 20:01:02,221 DEBUG [Listener at localhost/37547] zookeeper.ZKUtil(164): regionserver:41535-0x10059926a4e0001, quorum=127.0.0.1:53178, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-15 20:01:02,222 DEBUG [Listener at localhost/37547] zookeeper.ZKUtil(164): regionserver:41535-0x10059926a4e0001, quorum=127.0.0.1:53178, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-15 20:01:02,223 DEBUG [Listener at localhost/37547] zookeeper.ZKUtil(164): regionserver:41535-0x10059926a4e0001, quorum=127.0.0.1:53178, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-15 20:01:02,223 DEBUG [Listener at localhost/37547] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=41535 2023-02-15 20:01:02,224 DEBUG [Listener at localhost/37547] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=41535 2023-02-15 20:01:02,225 DEBUG [Listener at localhost/37547] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=41535 2023-02-15 20:01:02,226 DEBUG [Listener at localhost/37547] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=41535 2023-02-15 20:01:02,226 DEBUG [Listener at localhost/37547] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=41535 2023-02-15 20:01:02,240 INFO [Listener at localhost/37547] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-15 20:01:02,240 INFO [Listener at localhost/37547] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-15 20:01:02,240 INFO [Listener at localhost/37547] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-15 20:01:02,241 INFO [Listener at localhost/37547] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-15 20:01:02,241 INFO [Listener at localhost/37547] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-15 20:01:02,241 INFO [Listener at localhost/37547] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-15 20:01:02,242 INFO [Listener at localhost/37547] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-15 20:01:02,244 INFO [Listener at localhost/37547] ipc.NettyRpcServer(120): Bind to /172.31.14.131:33367 2023-02-15 20:01:02,244 INFO [Listener at localhost/37547] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-15 20:01:02,246 DEBUG [Listener at localhost/37547] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-15 20:01:02,247 INFO [Listener at localhost/37547] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-15 20:01:02,250 INFO [Listener at localhost/37547] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-15 20:01:02,253 INFO [Listener at localhost/37547] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:33367 connecting to ZooKeeper ensemble=127.0.0.1:53178 2023-02-15 20:01:02,258 DEBUG [Listener at localhost/37547-EventThread] zookeeper.ZKWatcher(600): regionserver:333670x0, quorum=127.0.0.1:53178, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-15 20:01:02,259 DEBUG [Listener at localhost/37547] zookeeper.ZKUtil(164): regionserver:333670x0, quorum=127.0.0.1:53178, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-15 20:01:02,259 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:33367-0x10059926a4e0002 connected 2023-02-15 20:01:02,260 DEBUG [Listener at localhost/37547] zookeeper.ZKUtil(164): regionserver:33367-0x10059926a4e0002, quorum=127.0.0.1:53178, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-15 20:01:02,261 DEBUG [Listener at localhost/37547] zookeeper.ZKUtil(164): regionserver:33367-0x10059926a4e0002, quorum=127.0.0.1:53178, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-15 20:01:02,261 DEBUG [Listener at localhost/37547] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=33367 2023-02-15 20:01:02,262 DEBUG [Listener at localhost/37547] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=33367 2023-02-15 20:01:02,264 DEBUG [Listener at localhost/37547] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=33367 2023-02-15 20:01:02,269 DEBUG [Listener at localhost/37547] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=33367 2023-02-15 20:01:02,269 DEBUG [Listener at localhost/37547] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=33367 2023-02-15 20:01:02,272 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,39607,1676491260960 2023-02-15 20:01:02,285 DEBUG [Listener at localhost/37547-EventThread] zookeeper.ZKWatcher(600): master:39607-0x10059926a4e0000, quorum=127.0.0.1:53178, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-15 20:01:02,286 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:39607-0x10059926a4e0000, quorum=127.0.0.1:53178, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,39607,1676491260960 2023-02-15 20:01:02,310 DEBUG [Listener at localhost/37547-EventThread] zookeeper.ZKWatcher(600): regionserver:41535-0x10059926a4e0001, quorum=127.0.0.1:53178, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-15 20:01:02,310 DEBUG [Listener at localhost/37547-EventThread] zookeeper.ZKWatcher(600): master:39607-0x10059926a4e0000, quorum=127.0.0.1:53178, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-15 20:01:02,311 DEBUG [Listener at localhost/37547-EventThread] zookeeper.ZKWatcher(600): master:39607-0x10059926a4e0000, quorum=127.0.0.1:53178, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-15 20:01:02,310 DEBUG [Listener at localhost/37547-EventThread] zookeeper.ZKWatcher(600): regionserver:33367-0x10059926a4e0002, quorum=127.0.0.1:53178, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-15 20:01:02,314 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:39607-0x10059926a4e0000, quorum=127.0.0.1:53178, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-15 20:01:02,315 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:39607-0x10059926a4e0000, quorum=127.0.0.1:53178, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-15 20:01:02,317 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,39607,1676491260960 from backup master directory 2023-02-15 20:01:02,321 DEBUG [Listener at localhost/37547-EventThread] zookeeper.ZKWatcher(600): master:39607-0x10059926a4e0000, quorum=127.0.0.1:53178, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,39607,1676491260960 2023-02-15 20:01:02,322 DEBUG [Listener at localhost/37547-EventThread] zookeeper.ZKWatcher(600): master:39607-0x10059926a4e0000, quorum=127.0.0.1:53178, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-15 20:01:02,323 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-15 20:01:02,323 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase4.apache.org,39607,1676491260960 2023-02-15 20:01:02,327 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating data MemStoreChunkPool with chunk size 2 MB, max count 352, initial count 0 2023-02-15 20:01:02,330 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 391, initial count 0 2023-02-15 20:01:02,436 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(628): Created cluster ID file at hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/hbase.id with ID: eaaf2725-1fea-4bb4-a797-cc879cab1c48 2023-02-15 20:01:02,494 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-15 20:01:02,515 DEBUG [Listener at localhost/37547-EventThread] zookeeper.ZKWatcher(600): master:39607-0x10059926a4e0000, quorum=127.0.0.1:53178, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-15 20:01:02,589 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x4532ccb8 to 127.0.0.1:53178 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-15 20:01:02,627 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@47802712, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-15 20:01:02,653 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-15 20:01:02,655 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-02-15 20:01:02,675 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(264): ClientProtocol::create wrong number of arguments, should be hadoop 3.2 or below 2023-02-15 20:01:02,675 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(270): ClientProtocol::create wrong number of arguments, should be hadoop 2.x 2023-02-15 20:01:02,677 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(279): can not find SHOULD_REPLICATE flag, should be hadoop 2.x java.lang.IllegalArgumentException: No enum constant org.apache.hadoop.fs.CreateFlag.SHOULD_REPLICATE at java.lang.Enum.valueOf(Enum.java:238) at org.apache.hadoop.fs.CreateFlag.valueOf(CreateFlag.java:63) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.loadShouldReplicateFlag(FanOutOneBlockAsyncDFSOutputHelper.java:277) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.(FanOutOneBlockAsyncDFSOutputHelper.java:304) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:139) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-02-15 20:01:02,682 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(243): No decryptEncryptedDataEncryptionKey method in DFSClient, should be hadoop version with HDFS-12396 java.lang.NoSuchMethodException: org.apache.hadoop.hdfs.DFSClient.decryptEncryptedDataEncryptionKey(org.apache.hadoop.fs.FileEncryptionInfo) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelperWithoutHDFS12396(FanOutOneBlockAsyncDFSOutputSaslHelper.java:182) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelper(FanOutOneBlockAsyncDFSOutputSaslHelper.java:241) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.(FanOutOneBlockAsyncDFSOutputSaslHelper.java:252) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:140) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-02-15 20:01:02,683 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-15 20:01:02,734 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7689): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/MasterData/data/master/store-tmp 2023-02-15 20:01:02,773 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 20:01:02,773 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-15 20:01:02,773 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-15 20:01:02,773 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-15 20:01:02,773 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-15 20:01:02,773 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-15 20:01:02,773 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-15 20:01:02,773 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-15 20:01:02,775 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/MasterData/WALs/jenkins-hbase4.apache.org,39607,1676491260960 2023-02-15 20:01:02,804 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C39607%2C1676491260960, suffix=, logDir=hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/MasterData/WALs/jenkins-hbase4.apache.org,39607,1676491260960, archiveDir=hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/MasterData/oldWALs, maxLogs=10 2023-02-15 20:01:02,866 DEBUG [RS-EventLoopGroup-4-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33337,DS-cf384845-6a2a-4d92-88a8-20246f6151b8,DISK] 2023-02-15 20:01:02,866 DEBUG [RS-EventLoopGroup-4-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39201,DS-1bd451f1-c46d-4e8f-bd6a-d8a04ad1fd70,DISK] 2023-02-15 20:01:02,874 DEBUG [RS-EventLoopGroup-4-3] asyncfs.ProtobufDecoder(123): Hadoop 3.2 and below use unshaded protobuf. java.lang.ClassNotFoundException: org.apache.hadoop.thirdparty.protobuf.MessageLite at java.net.URLClassLoader.findClass(URLClassLoader.java:387) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.io.asyncfs.ProtobufDecoder.(ProtobufDecoder.java:118) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.processWriteBlockResponse(FanOutOneBlockAsyncDFSOutputHelper.java:340) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$100(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$4.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:424) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:557) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.addListener(DefaultPromise.java:185) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.initialize(FanOutOneBlockAsyncDFSOutputHelper.java:418) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$300(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:476) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:471) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setSuccess0(DefaultPromise.java:625) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:105) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPromise.trySuccess(DefaultChannelPromise.java:84) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:653) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:691) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-02-15 20:01:02,950 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/MasterData/WALs/jenkins-hbase4.apache.org,39607,1676491260960/jenkins-hbase4.apache.org%2C39607%2C1676491260960.1676491262815 2023-02-15 20:01:02,951 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:33337,DS-cf384845-6a2a-4d92-88a8-20246f6151b8,DISK], DatanodeInfoWithStorage[127.0.0.1:39201,DS-1bd451f1-c46d-4e8f-bd6a-d8a04ad1fd70,DISK]] 2023-02-15 20:01:02,951 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7850): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-02-15 20:01:02,952 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 20:01:02,956 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7890): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-02-15 20:01:02,957 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7893): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-02-15 20:01:03,025 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-02-15 20:01:03,033 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-02-15 20:01:03,062 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-02-15 20:01:03,074 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 20:01:03,080 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-15 20:01:03,081 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-15 20:01:03,096 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1054): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-02-15 20:01:03,101 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-15 20:01:03,102 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1071): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68616758, jitterRate=0.022469371557235718}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-15 20:01:03,102 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(964): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-15 20:01:03,104 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-02-15 20:01:03,126 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-02-15 20:01:03,126 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-02-15 20:01:03,129 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-02-15 20:01:03,131 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 1 msec 2023-02-15 20:01:03,167 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 35 msec 2023-02-15 20:01:03,167 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(95): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-02-15 20:01:03,198 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-02-15 20:01:03,204 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-02-15 20:01:03,232 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-02-15 20:01:03,237 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-02-15 20:01:03,238 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:39607-0x10059926a4e0000, quorum=127.0.0.1:53178, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-02-15 20:01:03,245 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-02-15 20:01:03,249 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:39607-0x10059926a4e0000, quorum=127.0.0.1:53178, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-02-15 20:01:03,253 DEBUG [Listener at localhost/37547-EventThread] zookeeper.ZKWatcher(600): master:39607-0x10059926a4e0000, quorum=127.0.0.1:53178, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-15 20:01:03,254 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:39607-0x10059926a4e0000, quorum=127.0.0.1:53178, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-02-15 20:01:03,255 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:39607-0x10059926a4e0000, quorum=127.0.0.1:53178, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-02-15 20:01:03,267 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:39607-0x10059926a4e0000, quorum=127.0.0.1:53178, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-02-15 20:01:03,272 DEBUG [Listener at localhost/37547-EventThread] zookeeper.ZKWatcher(600): regionserver:33367-0x10059926a4e0002, quorum=127.0.0.1:53178, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-15 20:01:03,272 DEBUG [Listener at localhost/37547-EventThread] zookeeper.ZKWatcher(600): regionserver:41535-0x10059926a4e0001, quorum=127.0.0.1:53178, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-15 20:01:03,272 DEBUG [Listener at localhost/37547-EventThread] zookeeper.ZKWatcher(600): master:39607-0x10059926a4e0000, quorum=127.0.0.1:53178, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-15 20:01:03,272 DEBUG [Listener at localhost/37547-EventThread] zookeeper.ZKWatcher(600): master:39607-0x10059926a4e0000, quorum=127.0.0.1:53178, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-15 20:01:03,273 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase4.apache.org,39607,1676491260960, sessionid=0x10059926a4e0000, setting cluster-up flag (Was=false) 2023-02-15 20:01:03,289 DEBUG [Listener at localhost/37547-EventThread] zookeeper.ZKWatcher(600): master:39607-0x10059926a4e0000, quorum=127.0.0.1:53178, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-15 20:01:03,295 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-02-15 20:01:03,302 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,39607,1676491260960 2023-02-15 20:01:03,309 DEBUG [Listener at localhost/37547-EventThread] zookeeper.ZKWatcher(600): master:39607-0x10059926a4e0000, quorum=127.0.0.1:53178, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-15 20:01:03,314 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-02-15 20:01:03,315 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,39607,1676491260960 2023-02-15 20:01:03,318 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/.hbase-snapshot/.tmp 2023-02-15 20:01:03,373 INFO [RS:0;jenkins-hbase4:41535] regionserver.HRegionServer(952): ClusterId : eaaf2725-1fea-4bb4-a797-cc879cab1c48 2023-02-15 20:01:03,373 INFO [RS:1;jenkins-hbase4:33367] regionserver.HRegionServer(952): ClusterId : eaaf2725-1fea-4bb4-a797-cc879cab1c48 2023-02-15 20:01:03,380 DEBUG [RS:1;jenkins-hbase4:33367] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-15 20:01:03,380 DEBUG [RS:0;jenkins-hbase4:41535] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-15 20:01:03,388 DEBUG [RS:1;jenkins-hbase4:33367] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-15 20:01:03,388 DEBUG [RS:1;jenkins-hbase4:33367] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-15 20:01:03,388 DEBUG [RS:0;jenkins-hbase4:41535] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-15 20:01:03,389 DEBUG [RS:0;jenkins-hbase4:41535] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-15 20:01:03,392 DEBUG [RS:1;jenkins-hbase4:33367] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-15 20:01:03,392 DEBUG [RS:0;jenkins-hbase4:41535] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-15 20:01:03,395 DEBUG [RS:0;jenkins-hbase4:41535] zookeeper.ReadOnlyZKClient(139): Connect 0x183c078f to 127.0.0.1:53178 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-15 20:01:03,395 DEBUG [RS:1;jenkins-hbase4:33367] zookeeper.ReadOnlyZKClient(139): Connect 0x573dbd02 to 127.0.0.1:53178 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-15 20:01:03,403 DEBUG [RS:0;jenkins-hbase4:41535] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@16fbfaf8, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-15 20:01:03,403 DEBUG [RS:1;jenkins-hbase4:33367] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@59fa4995, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-15 20:01:03,404 DEBUG [RS:0;jenkins-hbase4:41535] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@12c46cff, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-15 20:01:03,404 DEBUG [RS:1;jenkins-hbase4:33367] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5dc5d672, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-15 20:01:03,432 DEBUG [RS:1;jenkins-hbase4:33367] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:33367 2023-02-15 20:01:03,434 DEBUG [RS:0;jenkins-hbase4:41535] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:41535 2023-02-15 20:01:03,438 INFO [RS:1;jenkins-hbase4:33367] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-15 20:01:03,438 INFO [RS:1;jenkins-hbase4:33367] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-15 20:01:03,438 INFO [RS:0;jenkins-hbase4:41535] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-15 20:01:03,438 INFO [RS:0;jenkins-hbase4:41535] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-15 20:01:03,438 DEBUG [RS:1;jenkins-hbase4:33367] regionserver.HRegionServer(1023): About to register with Master. 2023-02-15 20:01:03,439 DEBUG [RS:0;jenkins-hbase4:41535] regionserver.HRegionServer(1023): About to register with Master. 2023-02-15 20:01:03,441 INFO [RS:1;jenkins-hbase4:33367] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,39607,1676491260960 with isa=jenkins-hbase4.apache.org/172.31.14.131:33367, startcode=1676491262239 2023-02-15 20:01:03,441 INFO [RS:0;jenkins-hbase4:41535] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,39607,1676491260960 with isa=jenkins-hbase4.apache.org/172.31.14.131:41535, startcode=1676491262190 2023-02-15 20:01:03,459 DEBUG [RS:1;jenkins-hbase4:33367] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-15 20:01:03,459 DEBUG [RS:0;jenkins-hbase4:41535] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-15 20:01:03,479 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-02-15 20:01:03,493 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-15 20:01:03,493 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-15 20:01:03,493 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-15 20:01:03,493 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-15 20:01:03,494 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-02-15 20:01:03,494 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 20:01:03,494 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-15 20:01:03,494 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 20:01:03,496 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1676491293496 2023-02-15 20:01:03,500 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-02-15 20:01:03,503 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-02-15 20:01:03,504 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-02-15 20:01:03,509 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-15 20:01:03,511 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-02-15 20:01:03,519 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-02-15 20:01:03,520 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-02-15 20:01:03,520 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35791, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=RegionServerStatusService 2023-02-15 20:01:03,520 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48483, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.1 (auth:SIMPLE), service=RegionServerStatusService 2023-02-15 20:01:03,522 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-02-15 20:01:03,522 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-02-15 20:01:03,522 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-15 20:01:03,523 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-02-15 20:01:03,527 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-02-15 20:01:03,527 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-02-15 20:01:03,530 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-02-15 20:01:03,530 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39607] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:577) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-02-15 20:01:03,530 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39607] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:577) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-02-15 20:01:03,531 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-02-15 20:01:03,536 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676491263533,5,FailOnTimeoutGroup] 2023-02-15 20:01:03,536 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676491263536,5,FailOnTimeoutGroup] 2023-02-15 20:01:03,536 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-15 20:01:03,536 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-02-15 20:01:03,539 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-02-15 20:01:03,539 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-02-15 20:01:03,570 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-15 20:01:03,571 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-15 20:01:03,571 INFO [PEWorker-1] regionserver.HRegion(7671): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a 2023-02-15 20:01:03,576 DEBUG [RS:1;jenkins-hbase4:33367] regionserver.HRegionServer(2829): Master is not running yet 2023-02-15 20:01:03,576 DEBUG [RS:0;jenkins-hbase4:41535] regionserver.HRegionServer(2829): Master is not running yet 2023-02-15 20:01:03,577 WARN [RS:1;jenkins-hbase4:33367] regionserver.HRegionServer(1031): reportForDuty failed; sleeping 1000 ms and then retrying. 2023-02-15 20:01:03,577 WARN [RS:0;jenkins-hbase4:41535] regionserver.HRegionServer(1031): reportForDuty failed; sleeping 1000 ms and then retrying. 2023-02-15 20:01:03,593 DEBUG [PEWorker-1] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 20:01:03,598 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-15 20:01:03,601 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/data/hbase/meta/1588230740/info 2023-02-15 20:01:03,602 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-15 20:01:03,604 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 20:01:03,605 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-15 20:01:03,607 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/data/hbase/meta/1588230740/rep_barrier 2023-02-15 20:01:03,608 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-15 20:01:03,609 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 20:01:03,609 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-15 20:01:03,611 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/data/hbase/meta/1588230740/table 2023-02-15 20:01:03,612 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-15 20:01:03,613 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 20:01:03,614 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/data/hbase/meta/1588230740 2023-02-15 20:01:03,615 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/data/hbase/meta/1588230740 2023-02-15 20:01:03,619 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-15 20:01:03,621 DEBUG [PEWorker-1] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-15 20:01:03,625 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-15 20:01:03,626 INFO [PEWorker-1] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63898361, jitterRate=-0.04784022271633148}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-15 20:01:03,626 DEBUG [PEWorker-1] regionserver.HRegion(964): Region open journal for 1588230740: 2023-02-15 20:01:03,626 DEBUG [PEWorker-1] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-15 20:01:03,626 INFO [PEWorker-1] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-15 20:01:03,626 DEBUG [PEWorker-1] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-15 20:01:03,626 DEBUG [PEWorker-1] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-15 20:01:03,626 DEBUG [PEWorker-1] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-15 20:01:03,627 INFO [PEWorker-1] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-15 20:01:03,627 DEBUG [PEWorker-1] regionserver.HRegion(1557): Region close journal for 1588230740: 2023-02-15 20:01:03,633 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-02-15 20:01:03,633 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-02-15 20:01:03,642 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-02-15 20:01:03,653 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-02-15 20:01:03,656 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-02-15 20:01:03,806 WARN [jenkins-hbase4:39607] assignment.AssignmentManager(2157): No servers available; cannot place 1 unassigned regions. 2023-02-15 20:01:04,578 INFO [RS:1;jenkins-hbase4:33367] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,39607,1676491260960 with isa=jenkins-hbase4.apache.org/172.31.14.131:33367, startcode=1676491262239 2023-02-15 20:01:04,578 INFO [RS:0;jenkins-hbase4:41535] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,39607,1676491260960 with isa=jenkins-hbase4.apache.org/172.31.14.131:41535, startcode=1676491262190 2023-02-15 20:01:04,584 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39607] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,33367,1676491262239 2023-02-15 20:01:04,585 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39607] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,41535,1676491262190 2023-02-15 20:01:04,591 DEBUG [RS:1;jenkins-hbase4:33367] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a 2023-02-15 20:01:04,591 DEBUG [RS:0;jenkins-hbase4:41535] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a 2023-02-15 20:01:04,592 DEBUG [RS:1;jenkins-hbase4:33367] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:38891 2023-02-15 20:01:04,592 DEBUG [RS:0;jenkins-hbase4:41535] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:38891 2023-02-15 20:01:04,592 DEBUG [RS:1;jenkins-hbase4:33367] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-15 20:01:04,592 DEBUG [RS:0;jenkins-hbase4:41535] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-15 20:01:04,601 DEBUG [Listener at localhost/37547-EventThread] zookeeper.ZKWatcher(600): master:39607-0x10059926a4e0000, quorum=127.0.0.1:53178, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-15 20:01:04,601 DEBUG [RS:1;jenkins-hbase4:33367] zookeeper.ZKUtil(162): regionserver:33367-0x10059926a4e0002, quorum=127.0.0.1:53178, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,33367,1676491262239 2023-02-15 20:01:04,602 DEBUG [RS:0;jenkins-hbase4:41535] zookeeper.ZKUtil(162): regionserver:41535-0x10059926a4e0001, quorum=127.0.0.1:53178, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,41535,1676491262190 2023-02-15 20:01:04,602 WARN [RS:1;jenkins-hbase4:33367] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-15 20:01:04,602 WARN [RS:0;jenkins-hbase4:41535] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-15 20:01:04,602 INFO [RS:1;jenkins-hbase4:33367] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-15 20:01:04,602 INFO [RS:0;jenkins-hbase4:41535] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-15 20:01:04,603 DEBUG [RS:1;jenkins-hbase4:33367] regionserver.HRegionServer(1947): logDir=hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/WALs/jenkins-hbase4.apache.org,33367,1676491262239 2023-02-15 20:01:04,603 DEBUG [RS:0;jenkins-hbase4:41535] regionserver.HRegionServer(1947): logDir=hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/WALs/jenkins-hbase4.apache.org,41535,1676491262190 2023-02-15 20:01:04,603 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,33367,1676491262239] 2023-02-15 20:01:04,603 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,41535,1676491262190] 2023-02-15 20:01:04,613 DEBUG [RS:0;jenkins-hbase4:41535] zookeeper.ZKUtil(162): regionserver:41535-0x10059926a4e0001, quorum=127.0.0.1:53178, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,33367,1676491262239 2023-02-15 20:01:04,613 DEBUG [RS:1;jenkins-hbase4:33367] zookeeper.ZKUtil(162): regionserver:33367-0x10059926a4e0002, quorum=127.0.0.1:53178, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,33367,1676491262239 2023-02-15 20:01:04,614 DEBUG [RS:1;jenkins-hbase4:33367] zookeeper.ZKUtil(162): regionserver:33367-0x10059926a4e0002, quorum=127.0.0.1:53178, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,41535,1676491262190 2023-02-15 20:01:04,614 DEBUG [RS:0;jenkins-hbase4:41535] zookeeper.ZKUtil(162): regionserver:41535-0x10059926a4e0001, quorum=127.0.0.1:53178, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,41535,1676491262190 2023-02-15 20:01:04,625 DEBUG [RS:0;jenkins-hbase4:41535] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-15 20:01:04,625 DEBUG [RS:1;jenkins-hbase4:33367] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-15 20:01:04,635 INFO [RS:0;jenkins-hbase4:41535] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-15 20:01:04,635 INFO [RS:1;jenkins-hbase4:33367] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-15 20:01:04,656 INFO [RS:0;jenkins-hbase4:41535] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-15 20:01:04,656 INFO [RS:1;jenkins-hbase4:33367] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-15 20:01:04,661 INFO [RS:1;jenkins-hbase4:33367] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-15 20:01:04,661 INFO [RS:0;jenkins-hbase4:41535] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-15 20:01:04,661 INFO [RS:1;jenkins-hbase4:33367] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-15 20:01:04,661 INFO [RS:0;jenkins-hbase4:41535] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-15 20:01:04,662 INFO [RS:0;jenkins-hbase4:41535] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-15 20:01:04,662 INFO [RS:1;jenkins-hbase4:33367] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-15 20:01:04,671 INFO [RS:0;jenkins-hbase4:41535] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-15 20:01:04,671 INFO [RS:1;jenkins-hbase4:33367] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-15 20:01:04,672 DEBUG [RS:0;jenkins-hbase4:41535] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 20:01:04,672 DEBUG [RS:1;jenkins-hbase4:33367] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 20:01:04,672 DEBUG [RS:0;jenkins-hbase4:41535] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 20:01:04,672 DEBUG [RS:1;jenkins-hbase4:33367] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 20:01:04,672 DEBUG [RS:0;jenkins-hbase4:41535] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 20:01:04,672 DEBUG [RS:1;jenkins-hbase4:33367] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 20:01:04,672 DEBUG [RS:0;jenkins-hbase4:41535] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 20:01:04,673 DEBUG [RS:1;jenkins-hbase4:33367] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 20:01:04,673 DEBUG [RS:0;jenkins-hbase4:41535] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 20:01:04,673 DEBUG [RS:1;jenkins-hbase4:33367] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 20:01:04,673 DEBUG [RS:0;jenkins-hbase4:41535] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-15 20:01:04,673 DEBUG [RS:1;jenkins-hbase4:33367] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-15 20:01:04,673 DEBUG [RS:0;jenkins-hbase4:41535] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 20:01:04,673 DEBUG [RS:1;jenkins-hbase4:33367] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 20:01:04,673 DEBUG [RS:0;jenkins-hbase4:41535] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 20:01:04,673 DEBUG [RS:1;jenkins-hbase4:33367] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 20:01:04,673 DEBUG [RS:0;jenkins-hbase4:41535] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 20:01:04,673 DEBUG [RS:1;jenkins-hbase4:33367] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 20:01:04,673 DEBUG [RS:0;jenkins-hbase4:41535] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 20:01:04,673 DEBUG [RS:1;jenkins-hbase4:33367] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 20:01:04,676 INFO [RS:0;jenkins-hbase4:41535] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-15 20:01:04,676 INFO [RS:0;jenkins-hbase4:41535] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-15 20:01:04,676 INFO [RS:0;jenkins-hbase4:41535] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-15 20:01:04,676 INFO [RS:1;jenkins-hbase4:33367] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-15 20:01:04,676 INFO [RS:1;jenkins-hbase4:33367] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-15 20:01:04,676 INFO [RS:1;jenkins-hbase4:33367] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-15 20:01:04,693 INFO [RS:1;jenkins-hbase4:33367] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-15 20:01:04,693 INFO [RS:0;jenkins-hbase4:41535] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-15 20:01:04,697 INFO [RS:1;jenkins-hbase4:33367] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,33367,1676491262239-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-15 20:01:04,697 INFO [RS:0;jenkins-hbase4:41535] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,41535,1676491262190-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-15 20:01:04,714 INFO [RS:1;jenkins-hbase4:33367] regionserver.Replication(203): jenkins-hbase4.apache.org,33367,1676491262239 started 2023-02-15 20:01:04,715 INFO [RS:1;jenkins-hbase4:33367] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,33367,1676491262239, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:33367, sessionid=0x10059926a4e0002 2023-02-15 20:01:04,715 DEBUG [RS:1;jenkins-hbase4:33367] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-15 20:01:04,715 DEBUG [RS:1;jenkins-hbase4:33367] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,33367,1676491262239 2023-02-15 20:01:04,715 DEBUG [RS:1;jenkins-hbase4:33367] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,33367,1676491262239' 2023-02-15 20:01:04,715 DEBUG [RS:1;jenkins-hbase4:33367] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-15 20:01:04,716 DEBUG [RS:1;jenkins-hbase4:33367] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-15 20:01:04,716 DEBUG [RS:1;jenkins-hbase4:33367] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-15 20:01:04,716 DEBUG [RS:1;jenkins-hbase4:33367] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-15 20:01:04,717 DEBUG [RS:1;jenkins-hbase4:33367] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,33367,1676491262239 2023-02-15 20:01:04,717 DEBUG [RS:1;jenkins-hbase4:33367] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,33367,1676491262239' 2023-02-15 20:01:04,717 DEBUG [RS:1;jenkins-hbase4:33367] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-15 20:01:04,717 DEBUG [RS:1;jenkins-hbase4:33367] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-15 20:01:04,718 DEBUG [RS:1;jenkins-hbase4:33367] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-15 20:01:04,718 INFO [RS:1;jenkins-hbase4:33367] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-15 20:01:04,718 INFO [RS:1;jenkins-hbase4:33367] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-15 20:01:04,720 INFO [RS:0;jenkins-hbase4:41535] regionserver.Replication(203): jenkins-hbase4.apache.org,41535,1676491262190 started 2023-02-15 20:01:04,720 INFO [RS:0;jenkins-hbase4:41535] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,41535,1676491262190, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:41535, sessionid=0x10059926a4e0001 2023-02-15 20:01:04,720 DEBUG [RS:0;jenkins-hbase4:41535] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-15 20:01:04,720 DEBUG [RS:0;jenkins-hbase4:41535] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,41535,1676491262190 2023-02-15 20:01:04,721 DEBUG [RS:0;jenkins-hbase4:41535] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,41535,1676491262190' 2023-02-15 20:01:04,721 DEBUG [RS:0;jenkins-hbase4:41535] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-15 20:01:04,721 DEBUG [RS:0;jenkins-hbase4:41535] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-15 20:01:04,722 DEBUG [RS:0;jenkins-hbase4:41535] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-15 20:01:04,722 DEBUG [RS:0;jenkins-hbase4:41535] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-15 20:01:04,722 DEBUG [RS:0;jenkins-hbase4:41535] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,41535,1676491262190 2023-02-15 20:01:04,722 DEBUG [RS:0;jenkins-hbase4:41535] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,41535,1676491262190' 2023-02-15 20:01:04,722 DEBUG [RS:0;jenkins-hbase4:41535] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-15 20:01:04,723 DEBUG [RS:0;jenkins-hbase4:41535] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-15 20:01:04,723 DEBUG [RS:0;jenkins-hbase4:41535] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-15 20:01:04,723 INFO [RS:0;jenkins-hbase4:41535] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-15 20:01:04,724 INFO [RS:0;jenkins-hbase4:41535] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-15 20:01:04,808 DEBUG [jenkins-hbase4:39607] assignment.AssignmentManager(2178): Processing assignQueue; systemServersCount=2, allServersCount=2 2023-02-15 20:01:04,813 DEBUG [jenkins-hbase4:39607] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-15 20:01:04,819 DEBUG [jenkins-hbase4:39607] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-15 20:01:04,820 DEBUG [jenkins-hbase4:39607] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-15 20:01:04,820 DEBUG [jenkins-hbase4:39607] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-15 20:01:04,822 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,41535,1676491262190, state=OPENING 2023-02-15 20:01:04,830 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-02-15 20:01:04,832 DEBUG [Listener at localhost/37547-EventThread] zookeeper.ZKWatcher(600): master:39607-0x10059926a4e0000, quorum=127.0.0.1:53178, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-15 20:01:04,832 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-15 20:01:04,836 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,41535,1676491262190}] 2023-02-15 20:01:05,024 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,41535,1676491262190 2023-02-15 20:01:05,026 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-15 20:01:05,030 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54616, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-15 20:01:05,043 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:meta,,1.1588230740 2023-02-15 20:01:05,043 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-15 20:01:05,047 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C41535%2C1676491262190.meta, suffix=.meta, logDir=hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/WALs/jenkins-hbase4.apache.org,41535,1676491262190, archiveDir=hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/oldWALs, maxLogs=32 2023-02-15 20:01:05,069 DEBUG [RS-EventLoopGroup-4-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39201,DS-1bd451f1-c46d-4e8f-bd6a-d8a04ad1fd70,DISK] 2023-02-15 20:01:05,070 DEBUG [RS-EventLoopGroup-4-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33337,DS-cf384845-6a2a-4d92-88a8-20246f6151b8,DISK] 2023-02-15 20:01:05,075 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/WALs/jenkins-hbase4.apache.org,41535,1676491262190/jenkins-hbase4.apache.org%2C41535%2C1676491262190.meta.1676491265051.meta 2023-02-15 20:01:05,076 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:39201,DS-1bd451f1-c46d-4e8f-bd6a-d8a04ad1fd70,DISK], DatanodeInfoWithStorage[127.0.0.1:33337,DS-cf384845-6a2a-4d92-88a8-20246f6151b8,DISK]] 2023-02-15 20:01:05,076 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-02-15 20:01:05,078 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-02-15 20:01:05,101 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8546): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-02-15 20:01:05,107 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-02-15 20:01:05,112 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-02-15 20:01:05,112 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 20:01:05,112 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 1588230740 2023-02-15 20:01:05,112 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 1588230740 2023-02-15 20:01:05,116 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-15 20:01:05,117 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/data/hbase/meta/1588230740/info 2023-02-15 20:01:05,118 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/data/hbase/meta/1588230740/info 2023-02-15 20:01:05,118 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-15 20:01:05,120 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 20:01:05,120 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-15 20:01:05,122 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/data/hbase/meta/1588230740/rep_barrier 2023-02-15 20:01:05,122 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/data/hbase/meta/1588230740/rep_barrier 2023-02-15 20:01:05,122 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-15 20:01:05,123 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 20:01:05,124 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-15 20:01:05,125 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/data/hbase/meta/1588230740/table 2023-02-15 20:01:05,125 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/data/hbase/meta/1588230740/table 2023-02-15 20:01:05,126 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-15 20:01:05,126 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 20:01:05,129 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/data/hbase/meta/1588230740 2023-02-15 20:01:05,132 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/data/hbase/meta/1588230740 2023-02-15 20:01:05,137 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-15 20:01:05,140 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-15 20:01:05,142 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68238565, jitterRate=0.01683385670185089}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-15 20:01:05,142 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 1588230740: 2023-02-15 20:01:05,156 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1676491265016 2023-02-15 20:01:05,179 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:meta,,1.1588230740 2023-02-15 20:01:05,180 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:meta,,1.1588230740 2023-02-15 20:01:05,181 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,41535,1676491262190, state=OPEN 2023-02-15 20:01:05,195 DEBUG [Listener at localhost/37547-EventThread] zookeeper.ZKWatcher(600): master:39607-0x10059926a4e0000, quorum=127.0.0.1:53178, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-02-15 20:01:05,195 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-15 20:01:05,200 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-02-15 20:01:05,200 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,41535,1676491262190 in 359 msec 2023-02-15 20:01:05,205 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-02-15 20:01:05,206 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 1.5590 sec 2023-02-15 20:01:05,211 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 1.8290 sec 2023-02-15 20:01:05,211 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1676491265211, completionTime=-1 2023-02-15 20:01:05,211 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=2; waited=0ms, expected min=2 server(s), max=2 server(s), master is running 2023-02-15 20:01:05,211 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1519): Joining cluster... 2023-02-15 20:01:05,280 DEBUG [hconnection-0x1f86c7f2-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-15 20:01:05,284 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54630, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-15 20:01:05,301 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1531): Number of RegionServers=2 2023-02-15 20:01:05,301 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1676491325301 2023-02-15 20:01:05,301 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1676491385301 2023-02-15 20:01:05,301 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1538): Joined the cluster in 89 msec 2023-02-15 20:01:05,331 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,39607,1676491260960-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-15 20:01:05,331 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,39607,1676491260960-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-15 20:01:05,331 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,39607,1676491260960-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-15 20:01:05,334 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:39607, period=300000, unit=MILLISECONDS is enabled. 2023-02-15 20:01:05,334 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-02-15 20:01:05,342 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-02-15 20:01:05,355 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-02-15 20:01:05,357 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-15 20:01:05,374 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-02-15 20:01:05,378 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-02-15 20:01:05,382 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-15 20:01:05,441 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/.tmp/data/hbase/namespace/9b913a56be4572b4f2949643b7fef2ba 2023-02-15 20:01:05,454 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/.tmp/data/hbase/namespace/9b913a56be4572b4f2949643b7fef2ba empty. 2023-02-15 20:01:05,456 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/.tmp/data/hbase/namespace/9b913a56be4572b4f2949643b7fef2ba 2023-02-15 20:01:05,456 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-02-15 20:01:05,498 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-02-15 20:01:05,501 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7671): creating {ENCODED => 9b913a56be4572b4f2949643b7fef2ba, NAME => 'hbase:namespace,,1676491265356.9b913a56be4572b4f2949643b7fef2ba.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/.tmp 2023-02-15 20:01:05,527 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676491265356.9b913a56be4572b4f2949643b7fef2ba.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 20:01:05,527 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1603): Closing 9b913a56be4572b4f2949643b7fef2ba, disabling compactions & flushes 2023-02-15 20:01:05,527 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676491265356.9b913a56be4572b4f2949643b7fef2ba. 2023-02-15 20:01:05,527 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676491265356.9b913a56be4572b4f2949643b7fef2ba. 2023-02-15 20:01:05,527 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676491265356.9b913a56be4572b4f2949643b7fef2ba. after waiting 0 ms 2023-02-15 20:01:05,527 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676491265356.9b913a56be4572b4f2949643b7fef2ba. 2023-02-15 20:01:05,527 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676491265356.9b913a56be4572b4f2949643b7fef2ba. 2023-02-15 20:01:05,527 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1557): Region close journal for 9b913a56be4572b4f2949643b7fef2ba: 2023-02-15 20:01:05,533 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-02-15 20:01:05,554 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1676491265356.9b913a56be4572b4f2949643b7fef2ba.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676491265537"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676491265537"}]},"ts":"1676491265537"} 2023-02-15 20:01:05,590 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-15 20:01:05,592 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-15 20:01:05,596 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676491265592"}]},"ts":"1676491265592"} 2023-02-15 20:01:05,628 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-02-15 20:01:05,633 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-15 20:01:05,634 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-15 20:01:05,634 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-15 20:01:05,634 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-15 20:01:05,638 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=9b913a56be4572b4f2949643b7fef2ba, ASSIGN}] 2023-02-15 20:01:05,644 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=9b913a56be4572b4f2949643b7fef2ba, ASSIGN 2023-02-15 20:01:05,646 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=9b913a56be4572b4f2949643b7fef2ba, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,41535,1676491262190; forceNewPlan=false, retain=false 2023-02-15 20:01:05,729 INFO [RS:1;jenkins-hbase4:33367] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C33367%2C1676491262239, suffix=, logDir=hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/WALs/jenkins-hbase4.apache.org,33367,1676491262239, archiveDir=hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/oldWALs, maxLogs=32 2023-02-15 20:01:05,729 INFO [RS:0;jenkins-hbase4:41535] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C41535%2C1676491262190, suffix=, logDir=hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/WALs/jenkins-hbase4.apache.org,41535,1676491262190, archiveDir=hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/oldWALs, maxLogs=32 2023-02-15 20:01:05,750 DEBUG [RS-EventLoopGroup-4-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33337,DS-cf384845-6a2a-4d92-88a8-20246f6151b8,DISK] 2023-02-15 20:01:05,750 DEBUG [RS-EventLoopGroup-4-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39201,DS-1bd451f1-c46d-4e8f-bd6a-d8a04ad1fd70,DISK] 2023-02-15 20:01:05,751 DEBUG [RS-EventLoopGroup-4-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39201,DS-1bd451f1-c46d-4e8f-bd6a-d8a04ad1fd70,DISK] 2023-02-15 20:01:05,751 DEBUG [RS-EventLoopGroup-4-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33337,DS-cf384845-6a2a-4d92-88a8-20246f6151b8,DISK] 2023-02-15 20:01:05,755 INFO [RS:0;jenkins-hbase4:41535] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/WALs/jenkins-hbase4.apache.org,41535,1676491262190/jenkins-hbase4.apache.org%2C41535%2C1676491262190.1676491265731 2023-02-15 20:01:05,755 INFO [RS:1;jenkins-hbase4:33367] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/WALs/jenkins-hbase4.apache.org,33367,1676491262239/jenkins-hbase4.apache.org%2C33367%2C1676491262239.1676491265731 2023-02-15 20:01:05,756 DEBUG [RS:0;jenkins-hbase4:41535] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:33337,DS-cf384845-6a2a-4d92-88a8-20246f6151b8,DISK], DatanodeInfoWithStorage[127.0.0.1:39201,DS-1bd451f1-c46d-4e8f-bd6a-d8a04ad1fd70,DISK]] 2023-02-15 20:01:05,756 DEBUG [RS:1;jenkins-hbase4:33367] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:39201,DS-1bd451f1-c46d-4e8f-bd6a-d8a04ad1fd70,DISK], DatanodeInfoWithStorage[127.0.0.1:33337,DS-cf384845-6a2a-4d92-88a8-20246f6151b8,DISK]] 2023-02-15 20:01:05,799 INFO [jenkins-hbase4:39607] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-15 20:01:05,799 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=9b913a56be4572b4f2949643b7fef2ba, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41535,1676491262190 2023-02-15 20:01:05,800 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1676491265356.9b913a56be4572b4f2949643b7fef2ba.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676491265799"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676491265799"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676491265799"}]},"ts":"1676491265799"} 2023-02-15 20:01:05,806 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 9b913a56be4572b4f2949643b7fef2ba, server=jenkins-hbase4.apache.org,41535,1676491262190}] 2023-02-15 20:01:05,969 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:namespace,,1676491265356.9b913a56be4572b4f2949643b7fef2ba. 2023-02-15 20:01:05,970 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 9b913a56be4572b4f2949643b7fef2ba, NAME => 'hbase:namespace,,1676491265356.9b913a56be4572b4f2949643b7fef2ba.', STARTKEY => '', ENDKEY => ''} 2023-02-15 20:01:05,971 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 9b913a56be4572b4f2949643b7fef2ba 2023-02-15 20:01:05,971 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676491265356.9b913a56be4572b4f2949643b7fef2ba.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 20:01:05,971 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 9b913a56be4572b4f2949643b7fef2ba 2023-02-15 20:01:05,971 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 9b913a56be4572b4f2949643b7fef2ba 2023-02-15 20:01:05,976 INFO [StoreOpener-9b913a56be4572b4f2949643b7fef2ba-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 9b913a56be4572b4f2949643b7fef2ba 2023-02-15 20:01:05,984 DEBUG [StoreOpener-9b913a56be4572b4f2949643b7fef2ba-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/data/hbase/namespace/9b913a56be4572b4f2949643b7fef2ba/info 2023-02-15 20:01:05,984 DEBUG [StoreOpener-9b913a56be4572b4f2949643b7fef2ba-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/data/hbase/namespace/9b913a56be4572b4f2949643b7fef2ba/info 2023-02-15 20:01:05,984 INFO [StoreOpener-9b913a56be4572b4f2949643b7fef2ba-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9b913a56be4572b4f2949643b7fef2ba columnFamilyName info 2023-02-15 20:01:05,985 INFO [StoreOpener-9b913a56be4572b4f2949643b7fef2ba-1] regionserver.HStore(310): Store=9b913a56be4572b4f2949643b7fef2ba/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 20:01:05,987 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/data/hbase/namespace/9b913a56be4572b4f2949643b7fef2ba 2023-02-15 20:01:05,988 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/data/hbase/namespace/9b913a56be4572b4f2949643b7fef2ba 2023-02-15 20:01:05,993 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 9b913a56be4572b4f2949643b7fef2ba 2023-02-15 20:01:05,997 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/data/hbase/namespace/9b913a56be4572b4f2949643b7fef2ba/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-15 20:01:06,002 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 9b913a56be4572b4f2949643b7fef2ba; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73279418, jitterRate=0.09194841980934143}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-15 20:01:06,002 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 9b913a56be4572b4f2949643b7fef2ba: 2023-02-15 20:01:06,004 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:namespace,,1676491265356.9b913a56be4572b4f2949643b7fef2ba., pid=6, masterSystemTime=1676491265960 2023-02-15 20:01:06,009 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:namespace,,1676491265356.9b913a56be4572b4f2949643b7fef2ba. 2023-02-15 20:01:06,010 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:namespace,,1676491265356.9b913a56be4572b4f2949643b7fef2ba. 2023-02-15 20:01:06,011 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=9b913a56be4572b4f2949643b7fef2ba, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,41535,1676491262190 2023-02-15 20:01:06,012 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1676491265356.9b913a56be4572b4f2949643b7fef2ba.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676491266010"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676491266010"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676491266010"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676491266010"}]},"ts":"1676491266010"} 2023-02-15 20:01:06,020 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-02-15 20:01:06,020 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 9b913a56be4572b4f2949643b7fef2ba, server=jenkins-hbase4.apache.org,41535,1676491262190 in 210 msec 2023-02-15 20:01:06,024 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-02-15 20:01:06,025 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=9b913a56be4572b4f2949643b7fef2ba, ASSIGN in 382 msec 2023-02-15 20:01:06,026 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-15 20:01:06,026 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676491266026"}]},"ts":"1676491266026"} 2023-02-15 20:01:06,029 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-02-15 20:01:06,034 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-02-15 20:01:06,037 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 676 msec 2023-02-15 20:01:06,090 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:39607-0x10059926a4e0000, quorum=127.0.0.1:53178, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-02-15 20:01:06,091 DEBUG [Listener at localhost/37547-EventThread] zookeeper.ZKWatcher(600): master:39607-0x10059926a4e0000, quorum=127.0.0.1:53178, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-02-15 20:01:06,091 DEBUG [Listener at localhost/37547-EventThread] zookeeper.ZKWatcher(600): master:39607-0x10059926a4e0000, quorum=127.0.0.1:53178, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-15 20:01:06,146 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-02-15 20:01:06,163 DEBUG [Listener at localhost/37547-EventThread] zookeeper.ZKWatcher(600): master:39607-0x10059926a4e0000, quorum=127.0.0.1:53178, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-15 20:01:06,169 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 31 msec 2023-02-15 20:01:06,173 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-02-15 20:01:06,187 DEBUG [Listener at localhost/37547-EventThread] zookeeper.ZKWatcher(600): master:39607-0x10059926a4e0000, quorum=127.0.0.1:53178, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-15 20:01:06,192 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 17 msec 2023-02-15 20:01:06,200 DEBUG [Listener at localhost/37547-EventThread] zookeeper.ZKWatcher(600): master:39607-0x10059926a4e0000, quorum=127.0.0.1:53178, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-02-15 20:01:06,208 DEBUG [Listener at localhost/37547-EventThread] zookeeper.ZKWatcher(600): master:39607-0x10059926a4e0000, quorum=127.0.0.1:53178, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-02-15 20:01:06,208 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 3.885sec 2023-02-15 20:01:06,211 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-02-15 20:01:06,213 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-02-15 20:01:06,213 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-02-15 20:01:06,215 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,39607,1676491260960-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-02-15 20:01:06,216 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,39607,1676491260960-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-02-15 20:01:06,226 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-02-15 20:01:06,282 DEBUG [Listener at localhost/37547] zookeeper.ReadOnlyZKClient(139): Connect 0x56159f41 to 127.0.0.1:53178 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-15 20:01:06,287 DEBUG [Listener at localhost/37547] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4104c894, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-15 20:01:06,346 DEBUG [hconnection-0x11545b24-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-15 20:01:06,360 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54642, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-15 20:01:06,372 INFO [Listener at localhost/37547] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,39607,1676491260960 2023-02-15 20:01:06,372 DEBUG [Listener at localhost/37547] mapreduce.TableSnapshotInputFormatTestBase(193): Ensuring table doesn't exist. 2023-02-15 20:01:06,383 DEBUG [Listener at localhost/37547] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-15 20:01:06,386 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60334, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-15 20:01:06,392 INFO [Listener at localhost/37547] client.HBaseAdmin$15(890): Started disable of testWithMapReduce 2023-02-15 20:01:06,398 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39607] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testWithMapReduce 2023-02-15 20:01:06,399 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39607] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.TableNotFoundException: testWithMapReduce at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.checkTableModifiable(AbstractStateMachineTableProcedure.java:125) at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.preflightChecks(AbstractStateMachineTableProcedure.java:157) at org.apache.hadoop.hbase.master.procedure.DisableTableProcedure.(DisableTableProcedure.java:78) at org.apache.hadoop.hbase.master.HMaster$11.run(HMaster.java:2429) at org.apache.hadoop.hbase.master.procedure.MasterProcedureUtil.submitProcedure(MasterProcedureUtil.java:132) at org.apache.hadoop.hbase.master.HMaster.disableTable(HMaster.java:2413) at org.apache.hadoop.hbase.master.MasterRpcServices.disableTable(MasterRpcServices.java:784) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-02-15 20:01:06,399 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39607] ipc.CallRunner(144): callId: 2 service: MasterService methodName: DisableTable size: 76 connection: 172.31.14.131:60334 deadline: 1676491326396, exception=org.apache.hadoop.hbase.TableNotFoundException: testWithMapReduce 2023-02-15 20:01:06,400 INFO [Listener at localhost/37547] mapreduce.TableSnapshotInputFormatTestBase(199): creating table 'testWithMapReduce' 2023-02-15 20:01:06,412 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39607] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-15 20:01:06,414 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39607] procedure2.ProcedureExecutor(1029): Stored pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testWithMapReduce 2023-02-15 20:01:06,418 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_PRE_OPERATION 2023-02-15 20:01:06,420 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-15 20:01:06,422 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39607] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testWithMapReduce" procId is: 10 2023-02-15 20:01:06,439 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39607] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-15 20:01:06,442 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/.tmp/data/default/testWithMapReduce/77b8837eb0dd784edf4b0582f0ba0a3f 2023-02-15 20:01:06,442 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/.tmp/data/default/testWithMapReduce/8a2219c4f89e37dec8687cefabd9fc25 2023-02-15 20:01:06,442 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/.tmp/data/default/testWithMapReduce/cfff17411e5ee60b92c4b80249237743 2023-02-15 20:01:06,442 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/.tmp/data/default/testWithMapReduce/30b6672c9889bbc2cc2b417a34f3f49e 2023-02-15 20:01:06,442 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/.tmp/data/default/testWithMapReduce/3506ea931c9649c226fb4c38a5165b6a 2023-02-15 20:01:06,443 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/.tmp/data/default/testWithMapReduce/ce146f62338407483a61920d7170f142 2023-02-15 20:01:06,443 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/.tmp/data/default/testWithMapReduce/77b8837eb0dd784edf4b0582f0ba0a3f empty. 2023-02-15 20:01:06,443 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/.tmp/data/default/testWithMapReduce/f26f31f3358f9f2d50b3c5d32cc7b35d 2023-02-15 20:01:06,443 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/.tmp/data/default/testWithMapReduce/aac41416f1d7fc83b90c2b3432a76ce6 2023-02-15 20:01:06,444 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/.tmp/data/default/testWithMapReduce/cfff17411e5ee60b92c4b80249237743 empty. 2023-02-15 20:01:06,444 DEBUG [HFileArchiver-5] backup.HFileArchiver(153): Directory hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/.tmp/data/default/testWithMapReduce/3506ea931c9649c226fb4c38a5165b6a empty. 2023-02-15 20:01:06,444 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/.tmp/data/default/testWithMapReduce/ce146f62338407483a61920d7170f142 empty. 2023-02-15 20:01:06,444 DEBUG [HFileArchiver-6] backup.HFileArchiver(153): Directory hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/.tmp/data/default/testWithMapReduce/30b6672c9889bbc2cc2b417a34f3f49e empty. 2023-02-15 20:01:06,446 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/.tmp/data/default/testWithMapReduce/8a2219c4f89e37dec8687cefabd9fc25 empty. 2023-02-15 20:01:06,446 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/.tmp/data/default/testWithMapReduce/77b8837eb0dd784edf4b0582f0ba0a3f 2023-02-15 20:01:06,446 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/.tmp/data/default/testWithMapReduce/f26f31f3358f9f2d50b3c5d32cc7b35d empty. 2023-02-15 20:01:06,446 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/.tmp/data/default/testWithMapReduce/da7189167b0a5e71ebfc52ccf8240947 2023-02-15 20:01:06,446 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/.tmp/data/default/testWithMapReduce/cfff17411e5ee60b92c4b80249237743 2023-02-15 20:01:06,446 DEBUG [HFileArchiver-5] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/.tmp/data/default/testWithMapReduce/3506ea931c9649c226fb4c38a5165b6a 2023-02-15 20:01:06,446 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/.tmp/data/default/testWithMapReduce/f5c7d59a05e094a402144fe6a2d882f0 2023-02-15 20:01:06,446 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/.tmp/data/default/testWithMapReduce/ce146f62338407483a61920d7170f142 2023-02-15 20:01:06,446 DEBUG [HFileArchiver-6] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/.tmp/data/default/testWithMapReduce/30b6672c9889bbc2cc2b417a34f3f49e 2023-02-15 20:01:06,446 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/.tmp/data/default/testWithMapReduce/aac41416f1d7fc83b90c2b3432a76ce6 empty. 2023-02-15 20:01:06,447 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/.tmp/data/default/testWithMapReduce/f26f31f3358f9f2d50b3c5d32cc7b35d 2023-02-15 20:01:06,447 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/.tmp/data/default/testWithMapReduce/8a2219c4f89e37dec8687cefabd9fc25 2023-02-15 20:01:06,447 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/.tmp/data/default/testWithMapReduce/f5c7d59a05e094a402144fe6a2d882f0 empty. 2023-02-15 20:01:06,447 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/.tmp/data/default/testWithMapReduce/da7189167b0a5e71ebfc52ccf8240947 empty. 2023-02-15 20:01:06,447 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/.tmp/data/default/testWithMapReduce/aac41416f1d7fc83b90c2b3432a76ce6 2023-02-15 20:01:06,447 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/.tmp/data/default/testWithMapReduce/f5c7d59a05e094a402144fe6a2d882f0 2023-02-15 20:01:06,447 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/.tmp/data/default/testWithMapReduce/da7189167b0a5e71ebfc52ccf8240947 2023-02-15 20:01:06,448 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testWithMapReduce regions 2023-02-15 20:01:06,467 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/.tmp/data/default/testWithMapReduce/.tabledesc/.tableinfo.0000000001 2023-02-15 20:01:06,469 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(7671): creating {ENCODED => 77b8837eb0dd784edf4b0582f0ba0a3f, NAME => 'testWithMapReduce,,1676491266407.77b8837eb0dd784edf4b0582f0ba0a3f.', STARTKEY => '', ENDKEY => 'aaa'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/.tmp 2023-02-15 20:01:06,470 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(7671): creating {ENCODED => cfff17411e5ee60b92c4b80249237743, NAME => 'testWithMapReduce,d\x84\x84,1676491266407.cfff17411e5ee60b92c4b80249237743.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/.tmp 2023-02-15 20:01:06,470 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(7671): creating {ENCODED => 8a2219c4f89e37dec8687cefabd9fc25, NAME => 'testWithMapReduce,aaa,1676491266407.8a2219c4f89e37dec8687cefabd9fc25.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/.tmp 2023-02-15 20:01:06,528 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,d\x84\x84,1676491266407.cfff17411e5ee60b92c4b80249237743.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 20:01:06,529 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1603): Closing cfff17411e5ee60b92c4b80249237743, disabling compactions & flushes 2023-02-15 20:01:06,529 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,d\x84\x84,1676491266407.cfff17411e5ee60b92c4b80249237743. 2023-02-15 20:01:06,529 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,d\x84\x84,1676491266407.cfff17411e5ee60b92c4b80249237743. 2023-02-15 20:01:06,529 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,d\x84\x84,1676491266407.cfff17411e5ee60b92c4b80249237743. after waiting 0 ms 2023-02-15 20:01:06,529 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,d\x84\x84,1676491266407.cfff17411e5ee60b92c4b80249237743. 2023-02-15 20:01:06,529 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,d\x84\x84,1676491266407.cfff17411e5ee60b92c4b80249237743. 2023-02-15 20:01:06,529 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1557): Region close journal for cfff17411e5ee60b92c4b80249237743: 2023-02-15 20:01:06,529 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676491266407.77b8837eb0dd784edf4b0582f0ba0a3f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 20:01:06,530 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1603): Closing 77b8837eb0dd784edf4b0582f0ba0a3f, disabling compactions & flushes 2023-02-15 20:01:06,530 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(7671): creating {ENCODED => 3506ea931c9649c226fb4c38a5165b6a, NAME => 'testWithMapReduce,g\xA7\xA7,1676491266407.3506ea931c9649c226fb4c38a5165b6a.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/.tmp 2023-02-15 20:01:06,530 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,aaa,1676491266407.8a2219c4f89e37dec8687cefabd9fc25.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 20:01:06,530 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676491266407.77b8837eb0dd784edf4b0582f0ba0a3f. 2023-02-15 20:01:06,530 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1603): Closing 8a2219c4f89e37dec8687cefabd9fc25, disabling compactions & flushes 2023-02-15 20:01:06,531 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676491266407.77b8837eb0dd784edf4b0582f0ba0a3f. 2023-02-15 20:01:06,531 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,aaa,1676491266407.8a2219c4f89e37dec8687cefabd9fc25. 2023-02-15 20:01:06,531 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676491266407.77b8837eb0dd784edf4b0582f0ba0a3f. after waiting 0 ms 2023-02-15 20:01:06,531 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,aaa,1676491266407.8a2219c4f89e37dec8687cefabd9fc25. 2023-02-15 20:01:06,531 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676491266407.77b8837eb0dd784edf4b0582f0ba0a3f. 2023-02-15 20:01:06,531 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,aaa,1676491266407.8a2219c4f89e37dec8687cefabd9fc25. after waiting 0 ms 2023-02-15 20:01:06,531 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,,1676491266407.77b8837eb0dd784edf4b0582f0ba0a3f. 2023-02-15 20:01:06,531 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,aaa,1676491266407.8a2219c4f89e37dec8687cefabd9fc25. 2023-02-15 20:01:06,531 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1557): Region close journal for 77b8837eb0dd784edf4b0582f0ba0a3f: 2023-02-15 20:01:06,531 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,aaa,1676491266407.8a2219c4f89e37dec8687cefabd9fc25. 2023-02-15 20:01:06,531 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1557): Region close journal for 8a2219c4f89e37dec8687cefabd9fc25: 2023-02-15 20:01:06,532 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(7671): creating {ENCODED => 30b6672c9889bbc2cc2b417a34f3f49e, NAME => 'testWithMapReduce,j\xCA\xCA,1676491266407.30b6672c9889bbc2cc2b417a34f3f49e.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/.tmp 2023-02-15 20:01:06,532 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(7671): creating {ENCODED => f26f31f3358f9f2d50b3c5d32cc7b35d, NAME => 'testWithMapReduce,m\xED\xED,1676491266407.f26f31f3358f9f2d50b3c5d32cc7b35d.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/.tmp 2023-02-15 20:01:06,551 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39607] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-15 20:01:06,572 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,j\xCA\xCA,1676491266407.30b6672c9889bbc2cc2b417a34f3f49e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 20:01:06,572 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,g\xA7\xA7,1676491266407.3506ea931c9649c226fb4c38a5165b6a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 20:01:06,573 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1603): Closing 30b6672c9889bbc2cc2b417a34f3f49e, disabling compactions & flushes 2023-02-15 20:01:06,573 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1603): Closing 3506ea931c9649c226fb4c38a5165b6a, disabling compactions & flushes 2023-02-15 20:01:06,573 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,j\xCA\xCA,1676491266407.30b6672c9889bbc2cc2b417a34f3f49e. 2023-02-15 20:01:06,573 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,g\xA7\xA7,1676491266407.3506ea931c9649c226fb4c38a5165b6a. 2023-02-15 20:01:06,573 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,j\xCA\xCA,1676491266407.30b6672c9889bbc2cc2b417a34f3f49e. 2023-02-15 20:01:06,573 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,g\xA7\xA7,1676491266407.3506ea931c9649c226fb4c38a5165b6a. 2023-02-15 20:01:06,573 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,j\xCA\xCA,1676491266407.30b6672c9889bbc2cc2b417a34f3f49e. after waiting 0 ms 2023-02-15 20:01:06,574 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,g\xA7\xA7,1676491266407.3506ea931c9649c226fb4c38a5165b6a. after waiting 0 ms 2023-02-15 20:01:06,574 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,j\xCA\xCA,1676491266407.30b6672c9889bbc2cc2b417a34f3f49e. 2023-02-15 20:01:06,574 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,g\xA7\xA7,1676491266407.3506ea931c9649c226fb4c38a5165b6a. 2023-02-15 20:01:06,574 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,j\xCA\xCA,1676491266407.30b6672c9889bbc2cc2b417a34f3f49e. 2023-02-15 20:01:06,574 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,g\xA7\xA7,1676491266407.3506ea931c9649c226fb4c38a5165b6a. 2023-02-15 20:01:06,575 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1557): Region close journal for 30b6672c9889bbc2cc2b417a34f3f49e: 2023-02-15 20:01:06,575 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1557): Region close journal for 3506ea931c9649c226fb4c38a5165b6a: 2023-02-15 20:01:06,576 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(7671): creating {ENCODED => ce146f62338407483a61920d7170f142, NAME => 'testWithMapReduce,t43,1676491266407.ce146f62338407483a61920d7170f142.', STARTKEY => 't43', ENDKEY => 'wWV'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/.tmp 2023-02-15 20:01:06,576 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(7671): creating {ENCODED => aac41416f1d7fc83b90c2b3432a76ce6, NAME => 'testWithMapReduce,q\x11\x10,1676491266407.aac41416f1d7fc83b90c2b3432a76ce6.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/.tmp 2023-02-15 20:01:06,576 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,m\xED\xED,1676491266407.f26f31f3358f9f2d50b3c5d32cc7b35d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 20:01:06,577 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1603): Closing f26f31f3358f9f2d50b3c5d32cc7b35d, disabling compactions & flushes 2023-02-15 20:01:06,577 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,m\xED\xED,1676491266407.f26f31f3358f9f2d50b3c5d32cc7b35d. 2023-02-15 20:01:06,577 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,m\xED\xED,1676491266407.f26f31f3358f9f2d50b3c5d32cc7b35d. 2023-02-15 20:01:06,577 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,m\xED\xED,1676491266407.f26f31f3358f9f2d50b3c5d32cc7b35d. after waiting 0 ms 2023-02-15 20:01:06,577 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,m\xED\xED,1676491266407.f26f31f3358f9f2d50b3c5d32cc7b35d. 2023-02-15 20:01:06,577 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,m\xED\xED,1676491266407.f26f31f3358f9f2d50b3c5d32cc7b35d. 2023-02-15 20:01:06,577 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1557): Region close journal for f26f31f3358f9f2d50b3c5d32cc7b35d: 2023-02-15 20:01:06,578 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(7671): creating {ENCODED => da7189167b0a5e71ebfc52ccf8240947, NAME => 'testWithMapReduce,wWV,1676491266407.da7189167b0a5e71ebfc52ccf8240947.', STARTKEY => 'wWV', ENDKEY => 'zz{'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/.tmp 2023-02-15 20:01:06,605 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,q\x11\x10,1676491266407.aac41416f1d7fc83b90c2b3432a76ce6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 20:01:06,608 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1603): Closing aac41416f1d7fc83b90c2b3432a76ce6, disabling compactions & flushes 2023-02-15 20:01:06,608 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,t43,1676491266407.ce146f62338407483a61920d7170f142.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 20:01:06,608 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,q\x11\x10,1676491266407.aac41416f1d7fc83b90c2b3432a76ce6. 2023-02-15 20:01:06,609 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1603): Closing ce146f62338407483a61920d7170f142, disabling compactions & flushes 2023-02-15 20:01:06,609 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,q\x11\x10,1676491266407.aac41416f1d7fc83b90c2b3432a76ce6. 2023-02-15 20:01:06,609 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,t43,1676491266407.ce146f62338407483a61920d7170f142. 2023-02-15 20:01:06,609 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,t43,1676491266407.ce146f62338407483a61920d7170f142. 2023-02-15 20:01:06,609 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,q\x11\x10,1676491266407.aac41416f1d7fc83b90c2b3432a76ce6. after waiting 0 ms 2023-02-15 20:01:06,609 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,t43,1676491266407.ce146f62338407483a61920d7170f142. after waiting 0 ms 2023-02-15 20:01:06,609 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,q\x11\x10,1676491266407.aac41416f1d7fc83b90c2b3432a76ce6. 2023-02-15 20:01:06,609 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,t43,1676491266407.ce146f62338407483a61920d7170f142. 2023-02-15 20:01:06,609 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,q\x11\x10,1676491266407.aac41416f1d7fc83b90c2b3432a76ce6. 2023-02-15 20:01:06,609 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,t43,1676491266407.ce146f62338407483a61920d7170f142. 2023-02-15 20:01:06,609 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1557): Region close journal for aac41416f1d7fc83b90c2b3432a76ce6: 2023-02-15 20:01:06,609 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1557): Region close journal for ce146f62338407483a61920d7170f142: 2023-02-15 20:01:06,610 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(7671): creating {ENCODED => f5c7d59a05e094a402144fe6a2d882f0, NAME => 'testWithMapReduce,zz{,1676491266407.f5c7d59a05e094a402144fe6a2d882f0.', STARTKEY => 'zz{', ENDKEY => ''}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/.tmp 2023-02-15 20:01:06,633 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,zz{,1676491266407.f5c7d59a05e094a402144fe6a2d882f0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 20:01:06,633 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1603): Closing f5c7d59a05e094a402144fe6a2d882f0, disabling compactions & flushes 2023-02-15 20:01:06,634 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,zz{,1676491266407.f5c7d59a05e094a402144fe6a2d882f0. 2023-02-15 20:01:06,634 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,zz{,1676491266407.f5c7d59a05e094a402144fe6a2d882f0. 2023-02-15 20:01:06,634 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,zz{,1676491266407.f5c7d59a05e094a402144fe6a2d882f0. after waiting 0 ms 2023-02-15 20:01:06,634 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,zz{,1676491266407.f5c7d59a05e094a402144fe6a2d882f0. 2023-02-15 20:01:06,634 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,zz{,1676491266407.f5c7d59a05e094a402144fe6a2d882f0. 2023-02-15 20:01:06,634 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1557): Region close journal for f5c7d59a05e094a402144fe6a2d882f0: 2023-02-15 20:01:06,754 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39607] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-15 20:01:07,008 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,wWV,1676491266407.da7189167b0a5e71ebfc52ccf8240947.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 20:01:07,009 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1603): Closing da7189167b0a5e71ebfc52ccf8240947, disabling compactions & flushes 2023-02-15 20:01:07,009 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,wWV,1676491266407.da7189167b0a5e71ebfc52ccf8240947. 2023-02-15 20:01:07,009 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,wWV,1676491266407.da7189167b0a5e71ebfc52ccf8240947. 2023-02-15 20:01:07,009 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,wWV,1676491266407.da7189167b0a5e71ebfc52ccf8240947. after waiting 0 ms 2023-02-15 20:01:07,009 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,wWV,1676491266407.da7189167b0a5e71ebfc52ccf8240947. 2023-02-15 20:01:07,009 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,wWV,1676491266407.da7189167b0a5e71ebfc52ccf8240947. 2023-02-15 20:01:07,009 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1557): Region close journal for da7189167b0a5e71ebfc52ccf8240947: 2023-02-15 20:01:07,015 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_ADD_TO_META 2023-02-15 20:01:07,017 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,d\\x84\\x84,1676491266407.cfff17411e5ee60b92c4b80249237743.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676491267016"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676491267016"}]},"ts":"1676491267016"} 2023-02-15 20:01:07,017 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,,1676491266407.77b8837eb0dd784edf4b0582f0ba0a3f.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676491267016"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676491267016"}]},"ts":"1676491267016"} 2023-02-15 20:01:07,017 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,aaa,1676491266407.8a2219c4f89e37dec8687cefabd9fc25.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676491267016"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676491267016"}]},"ts":"1676491267016"} 2023-02-15 20:01:07,017 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,j\\xCA\\xCA,1676491266407.30b6672c9889bbc2cc2b417a34f3f49e.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676491267016"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676491267016"}]},"ts":"1676491267016"} 2023-02-15 20:01:07,017 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,g\\xA7\\xA7,1676491266407.3506ea931c9649c226fb4c38a5165b6a.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676491267016"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676491267016"}]},"ts":"1676491267016"} 2023-02-15 20:01:07,017 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,m\\xED\\xED,1676491266407.f26f31f3358f9f2d50b3c5d32cc7b35d.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676491267016"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676491267016"}]},"ts":"1676491267016"} 2023-02-15 20:01:07,018 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,q\\x11\\x10,1676491266407.aac41416f1d7fc83b90c2b3432a76ce6.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676491267016"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676491267016"}]},"ts":"1676491267016"} 2023-02-15 20:01:07,018 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,t43,1676491266407.ce146f62338407483a61920d7170f142.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676491267016"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676491267016"}]},"ts":"1676491267016"} 2023-02-15 20:01:07,018 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,zz{,1676491266407.f5c7d59a05e094a402144fe6a2d882f0.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676491267016"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676491267016"}]},"ts":"1676491267016"} 2023-02-15 20:01:07,018 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,wWV,1676491266407.da7189167b0a5e71ebfc52ccf8240947.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676491267016"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676491267016"}]},"ts":"1676491267016"} 2023-02-15 20:01:07,058 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39607] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-15 20:01:07,074 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 10 regions to meta. 2023-02-15 20:01:07,076 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-15 20:01:07,076 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676491267076"}]},"ts":"1676491267076"} 2023-02-15 20:01:07,079 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=ENABLING in hbase:meta 2023-02-15 20:01:07,084 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-15 20:01:07,099 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-15 20:01:07,099 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-15 20:01:07,099 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-15 20:01:07,100 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=77b8837eb0dd784edf4b0582f0ba0a3f, ASSIGN}, {pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=8a2219c4f89e37dec8687cefabd9fc25, ASSIGN}, {pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=cfff17411e5ee60b92c4b80249237743, ASSIGN}, {pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=3506ea931c9649c226fb4c38a5165b6a, ASSIGN}, {pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=30b6672c9889bbc2cc2b417a34f3f49e, ASSIGN}, {pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=f26f31f3358f9f2d50b3c5d32cc7b35d, ASSIGN}, {pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=aac41416f1d7fc83b90c2b3432a76ce6, ASSIGN}, {pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=ce146f62338407483a61920d7170f142, ASSIGN}, {pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=da7189167b0a5e71ebfc52ccf8240947, ASSIGN}, {pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=f5c7d59a05e094a402144fe6a2d882f0, ASSIGN}] 2023-02-15 20:01:07,104 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=8a2219c4f89e37dec8687cefabd9fc25, ASSIGN 2023-02-15 20:01:07,105 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=77b8837eb0dd784edf4b0582f0ba0a3f, ASSIGN 2023-02-15 20:01:07,106 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=cfff17411e5ee60b92c4b80249237743, ASSIGN 2023-02-15 20:01:07,106 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=f26f31f3358f9f2d50b3c5d32cc7b35d, ASSIGN 2023-02-15 20:01:07,107 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=f5c7d59a05e094a402144fe6a2d882f0, ASSIGN 2023-02-15 20:01:07,108 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=f26f31f3358f9f2d50b3c5d32cc7b35d, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,33367,1676491262239; forceNewPlan=false, retain=false 2023-02-15 20:01:07,108 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=8a2219c4f89e37dec8687cefabd9fc25, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,41535,1676491262190; forceNewPlan=false, retain=false 2023-02-15 20:01:07,108 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=cfff17411e5ee60b92c4b80249237743, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,41535,1676491262190; forceNewPlan=false, retain=false 2023-02-15 20:01:07,108 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=77b8837eb0dd784edf4b0582f0ba0a3f, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,33367,1676491262239; forceNewPlan=false, retain=false 2023-02-15 20:01:07,109 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=f5c7d59a05e094a402144fe6a2d882f0, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,41535,1676491262190; forceNewPlan=false, retain=false 2023-02-15 20:01:07,109 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=da7189167b0a5e71ebfc52ccf8240947, ASSIGN 2023-02-15 20:01:07,110 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=ce146f62338407483a61920d7170f142, ASSIGN 2023-02-15 20:01:07,110 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=aac41416f1d7fc83b90c2b3432a76ce6, ASSIGN 2023-02-15 20:01:07,111 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=30b6672c9889bbc2cc2b417a34f3f49e, ASSIGN 2023-02-15 20:01:07,112 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=da7189167b0a5e71ebfc52ccf8240947, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,33367,1676491262239; forceNewPlan=false, retain=false 2023-02-15 20:01:07,112 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=ce146f62338407483a61920d7170f142, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,33367,1676491262239; forceNewPlan=false, retain=false 2023-02-15 20:01:07,112 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=3506ea931c9649c226fb4c38a5165b6a, ASSIGN 2023-02-15 20:01:07,113 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=aac41416f1d7fc83b90c2b3432a76ce6, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,41535,1676491262190; forceNewPlan=false, retain=false 2023-02-15 20:01:07,113 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=30b6672c9889bbc2cc2b417a34f3f49e, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,33367,1676491262239; forceNewPlan=false, retain=false 2023-02-15 20:01:07,115 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=3506ea931c9649c226fb4c38a5165b6a, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,41535,1676491262190; forceNewPlan=false, retain=false 2023-02-15 20:01:07,258 INFO [jenkins-hbase4:39607] balancer.BaseLoadBalancer(1545): Reassigned 10 regions. 10 retained the pre-restart assignment. 2023-02-15 20:01:07,262 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=17 updating hbase:meta row=aac41416f1d7fc83b90c2b3432a76ce6, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41535,1676491262190 2023-02-15 20:01:07,262 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=3506ea931c9649c226fb4c38a5165b6a, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41535,1676491262190 2023-02-15 20:01:07,262 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=cfff17411e5ee60b92c4b80249237743, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41535,1676491262190 2023-02-15 20:01:07,262 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=12 updating hbase:meta row=8a2219c4f89e37dec8687cefabd9fc25, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41535,1676491262190 2023-02-15 20:01:07,263 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,q\\x11\\x10,1676491266407.aac41416f1d7fc83b90c2b3432a76ce6.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676491267262"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676491267262"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676491267262"}]},"ts":"1676491267262"} 2023-02-15 20:01:07,263 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,d\\x84\\x84,1676491266407.cfff17411e5ee60b92c4b80249237743.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676491267262"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676491267262"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676491267262"}]},"ts":"1676491267262"} 2023-02-15 20:01:07,263 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,aaa,1676491266407.8a2219c4f89e37dec8687cefabd9fc25.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676491267262"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676491267262"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676491267262"}]},"ts":"1676491267262"} 2023-02-15 20:01:07,262 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=f5c7d59a05e094a402144fe6a2d882f0, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41535,1676491262190 2023-02-15 20:01:07,263 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,zz{,1676491266407.f5c7d59a05e094a402144fe6a2d882f0.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676491267262"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676491267262"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676491267262"}]},"ts":"1676491267262"} 2023-02-15 20:01:07,263 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,g\\xA7\\xA7,1676491266407.3506ea931c9649c226fb4c38a5165b6a.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676491267262"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676491267262"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676491267262"}]},"ts":"1676491267262"} 2023-02-15 20:01:07,267 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=21, ppid=13, state=RUNNABLE; OpenRegionProcedure cfff17411e5ee60b92c4b80249237743, server=jenkins-hbase4.apache.org,41535,1676491262190}] 2023-02-15 20:01:07,272 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=22, ppid=17, state=RUNNABLE; OpenRegionProcedure aac41416f1d7fc83b90c2b3432a76ce6, server=jenkins-hbase4.apache.org,41535,1676491262190}] 2023-02-15 20:01:07,276 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=23, ppid=12, state=RUNNABLE; OpenRegionProcedure 8a2219c4f89e37dec8687cefabd9fc25, server=jenkins-hbase4.apache.org,41535,1676491262190}] 2023-02-15 20:01:07,278 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=30b6672c9889bbc2cc2b417a34f3f49e, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,33367,1676491262239 2023-02-15 20:01:07,278 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,j\\xCA\\xCA,1676491266407.30b6672c9889bbc2cc2b417a34f3f49e.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676491267278"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676491267278"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676491267278"}]},"ts":"1676491267278"} 2023-02-15 20:01:07,282 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=19 updating hbase:meta row=da7189167b0a5e71ebfc52ccf8240947, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,33367,1676491262239 2023-02-15 20:01:07,282 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,wWV,1676491266407.da7189167b0a5e71ebfc52ccf8240947.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676491267282"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676491267282"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676491267282"}]},"ts":"1676491267282"} 2023-02-15 20:01:07,282 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=24, ppid=20, state=RUNNABLE; OpenRegionProcedure f5c7d59a05e094a402144fe6a2d882f0, server=jenkins-hbase4.apache.org,41535,1676491262190}] 2023-02-15 20:01:07,284 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=77b8837eb0dd784edf4b0582f0ba0a3f, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,33367,1676491262239 2023-02-15 20:01:07,285 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,,1676491266407.77b8837eb0dd784edf4b0582f0ba0a3f.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676491267284"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676491267284"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676491267284"}]},"ts":"1676491267284"} 2023-02-15 20:01:07,290 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=25, ppid=14, state=RUNNABLE; OpenRegionProcedure 3506ea931c9649c226fb4c38a5165b6a, server=jenkins-hbase4.apache.org,41535,1676491262190}] 2023-02-15 20:01:07,293 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=26, ppid=15, state=RUNNABLE; OpenRegionProcedure 30b6672c9889bbc2cc2b417a34f3f49e, server=jenkins-hbase4.apache.org,33367,1676491262239}] 2023-02-15 20:01:07,294 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=f26f31f3358f9f2d50b3c5d32cc7b35d, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,33367,1676491262239 2023-02-15 20:01:07,294 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,m\\xED\\xED,1676491266407.f26f31f3358f9f2d50b3c5d32cc7b35d.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676491267294"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676491267294"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676491267294"}]},"ts":"1676491267294"} 2023-02-15 20:01:07,294 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=27, ppid=19, state=RUNNABLE; OpenRegionProcedure da7189167b0a5e71ebfc52ccf8240947, server=jenkins-hbase4.apache.org,33367,1676491262239}] 2023-02-15 20:01:07,296 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=28, ppid=11, state=RUNNABLE; OpenRegionProcedure 77b8837eb0dd784edf4b0582f0ba0a3f, server=jenkins-hbase4.apache.org,33367,1676491262239}] 2023-02-15 20:01:07,298 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=29, ppid=16, state=RUNNABLE; OpenRegionProcedure f26f31f3358f9f2d50b3c5d32cc7b35d, server=jenkins-hbase4.apache.org,33367,1676491262239}] 2023-02-15 20:01:07,307 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=18 updating hbase:meta row=ce146f62338407483a61920d7170f142, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,33367,1676491262239 2023-02-15 20:01:07,307 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,t43,1676491266407.ce146f62338407483a61920d7170f142.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676491267307"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676491267307"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676491267307"}]},"ts":"1676491267307"} 2023-02-15 20:01:07,311 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=30, ppid=18, state=RUNNABLE; OpenRegionProcedure ce146f62338407483a61920d7170f142, server=jenkins-hbase4.apache.org,33367,1676491262239}] 2023-02-15 20:01:07,431 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,g\xA7\xA7,1676491266407.3506ea931c9649c226fb4c38a5165b6a. 2023-02-15 20:01:07,432 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 3506ea931c9649c226fb4c38a5165b6a, NAME => 'testWithMapReduce,g\xA7\xA7,1676491266407.3506ea931c9649c226fb4c38a5165b6a.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'} 2023-02-15 20:01:07,432 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 3506ea931c9649c226fb4c38a5165b6a 2023-02-15 20:01:07,432 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,g\xA7\xA7,1676491266407.3506ea931c9649c226fb4c38a5165b6a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 20:01:07,432 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 3506ea931c9649c226fb4c38a5165b6a 2023-02-15 20:01:07,432 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 3506ea931c9649c226fb4c38a5165b6a 2023-02-15 20:01:07,435 INFO [StoreOpener-3506ea931c9649c226fb4c38a5165b6a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 3506ea931c9649c226fb4c38a5165b6a 2023-02-15 20:01:07,437 DEBUG [StoreOpener-3506ea931c9649c226fb4c38a5165b6a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/data/default/testWithMapReduce/3506ea931c9649c226fb4c38a5165b6a/f1 2023-02-15 20:01:07,437 DEBUG [StoreOpener-3506ea931c9649c226fb4c38a5165b6a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/data/default/testWithMapReduce/3506ea931c9649c226fb4c38a5165b6a/f1 2023-02-15 20:01:07,438 INFO [StoreOpener-3506ea931c9649c226fb4c38a5165b6a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3506ea931c9649c226fb4c38a5165b6a columnFamilyName f1 2023-02-15 20:01:07,439 INFO [StoreOpener-3506ea931c9649c226fb4c38a5165b6a-1] regionserver.HStore(310): Store=3506ea931c9649c226fb4c38a5165b6a/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 20:01:07,439 INFO [StoreOpener-3506ea931c9649c226fb4c38a5165b6a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 3506ea931c9649c226fb4c38a5165b6a 2023-02-15 20:01:07,442 DEBUG [StoreOpener-3506ea931c9649c226fb4c38a5165b6a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/data/default/testWithMapReduce/3506ea931c9649c226fb4c38a5165b6a/f2 2023-02-15 20:01:07,442 DEBUG [StoreOpener-3506ea931c9649c226fb4c38a5165b6a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/data/default/testWithMapReduce/3506ea931c9649c226fb4c38a5165b6a/f2 2023-02-15 20:01:07,443 INFO [StoreOpener-3506ea931c9649c226fb4c38a5165b6a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3506ea931c9649c226fb4c38a5165b6a columnFamilyName f2 2023-02-15 20:01:07,444 INFO [StoreOpener-3506ea931c9649c226fb4c38a5165b6a-1] regionserver.HStore(310): Store=3506ea931c9649c226fb4c38a5165b6a/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 20:01:07,446 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/data/default/testWithMapReduce/3506ea931c9649c226fb4c38a5165b6a 2023-02-15 20:01:07,448 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/data/default/testWithMapReduce/3506ea931c9649c226fb4c38a5165b6a 2023-02-15 20:01:07,451 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-15 20:01:07,452 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 3506ea931c9649c226fb4c38a5165b6a 2023-02-15 20:01:07,455 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,33367,1676491262239 2023-02-15 20:01:07,455 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-15 20:01:07,456 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/data/default/testWithMapReduce/3506ea931c9649c226fb4c38a5165b6a/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-15 20:01:07,458 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36654, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-15 20:01:07,459 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 3506ea931c9649c226fb4c38a5165b6a; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72789175, jitterRate=0.08464322984218597}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-15 20:01:07,459 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 3506ea931c9649c226fb4c38a5165b6a: 2023-02-15 20:01:07,460 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,g\xA7\xA7,1676491266407.3506ea931c9649c226fb4c38a5165b6a., pid=25, masterSystemTime=1676491267422 2023-02-15 20:01:07,463 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,g\xA7\xA7,1676491266407.3506ea931c9649c226fb4c38a5165b6a. 2023-02-15 20:01:07,463 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,g\xA7\xA7,1676491266407.3506ea931c9649c226fb4c38a5165b6a. 2023-02-15 20:01:07,463 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,aaa,1676491266407.8a2219c4f89e37dec8687cefabd9fc25. 2023-02-15 20:01:07,463 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 8a2219c4f89e37dec8687cefabd9fc25, NAME => 'testWithMapReduce,aaa,1676491266407.8a2219c4f89e37dec8687cefabd9fc25.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'} 2023-02-15 20:01:07,464 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,j\xCA\xCA,1676491266407.30b6672c9889bbc2cc2b417a34f3f49e. 2023-02-15 20:01:07,464 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 30b6672c9889bbc2cc2b417a34f3f49e, NAME => 'testWithMapReduce,j\xCA\xCA,1676491266407.30b6672c9889bbc2cc2b417a34f3f49e.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'} 2023-02-15 20:01:07,464 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 8a2219c4f89e37dec8687cefabd9fc25 2023-02-15 20:01:07,465 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,aaa,1676491266407.8a2219c4f89e37dec8687cefabd9fc25.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 20:01:07,465 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 8a2219c4f89e37dec8687cefabd9fc25 2023-02-15 20:01:07,465 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 8a2219c4f89e37dec8687cefabd9fc25 2023-02-15 20:01:07,465 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 30b6672c9889bbc2cc2b417a34f3f49e 2023-02-15 20:01:07,465 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,j\xCA\xCA,1676491266407.30b6672c9889bbc2cc2b417a34f3f49e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 20:01:07,465 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=3506ea931c9649c226fb4c38a5165b6a, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,41535,1676491262190 2023-02-15 20:01:07,465 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,g\\xA7\\xA7,1676491266407.3506ea931c9649c226fb4c38a5165b6a.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676491267465"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676491267465"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676491267465"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676491267465"}]},"ts":"1676491267465"} 2023-02-15 20:01:07,465 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 30b6672c9889bbc2cc2b417a34f3f49e 2023-02-15 20:01:07,466 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 30b6672c9889bbc2cc2b417a34f3f49e 2023-02-15 20:01:07,467 INFO [StoreOpener-8a2219c4f89e37dec8687cefabd9fc25-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 8a2219c4f89e37dec8687cefabd9fc25 2023-02-15 20:01:07,468 INFO [StoreOpener-30b6672c9889bbc2cc2b417a34f3f49e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 30b6672c9889bbc2cc2b417a34f3f49e 2023-02-15 20:01:07,471 DEBUG [StoreOpener-30b6672c9889bbc2cc2b417a34f3f49e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/data/default/testWithMapReduce/30b6672c9889bbc2cc2b417a34f3f49e/f1 2023-02-15 20:01:07,471 DEBUG [StoreOpener-30b6672c9889bbc2cc2b417a34f3f49e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/data/default/testWithMapReduce/30b6672c9889bbc2cc2b417a34f3f49e/f1 2023-02-15 20:01:07,471 INFO [StoreOpener-30b6672c9889bbc2cc2b417a34f3f49e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 30b6672c9889bbc2cc2b417a34f3f49e columnFamilyName f1 2023-02-15 20:01:07,472 DEBUG [StoreOpener-8a2219c4f89e37dec8687cefabd9fc25-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/data/default/testWithMapReduce/8a2219c4f89e37dec8687cefabd9fc25/f1 2023-02-15 20:01:07,472 DEBUG [StoreOpener-8a2219c4f89e37dec8687cefabd9fc25-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/data/default/testWithMapReduce/8a2219c4f89e37dec8687cefabd9fc25/f1 2023-02-15 20:01:07,472 INFO [StoreOpener-8a2219c4f89e37dec8687cefabd9fc25-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8a2219c4f89e37dec8687cefabd9fc25 columnFamilyName f1 2023-02-15 20:01:07,474 INFO [StoreOpener-30b6672c9889bbc2cc2b417a34f3f49e-1] regionserver.HStore(310): Store=30b6672c9889bbc2cc2b417a34f3f49e/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 20:01:07,474 INFO [StoreOpener-8a2219c4f89e37dec8687cefabd9fc25-1] regionserver.HStore(310): Store=8a2219c4f89e37dec8687cefabd9fc25/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 20:01:07,475 INFO [StoreOpener-30b6672c9889bbc2cc2b417a34f3f49e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 30b6672c9889bbc2cc2b417a34f3f49e 2023-02-15 20:01:07,475 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=25, resume processing ppid=14 2023-02-15 20:01:07,475 INFO [StoreOpener-8a2219c4f89e37dec8687cefabd9fc25-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 8a2219c4f89e37dec8687cefabd9fc25 2023-02-15 20:01:07,475 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=25, ppid=14, state=SUCCESS; OpenRegionProcedure 3506ea931c9649c226fb4c38a5165b6a, server=jenkins-hbase4.apache.org,41535,1676491262190 in 179 msec 2023-02-15 20:01:07,478 DEBUG [StoreOpener-30b6672c9889bbc2cc2b417a34f3f49e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/data/default/testWithMapReduce/30b6672c9889bbc2cc2b417a34f3f49e/f2 2023-02-15 20:01:07,478 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=14, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=3506ea931c9649c226fb4c38a5165b6a, ASSIGN in 376 msec 2023-02-15 20:01:07,478 DEBUG [StoreOpener-30b6672c9889bbc2cc2b417a34f3f49e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/data/default/testWithMapReduce/30b6672c9889bbc2cc2b417a34f3f49e/f2 2023-02-15 20:01:07,478 DEBUG [StoreOpener-8a2219c4f89e37dec8687cefabd9fc25-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/data/default/testWithMapReduce/8a2219c4f89e37dec8687cefabd9fc25/f2 2023-02-15 20:01:07,478 DEBUG [StoreOpener-8a2219c4f89e37dec8687cefabd9fc25-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/data/default/testWithMapReduce/8a2219c4f89e37dec8687cefabd9fc25/f2 2023-02-15 20:01:07,479 INFO [StoreOpener-30b6672c9889bbc2cc2b417a34f3f49e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 30b6672c9889bbc2cc2b417a34f3f49e columnFamilyName f2 2023-02-15 20:01:07,479 INFO [StoreOpener-8a2219c4f89e37dec8687cefabd9fc25-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8a2219c4f89e37dec8687cefabd9fc25 columnFamilyName f2 2023-02-15 20:01:07,479 INFO [StoreOpener-30b6672c9889bbc2cc2b417a34f3f49e-1] regionserver.HStore(310): Store=30b6672c9889bbc2cc2b417a34f3f49e/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 20:01:07,480 INFO [StoreOpener-8a2219c4f89e37dec8687cefabd9fc25-1] regionserver.HStore(310): Store=8a2219c4f89e37dec8687cefabd9fc25/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 20:01:07,482 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/data/default/testWithMapReduce/30b6672c9889bbc2cc2b417a34f3f49e 2023-02-15 20:01:07,482 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/data/default/testWithMapReduce/8a2219c4f89e37dec8687cefabd9fc25 2023-02-15 20:01:07,483 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/data/default/testWithMapReduce/8a2219c4f89e37dec8687cefabd9fc25 2023-02-15 20:01:07,483 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/data/default/testWithMapReduce/30b6672c9889bbc2cc2b417a34f3f49e 2023-02-15 20:01:07,487 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-15 20:01:07,488 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-15 20:01:07,490 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 30b6672c9889bbc2cc2b417a34f3f49e 2023-02-15 20:01:07,490 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 8a2219c4f89e37dec8687cefabd9fc25 2023-02-15 20:01:07,494 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/data/default/testWithMapReduce/30b6672c9889bbc2cc2b417a34f3f49e/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-15 20:01:07,494 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/data/default/testWithMapReduce/8a2219c4f89e37dec8687cefabd9fc25/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-15 20:01:07,495 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 30b6672c9889bbc2cc2b417a34f3f49e; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67024388, jitterRate=-0.0012587904930114746}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-15 20:01:07,495 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 30b6672c9889bbc2cc2b417a34f3f49e: 2023-02-15 20:01:07,495 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 8a2219c4f89e37dec8687cefabd9fc25; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59904465, jitterRate=-0.10735391080379486}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-15 20:01:07,495 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 8a2219c4f89e37dec8687cefabd9fc25: 2023-02-15 20:01:07,497 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,aaa,1676491266407.8a2219c4f89e37dec8687cefabd9fc25., pid=23, masterSystemTime=1676491267422 2023-02-15 20:01:07,501 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,aaa,1676491266407.8a2219c4f89e37dec8687cefabd9fc25. 2023-02-15 20:01:07,501 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,aaa,1676491266407.8a2219c4f89e37dec8687cefabd9fc25. 2023-02-15 20:01:07,501 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,d\x84\x84,1676491266407.cfff17411e5ee60b92c4b80249237743. 2023-02-15 20:01:07,501 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => cfff17411e5ee60b92c4b80249237743, NAME => 'testWithMapReduce,d\x84\x84,1676491266407.cfff17411e5ee60b92c4b80249237743.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'} 2023-02-15 20:01:07,501 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,j\xCA\xCA,1676491266407.30b6672c9889bbc2cc2b417a34f3f49e., pid=26, masterSystemTime=1676491267454 2023-02-15 20:01:07,503 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce cfff17411e5ee60b92c4b80249237743 2023-02-15 20:01:07,503 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=12 updating hbase:meta row=8a2219c4f89e37dec8687cefabd9fc25, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,41535,1676491262190 2023-02-15 20:01:07,508 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,d\x84\x84,1676491266407.cfff17411e5ee60b92c4b80249237743.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 20:01:07,508 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for cfff17411e5ee60b92c4b80249237743 2023-02-15 20:01:07,509 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for cfff17411e5ee60b92c4b80249237743 2023-02-15 20:01:07,509 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,aaa,1676491266407.8a2219c4f89e37dec8687cefabd9fc25.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676491267502"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676491267502"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676491267502"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676491267502"}]},"ts":"1676491267502"} 2023-02-15 20:01:07,512 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,j\xCA\xCA,1676491266407.30b6672c9889bbc2cc2b417a34f3f49e. 2023-02-15 20:01:07,512 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,j\xCA\xCA,1676491266407.30b6672c9889bbc2cc2b417a34f3f49e. 2023-02-15 20:01:07,513 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,m\xED\xED,1676491266407.f26f31f3358f9f2d50b3c5d32cc7b35d. 2023-02-15 20:01:07,513 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => f26f31f3358f9f2d50b3c5d32cc7b35d, NAME => 'testWithMapReduce,m\xED\xED,1676491266407.f26f31f3358f9f2d50b3c5d32cc7b35d.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'} 2023-02-15 20:01:07,513 INFO [StoreOpener-cfff17411e5ee60b92c4b80249237743-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region cfff17411e5ee60b92c4b80249237743 2023-02-15 20:01:07,514 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce f26f31f3358f9f2d50b3c5d32cc7b35d 2023-02-15 20:01:07,515 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,m\xED\xED,1676491266407.f26f31f3358f9f2d50b3c5d32cc7b35d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 20:01:07,515 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for f26f31f3358f9f2d50b3c5d32cc7b35d 2023-02-15 20:01:07,515 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=30b6672c9889bbc2cc2b417a34f3f49e, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,33367,1676491262239 2023-02-15 20:01:07,515 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for f26f31f3358f9f2d50b3c5d32cc7b35d 2023-02-15 20:01:07,515 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,j\\xCA\\xCA,1676491266407.30b6672c9889bbc2cc2b417a34f3f49e.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676491267515"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676491267515"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676491267515"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676491267515"}]},"ts":"1676491267515"} 2023-02-15 20:01:07,518 DEBUG [StoreOpener-cfff17411e5ee60b92c4b80249237743-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/data/default/testWithMapReduce/cfff17411e5ee60b92c4b80249237743/f1 2023-02-15 20:01:07,518 DEBUG [StoreOpener-cfff17411e5ee60b92c4b80249237743-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/data/default/testWithMapReduce/cfff17411e5ee60b92c4b80249237743/f1 2023-02-15 20:01:07,519 INFO [StoreOpener-cfff17411e5ee60b92c4b80249237743-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region cfff17411e5ee60b92c4b80249237743 columnFamilyName f1 2023-02-15 20:01:07,520 INFO [StoreOpener-cfff17411e5ee60b92c4b80249237743-1] regionserver.HStore(310): Store=cfff17411e5ee60b92c4b80249237743/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 20:01:07,520 INFO [StoreOpener-cfff17411e5ee60b92c4b80249237743-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region cfff17411e5ee60b92c4b80249237743 2023-02-15 20:01:07,520 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=23, resume processing ppid=12 2023-02-15 20:01:07,522 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=23, ppid=12, state=SUCCESS; OpenRegionProcedure 8a2219c4f89e37dec8687cefabd9fc25, server=jenkins-hbase4.apache.org,41535,1676491262190 in 238 msec 2023-02-15 20:01:07,522 INFO [StoreOpener-f26f31f3358f9f2d50b3c5d32cc7b35d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region f26f31f3358f9f2d50b3c5d32cc7b35d 2023-02-15 20:01:07,523 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=26, resume processing ppid=15 2023-02-15 20:01:07,523 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=26, ppid=15, state=SUCCESS; OpenRegionProcedure 30b6672c9889bbc2cc2b417a34f3f49e, server=jenkins-hbase4.apache.org,33367,1676491262239 in 225 msec 2023-02-15 20:01:07,523 DEBUG [StoreOpener-cfff17411e5ee60b92c4b80249237743-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/data/default/testWithMapReduce/cfff17411e5ee60b92c4b80249237743/f2 2023-02-15 20:01:07,523 DEBUG [StoreOpener-cfff17411e5ee60b92c4b80249237743-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/data/default/testWithMapReduce/cfff17411e5ee60b92c4b80249237743/f2 2023-02-15 20:01:07,524 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=12, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=8a2219c4f89e37dec8687cefabd9fc25, ASSIGN in 422 msec 2023-02-15 20:01:07,525 INFO [StoreOpener-cfff17411e5ee60b92c4b80249237743-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region cfff17411e5ee60b92c4b80249237743 columnFamilyName f2 2023-02-15 20:01:07,525 DEBUG [StoreOpener-f26f31f3358f9f2d50b3c5d32cc7b35d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/data/default/testWithMapReduce/f26f31f3358f9f2d50b3c5d32cc7b35d/f1 2023-02-15 20:01:07,526 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=15, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=30b6672c9889bbc2cc2b417a34f3f49e, ASSIGN in 424 msec 2023-02-15 20:01:07,526 DEBUG [StoreOpener-f26f31f3358f9f2d50b3c5d32cc7b35d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/data/default/testWithMapReduce/f26f31f3358f9f2d50b3c5d32cc7b35d/f1 2023-02-15 20:01:07,526 INFO [StoreOpener-cfff17411e5ee60b92c4b80249237743-1] regionserver.HStore(310): Store=cfff17411e5ee60b92c4b80249237743/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 20:01:07,527 INFO [StoreOpener-f26f31f3358f9f2d50b3c5d32cc7b35d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f26f31f3358f9f2d50b3c5d32cc7b35d columnFamilyName f1 2023-02-15 20:01:07,528 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/data/default/testWithMapReduce/cfff17411e5ee60b92c4b80249237743 2023-02-15 20:01:07,528 INFO [StoreOpener-f26f31f3358f9f2d50b3c5d32cc7b35d-1] regionserver.HStore(310): Store=f26f31f3358f9f2d50b3c5d32cc7b35d/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 20:01:07,529 INFO [StoreOpener-f26f31f3358f9f2d50b3c5d32cc7b35d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region f26f31f3358f9f2d50b3c5d32cc7b35d 2023-02-15 20:01:07,529 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/data/default/testWithMapReduce/cfff17411e5ee60b92c4b80249237743 2023-02-15 20:01:07,533 DEBUG [StoreOpener-f26f31f3358f9f2d50b3c5d32cc7b35d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/data/default/testWithMapReduce/f26f31f3358f9f2d50b3c5d32cc7b35d/f2 2023-02-15 20:01:07,533 DEBUG [StoreOpener-f26f31f3358f9f2d50b3c5d32cc7b35d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/data/default/testWithMapReduce/f26f31f3358f9f2d50b3c5d32cc7b35d/f2 2023-02-15 20:01:07,534 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-15 20:01:07,534 INFO [StoreOpener-f26f31f3358f9f2d50b3c5d32cc7b35d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f26f31f3358f9f2d50b3c5d32cc7b35d columnFamilyName f2 2023-02-15 20:01:07,536 INFO [StoreOpener-f26f31f3358f9f2d50b3c5d32cc7b35d-1] regionserver.HStore(310): Store=f26f31f3358f9f2d50b3c5d32cc7b35d/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 20:01:07,537 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for cfff17411e5ee60b92c4b80249237743 2023-02-15 20:01:07,538 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/data/default/testWithMapReduce/f26f31f3358f9f2d50b3c5d32cc7b35d 2023-02-15 20:01:07,539 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/data/default/testWithMapReduce/f26f31f3358f9f2d50b3c5d32cc7b35d 2023-02-15 20:01:07,542 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/data/default/testWithMapReduce/cfff17411e5ee60b92c4b80249237743/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-15 20:01:07,543 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-15 20:01:07,543 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened cfff17411e5ee60b92c4b80249237743; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63185400, jitterRate=-0.0584641695022583}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-15 20:01:07,543 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for cfff17411e5ee60b92c4b80249237743: 2023-02-15 20:01:07,545 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,d\x84\x84,1676491266407.cfff17411e5ee60b92c4b80249237743., pid=21, masterSystemTime=1676491267422 2023-02-15 20:01:07,545 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for f26f31f3358f9f2d50b3c5d32cc7b35d 2023-02-15 20:01:07,547 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,d\x84\x84,1676491266407.cfff17411e5ee60b92c4b80249237743. 2023-02-15 20:01:07,547 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,d\x84\x84,1676491266407.cfff17411e5ee60b92c4b80249237743. 2023-02-15 20:01:07,548 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,zz{,1676491266407.f5c7d59a05e094a402144fe6a2d882f0. 2023-02-15 20:01:07,548 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => f5c7d59a05e094a402144fe6a2d882f0, NAME => 'testWithMapReduce,zz{,1676491266407.f5c7d59a05e094a402144fe6a2d882f0.', STARTKEY => 'zz{', ENDKEY => ''} 2023-02-15 20:01:07,548 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=cfff17411e5ee60b92c4b80249237743, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,41535,1676491262190 2023-02-15 20:01:07,549 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/data/default/testWithMapReduce/f26f31f3358f9f2d50b3c5d32cc7b35d/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-15 20:01:07,549 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce f5c7d59a05e094a402144fe6a2d882f0 2023-02-15 20:01:07,549 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,d\\x84\\x84,1676491266407.cfff17411e5ee60b92c4b80249237743.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676491267548"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676491267548"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676491267548"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676491267548"}]},"ts":"1676491267548"} 2023-02-15 20:01:07,549 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,zz{,1676491266407.f5c7d59a05e094a402144fe6a2d882f0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 20:01:07,549 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for f5c7d59a05e094a402144fe6a2d882f0 2023-02-15 20:01:07,549 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened f26f31f3358f9f2d50b3c5d32cc7b35d; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70902734, jitterRate=0.05653306841850281}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-15 20:01:07,550 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for f26f31f3358f9f2d50b3c5d32cc7b35d: 2023-02-15 20:01:07,550 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for f5c7d59a05e094a402144fe6a2d882f0 2023-02-15 20:01:07,551 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,m\xED\xED,1676491266407.f26f31f3358f9f2d50b3c5d32cc7b35d., pid=29, masterSystemTime=1676491267454 2023-02-15 20:01:07,555 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,m\xED\xED,1676491266407.f26f31f3358f9f2d50b3c5d32cc7b35d. 2023-02-15 20:01:07,555 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,m\xED\xED,1676491266407.f26f31f3358f9f2d50b3c5d32cc7b35d. 2023-02-15 20:01:07,555 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,,1676491266407.77b8837eb0dd784edf4b0582f0ba0a3f. 2023-02-15 20:01:07,555 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 77b8837eb0dd784edf4b0582f0ba0a3f, NAME => 'testWithMapReduce,,1676491266407.77b8837eb0dd784edf4b0582f0ba0a3f.', STARTKEY => '', ENDKEY => 'aaa'} 2023-02-15 20:01:07,556 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 77b8837eb0dd784edf4b0582f0ba0a3f 2023-02-15 20:01:07,556 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676491266407.77b8837eb0dd784edf4b0582f0ba0a3f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 20:01:07,556 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 77b8837eb0dd784edf4b0582f0ba0a3f 2023-02-15 20:01:07,556 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 77b8837eb0dd784edf4b0582f0ba0a3f 2023-02-15 20:01:07,556 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=f26f31f3358f9f2d50b3c5d32cc7b35d, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,33367,1676491262239 2023-02-15 20:01:07,557 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,m\\xED\\xED,1676491266407.f26f31f3358f9f2d50b3c5d32cc7b35d.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676491267556"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676491267556"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676491267556"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676491267556"}]},"ts":"1676491267556"} 2023-02-15 20:01:07,558 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=21, resume processing ppid=13 2023-02-15 20:01:07,558 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=21, ppid=13, state=SUCCESS; OpenRegionProcedure cfff17411e5ee60b92c4b80249237743, server=jenkins-hbase4.apache.org,41535,1676491262190 in 286 msec 2023-02-15 20:01:07,560 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39607] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-15 20:01:07,563 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=29, resume processing ppid=16 2023-02-15 20:01:07,565 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=29, ppid=16, state=SUCCESS; OpenRegionProcedure f26f31f3358f9f2d50b3c5d32cc7b35d, server=jenkins-hbase4.apache.org,33367,1676491262239 in 262 msec 2023-02-15 20:01:07,561 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=13, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=cfff17411e5ee60b92c4b80249237743, ASSIGN in 459 msec 2023-02-15 20:01:07,569 INFO [StoreOpener-77b8837eb0dd784edf4b0582f0ba0a3f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 77b8837eb0dd784edf4b0582f0ba0a3f 2023-02-15 20:01:07,569 INFO [StoreOpener-f5c7d59a05e094a402144fe6a2d882f0-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region f5c7d59a05e094a402144fe6a2d882f0 2023-02-15 20:01:07,571 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=f26f31f3358f9f2d50b3c5d32cc7b35d, ASSIGN in 464 msec 2023-02-15 20:01:07,572 DEBUG [StoreOpener-77b8837eb0dd784edf4b0582f0ba0a3f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/data/default/testWithMapReduce/77b8837eb0dd784edf4b0582f0ba0a3f/f1 2023-02-15 20:01:07,572 DEBUG [StoreOpener-77b8837eb0dd784edf4b0582f0ba0a3f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/data/default/testWithMapReduce/77b8837eb0dd784edf4b0582f0ba0a3f/f1 2023-02-15 20:01:07,572 DEBUG [StoreOpener-f5c7d59a05e094a402144fe6a2d882f0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/data/default/testWithMapReduce/f5c7d59a05e094a402144fe6a2d882f0/f1 2023-02-15 20:01:07,572 DEBUG [StoreOpener-f5c7d59a05e094a402144fe6a2d882f0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/data/default/testWithMapReduce/f5c7d59a05e094a402144fe6a2d882f0/f1 2023-02-15 20:01:07,572 INFO [StoreOpener-77b8837eb0dd784edf4b0582f0ba0a3f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 77b8837eb0dd784edf4b0582f0ba0a3f columnFamilyName f1 2023-02-15 20:01:07,572 INFO [StoreOpener-f5c7d59a05e094a402144fe6a2d882f0-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f5c7d59a05e094a402144fe6a2d882f0 columnFamilyName f1 2023-02-15 20:01:07,573 INFO [StoreOpener-77b8837eb0dd784edf4b0582f0ba0a3f-1] regionserver.HStore(310): Store=77b8837eb0dd784edf4b0582f0ba0a3f/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 20:01:07,574 INFO [StoreOpener-77b8837eb0dd784edf4b0582f0ba0a3f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 77b8837eb0dd784edf4b0582f0ba0a3f 2023-02-15 20:01:07,574 INFO [StoreOpener-f5c7d59a05e094a402144fe6a2d882f0-1] regionserver.HStore(310): Store=f5c7d59a05e094a402144fe6a2d882f0/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 20:01:07,575 INFO [StoreOpener-f5c7d59a05e094a402144fe6a2d882f0-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region f5c7d59a05e094a402144fe6a2d882f0 2023-02-15 20:01:07,577 DEBUG [StoreOpener-77b8837eb0dd784edf4b0582f0ba0a3f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/data/default/testWithMapReduce/77b8837eb0dd784edf4b0582f0ba0a3f/f2 2023-02-15 20:01:07,577 DEBUG [StoreOpener-77b8837eb0dd784edf4b0582f0ba0a3f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/data/default/testWithMapReduce/77b8837eb0dd784edf4b0582f0ba0a3f/f2 2023-02-15 20:01:07,577 INFO [StoreOpener-77b8837eb0dd784edf4b0582f0ba0a3f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 77b8837eb0dd784edf4b0582f0ba0a3f columnFamilyName f2 2023-02-15 20:01:07,578 INFO [StoreOpener-77b8837eb0dd784edf4b0582f0ba0a3f-1] regionserver.HStore(310): Store=77b8837eb0dd784edf4b0582f0ba0a3f/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 20:01:07,580 DEBUG [StoreOpener-f5c7d59a05e094a402144fe6a2d882f0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/data/default/testWithMapReduce/f5c7d59a05e094a402144fe6a2d882f0/f2 2023-02-15 20:01:07,580 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/data/default/testWithMapReduce/77b8837eb0dd784edf4b0582f0ba0a3f 2023-02-15 20:01:07,580 DEBUG [StoreOpener-f5c7d59a05e094a402144fe6a2d882f0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/data/default/testWithMapReduce/f5c7d59a05e094a402144fe6a2d882f0/f2 2023-02-15 20:01:07,581 INFO [StoreOpener-f5c7d59a05e094a402144fe6a2d882f0-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f5c7d59a05e094a402144fe6a2d882f0 columnFamilyName f2 2023-02-15 20:01:07,581 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/data/default/testWithMapReduce/77b8837eb0dd784edf4b0582f0ba0a3f 2023-02-15 20:01:07,582 INFO [StoreOpener-f5c7d59a05e094a402144fe6a2d882f0-1] regionserver.HStore(310): Store=f5c7d59a05e094a402144fe6a2d882f0/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 20:01:07,585 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/data/default/testWithMapReduce/f5c7d59a05e094a402144fe6a2d882f0 2023-02-15 20:01:07,585 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/data/default/testWithMapReduce/f5c7d59a05e094a402144fe6a2d882f0 2023-02-15 20:01:07,586 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-15 20:01:07,588 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 77b8837eb0dd784edf4b0582f0ba0a3f 2023-02-15 20:01:07,589 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-15 20:01:07,591 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for f5c7d59a05e094a402144fe6a2d882f0 2023-02-15 20:01:07,591 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/data/default/testWithMapReduce/77b8837eb0dd784edf4b0582f0ba0a3f/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-15 20:01:07,592 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 77b8837eb0dd784edf4b0582f0ba0a3f; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59002763, jitterRate=-0.12079031765460968}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-15 20:01:07,592 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 77b8837eb0dd784edf4b0582f0ba0a3f: 2023-02-15 20:01:07,594 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,,1676491266407.77b8837eb0dd784edf4b0582f0ba0a3f., pid=28, masterSystemTime=1676491267454 2023-02-15 20:01:07,594 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/data/default/testWithMapReduce/f5c7d59a05e094a402144fe6a2d882f0/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-15 20:01:07,595 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened f5c7d59a05e094a402144fe6a2d882f0; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72737628, jitterRate=0.08387511968612671}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-15 20:01:07,595 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for f5c7d59a05e094a402144fe6a2d882f0: 2023-02-15 20:01:07,597 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,,1676491266407.77b8837eb0dd784edf4b0582f0ba0a3f. 2023-02-15 20:01:07,597 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,,1676491266407.77b8837eb0dd784edf4b0582f0ba0a3f. 2023-02-15 20:01:07,597 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,t43,1676491266407.ce146f62338407483a61920d7170f142. 2023-02-15 20:01:07,597 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,zz{,1676491266407.f5c7d59a05e094a402144fe6a2d882f0., pid=24, masterSystemTime=1676491267422 2023-02-15 20:01:07,597 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => ce146f62338407483a61920d7170f142, NAME => 'testWithMapReduce,t43,1676491266407.ce146f62338407483a61920d7170f142.', STARTKEY => 't43', ENDKEY => 'wWV'} 2023-02-15 20:01:07,597 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce ce146f62338407483a61920d7170f142 2023-02-15 20:01:07,598 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,t43,1676491266407.ce146f62338407483a61920d7170f142.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 20:01:07,598 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for ce146f62338407483a61920d7170f142 2023-02-15 20:01:07,598 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for ce146f62338407483a61920d7170f142 2023-02-15 20:01:07,598 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=77b8837eb0dd784edf4b0582f0ba0a3f, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,33367,1676491262239 2023-02-15 20:01:07,598 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,,1676491266407.77b8837eb0dd784edf4b0582f0ba0a3f.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676491267598"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676491267598"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676491267598"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676491267598"}]},"ts":"1676491267598"} 2023-02-15 20:01:07,600 INFO [StoreOpener-ce146f62338407483a61920d7170f142-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region ce146f62338407483a61920d7170f142 2023-02-15 20:01:07,600 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,zz{,1676491266407.f5c7d59a05e094a402144fe6a2d882f0. 2023-02-15 20:01:07,600 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,zz{,1676491266407.f5c7d59a05e094a402144fe6a2d882f0. 2023-02-15 20:01:07,600 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,q\x11\x10,1676491266407.aac41416f1d7fc83b90c2b3432a76ce6. 2023-02-15 20:01:07,601 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => aac41416f1d7fc83b90c2b3432a76ce6, NAME => 'testWithMapReduce,q\x11\x10,1676491266407.aac41416f1d7fc83b90c2b3432a76ce6.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'} 2023-02-15 20:01:07,601 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce aac41416f1d7fc83b90c2b3432a76ce6 2023-02-15 20:01:07,601 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,q\x11\x10,1676491266407.aac41416f1d7fc83b90c2b3432a76ce6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 20:01:07,601 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for aac41416f1d7fc83b90c2b3432a76ce6 2023-02-15 20:01:07,601 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for aac41416f1d7fc83b90c2b3432a76ce6 2023-02-15 20:01:07,602 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=f5c7d59a05e094a402144fe6a2d882f0, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,41535,1676491262190 2023-02-15 20:01:07,602 DEBUG [StoreOpener-ce146f62338407483a61920d7170f142-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/data/default/testWithMapReduce/ce146f62338407483a61920d7170f142/f1 2023-02-15 20:01:07,602 DEBUG [StoreOpener-ce146f62338407483a61920d7170f142-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/data/default/testWithMapReduce/ce146f62338407483a61920d7170f142/f1 2023-02-15 20:01:07,602 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,zz{,1676491266407.f5c7d59a05e094a402144fe6a2d882f0.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676491267602"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676491267602"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676491267602"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676491267602"}]},"ts":"1676491267602"} 2023-02-15 20:01:07,603 INFO [StoreOpener-ce146f62338407483a61920d7170f142-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ce146f62338407483a61920d7170f142 columnFamilyName f1 2023-02-15 20:01:07,604 INFO [StoreOpener-ce146f62338407483a61920d7170f142-1] regionserver.HStore(310): Store=ce146f62338407483a61920d7170f142/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 20:01:07,604 INFO [StoreOpener-ce146f62338407483a61920d7170f142-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region ce146f62338407483a61920d7170f142 2023-02-15 20:01:07,606 DEBUG [StoreOpener-ce146f62338407483a61920d7170f142-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/data/default/testWithMapReduce/ce146f62338407483a61920d7170f142/f2 2023-02-15 20:01:07,606 DEBUG [StoreOpener-ce146f62338407483a61920d7170f142-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/data/default/testWithMapReduce/ce146f62338407483a61920d7170f142/f2 2023-02-15 20:01:07,607 INFO [StoreOpener-ce146f62338407483a61920d7170f142-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ce146f62338407483a61920d7170f142 columnFamilyName f2 2023-02-15 20:01:07,608 INFO [StoreOpener-ce146f62338407483a61920d7170f142-1] regionserver.HStore(310): Store=ce146f62338407483a61920d7170f142/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 20:01:07,609 INFO [StoreOpener-aac41416f1d7fc83b90c2b3432a76ce6-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region aac41416f1d7fc83b90c2b3432a76ce6 2023-02-15 20:01:07,611 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=28, resume processing ppid=11 2023-02-15 20:01:07,611 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=28, ppid=11, state=SUCCESS; OpenRegionProcedure 77b8837eb0dd784edf4b0582f0ba0a3f, server=jenkins-hbase4.apache.org,33367,1676491262239 in 306 msec 2023-02-15 20:01:07,611 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/data/default/testWithMapReduce/ce146f62338407483a61920d7170f142 2023-02-15 20:01:07,611 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/data/default/testWithMapReduce/ce146f62338407483a61920d7170f142 2023-02-15 20:01:07,612 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=24, resume processing ppid=20 2023-02-15 20:01:07,612 DEBUG [StoreOpener-aac41416f1d7fc83b90c2b3432a76ce6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/data/default/testWithMapReduce/aac41416f1d7fc83b90c2b3432a76ce6/f1 2023-02-15 20:01:07,612 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=24, ppid=20, state=SUCCESS; OpenRegionProcedure f5c7d59a05e094a402144fe6a2d882f0, server=jenkins-hbase4.apache.org,41535,1676491262190 in 324 msec 2023-02-15 20:01:07,612 DEBUG [StoreOpener-aac41416f1d7fc83b90c2b3432a76ce6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/data/default/testWithMapReduce/aac41416f1d7fc83b90c2b3432a76ce6/f1 2023-02-15 20:01:07,613 INFO [StoreOpener-aac41416f1d7fc83b90c2b3432a76ce6-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region aac41416f1d7fc83b90c2b3432a76ce6 columnFamilyName f1 2023-02-15 20:01:07,614 INFO [StoreOpener-aac41416f1d7fc83b90c2b3432a76ce6-1] regionserver.HStore(310): Store=aac41416f1d7fc83b90c2b3432a76ce6/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 20:01:07,614 INFO [StoreOpener-aac41416f1d7fc83b90c2b3432a76ce6-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region aac41416f1d7fc83b90c2b3432a76ce6 2023-02-15 20:01:07,615 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-15 20:01:07,616 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=77b8837eb0dd784edf4b0582f0ba0a3f, ASSIGN in 512 msec 2023-02-15 20:01:07,616 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=20, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=f5c7d59a05e094a402144fe6a2d882f0, ASSIGN in 513 msec 2023-02-15 20:01:07,616 DEBUG [StoreOpener-aac41416f1d7fc83b90c2b3432a76ce6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/data/default/testWithMapReduce/aac41416f1d7fc83b90c2b3432a76ce6/f2 2023-02-15 20:01:07,617 DEBUG [StoreOpener-aac41416f1d7fc83b90c2b3432a76ce6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/data/default/testWithMapReduce/aac41416f1d7fc83b90c2b3432a76ce6/f2 2023-02-15 20:01:07,617 INFO [StoreOpener-aac41416f1d7fc83b90c2b3432a76ce6-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region aac41416f1d7fc83b90c2b3432a76ce6 columnFamilyName f2 2023-02-15 20:01:07,618 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for ce146f62338407483a61920d7170f142 2023-02-15 20:01:07,618 INFO [StoreOpener-aac41416f1d7fc83b90c2b3432a76ce6-1] regionserver.HStore(310): Store=aac41416f1d7fc83b90c2b3432a76ce6/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 20:01:07,620 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/data/default/testWithMapReduce/aac41416f1d7fc83b90c2b3432a76ce6 2023-02-15 20:01:07,621 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/data/default/testWithMapReduce/aac41416f1d7fc83b90c2b3432a76ce6 2023-02-15 20:01:07,624 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/data/default/testWithMapReduce/ce146f62338407483a61920d7170f142/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-15 20:01:07,624 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-15 20:01:07,625 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened ce146f62338407483a61920d7170f142; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59303238, jitterRate=-0.1163128912448883}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-15 20:01:07,625 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for ce146f62338407483a61920d7170f142: 2023-02-15 20:01:07,626 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for aac41416f1d7fc83b90c2b3432a76ce6 2023-02-15 20:01:07,627 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,t43,1676491266407.ce146f62338407483a61920d7170f142., pid=30, masterSystemTime=1676491267454 2023-02-15 20:01:07,629 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,t43,1676491266407.ce146f62338407483a61920d7170f142. 2023-02-15 20:01:07,629 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,t43,1676491266407.ce146f62338407483a61920d7170f142. 2023-02-15 20:01:07,629 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,wWV,1676491266407.da7189167b0a5e71ebfc52ccf8240947. 2023-02-15 20:01:07,630 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => da7189167b0a5e71ebfc52ccf8240947, NAME => 'testWithMapReduce,wWV,1676491266407.da7189167b0a5e71ebfc52ccf8240947.', STARTKEY => 'wWV', ENDKEY => 'zz{'} 2023-02-15 20:01:07,631 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=18 updating hbase:meta row=ce146f62338407483a61920d7170f142, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,33367,1676491262239 2023-02-15 20:01:07,631 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,t43,1676491266407.ce146f62338407483a61920d7170f142.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676491267630"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676491267630"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676491267630"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676491267630"}]},"ts":"1676491267630"} 2023-02-15 20:01:07,631 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/data/default/testWithMapReduce/aac41416f1d7fc83b90c2b3432a76ce6/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-15 20:01:07,632 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce da7189167b0a5e71ebfc52ccf8240947 2023-02-15 20:01:07,632 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,wWV,1676491266407.da7189167b0a5e71ebfc52ccf8240947.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 20:01:07,632 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for da7189167b0a5e71ebfc52ccf8240947 2023-02-15 20:01:07,632 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for da7189167b0a5e71ebfc52ccf8240947 2023-02-15 20:01:07,632 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened aac41416f1d7fc83b90c2b3432a76ce6; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72497717, jitterRate=0.08030016720294952}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-15 20:01:07,632 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for aac41416f1d7fc83b90c2b3432a76ce6: 2023-02-15 20:01:07,635 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,q\x11\x10,1676491266407.aac41416f1d7fc83b90c2b3432a76ce6., pid=22, masterSystemTime=1676491267422 2023-02-15 20:01:07,637 INFO [StoreOpener-da7189167b0a5e71ebfc52ccf8240947-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region da7189167b0a5e71ebfc52ccf8240947 2023-02-15 20:01:07,638 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=30, resume processing ppid=18 2023-02-15 20:01:07,638 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=30, ppid=18, state=SUCCESS; OpenRegionProcedure ce146f62338407483a61920d7170f142, server=jenkins-hbase4.apache.org,33367,1676491262239 in 323 msec 2023-02-15 20:01:07,638 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,q\x11\x10,1676491266407.aac41416f1d7fc83b90c2b3432a76ce6. 2023-02-15 20:01:07,638 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,q\x11\x10,1676491266407.aac41416f1d7fc83b90c2b3432a76ce6. 2023-02-15 20:01:07,639 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=17 updating hbase:meta row=aac41416f1d7fc83b90c2b3432a76ce6, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,41535,1676491262190 2023-02-15 20:01:07,639 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,q\\x11\\x10,1676491266407.aac41416f1d7fc83b90c2b3432a76ce6.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676491267639"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676491267639"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676491267639"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676491267639"}]},"ts":"1676491267639"} 2023-02-15 20:01:07,639 DEBUG [StoreOpener-da7189167b0a5e71ebfc52ccf8240947-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/data/default/testWithMapReduce/da7189167b0a5e71ebfc52ccf8240947/f1 2023-02-15 20:01:07,639 DEBUG [StoreOpener-da7189167b0a5e71ebfc52ccf8240947-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/data/default/testWithMapReduce/da7189167b0a5e71ebfc52ccf8240947/f1 2023-02-15 20:01:07,640 INFO [StoreOpener-da7189167b0a5e71ebfc52ccf8240947-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region da7189167b0a5e71ebfc52ccf8240947 columnFamilyName f1 2023-02-15 20:01:07,640 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=18, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=ce146f62338407483a61920d7170f142, ASSIGN in 539 msec 2023-02-15 20:01:07,641 INFO [StoreOpener-da7189167b0a5e71ebfc52ccf8240947-1] regionserver.HStore(310): Store=da7189167b0a5e71ebfc52ccf8240947/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 20:01:07,641 INFO [StoreOpener-da7189167b0a5e71ebfc52ccf8240947-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region da7189167b0a5e71ebfc52ccf8240947 2023-02-15 20:01:07,643 DEBUG [StoreOpener-da7189167b0a5e71ebfc52ccf8240947-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/data/default/testWithMapReduce/da7189167b0a5e71ebfc52ccf8240947/f2 2023-02-15 20:01:07,643 DEBUG [StoreOpener-da7189167b0a5e71ebfc52ccf8240947-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/data/default/testWithMapReduce/da7189167b0a5e71ebfc52ccf8240947/f2 2023-02-15 20:01:07,644 INFO [StoreOpener-da7189167b0a5e71ebfc52ccf8240947-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region da7189167b0a5e71ebfc52ccf8240947 columnFamilyName f2 2023-02-15 20:01:07,645 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=22, resume processing ppid=17 2023-02-15 20:01:07,645 INFO [StoreOpener-da7189167b0a5e71ebfc52ccf8240947-1] regionserver.HStore(310): Store=da7189167b0a5e71ebfc52ccf8240947/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 20:01:07,645 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=22, ppid=17, state=SUCCESS; OpenRegionProcedure aac41416f1d7fc83b90c2b3432a76ce6, server=jenkins-hbase4.apache.org,41535,1676491262190 in 370 msec 2023-02-15 20:01:07,647 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/data/default/testWithMapReduce/da7189167b0a5e71ebfc52ccf8240947 2023-02-15 20:01:07,647 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=aac41416f1d7fc83b90c2b3432a76ce6, ASSIGN in 546 msec 2023-02-15 20:01:07,647 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/data/default/testWithMapReduce/da7189167b0a5e71ebfc52ccf8240947 2023-02-15 20:01:07,650 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-15 20:01:07,651 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for da7189167b0a5e71ebfc52ccf8240947 2023-02-15 20:01:07,654 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/data/default/testWithMapReduce/da7189167b0a5e71ebfc52ccf8240947/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-15 20:01:07,655 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened da7189167b0a5e71ebfc52ccf8240947; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63551481, jitterRate=-0.05300913751125336}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-15 20:01:07,655 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for da7189167b0a5e71ebfc52ccf8240947: 2023-02-15 20:01:07,656 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,wWV,1676491266407.da7189167b0a5e71ebfc52ccf8240947., pid=27, masterSystemTime=1676491267454 2023-02-15 20:01:07,658 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,wWV,1676491266407.da7189167b0a5e71ebfc52ccf8240947. 2023-02-15 20:01:07,658 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,wWV,1676491266407.da7189167b0a5e71ebfc52ccf8240947. 2023-02-15 20:01:07,659 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=19 updating hbase:meta row=da7189167b0a5e71ebfc52ccf8240947, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,33367,1676491262239 2023-02-15 20:01:07,659 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,wWV,1676491266407.da7189167b0a5e71ebfc52ccf8240947.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676491267659"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676491267659"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676491267659"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676491267659"}]},"ts":"1676491267659"} 2023-02-15 20:01:07,665 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=27, resume processing ppid=19 2023-02-15 20:01:07,665 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=27, ppid=19, state=SUCCESS; OpenRegionProcedure da7189167b0a5e71ebfc52ccf8240947, server=jenkins-hbase4.apache.org,33367,1676491262239 in 368 msec 2023-02-15 20:01:07,668 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=19, resume processing ppid=10 2023-02-15 20:01:07,668 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=19, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=da7189167b0a5e71ebfc52ccf8240947, ASSIGN in 566 msec 2023-02-15 20:01:07,669 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-15 20:01:07,669 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676491267669"}]},"ts":"1676491267669"} 2023-02-15 20:01:07,672 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=ENABLED in hbase:meta 2023-02-15 20:01:07,675 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_POST_OPERATION 2023-02-15 20:01:07,679 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=10, state=SUCCESS; CreateTableProcedure table=testWithMapReduce in 1.2630 sec 2023-02-15 20:01:08,568 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39607] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-15 20:01:08,568 INFO [Listener at localhost/37547] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testWithMapReduce, procId: 10 completed 2023-02-15 20:01:08,568 DEBUG [Listener at localhost/37547] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testWithMapReduce get assigned. Timeout = 60000ms 2023-02-15 20:01:08,570 INFO [Listener at localhost/37547] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-15 20:01:08,579 INFO [Listener at localhost/37547] hbase.HBaseTestingUtility(3484): All regions for table testWithMapReduce assigned to meta. Checking AM states. 2023-02-15 20:01:08,579 INFO [Listener at localhost/37547] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-15 20:01:08,580 INFO [Listener at localhost/37547] hbase.HBaseTestingUtility(3504): All regions for table testWithMapReduce assigned. 2023-02-15 20:01:08,580 INFO [Listener at localhost/37547] mapreduce.TableSnapshotInputFormatTestBase(207): put some stuff in the table 2023-02-15 20:01:08,726 DEBUG [hconnection-0x11545b24-shared-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-15 20:01:08,824 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36660, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-15 20:01:08,856 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41535] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 8788 Client: jenkins//172.31.14.131 first region in multi=testWithMapReduce,aaa,1676491266407.8a2219c4f89e37dec8687cefabd9fc25. 2023-02-15 20:01:08,858 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33367] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 8788 Client: jenkins//172.31.14.131 first region in multi=testWithMapReduce,j\xCA\xCA,1676491266407.30b6672c9889bbc2cc2b417a34f3f49e. 2023-02-15 20:01:09,141 INFO [Listener at localhost/37547] mapreduce.TableSnapshotInputFormatTestBase(214): snapshot 2023-02-15 20:01:09,144 INFO [Listener at localhost/37547] snapshot.SnapshotTestingUtils(396): taking snapshot. 2023-02-15 20:01:09,155 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39607] master.MasterRpcServices(1580): Client=jenkins//172.31.14.131 snapshot request for:{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-15 20:01:09,155 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39607] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1676491269155 (current time:1676491269155). 2023-02-15 20:01:09,155 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39607] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-02-15 20:01:09,155 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39607] zookeeper.ReadOnlyZKClient(139): Connect 0x532748b8 to 127.0.0.1:53178 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-15 20:01:09,161 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39607] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@49759749, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-15 20:01:09,165 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39607] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-15 20:01:09,167 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54650, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-15 20:01:09,169 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39607] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x532748b8 to 127.0.0.1:53178 2023-02-15 20:01:09,169 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39607] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-15 20:01:09,171 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39607] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-02-15 20:01:09,171 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39607] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-15 20:01:09,193 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39607] procedure2.ProcedureExecutor(1029): Stored pid=31, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-15 20:01:09,194 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=31, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-15 20:01:09,196 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=31, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE; timeout=600000, timestamp=1676491869196 2023-02-15 20:01:09,196 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39607] snapshot.SnapshotManager(653): Started snapshot: { ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-15 20:01:09,197 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot testWithMapReduceMultiRegion C_M_SNAPSHOT_TABLE on table testWithMapReduce 2023-02-15 20:01:09,199 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=31, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-15 20:01:09,200 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-15 20:01:09,203 DEBUG [Listener at localhost/37547] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-02-15 20:01:09,203 DEBUG [Listener at localhost/37547] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-02-15 20:01:09,204 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=31, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE in 14 msec 2023-02-15 20:01:09,205 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-15 20:01:09,206 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=32, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED; timeout=600000, timestamp=1676491869206 2023-02-15 20:01:09,238 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure testWithMapReduceMultiRegion 2023-02-15 20:01:09,239 INFO [(jenkins-hbase4.apache.org,39607,1676491260960)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMapReduceMultiRegion' 2023-02-15 20:01:09,239 DEBUG [(jenkins-hbase4.apache.org,39607,1676491260960)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-15 20:01:09,240 DEBUG [(jenkins-hbase4.apache.org,39607,1676491260960)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMapReduceMultiRegion' starting 'acquire' 2023-02-15 20:01:09,240 DEBUG [(jenkins-hbase4.apache.org,39607,1676491260960)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMapReduceMultiRegion', kicking off acquire phase on members. 2023-02-15 20:01:09,240 DEBUG [(jenkins-hbase4.apache.org,39607,1676491260960)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39607-0x10059926a4e0000, quorum=127.0.0.1:53178, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-15 20:01:09,241 DEBUG [(jenkins-hbase4.apache.org,39607,1676491260960)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion 2023-02-15 20:01:09,244 DEBUG [Listener at localhost/37547-EventThread] zookeeper.ZKWatcher(600): regionserver:41535-0x10059926a4e0001, quorum=127.0.0.1:53178, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-15 20:01:09,244 DEBUG [Listener at localhost/37547-EventThread] zookeeper.ZKWatcher(600): regionserver:33367-0x10059926a4e0002, quorum=127.0.0.1:53178, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-15 20:01:09,244 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-15 20:01:09,244 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-15 20:01:09,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-15 20:01:09,244 DEBUG [(jenkins-hbase4.apache.org,39607,1676491260960)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,33367,1676491262239 2023-02-15 20:01:09,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-15 20:01:09,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMapReduceMultiRegion 2023-02-15 20:01:09,245 DEBUG [(jenkins-hbase4.apache.org,39607,1676491260960)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39607-0x10059926a4e0000, quorum=127.0.0.1:53178, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,33367,1676491262239 2023-02-15 20:01:09,245 DEBUG [(jenkins-hbase4.apache.org,39607,1676491260960)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,41535,1676491262190 2023-02-15 20:01:09,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMapReduceMultiRegion 2023-02-15 20:01:09,245 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33367-0x10059926a4e0002, quorum=127.0.0.1:53178, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-15 20:01:09,246 DEBUG [(jenkins-hbase4.apache.org,39607,1676491260960)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39607-0x10059926a4e0000, quorum=127.0.0.1:53178, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,41535,1676491262190 2023-02-15 20:01:09,246 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41535-0x10059926a4e0001, quorum=127.0.0.1:53178, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-15 20:01:09,246 DEBUG [(jenkins-hbase4.apache.org,39607,1676491260960)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-15 20:01:09,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 66 2023-02-15 20:01:09,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion 2023-02-15 20:01:09,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 66 2023-02-15 20:01:09,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion 2023-02-15 20:01:09,246 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMapReduceMultiRegion from table testWithMapReduce type FLUSH 2023-02-15 20:01:09,246 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMapReduceMultiRegion from table testWithMapReduce type FLUSH 2023-02-15 20:01:09,250 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduceMultiRegion 2023-02-15 20:01:09,250 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduceMultiRegion 2023-02-15 20:01:09,250 DEBUG [member: 'jenkins-hbase4.apache.org,33367,1676491262239' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduceMultiRegion' with timeout 300000ms 2023-02-15 20:01:09,250 DEBUG [member: 'jenkins-hbase4.apache.org,33367,1676491262239' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-15 20:01:09,250 DEBUG [member: 'jenkins-hbase4.apache.org,41535,1676491262190' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduceMultiRegion' with timeout 300000ms 2023-02-15 20:01:09,251 DEBUG [member: 'jenkins-hbase4.apache.org,33367,1676491262239' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduceMultiRegion' starting 'acquire' stage 2023-02-15 20:01:09,251 DEBUG [member: 'jenkins-hbase4.apache.org,41535,1676491262190' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-15 20:01:09,251 DEBUG [member: 'jenkins-hbase4.apache.org,33367,1676491262239' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduceMultiRegion' locally acquired 2023-02-15 20:01:09,251 DEBUG [member: 'jenkins-hbase4.apache.org,41535,1676491262190' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduceMultiRegion' starting 'acquire' stage 2023-02-15 20:01:09,251 DEBUG [member: 'jenkins-hbase4.apache.org,41535,1676491262190' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduceMultiRegion' locally acquired 2023-02-15 20:01:09,251 DEBUG [member: 'jenkins-hbase4.apache.org,41535,1676491262190' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41535,1676491262190' joining acquired barrier for procedure (testWithMapReduceMultiRegion) in zk 2023-02-15 20:01:09,251 DEBUG [member: 'jenkins-hbase4.apache.org,33367,1676491262239' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33367,1676491262239' joining acquired barrier for procedure (testWithMapReduceMultiRegion) in zk 2023-02-15 20:01:09,254 DEBUG [Listener at localhost/37547-EventThread] zookeeper.ZKWatcher(600): master:39607-0x10059926a4e0000, quorum=127.0.0.1:53178, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,33367,1676491262239 2023-02-15 20:01:09,254 DEBUG [member: 'jenkins-hbase4.apache.org,33367,1676491262239' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-15 20:01:09,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,33367,1676491262239 2023-02-15 20:01:09,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-15 20:01:09,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-15 20:01:09,254 DEBUG [Listener at localhost/37547-EventThread] zookeeper.ZKWatcher(600): master:39607-0x10059926a4e0000, quorum=127.0.0.1:53178, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,41535,1676491262190 2023-02-15 20:01:09,254 DEBUG [member: 'jenkins-hbase4.apache.org,41535,1676491262190' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-15 20:01:09,254 DEBUG [member: 'jenkins-hbase4.apache.org,33367,1676491262239' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33367-0x10059926a4e0002, quorum=127.0.0.1:53178, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-15 20:01:09,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-15 20:01:09,255 DEBUG [member: 'jenkins-hbase4.apache.org,33367,1676491262239' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduceMultiRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-15 20:01:09,255 DEBUG [member: 'jenkins-hbase4.apache.org,41535,1676491262190' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41535-0x10059926a4e0001, quorum=127.0.0.1:53178, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-15 20:01:09,255 DEBUG [member: 'jenkins-hbase4.apache.org,41535,1676491262190' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduceMultiRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-15 20:01:09,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-15 20:01:09,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-15 20:01:09,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33367,1676491262239 2023-02-15 20:01:09,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41535,1676491262190 2023-02-15 20:01:09,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-15 20:01:09,257 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,33367,1676491262239' joining acquired barrier for procedure 'testWithMapReduceMultiRegion' on coordinator 2023-02-15 20:01:09,257 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5da3e521[Count = 1] remaining members to acquire global barrier 2023-02-15 20:01:09,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,41535,1676491262190 2023-02-15 20:01:09,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-15 20:01:09,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-15 20:01:09,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-15 20:01:09,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-15 20:01:09,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-15 20:01:09,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33367,1676491262239 2023-02-15 20:01:09,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41535,1676491262190 2023-02-15 20:01:09,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-15 20:01:09,260 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41535,1676491262190' joining acquired barrier for procedure 'testWithMapReduceMultiRegion' on coordinator 2023-02-15 20:01:09,260 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5da3e521[Count = 0] remaining members to acquire global barrier 2023-02-15 20:01:09,260 DEBUG [(jenkins-hbase4.apache.org,39607,1676491260960)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMapReduceMultiRegion' starting 'in-barrier' execution. 2023-02-15 20:01:09,260 DEBUG [(jenkins-hbase4.apache.org,39607,1676491260960)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-15 20:01:09,262 DEBUG [Listener at localhost/37547-EventThread] zookeeper.ZKWatcher(600): regionserver:41535-0x10059926a4e0001, quorum=127.0.0.1:53178, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-15 20:01:09,262 DEBUG [Listener at localhost/37547-EventThread] zookeeper.ZKWatcher(600): regionserver:33367-0x10059926a4e0002, quorum=127.0.0.1:53178, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-15 20:01:09,262 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-15 20:01:09,262 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-15 20:01:09,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-15 20:01:09,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-15 20:01:09,262 DEBUG [member: 'jenkins-hbase4.apache.org,41535,1676491262190' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduceMultiRegion' received 'reached' from coordinator. 2023-02-15 20:01:09,262 DEBUG [member: 'jenkins-hbase4.apache.org,33367,1676491262239' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduceMultiRegion' received 'reached' from coordinator. 2023-02-15 20:01:09,262 DEBUG [(jenkins-hbase4.apache.org,39607,1676491260960)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39607-0x10059926a4e0000, quorum=127.0.0.1:53178, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,33367,1676491262239 2023-02-15 20:01:09,263 DEBUG [(jenkins-hbase4.apache.org,39607,1676491260960)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39607-0x10059926a4e0000, quorum=127.0.0.1:53178, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,41535,1676491262190 2023-02-15 20:01:09,263 DEBUG [(jenkins-hbase4.apache.org,39607,1676491260960)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-15 20:01:09,263 DEBUG [rs(jenkins-hbase4.apache.org,41535,1676491262190)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,zz{,1676491266407.f5c7d59a05e094a402144fe6a2d882f0. 2023-02-15 20:01:09,263 DEBUG [rs(jenkins-hbase4.apache.org,33367,1676491262239)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,t43,1676491266407.ce146f62338407483a61920d7170f142. 2023-02-15 20:01:09,263 DEBUG [rs(jenkins-hbase4.apache.org,41535,1676491262190)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,g\xA7\xA7,1676491266407.3506ea931c9649c226fb4c38a5165b6a. 2023-02-15 20:01:09,264 DEBUG [rs(jenkins-hbase4.apache.org,41535,1676491262190)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,zz{,1676491266407.f5c7d59a05e094a402144fe6a2d882f0. started... 2023-02-15 20:01:09,264 DEBUG [rs(jenkins-hbase4.apache.org,33367,1676491262239)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,t43,1676491266407.ce146f62338407483a61920d7170f142. started... 2023-02-15 20:01:09,264 DEBUG [rs(jenkins-hbase4.apache.org,41535,1676491262190)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,g\xA7\xA7,1676491266407.3506ea931c9649c226fb4c38a5165b6a. started... 2023-02-15 20:01:09,264 DEBUG [rs(jenkins-hbase4.apache.org,33367,1676491262239)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,m\xED\xED,1676491266407.f26f31f3358f9f2d50b3c5d32cc7b35d. 2023-02-15 20:01:09,264 DEBUG [rs(jenkins-hbase4.apache.org,41535,1676491262190)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,q\x11\x10,1676491266407.aac41416f1d7fc83b90c2b3432a76ce6. 2023-02-15 20:01:09,264 DEBUG [rs(jenkins-hbase4.apache.org,33367,1676491262239)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,m\xED\xED,1676491266407.f26f31f3358f9f2d50b3c5d32cc7b35d. started... 2023-02-15 20:01:09,264 DEBUG [rs(jenkins-hbase4.apache.org,33367,1676491262239)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,wWV,1676491266407.da7189167b0a5e71ebfc52ccf8240947. 2023-02-15 20:01:09,264 DEBUG [member: 'jenkins-hbase4.apache.org,41535,1676491262190' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 5 regions 2023-02-15 20:01:09,264 DEBUG [rs(jenkins-hbase4.apache.org,33367,1676491262239)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,wWV,1676491266407.da7189167b0a5e71ebfc52ccf8240947. started... 2023-02-15 20:01:09,264 DEBUG [member: 'jenkins-hbase4.apache.org,41535,1676491262190' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-15 20:01:09,264 DEBUG [member: 'jenkins-hbase4.apache.org,33367,1676491262239' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 5 regions 2023-02-15 20:01:09,264 DEBUG [member: 'jenkins-hbase4.apache.org,33367,1676491262239' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-15 20:01:09,264 DEBUG [rs(jenkins-hbase4.apache.org,41535,1676491262190)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,q\x11\x10,1676491266407.aac41416f1d7fc83b90c2b3432a76ce6. started... 2023-02-15 20:01:09,270 INFO [rs(jenkins-hbase4.apache.org,33367,1676491262239)-snapshot-pool-2] regionserver.HRegion(2744): Flushing da7189167b0a5e71ebfc52ccf8240947 2/2 column families, dataSize=158.44 KB heapSize=549.75 KB 2023-02-15 20:01:09,271 INFO [rs(jenkins-hbase4.apache.org,33367,1676491262239)-snapshot-pool-0] regionserver.HRegion(2744): Flushing ce146f62338407483a61920d7170f142 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-15 20:01:09,270 INFO [rs(jenkins-hbase4.apache.org,33367,1676491262239)-snapshot-pool-1] regionserver.HRegion(2744): Flushing f26f31f3358f9f2d50b3c5d32cc7b35d 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-15 20:01:09,270 INFO [rs(jenkins-hbase4.apache.org,41535,1676491262190)-snapshot-pool-2] regionserver.HRegion(2744): Flushing aac41416f1d7fc83b90c2b3432a76ce6 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-15 20:01:09,272 INFO [rs(jenkins-hbase4.apache.org,41535,1676491262190)-snapshot-pool-1] regionserver.HRegion(2744): Flushing 3506ea931c9649c226fb4c38a5165b6a 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-15 20:01:09,273 DEBUG [rs(jenkins-hbase4.apache.org,41535,1676491262190)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for f5c7d59a05e094a402144fe6a2d882f0: 2023-02-15 20:01:09,274 DEBUG [rs(jenkins-hbase4.apache.org,41535,1676491262190)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,zz{,1676491266407.f5c7d59a05e094a402144fe6a2d882f0.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-15 20:01:09,279 DEBUG [rs(jenkins-hbase4.apache.org,41535,1676491262190)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-15 20:01:09,283 DEBUG [rs(jenkins-hbase4.apache.org,41535,1676491262190)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-15 20:01:09,283 DEBUG [rs(jenkins-hbase4.apache.org,41535,1676491262190)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-15 20:01:09,303 DEBUG [Listener at localhost/37547] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-15 20:01:09,309 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39607] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-15 20:01:09,313 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39607] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-15 20:01:09,314 DEBUG [Listener at localhost/37547] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-02-15 20:01:09,319 DEBUG [rs(jenkins-hbase4.apache.org,41535,1676491262190)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,zz{,1676491266407.f5c7d59a05e094a402144fe6a2d882f0. completed. 2023-02-15 20:01:09,319 DEBUG [rs(jenkins-hbase4.apache.org,41535,1676491262190)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,zz{,1676491266407.f5c7d59a05e094a402144fe6a2d882f0. 2023-02-15 20:01:09,321 DEBUG [rs(jenkins-hbase4.apache.org,41535,1676491262190)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,aaa,1676491266407.8a2219c4f89e37dec8687cefabd9fc25. 2023-02-15 20:01:09,321 DEBUG [member: 'jenkins-hbase4.apache.org,41535,1676491262190' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/5 local region snapshots. 2023-02-15 20:01:09,321 DEBUG [rs(jenkins-hbase4.apache.org,41535,1676491262190)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,aaa,1676491266407.8a2219c4f89e37dec8687cefabd9fc25. started... 2023-02-15 20:01:09,322 INFO [rs(jenkins-hbase4.apache.org,41535,1676491262190)-snapshot-pool-0] regionserver.HRegion(2744): Flushing 8a2219c4f89e37dec8687cefabd9fc25 2/2 column families, dataSize=158.44 KB heapSize=549.75 KB 2023-02-15 20:01:09,514 DEBUG [Listener at localhost/37547] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-15 20:01:09,515 INFO [rs(jenkins-hbase4.apache.org,33367,1676491262239)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/data/default/testWithMapReduce/da7189167b0a5e71ebfc52ccf8240947/.tmp/f1/b19871dfbf874f2d814f559e617022a3 2023-02-15 20:01:09,517 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39607] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-15 20:01:09,517 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39607] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-15 20:01:09,518 DEBUG [Listener at localhost/37547] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-02-15 20:01:09,519 INFO [rs(jenkins-hbase4.apache.org,41535,1676491262190)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/data/default/testWithMapReduce/8a2219c4f89e37dec8687cefabd9fc25/.tmp/f1/b147a9e48d4e4e39aa9c981c22189d7c 2023-02-15 20:01:09,533 INFO [rs(jenkins-hbase4.apache.org,41535,1676491262190)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/data/default/testWithMapReduce/3506ea931c9649c226fb4c38a5165b6a/.tmp/f1/584b33569807402bab19c695007854d6 2023-02-15 20:01:09,540 INFO [rs(jenkins-hbase4.apache.org,41535,1676491262190)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/data/default/testWithMapReduce/aac41416f1d7fc83b90c2b3432a76ce6/.tmp/f1/9fd9cfca86f946febf2708c1bc10bdbd 2023-02-15 20:01:09,647 INFO [rs(jenkins-hbase4.apache.org,41535,1676491262190)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/data/default/testWithMapReduce/8a2219c4f89e37dec8687cefabd9fc25/.tmp/f2/94652720be85460cba80f932503517b1 2023-02-15 20:01:09,652 INFO [rs(jenkins-hbase4.apache.org,41535,1676491262190)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/data/default/testWithMapReduce/3506ea931c9649c226fb4c38a5165b6a/.tmp/f2/1b8744dea70f47e290b386aa438b28ee 2023-02-15 20:01:09,654 INFO [rs(jenkins-hbase4.apache.org,41535,1676491262190)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/data/default/testWithMapReduce/aac41416f1d7fc83b90c2b3432a76ce6/.tmp/f2/fdf07ac3996e436f919b533a96fe4829 2023-02-15 20:01:09,664 DEBUG [rs(jenkins-hbase4.apache.org,41535,1676491262190)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/data/default/testWithMapReduce/3506ea931c9649c226fb4c38a5165b6a/.tmp/f1/584b33569807402bab19c695007854d6 as hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/data/default/testWithMapReduce/3506ea931c9649c226fb4c38a5165b6a/f1/584b33569807402bab19c695007854d6 2023-02-15 20:01:09,664 DEBUG [rs(jenkins-hbase4.apache.org,41535,1676491262190)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/data/default/testWithMapReduce/8a2219c4f89e37dec8687cefabd9fc25/.tmp/f1/b147a9e48d4e4e39aa9c981c22189d7c as hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/data/default/testWithMapReduce/8a2219c4f89e37dec8687cefabd9fc25/f1/b147a9e48d4e4e39aa9c981c22189d7c 2023-02-15 20:01:09,667 DEBUG [rs(jenkins-hbase4.apache.org,41535,1676491262190)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/data/default/testWithMapReduce/aac41416f1d7fc83b90c2b3432a76ce6/.tmp/f1/9fd9cfca86f946febf2708c1bc10bdbd as hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/data/default/testWithMapReduce/aac41416f1d7fc83b90c2b3432a76ce6/f1/9fd9cfca86f946febf2708c1bc10bdbd 2023-02-15 20:01:09,677 INFO [rs(jenkins-hbase4.apache.org,41535,1676491262190)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/data/default/testWithMapReduce/3506ea931c9649c226fb4c38a5165b6a/f1/584b33569807402bab19c695007854d6, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-15 20:01:09,677 INFO [rs(jenkins-hbase4.apache.org,41535,1676491262190)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/data/default/testWithMapReduce/aac41416f1d7fc83b90c2b3432a76ce6/f1/9fd9cfca86f946febf2708c1bc10bdbd, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-15 20:01:09,680 DEBUG [rs(jenkins-hbase4.apache.org,41535,1676491262190)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/data/default/testWithMapReduce/3506ea931c9649c226fb4c38a5165b6a/.tmp/f2/1b8744dea70f47e290b386aa438b28ee as hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/data/default/testWithMapReduce/3506ea931c9649c226fb4c38a5165b6a/f2/1b8744dea70f47e290b386aa438b28ee 2023-02-15 20:01:09,680 DEBUG [rs(jenkins-hbase4.apache.org,41535,1676491262190)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/data/default/testWithMapReduce/aac41416f1d7fc83b90c2b3432a76ce6/.tmp/f2/fdf07ac3996e436f919b533a96fe4829 as hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/data/default/testWithMapReduce/aac41416f1d7fc83b90c2b3432a76ce6/f2/fdf07ac3996e436f919b533a96fe4829 2023-02-15 20:01:09,682 INFO [rs(jenkins-hbase4.apache.org,41535,1676491262190)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/data/default/testWithMapReduce/8a2219c4f89e37dec8687cefabd9fc25/f1/b147a9e48d4e4e39aa9c981c22189d7c, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-15 20:01:09,685 DEBUG [rs(jenkins-hbase4.apache.org,41535,1676491262190)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/data/default/testWithMapReduce/8a2219c4f89e37dec8687cefabd9fc25/.tmp/f2/94652720be85460cba80f932503517b1 as hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/data/default/testWithMapReduce/8a2219c4f89e37dec8687cefabd9fc25/f2/94652720be85460cba80f932503517b1 2023-02-15 20:01:09,690 INFO [rs(jenkins-hbase4.apache.org,41535,1676491262190)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/data/default/testWithMapReduce/aac41416f1d7fc83b90c2b3432a76ce6/f2/fdf07ac3996e436f919b533a96fe4829, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-15 20:01:09,692 INFO [rs(jenkins-hbase4.apache.org,41535,1676491262190)-snapshot-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for aac41416f1d7fc83b90c2b3432a76ce6 in 426ms, sequenceid=5, compaction requested=false 2023-02-15 20:01:09,692 INFO [rs(jenkins-hbase4.apache.org,41535,1676491262190)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/data/default/testWithMapReduce/3506ea931c9649c226fb4c38a5165b6a/f2/1b8744dea70f47e290b386aa438b28ee, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-15 20:01:09,694 INFO [rs(jenkins-hbase4.apache.org,41535,1676491262190)-snapshot-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 3506ea931c9649c226fb4c38a5165b6a in 422ms, sequenceid=5, compaction requested=false 2023-02-15 20:01:09,694 DEBUG [rs(jenkins-hbase4.apache.org,41535,1676491262190)-snapshot-pool-2] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testWithMapReduce' 2023-02-15 20:01:09,694 DEBUG [rs(jenkins-hbase4.apache.org,41535,1676491262190)-snapshot-pool-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testWithMapReduce' 2023-02-15 20:01:09,698 DEBUG [rs(jenkins-hbase4.apache.org,41535,1676491262190)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for aac41416f1d7fc83b90c2b3432a76ce6: 2023-02-15 20:01:09,698 DEBUG [rs(jenkins-hbase4.apache.org,41535,1676491262190)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for 3506ea931c9649c226fb4c38a5165b6a: 2023-02-15 20:01:09,698 DEBUG [rs(jenkins-hbase4.apache.org,41535,1676491262190)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,q\x11\x10,1676491266407.aac41416f1d7fc83b90c2b3432a76ce6.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-15 20:01:09,698 DEBUG [rs(jenkins-hbase4.apache.org,41535,1676491262190)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,g\xA7\xA7,1676491266407.3506ea931c9649c226fb4c38a5165b6a.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-15 20:01:09,698 DEBUG [rs(jenkins-hbase4.apache.org,41535,1676491262190)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-15 20:01:09,698 DEBUG [rs(jenkins-hbase4.apache.org,41535,1676491262190)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-15 20:01:09,698 DEBUG [rs(jenkins-hbase4.apache.org,41535,1676491262190)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/data/default/testWithMapReduce/3506ea931c9649c226fb4c38a5165b6a/f1/584b33569807402bab19c695007854d6] hfiles 2023-02-15 20:01:09,698 DEBUG [rs(jenkins-hbase4.apache.org,41535,1676491262190)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/data/default/testWithMapReduce/aac41416f1d7fc83b90c2b3432a76ce6/f1/9fd9cfca86f946febf2708c1bc10bdbd] hfiles 2023-02-15 20:01:09,698 DEBUG [rs(jenkins-hbase4.apache.org,41535,1676491262190)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/data/default/testWithMapReduce/3506ea931c9649c226fb4c38a5165b6a/f1/584b33569807402bab19c695007854d6 for snapshot=testWithMapReduceMultiRegion 2023-02-15 20:01:09,698 DEBUG [rs(jenkins-hbase4.apache.org,41535,1676491262190)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/data/default/testWithMapReduce/aac41416f1d7fc83b90c2b3432a76ce6/f1/9fd9cfca86f946febf2708c1bc10bdbd for snapshot=testWithMapReduceMultiRegion 2023-02-15 20:01:09,703 DEBUG [rs(jenkins-hbase4.apache.org,41535,1676491262190)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/data/default/testWithMapReduce/3506ea931c9649c226fb4c38a5165b6a/f2/1b8744dea70f47e290b386aa438b28ee] hfiles 2023-02-15 20:01:09,703 DEBUG [rs(jenkins-hbase4.apache.org,41535,1676491262190)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/data/default/testWithMapReduce/aac41416f1d7fc83b90c2b3432a76ce6/f2/fdf07ac3996e436f919b533a96fe4829] hfiles 2023-02-15 20:01:09,704 DEBUG [rs(jenkins-hbase4.apache.org,41535,1676491262190)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/data/default/testWithMapReduce/3506ea931c9649c226fb4c38a5165b6a/f2/1b8744dea70f47e290b386aa438b28ee for snapshot=testWithMapReduceMultiRegion 2023-02-15 20:01:09,704 DEBUG [rs(jenkins-hbase4.apache.org,41535,1676491262190)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/data/default/testWithMapReduce/aac41416f1d7fc83b90c2b3432a76ce6/f2/fdf07ac3996e436f919b533a96fe4829 for snapshot=testWithMapReduceMultiRegion 2023-02-15 20:01:09,706 INFO [rs(jenkins-hbase4.apache.org,41535,1676491262190)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/data/default/testWithMapReduce/8a2219c4f89e37dec8687cefabd9fc25/f2/94652720be85460cba80f932503517b1, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-15 20:01:09,709 INFO [rs(jenkins-hbase4.apache.org,41535,1676491262190)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~158.44 KB/162240, heapSize ~549.72 KB/562912, currentSize=0 B/0 for 8a2219c4f89e37dec8687cefabd9fc25 in 387ms, sequenceid=5, compaction requested=false 2023-02-15 20:01:09,710 DEBUG [rs(jenkins-hbase4.apache.org,41535,1676491262190)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 8a2219c4f89e37dec8687cefabd9fc25: 2023-02-15 20:01:09,710 DEBUG [rs(jenkins-hbase4.apache.org,41535,1676491262190)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,aaa,1676491266407.8a2219c4f89e37dec8687cefabd9fc25.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-15 20:01:09,710 DEBUG [rs(jenkins-hbase4.apache.org,41535,1676491262190)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-15 20:01:09,710 DEBUG [rs(jenkins-hbase4.apache.org,41535,1676491262190)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/data/default/testWithMapReduce/8a2219c4f89e37dec8687cefabd9fc25/f1/b147a9e48d4e4e39aa9c981c22189d7c] hfiles 2023-02-15 20:01:09,710 DEBUG [rs(jenkins-hbase4.apache.org,41535,1676491262190)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/data/default/testWithMapReduce/8a2219c4f89e37dec8687cefabd9fc25/f1/b147a9e48d4e4e39aa9c981c22189d7c for snapshot=testWithMapReduceMultiRegion 2023-02-15 20:01:09,710 DEBUG [rs(jenkins-hbase4.apache.org,41535,1676491262190)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/data/default/testWithMapReduce/8a2219c4f89e37dec8687cefabd9fc25/f2/94652720be85460cba80f932503517b1] hfiles 2023-02-15 20:01:09,710 DEBUG [rs(jenkins-hbase4.apache.org,41535,1676491262190)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/data/default/testWithMapReduce/8a2219c4f89e37dec8687cefabd9fc25/f2/94652720be85460cba80f932503517b1 for snapshot=testWithMapReduceMultiRegion 2023-02-15 20:01:09,737 DEBUG [rs(jenkins-hbase4.apache.org,41535,1676491262190)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,g\xA7\xA7,1676491266407.3506ea931c9649c226fb4c38a5165b6a. completed. 2023-02-15 20:01:09,738 DEBUG [rs(jenkins-hbase4.apache.org,41535,1676491262190)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,g\xA7\xA7,1676491266407.3506ea931c9649c226fb4c38a5165b6a. 2023-02-15 20:01:09,738 DEBUG [rs(jenkins-hbase4.apache.org,41535,1676491262190)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,d\x84\x84,1676491266407.cfff17411e5ee60b92c4b80249237743. 2023-02-15 20:01:09,738 DEBUG [member: 'jenkins-hbase4.apache.org,41535,1676491262190' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 2/5 local region snapshots. 2023-02-15 20:01:09,738 DEBUG [rs(jenkins-hbase4.apache.org,41535,1676491262190)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,d\x84\x84,1676491266407.cfff17411e5ee60b92c4b80249237743. started... 2023-02-15 20:01:09,739 INFO [rs(jenkins-hbase4.apache.org,41535,1676491262190)-snapshot-pool-1] regionserver.HRegion(2744): Flushing cfff17411e5ee60b92c4b80249237743 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-15 20:01:09,740 DEBUG [rs(jenkins-hbase4.apache.org,41535,1676491262190)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,q\x11\x10,1676491266407.aac41416f1d7fc83b90c2b3432a76ce6. completed. 2023-02-15 20:01:09,740 DEBUG [rs(jenkins-hbase4.apache.org,41535,1676491262190)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,q\x11\x10,1676491266407.aac41416f1d7fc83b90c2b3432a76ce6. 2023-02-15 20:01:09,740 DEBUG [rs(jenkins-hbase4.apache.org,41535,1676491262190)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,aaa,1676491266407.8a2219c4f89e37dec8687cefabd9fc25. completed. 2023-02-15 20:01:09,740 DEBUG [rs(jenkins-hbase4.apache.org,41535,1676491262190)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,aaa,1676491266407.8a2219c4f89e37dec8687cefabd9fc25. 2023-02-15 20:01:09,740 DEBUG [member: 'jenkins-hbase4.apache.org,41535,1676491262190' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 3/5 local region snapshots. 2023-02-15 20:01:09,740 DEBUG [member: 'jenkins-hbase4.apache.org,41535,1676491262190' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 4/5 local region snapshots. 2023-02-15 20:01:09,762 INFO [rs(jenkins-hbase4.apache.org,41535,1676491262190)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/data/default/testWithMapReduce/cfff17411e5ee60b92c4b80249237743/.tmp/f1/2b66b94b8cac4024b68e4f193fbadd83 2023-02-15 20:01:09,788 INFO [rs(jenkins-hbase4.apache.org,41535,1676491262190)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/data/default/testWithMapReduce/cfff17411e5ee60b92c4b80249237743/.tmp/f2/a1a93d17faa940fd860aa03d710c0091 2023-02-15 20:01:09,798 DEBUG [rs(jenkins-hbase4.apache.org,41535,1676491262190)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/data/default/testWithMapReduce/cfff17411e5ee60b92c4b80249237743/.tmp/f1/2b66b94b8cac4024b68e4f193fbadd83 as hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/data/default/testWithMapReduce/cfff17411e5ee60b92c4b80249237743/f1/2b66b94b8cac4024b68e4f193fbadd83 2023-02-15 20:01:09,805 INFO [rs(jenkins-hbase4.apache.org,41535,1676491262190)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/data/default/testWithMapReduce/cfff17411e5ee60b92c4b80249237743/f1/2b66b94b8cac4024b68e4f193fbadd83, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-15 20:01:09,806 DEBUG [rs(jenkins-hbase4.apache.org,41535,1676491262190)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/data/default/testWithMapReduce/cfff17411e5ee60b92c4b80249237743/.tmp/f2/a1a93d17faa940fd860aa03d710c0091 as hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/data/default/testWithMapReduce/cfff17411e5ee60b92c4b80249237743/f2/a1a93d17faa940fd860aa03d710c0091 2023-02-15 20:01:09,814 INFO [rs(jenkins-hbase4.apache.org,41535,1676491262190)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/data/default/testWithMapReduce/cfff17411e5ee60b92c4b80249237743/f2/a1a93d17faa940fd860aa03d710c0091, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-15 20:01:09,815 INFO [rs(jenkins-hbase4.apache.org,41535,1676491262190)-snapshot-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for cfff17411e5ee60b92c4b80249237743 in 76ms, sequenceid=5, compaction requested=false 2023-02-15 20:01:09,815 DEBUG [rs(jenkins-hbase4.apache.org,41535,1676491262190)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for cfff17411e5ee60b92c4b80249237743: 2023-02-15 20:01:09,815 DEBUG [rs(jenkins-hbase4.apache.org,41535,1676491262190)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,d\x84\x84,1676491266407.cfff17411e5ee60b92c4b80249237743.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-15 20:01:09,815 DEBUG [rs(jenkins-hbase4.apache.org,41535,1676491262190)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-15 20:01:09,815 DEBUG [rs(jenkins-hbase4.apache.org,41535,1676491262190)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/data/default/testWithMapReduce/cfff17411e5ee60b92c4b80249237743/f1/2b66b94b8cac4024b68e4f193fbadd83] hfiles 2023-02-15 20:01:09,815 DEBUG [rs(jenkins-hbase4.apache.org,41535,1676491262190)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/data/default/testWithMapReduce/cfff17411e5ee60b92c4b80249237743/f1/2b66b94b8cac4024b68e4f193fbadd83 for snapshot=testWithMapReduceMultiRegion 2023-02-15 20:01:09,815 DEBUG [rs(jenkins-hbase4.apache.org,41535,1676491262190)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/data/default/testWithMapReduce/cfff17411e5ee60b92c4b80249237743/f2/a1a93d17faa940fd860aa03d710c0091] hfiles 2023-02-15 20:01:09,815 DEBUG [rs(jenkins-hbase4.apache.org,41535,1676491262190)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/data/default/testWithMapReduce/cfff17411e5ee60b92c4b80249237743/f2/a1a93d17faa940fd860aa03d710c0091 for snapshot=testWithMapReduceMultiRegion 2023-02-15 20:01:09,818 DEBUG [Listener at localhost/37547] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-15 20:01:09,819 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39607] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-15 20:01:09,819 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39607] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-15 20:01:09,820 DEBUG [Listener at localhost/37547] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-02-15 20:01:09,827 DEBUG [rs(jenkins-hbase4.apache.org,41535,1676491262190)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,d\x84\x84,1676491266407.cfff17411e5ee60b92c4b80249237743. completed. 2023-02-15 20:01:09,827 DEBUG [rs(jenkins-hbase4.apache.org,41535,1676491262190)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,d\x84\x84,1676491266407.cfff17411e5ee60b92c4b80249237743. 2023-02-15 20:01:09,827 DEBUG [member: 'jenkins-hbase4.apache.org,41535,1676491262190' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 5/5 local region snapshots. 2023-02-15 20:01:09,827 DEBUG [member: 'jenkins-hbase4.apache.org,41535,1676491262190' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 5 local region snapshots. 2023-02-15 20:01:09,827 DEBUG [member: 'jenkins-hbase4.apache.org,41535,1676491262190' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,41535,1676491262190 2023-02-15 20:01:09,827 DEBUG [member: 'jenkins-hbase4.apache.org,41535,1676491262190' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduceMultiRegion' locally completed 2023-02-15 20:01:09,827 DEBUG [member: 'jenkins-hbase4.apache.org,41535,1676491262190' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduceMultiRegion' completed for member 'jenkins-hbase4.apache.org,41535,1676491262190' in zk 2023-02-15 20:01:09,832 DEBUG [Listener at localhost/37547-EventThread] zookeeper.ZKWatcher(600): master:39607-0x10059926a4e0000, quorum=127.0.0.1:53178, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,41535,1676491262190 2023-02-15 20:01:09,832 DEBUG [member: 'jenkins-hbase4.apache.org,41535,1676491262190' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduceMultiRegion' has notified controller of completion 2023-02-15 20:01:09,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,41535,1676491262190 2023-02-15 20:01:09,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-15 20:01:09,832 DEBUG [member: 'jenkins-hbase4.apache.org,41535,1676491262190' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-15 20:01:09,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-15 20:01:09,832 DEBUG [member: 'jenkins-hbase4.apache.org,41535,1676491262190' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduceMultiRegion' completed. 2023-02-15 20:01:09,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-15 20:01:09,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-15 20:01:09,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-15 20:01:09,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33367,1676491262239 2023-02-15 20:01:09,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41535,1676491262190 2023-02-15 20:01:09,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-15 20:01:09,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-15 20:01:09,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41535,1676491262190 2023-02-15 20:01:09,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduceMultiRegion' member 'jenkins-hbase4.apache.org,41535,1676491262190': 2023-02-15 20:01:09,836 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41535,1676491262190' released barrier for procedure'testWithMapReduceMultiRegion', counting down latch. Waiting for 1 more 2023-02-15 20:01:09,927 INFO [rs(jenkins-hbase4.apache.org,33367,1676491262239)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/data/default/testWithMapReduce/ce146f62338407483a61920d7170f142/.tmp/f1/3b645a76ccc943eca010c41a29ae08c8 2023-02-15 20:01:09,940 INFO [rs(jenkins-hbase4.apache.org,33367,1676491262239)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/data/default/testWithMapReduce/f26f31f3358f9f2d50b3c5d32cc7b35d/.tmp/f1/e9d819bfab2d44ebbd85de59dbaa3ed0 2023-02-15 20:01:09,952 INFO [rs(jenkins-hbase4.apache.org,33367,1676491262239)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/data/default/testWithMapReduce/ce146f62338407483a61920d7170f142/.tmp/f2/995c8facb2294aa3a01a52aea6ce503a 2023-02-15 20:01:09,961 DEBUG [rs(jenkins-hbase4.apache.org,33367,1676491262239)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/data/default/testWithMapReduce/ce146f62338407483a61920d7170f142/.tmp/f1/3b645a76ccc943eca010c41a29ae08c8 as hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/data/default/testWithMapReduce/ce146f62338407483a61920d7170f142/f1/3b645a76ccc943eca010c41a29ae08c8 2023-02-15 20:01:09,969 INFO [rs(jenkins-hbase4.apache.org,33367,1676491262239)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/data/default/testWithMapReduce/f26f31f3358f9f2d50b3c5d32cc7b35d/.tmp/f2/47b72bdb129e429abeee819914e83fb2 2023-02-15 20:01:09,972 INFO [rs(jenkins-hbase4.apache.org,33367,1676491262239)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/data/default/testWithMapReduce/ce146f62338407483a61920d7170f142/f1/3b645a76ccc943eca010c41a29ae08c8, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-15 20:01:09,973 DEBUG [rs(jenkins-hbase4.apache.org,33367,1676491262239)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/data/default/testWithMapReduce/ce146f62338407483a61920d7170f142/.tmp/f2/995c8facb2294aa3a01a52aea6ce503a as hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/data/default/testWithMapReduce/ce146f62338407483a61920d7170f142/f2/995c8facb2294aa3a01a52aea6ce503a 2023-02-15 20:01:09,979 DEBUG [rs(jenkins-hbase4.apache.org,33367,1676491262239)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/data/default/testWithMapReduce/f26f31f3358f9f2d50b3c5d32cc7b35d/.tmp/f1/e9d819bfab2d44ebbd85de59dbaa3ed0 as hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/data/default/testWithMapReduce/f26f31f3358f9f2d50b3c5d32cc7b35d/f1/e9d819bfab2d44ebbd85de59dbaa3ed0 2023-02-15 20:01:09,982 INFO [rs(jenkins-hbase4.apache.org,33367,1676491262239)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/data/default/testWithMapReduce/ce146f62338407483a61920d7170f142/f2/995c8facb2294aa3a01a52aea6ce503a, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-15 20:01:09,983 INFO [rs(jenkins-hbase4.apache.org,33367,1676491262239)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for ce146f62338407483a61920d7170f142 in 713ms, sequenceid=5, compaction requested=false 2023-02-15 20:01:09,983 DEBUG [rs(jenkins-hbase4.apache.org,33367,1676491262239)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for ce146f62338407483a61920d7170f142: 2023-02-15 20:01:09,984 DEBUG [rs(jenkins-hbase4.apache.org,33367,1676491262239)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,t43,1676491266407.ce146f62338407483a61920d7170f142.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-15 20:01:09,984 DEBUG [rs(jenkins-hbase4.apache.org,33367,1676491262239)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-15 20:01:09,984 DEBUG [rs(jenkins-hbase4.apache.org,33367,1676491262239)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/data/default/testWithMapReduce/ce146f62338407483a61920d7170f142/f1/3b645a76ccc943eca010c41a29ae08c8] hfiles 2023-02-15 20:01:09,984 DEBUG [rs(jenkins-hbase4.apache.org,33367,1676491262239)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/data/default/testWithMapReduce/ce146f62338407483a61920d7170f142/f1/3b645a76ccc943eca010c41a29ae08c8 for snapshot=testWithMapReduceMultiRegion 2023-02-15 20:01:09,984 DEBUG [rs(jenkins-hbase4.apache.org,33367,1676491262239)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/data/default/testWithMapReduce/ce146f62338407483a61920d7170f142/f2/995c8facb2294aa3a01a52aea6ce503a] hfiles 2023-02-15 20:01:09,984 DEBUG [rs(jenkins-hbase4.apache.org,33367,1676491262239)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/data/default/testWithMapReduce/ce146f62338407483a61920d7170f142/f2/995c8facb2294aa3a01a52aea6ce503a for snapshot=testWithMapReduceMultiRegion 2023-02-15 20:01:09,988 INFO [rs(jenkins-hbase4.apache.org,33367,1676491262239)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/data/default/testWithMapReduce/f26f31f3358f9f2d50b3c5d32cc7b35d/f1/e9d819bfab2d44ebbd85de59dbaa3ed0, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-15 20:01:09,989 DEBUG [rs(jenkins-hbase4.apache.org,33367,1676491262239)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/data/default/testWithMapReduce/f26f31f3358f9f2d50b3c5d32cc7b35d/.tmp/f2/47b72bdb129e429abeee819914e83fb2 as hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/data/default/testWithMapReduce/f26f31f3358f9f2d50b3c5d32cc7b35d/f2/47b72bdb129e429abeee819914e83fb2 2023-02-15 20:01:09,999 INFO [rs(jenkins-hbase4.apache.org,33367,1676491262239)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/data/default/testWithMapReduce/f26f31f3358f9f2d50b3c5d32cc7b35d/f2/47b72bdb129e429abeee819914e83fb2, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-15 20:01:10,000 INFO [rs(jenkins-hbase4.apache.org,33367,1676491262239)-snapshot-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for f26f31f3358f9f2d50b3c5d32cc7b35d in 730ms, sequenceid=5, compaction requested=false 2023-02-15 20:01:10,002 DEBUG [rs(jenkins-hbase4.apache.org,33367,1676491262239)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for f26f31f3358f9f2d50b3c5d32cc7b35d: 2023-02-15 20:01:10,002 DEBUG [rs(jenkins-hbase4.apache.org,33367,1676491262239)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,m\xED\xED,1676491266407.f26f31f3358f9f2d50b3c5d32cc7b35d.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-15 20:01:10,002 DEBUG [rs(jenkins-hbase4.apache.org,33367,1676491262239)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-15 20:01:10,002 DEBUG [rs(jenkins-hbase4.apache.org,33367,1676491262239)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/data/default/testWithMapReduce/f26f31f3358f9f2d50b3c5d32cc7b35d/f1/e9d819bfab2d44ebbd85de59dbaa3ed0] hfiles 2023-02-15 20:01:10,002 DEBUG [rs(jenkins-hbase4.apache.org,33367,1676491262239)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/data/default/testWithMapReduce/f26f31f3358f9f2d50b3c5d32cc7b35d/f1/e9d819bfab2d44ebbd85de59dbaa3ed0 for snapshot=testWithMapReduceMultiRegion 2023-02-15 20:01:10,003 DEBUG [rs(jenkins-hbase4.apache.org,33367,1676491262239)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/data/default/testWithMapReduce/f26f31f3358f9f2d50b3c5d32cc7b35d/f2/47b72bdb129e429abeee819914e83fb2] hfiles 2023-02-15 20:01:10,003 DEBUG [rs(jenkins-hbase4.apache.org,33367,1676491262239)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/data/default/testWithMapReduce/f26f31f3358f9f2d50b3c5d32cc7b35d/f2/47b72bdb129e429abeee819914e83fb2 for snapshot=testWithMapReduceMultiRegion 2023-02-15 20:01:10,005 DEBUG [rs(jenkins-hbase4.apache.org,33367,1676491262239)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,t43,1676491266407.ce146f62338407483a61920d7170f142. completed. 2023-02-15 20:01:10,005 DEBUG [rs(jenkins-hbase4.apache.org,33367,1676491262239)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,t43,1676491266407.ce146f62338407483a61920d7170f142. 2023-02-15 20:01:10,005 DEBUG [rs(jenkins-hbase4.apache.org,33367,1676491262239)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,j\xCA\xCA,1676491266407.30b6672c9889bbc2cc2b417a34f3f49e. 2023-02-15 20:01:10,005 DEBUG [member: 'jenkins-hbase4.apache.org,33367,1676491262239' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/5 local region snapshots. 2023-02-15 20:01:10,005 DEBUG [rs(jenkins-hbase4.apache.org,33367,1676491262239)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,j\xCA\xCA,1676491266407.30b6672c9889bbc2cc2b417a34f3f49e. started... 2023-02-15 20:01:10,006 INFO [rs(jenkins-hbase4.apache.org,33367,1676491262239)-snapshot-pool-0] regionserver.HRegion(2744): Flushing 30b6672c9889bbc2cc2b417a34f3f49e 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-15 20:01:10,022 INFO [rs(jenkins-hbase4.apache.org,33367,1676491262239)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/data/default/testWithMapReduce/30b6672c9889bbc2cc2b417a34f3f49e/.tmp/f1/ec2992e2ea234979a8399c1be6782eb8 2023-02-15 20:01:10,048 INFO [rs(jenkins-hbase4.apache.org,33367,1676491262239)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/data/default/testWithMapReduce/30b6672c9889bbc2cc2b417a34f3f49e/.tmp/f2/7f7ba19388734301a91db45ebb2ab429 2023-02-15 20:01:10,050 INFO [rs(jenkins-hbase4.apache.org,33367,1676491262239)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/data/default/testWithMapReduce/da7189167b0a5e71ebfc52ccf8240947/.tmp/f2/305eda5d270a4058a64e4c581a9ab11d 2023-02-15 20:01:10,056 DEBUG [rs(jenkins-hbase4.apache.org,33367,1676491262239)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/data/default/testWithMapReduce/30b6672c9889bbc2cc2b417a34f3f49e/.tmp/f1/ec2992e2ea234979a8399c1be6782eb8 as hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/data/default/testWithMapReduce/30b6672c9889bbc2cc2b417a34f3f49e/f1/ec2992e2ea234979a8399c1be6782eb8 2023-02-15 20:01:10,064 INFO [rs(jenkins-hbase4.apache.org,33367,1676491262239)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/data/default/testWithMapReduce/30b6672c9889bbc2cc2b417a34f3f49e/f1/ec2992e2ea234979a8399c1be6782eb8, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-15 20:01:10,066 DEBUG [rs(jenkins-hbase4.apache.org,33367,1676491262239)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/data/default/testWithMapReduce/30b6672c9889bbc2cc2b417a34f3f49e/.tmp/f2/7f7ba19388734301a91db45ebb2ab429 as hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/data/default/testWithMapReduce/30b6672c9889bbc2cc2b417a34f3f49e/f2/7f7ba19388734301a91db45ebb2ab429 2023-02-15 20:01:10,072 DEBUG [rs(jenkins-hbase4.apache.org,33367,1676491262239)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/data/default/testWithMapReduce/da7189167b0a5e71ebfc52ccf8240947/.tmp/f1/b19871dfbf874f2d814f559e617022a3 as hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/data/default/testWithMapReduce/da7189167b0a5e71ebfc52ccf8240947/f1/b19871dfbf874f2d814f559e617022a3 2023-02-15 20:01:10,078 INFO [rs(jenkins-hbase4.apache.org,33367,1676491262239)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/data/default/testWithMapReduce/30b6672c9889bbc2cc2b417a34f3f49e/f2/7f7ba19388734301a91db45ebb2ab429, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-15 20:01:10,086 INFO [rs(jenkins-hbase4.apache.org,33367,1676491262239)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/data/default/testWithMapReduce/da7189167b0a5e71ebfc52ccf8240947/f1/b19871dfbf874f2d814f559e617022a3, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-15 20:01:10,087 DEBUG [rs(jenkins-hbase4.apache.org,33367,1676491262239)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/data/default/testWithMapReduce/da7189167b0a5e71ebfc52ccf8240947/.tmp/f2/305eda5d270a4058a64e4c581a9ab11d as hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/data/default/testWithMapReduce/da7189167b0a5e71ebfc52ccf8240947/f2/305eda5d270a4058a64e4c581a9ab11d 2023-02-15 20:01:10,088 INFO [rs(jenkins-hbase4.apache.org,33367,1676491262239)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 30b6672c9889bbc2cc2b417a34f3f49e in 82ms, sequenceid=5, compaction requested=false 2023-02-15 20:01:10,088 DEBUG [rs(jenkins-hbase4.apache.org,33367,1676491262239)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 30b6672c9889bbc2cc2b417a34f3f49e: 2023-02-15 20:01:10,088 DEBUG [rs(jenkins-hbase4.apache.org,33367,1676491262239)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,j\xCA\xCA,1676491266407.30b6672c9889bbc2cc2b417a34f3f49e.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-15 20:01:10,088 DEBUG [rs(jenkins-hbase4.apache.org,33367,1676491262239)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-15 20:01:10,089 DEBUG [rs(jenkins-hbase4.apache.org,33367,1676491262239)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/data/default/testWithMapReduce/30b6672c9889bbc2cc2b417a34f3f49e/f1/ec2992e2ea234979a8399c1be6782eb8] hfiles 2023-02-15 20:01:10,089 DEBUG [rs(jenkins-hbase4.apache.org,33367,1676491262239)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/data/default/testWithMapReduce/30b6672c9889bbc2cc2b417a34f3f49e/f1/ec2992e2ea234979a8399c1be6782eb8 for snapshot=testWithMapReduceMultiRegion 2023-02-15 20:01:10,089 DEBUG [rs(jenkins-hbase4.apache.org,33367,1676491262239)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/data/default/testWithMapReduce/30b6672c9889bbc2cc2b417a34f3f49e/f2/7f7ba19388734301a91db45ebb2ab429] hfiles 2023-02-15 20:01:10,089 DEBUG [rs(jenkins-hbase4.apache.org,33367,1676491262239)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/data/default/testWithMapReduce/30b6672c9889bbc2cc2b417a34f3f49e/f2/7f7ba19388734301a91db45ebb2ab429 for snapshot=testWithMapReduceMultiRegion 2023-02-15 20:01:10,104 INFO [rs(jenkins-hbase4.apache.org,33367,1676491262239)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/data/default/testWithMapReduce/da7189167b0a5e71ebfc52ccf8240947/f2/305eda5d270a4058a64e4c581a9ab11d, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-15 20:01:10,105 INFO [rs(jenkins-hbase4.apache.org,33367,1676491262239)-snapshot-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~158.44 KB/162240, heapSize ~549.72 KB/562912, currentSize=0 B/0 for da7189167b0a5e71ebfc52ccf8240947 in 836ms, sequenceid=5, compaction requested=false 2023-02-15 20:01:10,105 DEBUG [rs(jenkins-hbase4.apache.org,33367,1676491262239)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for da7189167b0a5e71ebfc52ccf8240947: 2023-02-15 20:01:10,106 DEBUG [rs(jenkins-hbase4.apache.org,33367,1676491262239)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,wWV,1676491266407.da7189167b0a5e71ebfc52ccf8240947.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-15 20:01:10,106 DEBUG [rs(jenkins-hbase4.apache.org,33367,1676491262239)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-15 20:01:10,106 DEBUG [rs(jenkins-hbase4.apache.org,33367,1676491262239)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/data/default/testWithMapReduce/da7189167b0a5e71ebfc52ccf8240947/f1/b19871dfbf874f2d814f559e617022a3] hfiles 2023-02-15 20:01:10,106 DEBUG [rs(jenkins-hbase4.apache.org,33367,1676491262239)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/data/default/testWithMapReduce/da7189167b0a5e71ebfc52ccf8240947/f1/b19871dfbf874f2d814f559e617022a3 for snapshot=testWithMapReduceMultiRegion 2023-02-15 20:01:10,106 DEBUG [rs(jenkins-hbase4.apache.org,33367,1676491262239)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/data/default/testWithMapReduce/da7189167b0a5e71ebfc52ccf8240947/f2/305eda5d270a4058a64e4c581a9ab11d] hfiles 2023-02-15 20:01:10,106 DEBUG [rs(jenkins-hbase4.apache.org,33367,1676491262239)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/data/default/testWithMapReduce/da7189167b0a5e71ebfc52ccf8240947/f2/305eda5d270a4058a64e4c581a9ab11d for snapshot=testWithMapReduceMultiRegion 2023-02-15 20:01:10,114 DEBUG [rs(jenkins-hbase4.apache.org,33367,1676491262239)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,j\xCA\xCA,1676491266407.30b6672c9889bbc2cc2b417a34f3f49e. completed. 2023-02-15 20:01:10,114 DEBUG [rs(jenkins-hbase4.apache.org,33367,1676491262239)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,j\xCA\xCA,1676491266407.30b6672c9889bbc2cc2b417a34f3f49e. 2023-02-15 20:01:10,115 DEBUG [rs(jenkins-hbase4.apache.org,33367,1676491262239)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,,1676491266407.77b8837eb0dd784edf4b0582f0ba0a3f. 2023-02-15 20:01:10,115 DEBUG [member: 'jenkins-hbase4.apache.org,33367,1676491262239' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 2/5 local region snapshots. 2023-02-15 20:01:10,115 DEBUG [rs(jenkins-hbase4.apache.org,33367,1676491262239)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,,1676491266407.77b8837eb0dd784edf4b0582f0ba0a3f. started... 2023-02-15 20:01:10,116 DEBUG [rs(jenkins-hbase4.apache.org,33367,1676491262239)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 77b8837eb0dd784edf4b0582f0ba0a3f: 2023-02-15 20:01:10,116 DEBUG [rs(jenkins-hbase4.apache.org,33367,1676491262239)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,,1676491266407.77b8837eb0dd784edf4b0582f0ba0a3f.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-15 20:01:10,116 DEBUG [rs(jenkins-hbase4.apache.org,33367,1676491262239)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-15 20:01:10,116 DEBUG [rs(jenkins-hbase4.apache.org,33367,1676491262239)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-15 20:01:10,116 DEBUG [rs(jenkins-hbase4.apache.org,33367,1676491262239)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-15 20:01:10,154 DEBUG [rs(jenkins-hbase4.apache.org,33367,1676491262239)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,wWV,1676491266407.da7189167b0a5e71ebfc52ccf8240947. completed. 2023-02-15 20:01:10,154 DEBUG [rs(jenkins-hbase4.apache.org,33367,1676491262239)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,wWV,1676491266407.da7189167b0a5e71ebfc52ccf8240947. 2023-02-15 20:01:10,154 DEBUG [member: 'jenkins-hbase4.apache.org,33367,1676491262239' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 3/5 local region snapshots. 2023-02-15 20:01:10,163 DEBUG [rs(jenkins-hbase4.apache.org,33367,1676491262239)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,,1676491266407.77b8837eb0dd784edf4b0582f0ba0a3f. completed. 2023-02-15 20:01:10,163 DEBUG [rs(jenkins-hbase4.apache.org,33367,1676491262239)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,,1676491266407.77b8837eb0dd784edf4b0582f0ba0a3f. 2023-02-15 20:01:10,163 DEBUG [member: 'jenkins-hbase4.apache.org,33367,1676491262239' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 4/5 local region snapshots. 2023-02-15 20:01:10,320 DEBUG [Listener at localhost/37547] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-15 20:01:10,322 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39607] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-15 20:01:10,322 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39607] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-15 20:01:10,323 DEBUG [Listener at localhost/37547] client.HBaseAdmin(2428): (#5) Sleeping: 1000ms while waiting for snapshot completion. 2023-02-15 20:01:10,416 DEBUG [rs(jenkins-hbase4.apache.org,33367,1676491262239)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,m\xED\xED,1676491266407.f26f31f3358f9f2d50b3c5d32cc7b35d. completed. 2023-02-15 20:01:10,416 DEBUG [rs(jenkins-hbase4.apache.org,33367,1676491262239)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,m\xED\xED,1676491266407.f26f31f3358f9f2d50b3c5d32cc7b35d. 2023-02-15 20:01:10,416 DEBUG [member: 'jenkins-hbase4.apache.org,33367,1676491262239' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 5/5 local region snapshots. 2023-02-15 20:01:10,416 DEBUG [member: 'jenkins-hbase4.apache.org,33367,1676491262239' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 5 local region snapshots. 2023-02-15 20:01:10,416 DEBUG [member: 'jenkins-hbase4.apache.org,33367,1676491262239' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,33367,1676491262239 2023-02-15 20:01:10,416 DEBUG [member: 'jenkins-hbase4.apache.org,33367,1676491262239' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduceMultiRegion' locally completed 2023-02-15 20:01:10,416 DEBUG [member: 'jenkins-hbase4.apache.org,33367,1676491262239' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduceMultiRegion' completed for member 'jenkins-hbase4.apache.org,33367,1676491262239' in zk 2023-02-15 20:01:10,419 DEBUG [Listener at localhost/37547-EventThread] zookeeper.ZKWatcher(600): master:39607-0x10059926a4e0000, quorum=127.0.0.1:53178, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,33367,1676491262239 2023-02-15 20:01:10,419 DEBUG [member: 'jenkins-hbase4.apache.org,33367,1676491262239' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduceMultiRegion' has notified controller of completion 2023-02-15 20:01:10,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,33367,1676491262239 2023-02-15 20:01:10,419 DEBUG [member: 'jenkins-hbase4.apache.org,33367,1676491262239' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-15 20:01:10,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-15 20:01:10,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-15 20:01:10,419 DEBUG [member: 'jenkins-hbase4.apache.org,33367,1676491262239' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduceMultiRegion' completed. 2023-02-15 20:01:10,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-15 20:01:10,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-15 20:01:10,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-15 20:01:10,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33367,1676491262239 2023-02-15 20:01:10,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41535,1676491262190 2023-02-15 20:01:10,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-15 20:01:10,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-15 20:01:10,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33367,1676491262239 2023-02-15 20:01:10,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41535,1676491262190 2023-02-15 20:01:10,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduceMultiRegion' member 'jenkins-hbase4.apache.org,33367,1676491262239': 2023-02-15 20:01:10,425 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,33367,1676491262239' released barrier for procedure'testWithMapReduceMultiRegion', counting down latch. Waiting for 0 more 2023-02-15 20:01:10,425 INFO [(jenkins-hbase4.apache.org,39607,1676491260960)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMapReduceMultiRegion' execution completed 2023-02-15 20:01:10,425 DEBUG [(jenkins-hbase4.apache.org,39607,1676491260960)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-15 20:01:10,425 DEBUG [(jenkins-hbase4.apache.org,39607,1676491260960)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-15 20:01:10,425 DEBUG [(jenkins-hbase4.apache.org,39607,1676491260960)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMapReduceMultiRegion 2023-02-15 20:01:10,425 INFO [(jenkins-hbase4.apache.org,39607,1676491260960)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMapReduceMultiRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-02-15 20:01:10,428 DEBUG [Listener at localhost/37547-EventThread] zookeeper.ZKWatcher(600): regionserver:33367-0x10059926a4e0002, quorum=127.0.0.1:53178, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-15 20:01:10,428 DEBUG [Listener at localhost/37547-EventThread] zookeeper.ZKWatcher(600): regionserver:41535-0x10059926a4e0001, quorum=127.0.0.1:53178, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-15 20:01:10,428 DEBUG [Listener at localhost/37547-EventThread] zookeeper.ZKWatcher(600): regionserver:33367-0x10059926a4e0002, quorum=127.0.0.1:53178, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-15 20:01:10,428 DEBUG [Listener at localhost/37547-EventThread] zookeeper.ZKWatcher(600): regionserver:41535-0x10059926a4e0001, quorum=127.0.0.1:53178, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-15 20:01:10,428 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-15 20:01:10,428 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-15 20:01:10,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-15 20:01:10,428 DEBUG [Listener at localhost/37547-EventThread] zookeeper.ZKWatcher(600): master:39607-0x10059926a4e0000, quorum=127.0.0.1:53178, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-15 20:01:10,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-15 20:01:10,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-15 20:01:10,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-15 20:01:10,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-15 20:01:10,429 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-15 20:01:10,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-15 20:01:10,429 DEBUG [(jenkins-hbase4.apache.org,39607,1676491260960)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39607-0x10059926a4e0000, quorum=127.0.0.1:53178, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,33367,1676491262239 2023-02-15 20:01:10,429 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-15 20:01:10,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-15 20:01:10,429 DEBUG [(jenkins-hbase4.apache.org,39607,1676491260960)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39607-0x10059926a4e0000, quorum=127.0.0.1:53178, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,41535,1676491262190 2023-02-15 20:01:10,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-15 20:01:10,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-15 20:01:10,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-15 20:01:10,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-15 20:01:10,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-15 20:01:10,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-15 20:01:10,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33367,1676491262239 2023-02-15 20:01:10,432 DEBUG [(jenkins-hbase4.apache.org,39607,1676491260960)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39607-0x10059926a4e0000, quorum=127.0.0.1:53178, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,33367,1676491262239 2023-02-15 20:01:10,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41535,1676491262190 2023-02-15 20:01:10,432 DEBUG [(jenkins-hbase4.apache.org,39607,1676491260960)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39607-0x10059926a4e0000, quorum=127.0.0.1:53178, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,41535,1676491262190 2023-02-15 20:01:10,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-15 20:01:10,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-15 20:01:10,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33367,1676491262239 2023-02-15 20:01:10,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41535,1676491262190 2023-02-15 20:01:10,446 DEBUG [Listener at localhost/37547-EventThread] zookeeper.ZKWatcher(600): master:39607-0x10059926a4e0000, quorum=127.0.0.1:53178, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,41535,1676491262190 2023-02-15 20:01:10,446 DEBUG [Listener at localhost/37547-EventThread] zookeeper.ZKWatcher(600): regionserver:41535-0x10059926a4e0001, quorum=127.0.0.1:53178, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-15 20:01:10,446 DEBUG [Listener at localhost/37547-EventThread] zookeeper.ZKWatcher(600): master:39607-0x10059926a4e0000, quorum=127.0.0.1:53178, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion 2023-02-15 20:01:10,446 DEBUG [Listener at localhost/37547-EventThread] zookeeper.ZKWatcher(600): regionserver:41535-0x10059926a4e0001, quorum=127.0.0.1:53178, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-15 20:01:10,446 DEBUG [Listener at localhost/37547-EventThread] zookeeper.ZKWatcher(600): regionserver:33367-0x10059926a4e0002, quorum=127.0.0.1:53178, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-15 20:01:10,446 DEBUG [(jenkins-hbase4.apache.org,39607,1676491260960)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-15 20:01:10,446 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for testWithMapReduceMultiRegion 2023-02-15 20:01:10,446 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-15 20:01:10,446 DEBUG [Listener at localhost/37547-EventThread] zookeeper.ZKWatcher(600): regionserver:33367-0x10059926a4e0002, quorum=127.0.0.1:53178, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-15 20:01:10,446 DEBUG [Listener at localhost/37547-EventThread] zookeeper.ZKWatcher(600): master:39607-0x10059926a4e0000, quorum=127.0.0.1:53178, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,33367,1676491262239 2023-02-15 20:01:10,446 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-15 20:01:10,447 DEBUG [Listener at localhost/37547-EventThread] zookeeper.ZKWatcher(600): master:39607-0x10059926a4e0000, quorum=127.0.0.1:53178, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion 2023-02-15 20:01:10,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-15 20:01:10,447 DEBUG [Listener at localhost/37547-EventThread] zookeeper.ZKWatcher(600): master:39607-0x10059926a4e0000, quorum=127.0.0.1:53178, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,41535,1676491262190 2023-02-15 20:01:10,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-15 20:01:10,447 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for testWithMapReduceMultiRegion 2023-02-15 20:01:10,447 DEBUG [Listener at localhost/37547-EventThread] zookeeper.ZKWatcher(600): master:39607-0x10059926a4e0000, quorum=127.0.0.1:53178, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-15 20:01:10,447 DEBUG [Listener at localhost/37547-EventThread] zookeeper.ZKWatcher(600): master:39607-0x10059926a4e0000, quorum=127.0.0.1:53178, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,33367,1676491262239 2023-02-15 20:01:10,447 DEBUG [Listener at localhost/37547-EventThread] zookeeper.ZKWatcher(600): master:39607-0x10059926a4e0000, quorum=127.0.0.1:53178, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-15 20:01:10,447 DEBUG [Listener at localhost/37547-EventThread] zookeeper.ZKWatcher(600): master:39607-0x10059926a4e0000, quorum=127.0.0.1:53178, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-15 20:01:10,447 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-15 20:01:10,447 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-15 20:01:10,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-15 20:01:10,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-15 20:01:10,450 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/.hbase-snapshot/.tmp/testWithMapReduceMultiRegion 2023-02-15 20:01:10,522 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/.hbase-snapshot/.tmp/testWithMapReduceMultiRegion to hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/.hbase-snapshot/testWithMapReduceMultiRegion 2023-02-15 20:01:10,549 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot testWithMapReduceMultiRegion of table testWithMapReduce completed 2023-02-15 20:01:10,550 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/.hbase-snapshot/.tmp/testWithMapReduceMultiRegion 2023-02-15 20:01:10,550 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/.hbase-snapshot/.tmp/testWithMapReduceMultiRegion 2023-02-15 20:01:10,550 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot testWithMapReduceMultiRegion C_M_SNAPSHOT_TABLE on table testWithMapReduce at 1676491269197Consolidate snapshot: testWithMapReduceMultiRegion at 1676491270447 (+1250 ms)Loading Region manifests for testWithMapReduceMultiRegion at 1676491270447Writing data manifest for testWithMapReduceMultiRegion at 1676491270467 (+20 ms)Verifying snapshot: testWithMapReduceMultiRegion at 1676491270489 (+22 ms)Snapshot testWithMapReduceMultiRegion of table testWithMapReduce completed at 1676491270549 (+60 ms) 2023-02-15 20:01:10,551 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=32, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-15 20:01:10,554 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=32, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED in 1.3530 sec 2023-02-15 20:01:10,678 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-02-15 20:01:10,735 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-02-15 20:01:10,736 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-02-15 20:01:11,114 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-15 20:01:11,115 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2023-02-15 20:01:11,323 DEBUG [Listener at localhost/37547] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-15 20:01:11,324 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39607] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-15 20:01:11,324 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39607] snapshot.SnapshotManager(401): Snapshot '{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' has completed, notifying client. 2023-02-15 20:01:11,325 INFO [Listener at localhost/37547] snapshot.SnapshotTestingUtils(399): Confirming snapshot exists. 2023-02-15 20:01:11,338 INFO [Listener at localhost/37547] snapshot.SnapshotTestingUtils(406): validating snapshot. 2023-02-15 20:01:11,353 INFO [Listener at localhost/37547] mapreduce.TableSnapshotInputFormatTestBase(218): load different values 2023-02-15 20:01:11,437 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41535] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 8788 Client: jenkins//172.31.14.131 first region in multi=testWithMapReduce,aaa,1676491266407.8a2219c4f89e37dec8687cefabd9fc25. 2023-02-15 20:01:11,443 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33367] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 8788 Client: jenkins//172.31.14.131 first region in multi=testWithMapReduce,j\xCA\xCA,1676491266407.30b6672c9889bbc2cc2b417a34f3f49e. 2023-02-15 20:01:11,618 INFO [Listener at localhost/37547] mapreduce.TableSnapshotInputFormatTestBase(222): cause flush to create new files in the region 2023-02-15 20:01:11,634 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39607] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-15 20:01:11,645 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39607] procedure.ProcedureCoordinator(165): Submitting procedure testWithMapReduce 2023-02-15 20:01:11,646 INFO [(jenkins-hbase4.apache.org,39607,1676491260960)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMapReduce' 2023-02-15 20:01:11,646 DEBUG [(jenkins-hbase4.apache.org,39607,1676491260960)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-15 20:01:11,647 DEBUG [(jenkins-hbase4.apache.org,39607,1676491260960)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMapReduce' starting 'acquire' 2023-02-15 20:01:11,647 DEBUG [(jenkins-hbase4.apache.org,39607,1676491260960)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMapReduce', kicking off acquire phase on members. 2023-02-15 20:01:11,648 DEBUG [(jenkins-hbase4.apache.org,39607,1676491260960)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39607-0x10059926a4e0000, quorum=127.0.0.1:53178, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-15 20:01:11,648 DEBUG [(jenkins-hbase4.apache.org,39607,1676491260960)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-15 20:01:11,649 DEBUG [Listener at localhost/37547-EventThread] zookeeper.ZKWatcher(600): regionserver:33367-0x10059926a4e0002, quorum=127.0.0.1:53178, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-15 20:01:11,650 DEBUG [Listener at localhost/37547-EventThread] zookeeper.ZKWatcher(600): regionserver:41535-0x10059926a4e0001, quorum=127.0.0.1:53178, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-15 20:01:11,650 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-15 20:01:11,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-15 20:01:11,650 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-15 20:01:11,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-15 20:01:11,650 DEBUG [(jenkins-hbase4.apache.org,39607,1676491260960)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,33367,1676491262239 2023-02-15 20:01:11,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-15 20:01:11,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-15 20:01:11,651 DEBUG [(jenkins-hbase4.apache.org,39607,1676491260960)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39607-0x10059926a4e0000, quorum=127.0.0.1:53178, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,33367,1676491262239 2023-02-15 20:01:11,651 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41535-0x10059926a4e0001, quorum=127.0.0.1:53178, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-15 20:01:11,651 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33367-0x10059926a4e0002, quorum=127.0.0.1:53178, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-15 20:01:11,651 DEBUG [(jenkins-hbase4.apache.org,39607,1676491260960)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,41535,1676491262190 2023-02-15 20:01:11,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-15 20:01:11,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-15 20:01:11,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-15 20:01:11,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-15 20:01:11,652 DEBUG [(jenkins-hbase4.apache.org,39607,1676491260960)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39607-0x10059926a4e0000, quorum=127.0.0.1:53178, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,41535,1676491262190 2023-02-15 20:01:11,652 DEBUG [(jenkins-hbase4.apache.org,39607,1676491260960)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-15 20:01:11,652 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMapReduce 2023-02-15 20:01:11,652 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMapReduce 2023-02-15 20:01:11,654 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduce 2023-02-15 20:01:11,654 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduce 2023-02-15 20:01:11,654 DEBUG [member: 'jenkins-hbase4.apache.org,41535,1676491262190' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduce' with timeout 60000ms 2023-02-15 20:01:11,655 DEBUG [member: 'jenkins-hbase4.apache.org,41535,1676491262190' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-15 20:01:11,656 DEBUG [member: 'jenkins-hbase4.apache.org,41535,1676491262190' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduce' starting 'acquire' stage 2023-02-15 20:01:11,657 DEBUG [member: 'jenkins-hbase4.apache.org,33367,1676491262239' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduce' with timeout 60000ms 2023-02-15 20:01:11,657 DEBUG [member: 'jenkins-hbase4.apache.org,33367,1676491262239' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-15 20:01:11,657 DEBUG [member: 'jenkins-hbase4.apache.org,33367,1676491262239' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduce' starting 'acquire' stage 2023-02-15 20:01:11,658 DEBUG [rs(jenkins-hbase4.apache.org,33367,1676491262239)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,t43,1676491266407.ce146f62338407483a61920d7170f142. 2023-02-15 20:01:11,658 DEBUG [rs(jenkins-hbase4.apache.org,33367,1676491262239)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,t43,1676491266407.ce146f62338407483a61920d7170f142. started... 2023-02-15 20:01:11,658 DEBUG [rs(jenkins-hbase4.apache.org,41535,1676491262190)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,zz{,1676491266407.f5c7d59a05e094a402144fe6a2d882f0. 2023-02-15 20:01:11,658 INFO [rs(jenkins-hbase4.apache.org,33367,1676491262239)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing ce146f62338407483a61920d7170f142 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-15 20:01:11,658 DEBUG [rs(jenkins-hbase4.apache.org,41535,1676491262190)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,zz{,1676491266407.f5c7d59a05e094a402144fe6a2d882f0. started... 2023-02-15 20:01:11,659 DEBUG [rs(jenkins-hbase4.apache.org,41535,1676491262190)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for f5c7d59a05e094a402144fe6a2d882f0: 2023-02-15 20:01:11,659 DEBUG [rs(jenkins-hbase4.apache.org,41535,1676491262190)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,zz{,1676491266407.f5c7d59a05e094a402144fe6a2d882f0. 2023-02-15 20:01:11,659 DEBUG [rs(jenkins-hbase4.apache.org,41535,1676491262190)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,q\x11\x10,1676491266407.aac41416f1d7fc83b90c2b3432a76ce6. 2023-02-15 20:01:11,659 DEBUG [rs(jenkins-hbase4.apache.org,41535,1676491262190)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,q\x11\x10,1676491266407.aac41416f1d7fc83b90c2b3432a76ce6. started... 2023-02-15 20:01:11,659 DEBUG [rs(jenkins-hbase4.apache.org,41535,1676491262190)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,g\xA7\xA7,1676491266407.3506ea931c9649c226fb4c38a5165b6a. 2023-02-15 20:01:11,660 DEBUG [rs(jenkins-hbase4.apache.org,41535,1676491262190)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,g\xA7\xA7,1676491266407.3506ea931c9649c226fb4c38a5165b6a. started... 2023-02-15 20:01:11,660 INFO [rs(jenkins-hbase4.apache.org,41535,1676491262190)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing aac41416f1d7fc83b90c2b3432a76ce6 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-15 20:01:11,660 INFO [rs(jenkins-hbase4.apache.org,41535,1676491262190)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 3506ea931c9649c226fb4c38a5165b6a 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-15 20:01:11,664 DEBUG [rs(jenkins-hbase4.apache.org,33367,1676491262239)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,m\xED\xED,1676491266407.f26f31f3358f9f2d50b3c5d32cc7b35d. 2023-02-15 20:01:11,664 DEBUG [rs(jenkins-hbase4.apache.org,33367,1676491262239)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,m\xED\xED,1676491266407.f26f31f3358f9f2d50b3c5d32cc7b35d. started... 2023-02-15 20:01:11,664 INFO [rs(jenkins-hbase4.apache.org,33367,1676491262239)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing f26f31f3358f9f2d50b3c5d32cc7b35d 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-15 20:01:11,665 DEBUG [member: 'jenkins-hbase4.apache.org,33367,1676491262239' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 5 regions 2023-02-15 20:01:11,665 DEBUG [rs(jenkins-hbase4.apache.org,41535,1676491262190)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,aaa,1676491266407.8a2219c4f89e37dec8687cefabd9fc25. 2023-02-15 20:01:11,665 DEBUG [member: 'jenkins-hbase4.apache.org,33367,1676491262239' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-15 20:01:11,665 DEBUG [member: 'jenkins-hbase4.apache.org,41535,1676491262190' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 5 regions 2023-02-15 20:01:11,666 DEBUG [rs(jenkins-hbase4.apache.org,33367,1676491262239)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,wWV,1676491266407.da7189167b0a5e71ebfc52ccf8240947. 2023-02-15 20:01:11,669 DEBUG [rs(jenkins-hbase4.apache.org,33367,1676491262239)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,wWV,1676491266407.da7189167b0a5e71ebfc52ccf8240947. started... 2023-02-15 20:01:11,666 DEBUG [member: 'jenkins-hbase4.apache.org,41535,1676491262190' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-15 20:01:11,669 DEBUG [member: 'jenkins-hbase4.apache.org,41535,1676491262190' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/5 local region flush tasks. 2023-02-15 20:01:11,666 DEBUG [rs(jenkins-hbase4.apache.org,41535,1676491262190)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,aaa,1676491266407.8a2219c4f89e37dec8687cefabd9fc25. started... 2023-02-15 20:01:11,669 INFO [rs(jenkins-hbase4.apache.org,33367,1676491262239)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing da7189167b0a5e71ebfc52ccf8240947 2/2 column families, dataSize=248.22 KB heapSize=634.25 KB 2023-02-15 20:01:11,669 INFO [rs(jenkins-hbase4.apache.org,41535,1676491262190)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 8a2219c4f89e37dec8687cefabd9fc25 2/2 column families, dataSize=248.22 KB heapSize=634.25 KB 2023-02-15 20:01:11,790 INFO [rs(jenkins-hbase4.apache.org,41535,1676491262190)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/data/default/testWithMapReduce/8a2219c4f89e37dec8687cefabd9fc25/.tmp/f1/eb9c2a0eb1a74c45ae7e4c7171c4590e 2023-02-15 20:01:11,792 INFO [rs(jenkins-hbase4.apache.org,33367,1676491262239)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/data/default/testWithMapReduce/ce146f62338407483a61920d7170f142/.tmp/f1/7712cf3c394d4f768b4b03d288f6a1ed 2023-02-15 20:01:11,797 INFO [rs(jenkins-hbase4.apache.org,41535,1676491262190)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/data/default/testWithMapReduce/3506ea931c9649c226fb4c38a5165b6a/.tmp/f1/6717a82d1b7c4defb86c5f60eab3cf11 2023-02-15 20:01:11,800 INFO [rs(jenkins-hbase4.apache.org,33367,1676491262239)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/data/default/testWithMapReduce/f26f31f3358f9f2d50b3c5d32cc7b35d/.tmp/f1/28443b8834a64448a36d76603a7bc046 2023-02-15 20:01:11,801 INFO [rs(jenkins-hbase4.apache.org,33367,1676491262239)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/data/default/testWithMapReduce/da7189167b0a5e71ebfc52ccf8240947/.tmp/f1/e199c168d268415c9a4609ae9b2e3670 2023-02-15 20:01:11,850 INFO [rs(jenkins-hbase4.apache.org,33367,1676491262239)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/data/default/testWithMapReduce/da7189167b0a5e71ebfc52ccf8240947/.tmp/f2/8d25fe20ffad48609d3e9f21e91d0871 2023-02-15 20:01:11,851 INFO [rs(jenkins-hbase4.apache.org,33367,1676491262239)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/data/default/testWithMapReduce/ce146f62338407483a61920d7170f142/.tmp/f2/e0e4950437544f398559fbc97075f122 2023-02-15 20:01:11,858 DEBUG [rs(jenkins-hbase4.apache.org,33367,1676491262239)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/data/default/testWithMapReduce/da7189167b0a5e71ebfc52ccf8240947/.tmp/f1/e199c168d268415c9a4609ae9b2e3670 as hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/data/default/testWithMapReduce/da7189167b0a5e71ebfc52ccf8240947/f1/e199c168d268415c9a4609ae9b2e3670 2023-02-15 20:01:11,860 DEBUG [rs(jenkins-hbase4.apache.org,33367,1676491262239)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/data/default/testWithMapReduce/ce146f62338407483a61920d7170f142/.tmp/f1/7712cf3c394d4f768b4b03d288f6a1ed as hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/data/default/testWithMapReduce/ce146f62338407483a61920d7170f142/f1/7712cf3c394d4f768b4b03d288f6a1ed 2023-02-15 20:01:11,863 INFO [rs(jenkins-hbase4.apache.org,33367,1676491262239)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/data/default/testWithMapReduce/f26f31f3358f9f2d50b3c5d32cc7b35d/.tmp/f2/8bb42134d4fe49e88a7ea2822eb8e329 2023-02-15 20:01:11,867 INFO [rs(jenkins-hbase4.apache.org,41535,1676491262190)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/data/default/testWithMapReduce/8a2219c4f89e37dec8687cefabd9fc25/.tmp/f2/34ef4ec0a4fa41c29b0e30b79e7e1387 2023-02-15 20:01:11,867 INFO [rs(jenkins-hbase4.apache.org,33367,1676491262239)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/data/default/testWithMapReduce/da7189167b0a5e71ebfc52ccf8240947/f1/e199c168d268415c9a4609ae9b2e3670, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-15 20:01:11,868 INFO [rs(jenkins-hbase4.apache.org,33367,1676491262239)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/data/default/testWithMapReduce/ce146f62338407483a61920d7170f142/f1/7712cf3c394d4f768b4b03d288f6a1ed, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-15 20:01:11,869 DEBUG [rs(jenkins-hbase4.apache.org,33367,1676491262239)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/data/default/testWithMapReduce/da7189167b0a5e71ebfc52ccf8240947/.tmp/f2/8d25fe20ffad48609d3e9f21e91d0871 as hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/data/default/testWithMapReduce/da7189167b0a5e71ebfc52ccf8240947/f2/8d25fe20ffad48609d3e9f21e91d0871 2023-02-15 20:01:11,870 DEBUG [rs(jenkins-hbase4.apache.org,33367,1676491262239)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/data/default/testWithMapReduce/ce146f62338407483a61920d7170f142/.tmp/f2/e0e4950437544f398559fbc97075f122 as hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/data/default/testWithMapReduce/ce146f62338407483a61920d7170f142/f2/e0e4950437544f398559fbc97075f122 2023-02-15 20:01:11,874 DEBUG [rs(jenkins-hbase4.apache.org,33367,1676491262239)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/data/default/testWithMapReduce/f26f31f3358f9f2d50b3c5d32cc7b35d/.tmp/f1/28443b8834a64448a36d76603a7bc046 as hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/data/default/testWithMapReduce/f26f31f3358f9f2d50b3c5d32cc7b35d/f1/28443b8834a64448a36d76603a7bc046 2023-02-15 20:01:11,875 DEBUG [rs(jenkins-hbase4.apache.org,41535,1676491262190)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/data/default/testWithMapReduce/8a2219c4f89e37dec8687cefabd9fc25/.tmp/f1/eb9c2a0eb1a74c45ae7e4c7171c4590e as hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/data/default/testWithMapReduce/8a2219c4f89e37dec8687cefabd9fc25/f1/eb9c2a0eb1a74c45ae7e4c7171c4590e 2023-02-15 20:01:11,879 INFO [rs(jenkins-hbase4.apache.org,33367,1676491262239)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/data/default/testWithMapReduce/da7189167b0a5e71ebfc52ccf8240947/f2/8d25fe20ffad48609d3e9f21e91d0871, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-15 20:01:11,880 INFO [rs(jenkins-hbase4.apache.org,33367,1676491262239)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~248.22 KB/254176, heapSize ~634.22 KB/649440, currentSize=0 B/0 for da7189167b0a5e71ebfc52ccf8240947 in 211ms, sequenceid=9, compaction requested=false 2023-02-15 20:01:11,880 DEBUG [rs(jenkins-hbase4.apache.org,33367,1676491262239)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for da7189167b0a5e71ebfc52ccf8240947: 2023-02-15 20:01:11,881 DEBUG [rs(jenkins-hbase4.apache.org,33367,1676491262239)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,wWV,1676491266407.da7189167b0a5e71ebfc52ccf8240947. 2023-02-15 20:01:11,881 DEBUG [rs(jenkins-hbase4.apache.org,33367,1676491262239)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,j\xCA\xCA,1676491266407.30b6672c9889bbc2cc2b417a34f3f49e. 2023-02-15 20:01:11,881 DEBUG [member: 'jenkins-hbase4.apache.org,33367,1676491262239' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/5 local region flush tasks. 2023-02-15 20:01:11,881 DEBUG [rs(jenkins-hbase4.apache.org,33367,1676491262239)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,j\xCA\xCA,1676491266407.30b6672c9889bbc2cc2b417a34f3f49e. started... 2023-02-15 20:01:11,881 INFO [rs(jenkins-hbase4.apache.org,33367,1676491262239)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 30b6672c9889bbc2cc2b417a34f3f49e 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-15 20:01:11,882 INFO [rs(jenkins-hbase4.apache.org,33367,1676491262239)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/data/default/testWithMapReduce/f26f31f3358f9f2d50b3c5d32cc7b35d/f1/28443b8834a64448a36d76603a7bc046, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-15 20:01:11,888 INFO [rs(jenkins-hbase4.apache.org,41535,1676491262190)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/data/default/testWithMapReduce/8a2219c4f89e37dec8687cefabd9fc25/f1/eb9c2a0eb1a74c45ae7e4c7171c4590e, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-15 20:01:11,889 DEBUG [rs(jenkins-hbase4.apache.org,41535,1676491262190)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/data/default/testWithMapReduce/8a2219c4f89e37dec8687cefabd9fc25/.tmp/f2/34ef4ec0a4fa41c29b0e30b79e7e1387 as hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/data/default/testWithMapReduce/8a2219c4f89e37dec8687cefabd9fc25/f2/34ef4ec0a4fa41c29b0e30b79e7e1387 2023-02-15 20:01:11,893 DEBUG [rs(jenkins-hbase4.apache.org,33367,1676491262239)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/data/default/testWithMapReduce/f26f31f3358f9f2d50b3c5d32cc7b35d/.tmp/f2/8bb42134d4fe49e88a7ea2822eb8e329 as hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/data/default/testWithMapReduce/f26f31f3358f9f2d50b3c5d32cc7b35d/f2/8bb42134d4fe49e88a7ea2822eb8e329 2023-02-15 20:01:11,895 INFO [rs(jenkins-hbase4.apache.org,33367,1676491262239)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/data/default/testWithMapReduce/ce146f62338407483a61920d7170f142/f2/e0e4950437544f398559fbc97075f122, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-15 20:01:11,896 INFO [rs(jenkins-hbase4.apache.org,33367,1676491262239)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for ce146f62338407483a61920d7170f142 in 238ms, sequenceid=9, compaction requested=false 2023-02-15 20:01:11,896 DEBUG [rs(jenkins-hbase4.apache.org,33367,1676491262239)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for ce146f62338407483a61920d7170f142: 2023-02-15 20:01:11,896 DEBUG [rs(jenkins-hbase4.apache.org,33367,1676491262239)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,t43,1676491266407.ce146f62338407483a61920d7170f142. 2023-02-15 20:01:11,896 DEBUG [member: 'jenkins-hbase4.apache.org,33367,1676491262239' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/5 local region flush tasks. 2023-02-15 20:01:11,896 DEBUG [rs(jenkins-hbase4.apache.org,33367,1676491262239)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,,1676491266407.77b8837eb0dd784edf4b0582f0ba0a3f. 2023-02-15 20:01:11,896 DEBUG [rs(jenkins-hbase4.apache.org,33367,1676491262239)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,,1676491266407.77b8837eb0dd784edf4b0582f0ba0a3f. started... 2023-02-15 20:01:11,897 DEBUG [rs(jenkins-hbase4.apache.org,33367,1676491262239)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 77b8837eb0dd784edf4b0582f0ba0a3f: 2023-02-15 20:01:11,897 DEBUG [rs(jenkins-hbase4.apache.org,33367,1676491262239)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,,1676491266407.77b8837eb0dd784edf4b0582f0ba0a3f. 2023-02-15 20:01:11,897 DEBUG [member: 'jenkins-hbase4.apache.org,33367,1676491262239' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/5 local region flush tasks. 2023-02-15 20:01:11,905 INFO [rs(jenkins-hbase4.apache.org,41535,1676491262190)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/data/default/testWithMapReduce/8a2219c4f89e37dec8687cefabd9fc25/f2/34ef4ec0a4fa41c29b0e30b79e7e1387, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-15 20:01:11,906 INFO [rs(jenkins-hbase4.apache.org,41535,1676491262190)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~248.22 KB/254176, heapSize ~634.22 KB/649440, currentSize=0 B/0 for 8a2219c4f89e37dec8687cefabd9fc25 in 237ms, sequenceid=9, compaction requested=false 2023-02-15 20:01:11,907 DEBUG [rs(jenkins-hbase4.apache.org,41535,1676491262190)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 8a2219c4f89e37dec8687cefabd9fc25: 2023-02-15 20:01:11,907 DEBUG [rs(jenkins-hbase4.apache.org,41535,1676491262190)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,aaa,1676491266407.8a2219c4f89e37dec8687cefabd9fc25. 2023-02-15 20:01:11,908 DEBUG [rs(jenkins-hbase4.apache.org,41535,1676491262190)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,d\x84\x84,1676491266407.cfff17411e5ee60b92c4b80249237743. 2023-02-15 20:01:11,908 DEBUG [member: 'jenkins-hbase4.apache.org,41535,1676491262190' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/5 local region flush tasks. 2023-02-15 20:01:11,908 DEBUG [rs(jenkins-hbase4.apache.org,41535,1676491262190)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,d\x84\x84,1676491266407.cfff17411e5ee60b92c4b80249237743. started... 2023-02-15 20:01:11,908 INFO [rs(jenkins-hbase4.apache.org,41535,1676491262190)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing cfff17411e5ee60b92c4b80249237743 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-15 20:01:11,911 INFO [rs(jenkins-hbase4.apache.org,33367,1676491262239)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/data/default/testWithMapReduce/f26f31f3358f9f2d50b3c5d32cc7b35d/f2/8bb42134d4fe49e88a7ea2822eb8e329, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-15 20:01:11,913 INFO [rs(jenkins-hbase4.apache.org,33367,1676491262239)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for f26f31f3358f9f2d50b3c5d32cc7b35d in 249ms, sequenceid=9, compaction requested=false 2023-02-15 20:01:11,913 DEBUG [rs(jenkins-hbase4.apache.org,33367,1676491262239)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for f26f31f3358f9f2d50b3c5d32cc7b35d: 2023-02-15 20:01:11,913 DEBUG [rs(jenkins-hbase4.apache.org,33367,1676491262239)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,m\xED\xED,1676491266407.f26f31f3358f9f2d50b3c5d32cc7b35d. 2023-02-15 20:01:11,913 DEBUG [member: 'jenkins-hbase4.apache.org,33367,1676491262239' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 4/5 local region flush tasks. 2023-02-15 20:01:11,920 INFO [rs(jenkins-hbase4.apache.org,33367,1676491262239)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/data/default/testWithMapReduce/30b6672c9889bbc2cc2b417a34f3f49e/.tmp/f1/85131266493445ac915b0c40d55c0070 2023-02-15 20:01:11,925 INFO [rs(jenkins-hbase4.apache.org,41535,1676491262190)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/data/default/testWithMapReduce/cfff17411e5ee60b92c4b80249237743/.tmp/f1/6bba3196e5b540e48a9df25fca510f9d 2023-02-15 20:01:11,938 INFO [rs(jenkins-hbase4.apache.org,33367,1676491262239)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/data/default/testWithMapReduce/30b6672c9889bbc2cc2b417a34f3f49e/.tmp/f2/e6b374c300554dc383a1d8e4f5c3eb51 2023-02-15 20:01:11,945 DEBUG [rs(jenkins-hbase4.apache.org,33367,1676491262239)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/data/default/testWithMapReduce/30b6672c9889bbc2cc2b417a34f3f49e/.tmp/f1/85131266493445ac915b0c40d55c0070 as hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/data/default/testWithMapReduce/30b6672c9889bbc2cc2b417a34f3f49e/f1/85131266493445ac915b0c40d55c0070 2023-02-15 20:01:11,946 INFO [rs(jenkins-hbase4.apache.org,41535,1676491262190)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/data/default/testWithMapReduce/cfff17411e5ee60b92c4b80249237743/.tmp/f2/ac50a363254a45e1bf697261d76f71cc 2023-02-15 20:01:11,952 DEBUG [rs(jenkins-hbase4.apache.org,41535,1676491262190)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/data/default/testWithMapReduce/cfff17411e5ee60b92c4b80249237743/.tmp/f1/6bba3196e5b540e48a9df25fca510f9d as hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/data/default/testWithMapReduce/cfff17411e5ee60b92c4b80249237743/f1/6bba3196e5b540e48a9df25fca510f9d 2023-02-15 20:01:11,953 INFO [rs(jenkins-hbase4.apache.org,33367,1676491262239)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/data/default/testWithMapReduce/30b6672c9889bbc2cc2b417a34f3f49e/f1/85131266493445ac915b0c40d55c0070, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-15 20:01:11,954 DEBUG [rs(jenkins-hbase4.apache.org,33367,1676491262239)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/data/default/testWithMapReduce/30b6672c9889bbc2cc2b417a34f3f49e/.tmp/f2/e6b374c300554dc383a1d8e4f5c3eb51 as hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/data/default/testWithMapReduce/30b6672c9889bbc2cc2b417a34f3f49e/f2/e6b374c300554dc383a1d8e4f5c3eb51 2023-02-15 20:01:11,961 INFO [rs(jenkins-hbase4.apache.org,33367,1676491262239)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/data/default/testWithMapReduce/30b6672c9889bbc2cc2b417a34f3f49e/f2/e6b374c300554dc383a1d8e4f5c3eb51, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-15 20:01:11,962 INFO [rs(jenkins-hbase4.apache.org,33367,1676491262239)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 30b6672c9889bbc2cc2b417a34f3f49e in 81ms, sequenceid=9, compaction requested=false 2023-02-15 20:01:11,962 DEBUG [rs(jenkins-hbase4.apache.org,33367,1676491262239)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 30b6672c9889bbc2cc2b417a34f3f49e: 2023-02-15 20:01:11,962 DEBUG [rs(jenkins-hbase4.apache.org,33367,1676491262239)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,j\xCA\xCA,1676491266407.30b6672c9889bbc2cc2b417a34f3f49e. 2023-02-15 20:01:11,962 DEBUG [member: 'jenkins-hbase4.apache.org,33367,1676491262239' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 5/5 local region flush tasks. 2023-02-15 20:01:11,963 DEBUG [member: 'jenkins-hbase4.apache.org,33367,1676491262239' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 5 local region flush tasks. 2023-02-15 20:01:11,963 DEBUG [member: 'jenkins-hbase4.apache.org,33367,1676491262239' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,33367,1676491262239 2023-02-15 20:01:11,963 DEBUG [member: 'jenkins-hbase4.apache.org,33367,1676491262239' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduce' locally acquired 2023-02-15 20:01:11,963 DEBUG [member: 'jenkins-hbase4.apache.org,33367,1676491262239' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33367,1676491262239' joining acquired barrier for procedure (testWithMapReduce) in zk 2023-02-15 20:01:11,963 INFO [rs(jenkins-hbase4.apache.org,41535,1676491262190)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/data/default/testWithMapReduce/cfff17411e5ee60b92c4b80249237743/f1/6bba3196e5b540e48a9df25fca510f9d, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-15 20:01:11,965 DEBUG [rs(jenkins-hbase4.apache.org,41535,1676491262190)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/data/default/testWithMapReduce/cfff17411e5ee60b92c4b80249237743/.tmp/f2/ac50a363254a45e1bf697261d76f71cc as hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/data/default/testWithMapReduce/cfff17411e5ee60b92c4b80249237743/f2/ac50a363254a45e1bf697261d76f71cc 2023-02-15 20:01:11,966 DEBUG [Listener at localhost/37547-EventThread] zookeeper.ZKWatcher(600): master:39607-0x10059926a4e0000, quorum=127.0.0.1:53178, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,33367,1676491262239 2023-02-15 20:01:11,966 DEBUG [member: 'jenkins-hbase4.apache.org,33367,1676491262239' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-15 20:01:11,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,33367,1676491262239 2023-02-15 20:01:11,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-15 20:01:11,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-15 20:01:11,966 DEBUG [member: 'jenkins-hbase4.apache.org,33367,1676491262239' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33367-0x10059926a4e0002, quorum=127.0.0.1:53178, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce 2023-02-15 20:01:11,966 DEBUG [member: 'jenkins-hbase4.apache.org,33367,1676491262239' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduce' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-15 20:01:11,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-15 20:01:11,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-15 20:01:11,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-15 20:01:11,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33367,1676491262239 2023-02-15 20:01:11,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-15 20:01:11,968 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,33367,1676491262239' joining acquired barrier for procedure 'testWithMapReduce' on coordinator 2023-02-15 20:01:11,969 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@29d74dee[Count = 1] remaining members to acquire global barrier 2023-02-15 20:01:11,972 INFO [rs(jenkins-hbase4.apache.org,41535,1676491262190)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/data/default/testWithMapReduce/cfff17411e5ee60b92c4b80249237743/f2/ac50a363254a45e1bf697261d76f71cc, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-15 20:01:11,973 INFO [rs(jenkins-hbase4.apache.org,41535,1676491262190)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for cfff17411e5ee60b92c4b80249237743 in 65ms, sequenceid=9, compaction requested=false 2023-02-15 20:01:11,973 DEBUG [rs(jenkins-hbase4.apache.org,41535,1676491262190)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for cfff17411e5ee60b92c4b80249237743: 2023-02-15 20:01:11,973 DEBUG [rs(jenkins-hbase4.apache.org,41535,1676491262190)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,d\x84\x84,1676491266407.cfff17411e5ee60b92c4b80249237743. 2023-02-15 20:01:11,974 DEBUG [member: 'jenkins-hbase4.apache.org,41535,1676491262190' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/5 local region flush tasks. 2023-02-15 20:01:12,194 INFO [rs(jenkins-hbase4.apache.org,41535,1676491262190)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/data/default/testWithMapReduce/aac41416f1d7fc83b90c2b3432a76ce6/.tmp/f1/57d4be8d48b346c7a016b59865fd1e02 2023-02-15 20:01:12,210 INFO [rs(jenkins-hbase4.apache.org,41535,1676491262190)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/data/default/testWithMapReduce/aac41416f1d7fc83b90c2b3432a76ce6/.tmp/f2/3669f67eb1b64ebaadc77923020a31c6 2023-02-15 20:01:12,216 DEBUG [rs(jenkins-hbase4.apache.org,41535,1676491262190)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/data/default/testWithMapReduce/aac41416f1d7fc83b90c2b3432a76ce6/.tmp/f1/57d4be8d48b346c7a016b59865fd1e02 as hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/data/default/testWithMapReduce/aac41416f1d7fc83b90c2b3432a76ce6/f1/57d4be8d48b346c7a016b59865fd1e02 2023-02-15 20:01:12,222 INFO [rs(jenkins-hbase4.apache.org,41535,1676491262190)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/data/default/testWithMapReduce/aac41416f1d7fc83b90c2b3432a76ce6/f1/57d4be8d48b346c7a016b59865fd1e02, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-15 20:01:12,223 DEBUG [rs(jenkins-hbase4.apache.org,41535,1676491262190)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/data/default/testWithMapReduce/aac41416f1d7fc83b90c2b3432a76ce6/.tmp/f2/3669f67eb1b64ebaadc77923020a31c6 as hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/data/default/testWithMapReduce/aac41416f1d7fc83b90c2b3432a76ce6/f2/3669f67eb1b64ebaadc77923020a31c6 2023-02-15 20:01:12,228 INFO [rs(jenkins-hbase4.apache.org,41535,1676491262190)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/data/default/testWithMapReduce/aac41416f1d7fc83b90c2b3432a76ce6/f2/3669f67eb1b64ebaadc77923020a31c6, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-15 20:01:12,230 INFO [rs(jenkins-hbase4.apache.org,41535,1676491262190)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for aac41416f1d7fc83b90c2b3432a76ce6 in 569ms, sequenceid=9, compaction requested=false 2023-02-15 20:01:12,230 DEBUG [rs(jenkins-hbase4.apache.org,41535,1676491262190)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for aac41416f1d7fc83b90c2b3432a76ce6: 2023-02-15 20:01:12,230 DEBUG [rs(jenkins-hbase4.apache.org,41535,1676491262190)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,q\x11\x10,1676491266407.aac41416f1d7fc83b90c2b3432a76ce6. 2023-02-15 20:01:12,230 DEBUG [member: 'jenkins-hbase4.apache.org,41535,1676491262190' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 4/5 local region flush tasks. 2023-02-15 20:01:12,255 INFO [rs(jenkins-hbase4.apache.org,41535,1676491262190)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/data/default/testWithMapReduce/3506ea931c9649c226fb4c38a5165b6a/.tmp/f2/54dd6083f71647188cca8be14640b96a 2023-02-15 20:01:12,261 DEBUG [rs(jenkins-hbase4.apache.org,41535,1676491262190)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/data/default/testWithMapReduce/3506ea931c9649c226fb4c38a5165b6a/.tmp/f1/6717a82d1b7c4defb86c5f60eab3cf11 as hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/data/default/testWithMapReduce/3506ea931c9649c226fb4c38a5165b6a/f1/6717a82d1b7c4defb86c5f60eab3cf11 2023-02-15 20:01:12,267 INFO [rs(jenkins-hbase4.apache.org,41535,1676491262190)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/data/default/testWithMapReduce/3506ea931c9649c226fb4c38a5165b6a/f1/6717a82d1b7c4defb86c5f60eab3cf11, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-15 20:01:12,268 DEBUG [rs(jenkins-hbase4.apache.org,41535,1676491262190)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/data/default/testWithMapReduce/3506ea931c9649c226fb4c38a5165b6a/.tmp/f2/54dd6083f71647188cca8be14640b96a as hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/data/default/testWithMapReduce/3506ea931c9649c226fb4c38a5165b6a/f2/54dd6083f71647188cca8be14640b96a 2023-02-15 20:01:12,273 INFO [rs(jenkins-hbase4.apache.org,41535,1676491262190)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/data/default/testWithMapReduce/3506ea931c9649c226fb4c38a5165b6a/f2/54dd6083f71647188cca8be14640b96a, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-15 20:01:12,274 INFO [rs(jenkins-hbase4.apache.org,41535,1676491262190)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 3506ea931c9649c226fb4c38a5165b6a in 614ms, sequenceid=9, compaction requested=false 2023-02-15 20:01:12,274 DEBUG [rs(jenkins-hbase4.apache.org,41535,1676491262190)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 3506ea931c9649c226fb4c38a5165b6a: 2023-02-15 20:01:12,274 DEBUG [rs(jenkins-hbase4.apache.org,41535,1676491262190)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,g\xA7\xA7,1676491266407.3506ea931c9649c226fb4c38a5165b6a. 2023-02-15 20:01:12,274 DEBUG [member: 'jenkins-hbase4.apache.org,41535,1676491262190' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 5/5 local region flush tasks. 2023-02-15 20:01:12,274 DEBUG [member: 'jenkins-hbase4.apache.org,41535,1676491262190' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 5 local region flush tasks. 2023-02-15 20:01:12,274 DEBUG [member: 'jenkins-hbase4.apache.org,41535,1676491262190' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41535,1676491262190 2023-02-15 20:01:12,274 DEBUG [member: 'jenkins-hbase4.apache.org,41535,1676491262190' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduce' locally acquired 2023-02-15 20:01:12,274 DEBUG [member: 'jenkins-hbase4.apache.org,41535,1676491262190' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41535,1676491262190' joining acquired barrier for procedure (testWithMapReduce) in zk 2023-02-15 20:01:12,276 DEBUG [Listener at localhost/37547-EventThread] zookeeper.ZKWatcher(600): master:39607-0x10059926a4e0000, quorum=127.0.0.1:53178, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,41535,1676491262190 2023-02-15 20:01:12,276 DEBUG [member: 'jenkins-hbase4.apache.org,41535,1676491262190' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-15 20:01:12,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,41535,1676491262190 2023-02-15 20:01:12,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-15 20:01:12,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-15 20:01:12,277 DEBUG [member: 'jenkins-hbase4.apache.org,41535,1676491262190' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41535-0x10059926a4e0001, quorum=127.0.0.1:53178, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce 2023-02-15 20:01:12,277 DEBUG [member: 'jenkins-hbase4.apache.org,41535,1676491262190' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduce' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-15 20:01:12,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-15 20:01:12,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-15 20:01:12,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-15 20:01:12,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33367,1676491262239 2023-02-15 20:01:12,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41535,1676491262190 2023-02-15 20:01:12,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-15 20:01:12,280 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41535,1676491262190' joining acquired barrier for procedure 'testWithMapReduce' on coordinator 2023-02-15 20:01:12,280 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@29d74dee[Count = 0] remaining members to acquire global barrier 2023-02-15 20:01:12,280 DEBUG [(jenkins-hbase4.apache.org,39607,1676491260960)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMapReduce' starting 'in-barrier' execution. 2023-02-15 20:01:12,280 DEBUG [(jenkins-hbase4.apache.org,39607,1676491260960)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-15 20:01:12,284 DEBUG [Listener at localhost/37547-EventThread] zookeeper.ZKWatcher(600): regionserver:41535-0x10059926a4e0001, quorum=127.0.0.1:53178, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-15 20:01:12,284 DEBUG [Listener at localhost/37547-EventThread] zookeeper.ZKWatcher(600): regionserver:33367-0x10059926a4e0002, quorum=127.0.0.1:53178, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-15 20:01:12,284 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-15 20:01:12,284 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-15 20:01:12,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-15 20:01:12,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-15 20:01:12,284 DEBUG [member: 'jenkins-hbase4.apache.org,41535,1676491262190' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduce' received 'reached' from coordinator. 2023-02-15 20:01:12,284 DEBUG [(jenkins-hbase4.apache.org,39607,1676491260960)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39607-0x10059926a4e0000, quorum=127.0.0.1:53178, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,33367,1676491262239 2023-02-15 20:01:12,284 DEBUG [member: 'jenkins-hbase4.apache.org,41535,1676491262190' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduce' locally completed 2023-02-15 20:01:12,285 DEBUG [member: 'jenkins-hbase4.apache.org,41535,1676491262190' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduce' completed for member 'jenkins-hbase4.apache.org,41535,1676491262190' in zk 2023-02-15 20:01:12,284 DEBUG [member: 'jenkins-hbase4.apache.org,33367,1676491262239' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduce' received 'reached' from coordinator. 2023-02-15 20:01:12,285 DEBUG [member: 'jenkins-hbase4.apache.org,33367,1676491262239' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduce' locally completed 2023-02-15 20:01:12,285 DEBUG [member: 'jenkins-hbase4.apache.org,33367,1676491262239' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduce' completed for member 'jenkins-hbase4.apache.org,33367,1676491262239' in zk 2023-02-15 20:01:12,285 DEBUG [(jenkins-hbase4.apache.org,39607,1676491260960)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39607-0x10059926a4e0000, quorum=127.0.0.1:53178, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,41535,1676491262190 2023-02-15 20:01:12,286 DEBUG [(jenkins-hbase4.apache.org,39607,1676491260960)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-15 20:01:12,287 DEBUG [Listener at localhost/37547-EventThread] zookeeper.ZKWatcher(600): master:39607-0x10059926a4e0000, quorum=127.0.0.1:53178, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,41535,1676491262190 2023-02-15 20:01:12,288 DEBUG [member: 'jenkins-hbase4.apache.org,41535,1676491262190' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduce' has notified controller of completion 2023-02-15 20:01:12,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,41535,1676491262190 2023-02-15 20:01:12,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-15 20:01:12,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-15 20:01:12,288 DEBUG [member: 'jenkins-hbase4.apache.org,41535,1676491262190' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-15 20:01:12,288 DEBUG [member: 'jenkins-hbase4.apache.org,41535,1676491262190' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduce' completed. 2023-02-15 20:01:12,289 DEBUG [Listener at localhost/37547-EventThread] zookeeper.ZKWatcher(600): master:39607-0x10059926a4e0000, quorum=127.0.0.1:53178, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,33367,1676491262239 2023-02-15 20:01:12,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-15 20:01:12,289 DEBUG [member: 'jenkins-hbase4.apache.org,33367,1676491262239' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduce' has notified controller of completion 2023-02-15 20:01:12,289 DEBUG [member: 'jenkins-hbase4.apache.org,33367,1676491262239' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-15 20:01:12,289 DEBUG [member: 'jenkins-hbase4.apache.org,33367,1676491262239' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduce' completed. 2023-02-15 20:01:12,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-15 20:01:12,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-15 20:01:12,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33367,1676491262239 2023-02-15 20:01:12,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41535,1676491262190 2023-02-15 20:01:12,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-15 20:01:12,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-15 20:01:12,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33367,1676491262239 2023-02-15 20:01:12,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41535,1676491262190 2023-02-15 20:01:12,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduce' member 'jenkins-hbase4.apache.org,41535,1676491262190': 2023-02-15 20:01:12,294 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41535,1676491262190' released barrier for procedure'testWithMapReduce', counting down latch. Waiting for 1 more 2023-02-15 20:01:12,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,33367,1676491262239 2023-02-15 20:01:12,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-15 20:01:12,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-15 20:01:12,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-15 20:01:12,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-15 20:01:12,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-15 20:01:12,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33367,1676491262239 2023-02-15 20:01:12,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41535,1676491262190 2023-02-15 20:01:12,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-15 20:01:12,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-15 20:01:12,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33367,1676491262239 2023-02-15 20:01:12,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41535,1676491262190 2023-02-15 20:01:12,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduce' member 'jenkins-hbase4.apache.org,33367,1676491262239': 2023-02-15 20:01:12,298 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,33367,1676491262239' released barrier for procedure'testWithMapReduce', counting down latch. Waiting for 0 more 2023-02-15 20:01:12,298 INFO [(jenkins-hbase4.apache.org,39607,1676491260960)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMapReduce' execution completed 2023-02-15 20:01:12,298 DEBUG [(jenkins-hbase4.apache.org,39607,1676491260960)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-15 20:01:12,298 DEBUG [(jenkins-hbase4.apache.org,39607,1676491260960)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-15 20:01:12,299 DEBUG [(jenkins-hbase4.apache.org,39607,1676491260960)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMapReduce 2023-02-15 20:01:12,299 INFO [(jenkins-hbase4.apache.org,39607,1676491260960)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMapReduceincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-15 20:01:12,301 DEBUG [Listener at localhost/37547-EventThread] zookeeper.ZKWatcher(600): regionserver:41535-0x10059926a4e0001, quorum=127.0.0.1:53178, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-15 20:01:12,301 DEBUG [Listener at localhost/37547-EventThread] zookeeper.ZKWatcher(600): master:39607-0x10059926a4e0000, quorum=127.0.0.1:53178, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-15 20:01:12,301 DEBUG [Listener at localhost/37547-EventThread] zookeeper.ZKWatcher(600): regionserver:33367-0x10059926a4e0002, quorum=127.0.0.1:53178, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-15 20:01:12,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-15 20:01:12,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-15 20:01:12,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-15 20:01:12,301 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-15 20:01:12,301 DEBUG [Listener at localhost/37547-EventThread] zookeeper.ZKWatcher(600): regionserver:33367-0x10059926a4e0002, quorum=127.0.0.1:53178, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-15 20:01:12,301 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-15 20:01:12,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-15 20:01:12,301 DEBUG [Listener at localhost/37547-EventThread] zookeeper.ZKWatcher(600): regionserver:41535-0x10059926a4e0001, quorum=127.0.0.1:53178, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-15 20:01:12,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-15 20:01:12,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-15 20:01:12,302 DEBUG [(jenkins-hbase4.apache.org,39607,1676491260960)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39607-0x10059926a4e0000, quorum=127.0.0.1:53178, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,33367,1676491262239 2023-02-15 20:01:12,302 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-15 20:01:12,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-15 20:01:12,302 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-15 20:01:12,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-15 20:01:12,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-15 20:01:12,303 DEBUG [(jenkins-hbase4.apache.org,39607,1676491260960)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39607-0x10059926a4e0000, quorum=127.0.0.1:53178, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,41535,1676491262190 2023-02-15 20:01:12,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-15 20:01:12,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-15 20:01:12,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-15 20:01:12,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-15 20:01:12,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33367,1676491262239 2023-02-15 20:01:12,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41535,1676491262190 2023-02-15 20:01:12,305 DEBUG [(jenkins-hbase4.apache.org,39607,1676491260960)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39607-0x10059926a4e0000, quorum=127.0.0.1:53178, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,33367,1676491262239 2023-02-15 20:01:12,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-15 20:01:12,305 DEBUG [(jenkins-hbase4.apache.org,39607,1676491260960)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39607-0x10059926a4e0000, quorum=127.0.0.1:53178, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,41535,1676491262190 2023-02-15 20:01:12,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-15 20:01:12,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33367,1676491262239 2023-02-15 20:01:12,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41535,1676491262190 2023-02-15 20:01:12,312 DEBUG [Listener at localhost/37547-EventThread] zookeeper.ZKWatcher(600): regionserver:41535-0x10059926a4e0001, quorum=127.0.0.1:53178, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-15 20:01:12,312 DEBUG [Listener at localhost/37547-EventThread] zookeeper.ZKWatcher(600): regionserver:41535-0x10059926a4e0001, quorum=127.0.0.1:53178, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-15 20:01:12,312 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-15 20:01:12,312 DEBUG [Listener at localhost/37547-EventThread] zookeeper.ZKWatcher(600): regionserver:33367-0x10059926a4e0002, quorum=127.0.0.1:53178, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-15 20:01:12,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-15 20:01:12,313 DEBUG [Listener at localhost/37547-EventThread] zookeeper.ZKWatcher(600): master:39607-0x10059926a4e0000, quorum=127.0.0.1:53178, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,41535,1676491262190 2023-02-15 20:01:12,313 DEBUG [Listener at localhost/37547-EventThread] zookeeper.ZKWatcher(600): master:39607-0x10059926a4e0000, quorum=127.0.0.1:53178, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-15 20:01:12,313 DEBUG [Listener at localhost/37547-EventThread] zookeeper.ZKWatcher(600): master:39607-0x10059926a4e0000, quorum=127.0.0.1:53178, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,33367,1676491262239 2023-02-15 20:01:12,313 DEBUG [Listener at localhost/37547-EventThread] zookeeper.ZKWatcher(600): master:39607-0x10059926a4e0000, quorum=127.0.0.1:53178, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-15 20:01:12,313 DEBUG [Listener at localhost/37547-EventThread] zookeeper.ZKWatcher(600): master:39607-0x10059926a4e0000, quorum=127.0.0.1:53178, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,41535,1676491262190 2023-02-15 20:01:12,313 DEBUG [Listener at localhost/37547-EventThread] zookeeper.ZKWatcher(600): master:39607-0x10059926a4e0000, quorum=127.0.0.1:53178, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-15 20:01:12,313 DEBUG [Listener at localhost/37547-EventThread] zookeeper.ZKWatcher(600): master:39607-0x10059926a4e0000, quorum=127.0.0.1:53178, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,33367,1676491262239 2023-02-15 20:01:12,313 DEBUG [Listener at localhost/37547-EventThread] zookeeper.ZKWatcher(600): master:39607-0x10059926a4e0000, quorum=127.0.0.1:53178, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-15 20:01:12,313 DEBUG [Listener at localhost/37547-EventThread] zookeeper.ZKWatcher(600): master:39607-0x10059926a4e0000, quorum=127.0.0.1:53178, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-15 20:01:12,313 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-15 20:01:12,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-15 20:01:12,313 DEBUG [Listener at localhost/37547-EventThread] zookeeper.ZKWatcher(600): regionserver:33367-0x10059926a4e0002, quorum=127.0.0.1:53178, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-15 20:01:12,313 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39607] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testWithMapReduce' 2023-02-15 20:01:12,313 DEBUG [(jenkins-hbase4.apache.org,39607,1676491260960)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-15 20:01:12,313 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-15 20:01:12,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-15 20:01:12,314 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-15 20:01:12,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-15 20:01:12,313 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39607] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-15 20:01:12,322 DEBUG [Listener at localhost/37547] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testWithMapReduce'' to complete. (max 20000 ms per retry) 2023-02-15 20:01:12,322 DEBUG [Listener at localhost/37547] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-15 20:01:12,422 DEBUG [Listener at localhost/37547] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-15 20:01:12,428 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39607] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-15 20:01:12,539 DEBUG [Listener at localhost/37547] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapred.TestTableSnapshotInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b60948e8-4ebf-4913-96a4-e7519f684365/hadoop-7896785917299184883.jar 2023-02-15 20:01:12,556 INFO [Listener at localhost/37547] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "testWithMapReduceMultiRegion" table: "testWithMapReduce" creation_time: 1676491269155 type: FLUSH version: 2 ttl: 0 2023-02-15 20:01:12,557 DEBUG [Listener at localhost/37547] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost:38891/user/jenkins/test-data/7cbd6db3-0023-7f08-6a1c-eea0c6f23bc1/testWithMapReduceMultiRegion/8bd4ee16-65d3-4e64-85ab-566f80ed3785/data/default/testWithMapReduce 2023-02-15 20:01:12,558 INFO [Listener at localhost/37547] snapshot.RestoreSnapshotHelper(239): region to add: ce146f62338407483a61920d7170f142 2023-02-15 20:01:12,558 INFO [Listener at localhost/37547] snapshot.RestoreSnapshotHelper(239): region to add: f26f31f3358f9f2d50b3c5d32cc7b35d 2023-02-15 20:01:12,559 INFO [Listener at localhost/37547] snapshot.RestoreSnapshotHelper(239): region to add: f5c7d59a05e094a402144fe6a2d882f0 2023-02-15 20:01:12,559 INFO [Listener at localhost/37547] snapshot.RestoreSnapshotHelper(239): region to add: da7189167b0a5e71ebfc52ccf8240947 2023-02-15 20:01:12,559 INFO [Listener at localhost/37547] snapshot.RestoreSnapshotHelper(239): region to add: 3506ea931c9649c226fb4c38a5165b6a 2023-02-15 20:01:12,559 INFO [Listener at localhost/37547] snapshot.RestoreSnapshotHelper(239): region to add: aac41416f1d7fc83b90c2b3432a76ce6 2023-02-15 20:01:12,559 INFO [Listener at localhost/37547] snapshot.RestoreSnapshotHelper(239): region to add: 30b6672c9889bbc2cc2b417a34f3f49e 2023-02-15 20:01:12,559 INFO [Listener at localhost/37547] snapshot.RestoreSnapshotHelper(239): region to add: 8a2219c4f89e37dec8687cefabd9fc25 2023-02-15 20:01:12,559 INFO [Listener at localhost/37547] snapshot.RestoreSnapshotHelper(239): region to add: 77b8837eb0dd784edf4b0582f0ba0a3f 2023-02-15 20:01:12,559 INFO [Listener at localhost/37547] snapshot.RestoreSnapshotHelper(239): region to add: cfff17411e5ee60b92c4b80249237743 2023-02-15 20:01:12,559 INFO [Listener at localhost/37547] snapshot.RestoreSnapshotHelper(585): clone region=ce146f62338407483a61920d7170f142 as ce146f62338407483a61920d7170f142 in snapshot testWithMapReduceMultiRegion 2023-02-15 20:01:12,559 INFO [Listener at localhost/37547] snapshot.RestoreSnapshotHelper(585): clone region=f26f31f3358f9f2d50b3c5d32cc7b35d as f26f31f3358f9f2d50b3c5d32cc7b35d in snapshot testWithMapReduceMultiRegion 2023-02-15 20:01:12,560 INFO [Listener at localhost/37547] snapshot.RestoreSnapshotHelper(585): clone region=f5c7d59a05e094a402144fe6a2d882f0 as f5c7d59a05e094a402144fe6a2d882f0 in snapshot testWithMapReduceMultiRegion 2023-02-15 20:01:12,560 INFO [Listener at localhost/37547] snapshot.RestoreSnapshotHelper(585): clone region=da7189167b0a5e71ebfc52ccf8240947 as da7189167b0a5e71ebfc52ccf8240947 in snapshot testWithMapReduceMultiRegion 2023-02-15 20:01:12,560 INFO [Listener at localhost/37547] snapshot.RestoreSnapshotHelper(585): clone region=3506ea931c9649c226fb4c38a5165b6a as 3506ea931c9649c226fb4c38a5165b6a in snapshot testWithMapReduceMultiRegion 2023-02-15 20:01:12,560 INFO [Listener at localhost/37547] snapshot.RestoreSnapshotHelper(585): clone region=aac41416f1d7fc83b90c2b3432a76ce6 as aac41416f1d7fc83b90c2b3432a76ce6 in snapshot testWithMapReduceMultiRegion 2023-02-15 20:01:12,560 INFO [Listener at localhost/37547] snapshot.RestoreSnapshotHelper(585): clone region=30b6672c9889bbc2cc2b417a34f3f49e as 30b6672c9889bbc2cc2b417a34f3f49e in snapshot testWithMapReduceMultiRegion 2023-02-15 20:01:12,560 INFO [Listener at localhost/37547] snapshot.RestoreSnapshotHelper(585): clone region=8a2219c4f89e37dec8687cefabd9fc25 as 8a2219c4f89e37dec8687cefabd9fc25 in snapshot testWithMapReduceMultiRegion 2023-02-15 20:01:12,560 INFO [Listener at localhost/37547] snapshot.RestoreSnapshotHelper(585): clone region=77b8837eb0dd784edf4b0582f0ba0a3f as 77b8837eb0dd784edf4b0582f0ba0a3f in snapshot testWithMapReduceMultiRegion 2023-02-15 20:01:12,560 INFO [Listener at localhost/37547] snapshot.RestoreSnapshotHelper(585): clone region=cfff17411e5ee60b92c4b80249237743 as cfff17411e5ee60b92c4b80249237743 in snapshot testWithMapReduceMultiRegion 2023-02-15 20:01:12,565 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(7671): creating {ENCODED => 3506ea931c9649c226fb4c38a5165b6a, NAME => 'testWithMapReduce,g\xA7\xA7,1676491266407.3506ea931c9649c226fb4c38a5165b6a.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38891/user/jenkins/test-data/7cbd6db3-0023-7f08-6a1c-eea0c6f23bc1/testWithMapReduceMultiRegion/8bd4ee16-65d3-4e64-85ab-566f80ed3785 2023-02-15 20:01:12,565 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(7671): creating {ENCODED => 8a2219c4f89e37dec8687cefabd9fc25, NAME => 'testWithMapReduce,aaa,1676491266407.8a2219c4f89e37dec8687cefabd9fc25.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38891/user/jenkins/test-data/7cbd6db3-0023-7f08-6a1c-eea0c6f23bc1/testWithMapReduceMultiRegion/8bd4ee16-65d3-4e64-85ab-566f80ed3785 2023-02-15 20:01:12,565 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(7671): creating {ENCODED => ce146f62338407483a61920d7170f142, NAME => 'testWithMapReduce,t43,1676491266407.ce146f62338407483a61920d7170f142.', STARTKEY => 't43', ENDKEY => 'wWV'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38891/user/jenkins/test-data/7cbd6db3-0023-7f08-6a1c-eea0c6f23bc1/testWithMapReduceMultiRegion/8bd4ee16-65d3-4e64-85ab-566f80ed3785 2023-02-15 20:01:12,565 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(7671): creating {ENCODED => 30b6672c9889bbc2cc2b417a34f3f49e, NAME => 'testWithMapReduce,j\xCA\xCA,1676491266407.30b6672c9889bbc2cc2b417a34f3f49e.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38891/user/jenkins/test-data/7cbd6db3-0023-7f08-6a1c-eea0c6f23bc1/testWithMapReduceMultiRegion/8bd4ee16-65d3-4e64-85ab-566f80ed3785 2023-02-15 20:01:12,566 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(7671): creating {ENCODED => aac41416f1d7fc83b90c2b3432a76ce6, NAME => 'testWithMapReduce,q\x11\x10,1676491266407.aac41416f1d7fc83b90c2b3432a76ce6.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38891/user/jenkins/test-data/7cbd6db3-0023-7f08-6a1c-eea0c6f23bc1/testWithMapReduceMultiRegion/8bd4ee16-65d3-4e64-85ab-566f80ed3785 2023-02-15 20:01:12,566 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(7671): creating {ENCODED => da7189167b0a5e71ebfc52ccf8240947, NAME => 'testWithMapReduce,wWV,1676491266407.da7189167b0a5e71ebfc52ccf8240947.', STARTKEY => 'wWV', ENDKEY => 'zz{'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38891/user/jenkins/test-data/7cbd6db3-0023-7f08-6a1c-eea0c6f23bc1/testWithMapReduceMultiRegion/8bd4ee16-65d3-4e64-85ab-566f80ed3785 2023-02-15 20:01:12,566 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(7671): creating {ENCODED => f5c7d59a05e094a402144fe6a2d882f0, NAME => 'testWithMapReduce,zz{,1676491266407.f5c7d59a05e094a402144fe6a2d882f0.', STARTKEY => 'zz{', ENDKEY => ''}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38891/user/jenkins/test-data/7cbd6db3-0023-7f08-6a1c-eea0c6f23bc1/testWithMapReduceMultiRegion/8bd4ee16-65d3-4e64-85ab-566f80ed3785 2023-02-15 20:01:12,566 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(7671): creating {ENCODED => f26f31f3358f9f2d50b3c5d32cc7b35d, NAME => 'testWithMapReduce,m\xED\xED,1676491266407.f26f31f3358f9f2d50b3c5d32cc7b35d.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38891/user/jenkins/test-data/7cbd6db3-0023-7f08-6a1c-eea0c6f23bc1/testWithMapReduceMultiRegion/8bd4ee16-65d3-4e64-85ab-566f80ed3785 2023-02-15 20:01:12,660 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,zz{,1676491266407.f5c7d59a05e094a402144fe6a2d882f0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 20:01:12,661 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1603): Closing f5c7d59a05e094a402144fe6a2d882f0, disabling compactions & flushes 2023-02-15 20:01:12,661 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,zz{,1676491266407.f5c7d59a05e094a402144fe6a2d882f0. 2023-02-15 20:01:12,661 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,zz{,1676491266407.f5c7d59a05e094a402144fe6a2d882f0. 2023-02-15 20:01:12,661 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,zz{,1676491266407.f5c7d59a05e094a402144fe6a2d882f0. after waiting 0 ms 2023-02-15 20:01:12,661 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,zz{,1676491266407.f5c7d59a05e094a402144fe6a2d882f0. 2023-02-15 20:01:12,661 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,zz{,1676491266407.f5c7d59a05e094a402144fe6a2d882f0. 2023-02-15 20:01:12,661 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1557): Region close journal for f5c7d59a05e094a402144fe6a2d882f0: 2023-02-15 20:01:12,661 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(7671): creating {ENCODED => 77b8837eb0dd784edf4b0582f0ba0a3f, NAME => 'testWithMapReduce,,1676491266407.77b8837eb0dd784edf4b0582f0ba0a3f.', STARTKEY => '', ENDKEY => 'aaa'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38891/user/jenkins/test-data/7cbd6db3-0023-7f08-6a1c-eea0c6f23bc1/testWithMapReduceMultiRegion/8bd4ee16-65d3-4e64-85ab-566f80ed3785 2023-02-15 20:01:12,662 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(865): Instantiated testWithMapReduce,g\xA7\xA7,1676491266407.3506ea931c9649c226fb4c38a5165b6a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 20:01:12,662 INFO [RestoreSnapshot-pool-4] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 584b33569807402bab19c695007854d6 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-15 20:01:12,663 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,t43,1676491266407.ce146f62338407483a61920d7170f142.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 20:01:12,663 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 3b645a76ccc943eca010c41a29ae08c8 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-15 20:01:12,663 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(865): Instantiated testWithMapReduce,wWV,1676491266407.da7189167b0a5e71ebfc52ccf8240947.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 20:01:12,664 INFO [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(628): Adding HFileLink b19871dfbf874f2d814f559e617022a3 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-15 20:01:12,671 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(865): Instantiated testWithMapReduce,q\x11\x10,1676491266407.aac41416f1d7fc83b90c2b3432a76ce6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 20:01:12,671 INFO [RestoreSnapshot-pool-5] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 9fd9cfca86f946febf2708c1bc10bdbd from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-15 20:01:12,671 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,m\xED\xED,1676491266407.f26f31f3358f9f2d50b3c5d32cc7b35d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 20:01:12,671 INFO [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(628): Adding HFileLink e9d819bfab2d44ebbd85de59dbaa3ed0 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-15 20:01:12,671 INFO [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 305eda5d270a4058a64e4c581a9ab11d from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-15 20:01:12,674 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 995c8facb2294aa3a01a52aea6ce503a from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-15 20:01:12,686 INFO [RestoreSnapshot-pool-4] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 1b8744dea70f47e290b386aa438b28ee from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-15 20:01:12,688 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(865): Instantiated testWithMapReduce,j\xCA\xCA,1676491266407.30b6672c9889bbc2cc2b417a34f3f49e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 20:01:12,688 INFO [RestoreSnapshot-pool-6] snapshot.RestoreSnapshotHelper(628): Adding HFileLink ec2992e2ea234979a8399c1be6782eb8 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-15 20:01:12,706 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1603): Closing ce146f62338407483a61920d7170f142, disabling compactions & flushes 2023-02-15 20:01:12,706 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,t43,1676491266407.ce146f62338407483a61920d7170f142. 2023-02-15 20:01:12,706 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,t43,1676491266407.ce146f62338407483a61920d7170f142. 2023-02-15 20:01:12,706 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,t43,1676491266407.ce146f62338407483a61920d7170f142. after waiting 0 ms 2023-02-15 20:01:12,706 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,t43,1676491266407.ce146f62338407483a61920d7170f142. 2023-02-15 20:01:12,706 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,t43,1676491266407.ce146f62338407483a61920d7170f142. 2023-02-15 20:01:12,706 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1557): Region close journal for ce146f62338407483a61920d7170f142: 2023-02-15 20:01:12,706 INFO [RestoreSnapshot-pool-5] snapshot.RestoreSnapshotHelper(628): Adding HFileLink fdf07ac3996e436f919b533a96fe4829 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-15 20:01:12,706 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(7671): creating {ENCODED => cfff17411e5ee60b92c4b80249237743, NAME => 'testWithMapReduce,d\x84\x84,1676491266407.cfff17411e5ee60b92c4b80249237743.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38891/user/jenkins/test-data/7cbd6db3-0023-7f08-6a1c-eea0c6f23bc1/testWithMapReduceMultiRegion/8bd4ee16-65d3-4e64-85ab-566f80ed3785 2023-02-15 20:01:12,707 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1603): Closing da7189167b0a5e71ebfc52ccf8240947, disabling compactions & flushes 2023-02-15 20:01:12,707 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(1625): Closing region testWithMapReduce,wWV,1676491266407.da7189167b0a5e71ebfc52ccf8240947. 2023-02-15 20:01:12,707 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,wWV,1676491266407.da7189167b0a5e71ebfc52ccf8240947. 2023-02-15 20:01:12,707 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,wWV,1676491266407.da7189167b0a5e71ebfc52ccf8240947. after waiting 0 ms 2023-02-15 20:01:12,707 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,wWV,1676491266407.da7189167b0a5e71ebfc52ccf8240947. 2023-02-15 20:01:12,707 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(1837): Closed testWithMapReduce,wWV,1676491266407.da7189167b0a5e71ebfc52ccf8240947. 2023-02-15 20:01:12,707 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1557): Region close journal for da7189167b0a5e71ebfc52ccf8240947: 2023-02-15 20:01:12,706 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1603): Closing 3506ea931c9649c226fb4c38a5165b6a, disabling compactions & flushes 2023-02-15 20:01:12,707 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(1625): Closing region testWithMapReduce,g\xA7\xA7,1676491266407.3506ea931c9649c226fb4c38a5165b6a. 2023-02-15 20:01:12,707 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,g\xA7\xA7,1676491266407.3506ea931c9649c226fb4c38a5165b6a. 2023-02-15 20:01:12,707 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,g\xA7\xA7,1676491266407.3506ea931c9649c226fb4c38a5165b6a. after waiting 0 ms 2023-02-15 20:01:12,707 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,g\xA7\xA7,1676491266407.3506ea931c9649c226fb4c38a5165b6a. 2023-02-15 20:01:12,707 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(1837): Closed testWithMapReduce,g\xA7\xA7,1676491266407.3506ea931c9649c226fb4c38a5165b6a. 2023-02-15 20:01:12,707 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1557): Region close journal for 3506ea931c9649c226fb4c38a5165b6a: 2023-02-15 20:01:12,710 INFO [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 47b72bdb129e429abeee819914e83fb2 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-15 20:01:12,710 INFO [RestoreSnapshot-pool-6] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 7f7ba19388734301a91db45ebb2ab429 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-15 20:01:12,711 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1603): Closing aac41416f1d7fc83b90c2b3432a76ce6, disabling compactions & flushes 2023-02-15 20:01:12,711 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(1625): Closing region testWithMapReduce,q\x11\x10,1676491266407.aac41416f1d7fc83b90c2b3432a76ce6. 2023-02-15 20:01:12,711 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,q\x11\x10,1676491266407.aac41416f1d7fc83b90c2b3432a76ce6. 2023-02-15 20:01:12,711 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,q\x11\x10,1676491266407.aac41416f1d7fc83b90c2b3432a76ce6. after waiting 0 ms 2023-02-15 20:01:12,711 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,q\x11\x10,1676491266407.aac41416f1d7fc83b90c2b3432a76ce6. 2023-02-15 20:01:12,711 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(1837): Closed testWithMapReduce,q\x11\x10,1676491266407.aac41416f1d7fc83b90c2b3432a76ce6. 2023-02-15 20:01:12,711 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1557): Region close journal for aac41416f1d7fc83b90c2b3432a76ce6: 2023-02-15 20:01:12,715 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676491266407.77b8837eb0dd784edf4b0582f0ba0a3f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 20:01:12,716 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1603): Closing 77b8837eb0dd784edf4b0582f0ba0a3f, disabling compactions & flushes 2023-02-15 20:01:12,716 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676491266407.77b8837eb0dd784edf4b0582f0ba0a3f. 2023-02-15 20:01:12,716 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676491266407.77b8837eb0dd784edf4b0582f0ba0a3f. 2023-02-15 20:01:12,716 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676491266407.77b8837eb0dd784edf4b0582f0ba0a3f. after waiting 0 ms 2023-02-15 20:01:12,716 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676491266407.77b8837eb0dd784edf4b0582f0ba0a3f. 2023-02-15 20:01:12,716 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,,1676491266407.77b8837eb0dd784edf4b0582f0ba0a3f. 2023-02-15 20:01:12,716 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1557): Region close journal for 77b8837eb0dd784edf4b0582f0ba0a3f: 2023-02-15 20:01:12,716 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1603): Closing f26f31f3358f9f2d50b3c5d32cc7b35d, disabling compactions & flushes 2023-02-15 20:01:12,716 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,m\xED\xED,1676491266407.f26f31f3358f9f2d50b3c5d32cc7b35d. 2023-02-15 20:01:12,716 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,m\xED\xED,1676491266407.f26f31f3358f9f2d50b3c5d32cc7b35d. 2023-02-15 20:01:12,716 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,m\xED\xED,1676491266407.f26f31f3358f9f2d50b3c5d32cc7b35d. after waiting 0 ms 2023-02-15 20:01:12,716 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,m\xED\xED,1676491266407.f26f31f3358f9f2d50b3c5d32cc7b35d. 2023-02-15 20:01:12,716 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,m\xED\xED,1676491266407.f26f31f3358f9f2d50b3c5d32cc7b35d. 2023-02-15 20:01:12,716 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1557): Region close journal for f26f31f3358f9f2d50b3c5d32cc7b35d: 2023-02-15 20:01:12,717 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1603): Closing 30b6672c9889bbc2cc2b417a34f3f49e, disabling compactions & flushes 2023-02-15 20:01:12,717 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(1625): Closing region testWithMapReduce,j\xCA\xCA,1676491266407.30b6672c9889bbc2cc2b417a34f3f49e. 2023-02-15 20:01:12,717 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,j\xCA\xCA,1676491266407.30b6672c9889bbc2cc2b417a34f3f49e. 2023-02-15 20:01:12,717 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,j\xCA\xCA,1676491266407.30b6672c9889bbc2cc2b417a34f3f49e. after waiting 0 ms 2023-02-15 20:01:12,717 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,j\xCA\xCA,1676491266407.30b6672c9889bbc2cc2b417a34f3f49e. 2023-02-15 20:01:12,717 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(1837): Closed testWithMapReduce,j\xCA\xCA,1676491266407.30b6672c9889bbc2cc2b417a34f3f49e. 2023-02-15 20:01:12,717 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1557): Region close journal for 30b6672c9889bbc2cc2b417a34f3f49e: 2023-02-15 20:01:12,719 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,d\x84\x84,1676491266407.cfff17411e5ee60b92c4b80249237743.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 20:01:12,719 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 2b66b94b8cac4024b68e4f193fbadd83 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-15 20:01:12,721 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink a1a93d17faa940fd860aa03d710c0091 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-15 20:01:12,724 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1603): Closing cfff17411e5ee60b92c4b80249237743, disabling compactions & flushes 2023-02-15 20:01:12,724 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,d\x84\x84,1676491266407.cfff17411e5ee60b92c4b80249237743. 2023-02-15 20:01:12,724 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,d\x84\x84,1676491266407.cfff17411e5ee60b92c4b80249237743. 2023-02-15 20:01:12,724 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,d\x84\x84,1676491266407.cfff17411e5ee60b92c4b80249237743. after waiting 0 ms 2023-02-15 20:01:12,724 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,d\x84\x84,1676491266407.cfff17411e5ee60b92c4b80249237743. 2023-02-15 20:01:12,724 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,d\x84\x84,1676491266407.cfff17411e5ee60b92c4b80249237743. 2023-02-15 20:01:12,724 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1557): Region close journal for cfff17411e5ee60b92c4b80249237743: 2023-02-15 20:01:13,087 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(865): Instantiated testWithMapReduce,aaa,1676491266407.8a2219c4f89e37dec8687cefabd9fc25.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 20:01:13,088 INFO [RestoreSnapshot-pool-7] snapshot.RestoreSnapshotHelper(628): Adding HFileLink b147a9e48d4e4e39aa9c981c22189d7c from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-15 20:01:13,091 INFO [RestoreSnapshot-pool-7] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 94652720be85460cba80f932503517b1 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-15 20:01:13,094 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1603): Closing 8a2219c4f89e37dec8687cefabd9fc25, disabling compactions & flushes 2023-02-15 20:01:13,094 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(1625): Closing region testWithMapReduce,aaa,1676491266407.8a2219c4f89e37dec8687cefabd9fc25. 2023-02-15 20:01:13,094 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,aaa,1676491266407.8a2219c4f89e37dec8687cefabd9fc25. 2023-02-15 20:01:13,094 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,aaa,1676491266407.8a2219c4f89e37dec8687cefabd9fc25. after waiting 0 ms 2023-02-15 20:01:13,094 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,aaa,1676491266407.8a2219c4f89e37dec8687cefabd9fc25. 2023-02-15 20:01:13,094 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(1837): Closed testWithMapReduce,aaa,1676491266407.8a2219c4f89e37dec8687cefabd9fc25. 2023-02-15 20:01:13,094 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1557): Region close journal for 8a2219c4f89e37dec8687cefabd9fc25: 2023-02-15 20:01:13,094 INFO [Listener at localhost/37547] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "testWithMapReduceMultiRegion" table: "testWithMapReduce" creation_time: 1676491269155 type: FLUSH version: 2 ttl: 0 2023-02-15 20:01:13,095 DEBUG [Listener at localhost/37547] snapshot.RestoreSnapshotHelper(832): Restored table dir:hdfs://localhost:38891/user/jenkins/test-data/7cbd6db3-0023-7f08-6a1c-eea0c6f23bc1/testWithMapReduceMultiRegion/8bd4ee16-65d3-4e64-85ab-566f80ed3785 2023-02-15 20:01:13,095 DEBUG [Listener at localhost/37547] util.CommonFSUtils(682): File system contents for path hdfs://localhost:38891/user/jenkins/test-data/7cbd6db3-0023-7f08-6a1c-eea0c6f23bc1/testWithMapReduceMultiRegion/8bd4ee16-65d3-4e64-85ab-566f80ed3785 2023-02-15 20:01:13,096 DEBUG [Listener at localhost/37547] util.CommonFSUtils(699): |-data/ 2023-02-15 20:01:13,096 DEBUG [Listener at localhost/37547] util.CommonFSUtils(699): |----default/ 2023-02-15 20:01:13,097 DEBUG [Listener at localhost/37547] util.CommonFSUtils(699): |-------testWithMapReduce/ 2023-02-15 20:01:13,097 DEBUG [Listener at localhost/37547] util.CommonFSUtils(699): |----------30b6672c9889bbc2cc2b417a34f3f49e/ 2023-02-15 20:01:13,098 DEBUG [Listener at localhost/37547] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-15 20:01:13,098 DEBUG [Listener at localhost/37547] util.CommonFSUtils(699): |-------------f1/ 2023-02-15 20:01:13,098 DEBUG [Listener at localhost/37547] util.CommonFSUtils(702): |----------------testWithMapReduce=30b6672c9889bbc2cc2b417a34f3f49e-ec2992e2ea234979a8399c1be6782eb8 2023-02-15 20:01:13,098 DEBUG [Listener at localhost/37547] util.CommonFSUtils(699): |-------------f2/ 2023-02-15 20:01:13,099 DEBUG [Listener at localhost/37547] util.CommonFSUtils(702): |----------------testWithMapReduce=30b6672c9889bbc2cc2b417a34f3f49e-7f7ba19388734301a91db45ebb2ab429 2023-02-15 20:01:13,099 DEBUG [Listener at localhost/37547] util.CommonFSUtils(699): |----------3506ea931c9649c226fb4c38a5165b6a/ 2023-02-15 20:01:13,099 DEBUG [Listener at localhost/37547] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-15 20:01:13,100 DEBUG [Listener at localhost/37547] util.CommonFSUtils(699): |-------------f1/ 2023-02-15 20:01:13,100 DEBUG [Listener at localhost/37547] util.CommonFSUtils(702): |----------------testWithMapReduce=3506ea931c9649c226fb4c38a5165b6a-584b33569807402bab19c695007854d6 2023-02-15 20:01:13,100 DEBUG [Listener at localhost/37547] util.CommonFSUtils(699): |-------------f2/ 2023-02-15 20:01:13,101 DEBUG [Listener at localhost/37547] util.CommonFSUtils(702): |----------------testWithMapReduce=3506ea931c9649c226fb4c38a5165b6a-1b8744dea70f47e290b386aa438b28ee 2023-02-15 20:01:13,101 DEBUG [Listener at localhost/37547] util.CommonFSUtils(699): |----------77b8837eb0dd784edf4b0582f0ba0a3f/ 2023-02-15 20:01:13,101 DEBUG [Listener at localhost/37547] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-15 20:01:13,101 DEBUG [Listener at localhost/37547] util.CommonFSUtils(699): |----------8a2219c4f89e37dec8687cefabd9fc25/ 2023-02-15 20:01:13,102 DEBUG [Listener at localhost/37547] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-15 20:01:13,102 DEBUG [Listener at localhost/37547] util.CommonFSUtils(699): |-------------f1/ 2023-02-15 20:01:13,103 DEBUG [Listener at localhost/37547] util.CommonFSUtils(702): |----------------testWithMapReduce=8a2219c4f89e37dec8687cefabd9fc25-b147a9e48d4e4e39aa9c981c22189d7c 2023-02-15 20:01:13,103 DEBUG [Listener at localhost/37547] util.CommonFSUtils(699): |-------------f2/ 2023-02-15 20:01:13,103 DEBUG [Listener at localhost/37547] util.CommonFSUtils(702): |----------------testWithMapReduce=8a2219c4f89e37dec8687cefabd9fc25-94652720be85460cba80f932503517b1 2023-02-15 20:01:13,103 DEBUG [Listener at localhost/37547] util.CommonFSUtils(699): |----------aac41416f1d7fc83b90c2b3432a76ce6/ 2023-02-15 20:01:13,104 DEBUG [Listener at localhost/37547] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-15 20:01:13,104 DEBUG [Listener at localhost/37547] util.CommonFSUtils(699): |-------------f1/ 2023-02-15 20:01:13,104 DEBUG [Listener at localhost/37547] util.CommonFSUtils(702): |----------------testWithMapReduce=aac41416f1d7fc83b90c2b3432a76ce6-9fd9cfca86f946febf2708c1bc10bdbd 2023-02-15 20:01:13,105 DEBUG [Listener at localhost/37547] util.CommonFSUtils(699): |-------------f2/ 2023-02-15 20:01:13,105 DEBUG [Listener at localhost/37547] util.CommonFSUtils(702): |----------------testWithMapReduce=aac41416f1d7fc83b90c2b3432a76ce6-fdf07ac3996e436f919b533a96fe4829 2023-02-15 20:01:13,105 DEBUG [Listener at localhost/37547] util.CommonFSUtils(699): |----------ce146f62338407483a61920d7170f142/ 2023-02-15 20:01:13,106 DEBUG [Listener at localhost/37547] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-15 20:01:13,106 DEBUG [Listener at localhost/37547] util.CommonFSUtils(699): |-------------f1/ 2023-02-15 20:01:13,107 DEBUG [Listener at localhost/37547] util.CommonFSUtils(702): |----------------testWithMapReduce=ce146f62338407483a61920d7170f142-3b645a76ccc943eca010c41a29ae08c8 2023-02-15 20:01:13,107 DEBUG [Listener at localhost/37547] util.CommonFSUtils(699): |-------------f2/ 2023-02-15 20:01:13,107 DEBUG [Listener at localhost/37547] util.CommonFSUtils(702): |----------------testWithMapReduce=ce146f62338407483a61920d7170f142-995c8facb2294aa3a01a52aea6ce503a 2023-02-15 20:01:13,107 DEBUG [Listener at localhost/37547] util.CommonFSUtils(699): |----------cfff17411e5ee60b92c4b80249237743/ 2023-02-15 20:01:13,108 DEBUG [Listener at localhost/37547] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-15 20:01:13,108 DEBUG [Listener at localhost/37547] util.CommonFSUtils(699): |-------------f1/ 2023-02-15 20:01:13,108 DEBUG [Listener at localhost/37547] util.CommonFSUtils(702): |----------------testWithMapReduce=cfff17411e5ee60b92c4b80249237743-2b66b94b8cac4024b68e4f193fbadd83 2023-02-15 20:01:13,108 DEBUG [Listener at localhost/37547] util.CommonFSUtils(699): |-------------f2/ 2023-02-15 20:01:13,109 DEBUG [Listener at localhost/37547] util.CommonFSUtils(702): |----------------testWithMapReduce=cfff17411e5ee60b92c4b80249237743-a1a93d17faa940fd860aa03d710c0091 2023-02-15 20:01:13,109 DEBUG [Listener at localhost/37547] util.CommonFSUtils(699): |----------da7189167b0a5e71ebfc52ccf8240947/ 2023-02-15 20:01:13,110 DEBUG [Listener at localhost/37547] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-15 20:01:13,110 DEBUG [Listener at localhost/37547] util.CommonFSUtils(699): |-------------f1/ 2023-02-15 20:01:13,110 DEBUG [Listener at localhost/37547] util.CommonFSUtils(702): |----------------testWithMapReduce=da7189167b0a5e71ebfc52ccf8240947-b19871dfbf874f2d814f559e617022a3 2023-02-15 20:01:13,110 DEBUG [Listener at localhost/37547] util.CommonFSUtils(699): |-------------f2/ 2023-02-15 20:01:13,111 DEBUG [Listener at localhost/37547] util.CommonFSUtils(702): |----------------testWithMapReduce=da7189167b0a5e71ebfc52ccf8240947-305eda5d270a4058a64e4c581a9ab11d 2023-02-15 20:01:13,111 DEBUG [Listener at localhost/37547] util.CommonFSUtils(699): |----------f26f31f3358f9f2d50b3c5d32cc7b35d/ 2023-02-15 20:01:13,111 DEBUG [Listener at localhost/37547] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-15 20:01:13,111 DEBUG [Listener at localhost/37547] util.CommonFSUtils(699): |-------------f1/ 2023-02-15 20:01:13,112 DEBUG [Listener at localhost/37547] util.CommonFSUtils(702): |----------------testWithMapReduce=f26f31f3358f9f2d50b3c5d32cc7b35d-e9d819bfab2d44ebbd85de59dbaa3ed0 2023-02-15 20:01:13,112 DEBUG [Listener at localhost/37547] util.CommonFSUtils(699): |-------------f2/ 2023-02-15 20:01:13,112 DEBUG [Listener at localhost/37547] util.CommonFSUtils(702): |----------------testWithMapReduce=f26f31f3358f9f2d50b3c5d32cc7b35d-47b72bdb129e429abeee819914e83fb2 2023-02-15 20:01:13,112 DEBUG [Listener at localhost/37547] util.CommonFSUtils(699): |----------f5c7d59a05e094a402144fe6a2d882f0/ 2023-02-15 20:01:13,113 DEBUG [Listener at localhost/37547] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-15 20:01:13,121 DEBUG [Listener at localhost/37547] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.17-SNAPSHOT.jar 2023-02-15 20:01:13,122 DEBUG [Listener at localhost/37547] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.17-SNAPSHOT.jar 2023-02-15 20:01:13,123 DEBUG [Listener at localhost/37547] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.17-SNAPSHOT.jar 2023-02-15 20:01:13,123 DEBUG [Listener at localhost/37547] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.17-SNAPSHOT.jar 2023-02-15 20:01:14,029 DEBUG [Listener at localhost/37547] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b60948e8-4ebf-4913-96a4-e7519f684365/hadoop-8012694530558782946.jar 2023-02-15 20:01:14,030 DEBUG [Listener at localhost/37547] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.17-SNAPSHOT.jar 2023-02-15 20:01:14,030 DEBUG [Listener at localhost/37547] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.17-SNAPSHOT.jar 2023-02-15 20:01:14,096 DEBUG [Listener at localhost/37547] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b60948e8-4ebf-4913-96a4-e7519f684365/hadoop-6549371609582815226.jar 2023-02-15 20:01:14,097 DEBUG [Listener at localhost/37547] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.17-SNAPSHOT.jar 2023-02-15 20:01:14,097 DEBUG [Listener at localhost/37547] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.17-SNAPSHOT.jar 2023-02-15 20:01:14,098 DEBUG [Listener at localhost/37547] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.17-SNAPSHOT.jar 2023-02-15 20:01:14,098 DEBUG [Listener at localhost/37547] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.17-SNAPSHOT.jar 2023-02-15 20:01:14,099 DEBUG [Listener at localhost/37547] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.17-SNAPSHOT.jar 2023-02-15 20:01:14,099 DEBUG [Listener at localhost/37547] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.17-SNAPSHOT.jar 2023-02-15 20:01:14,099 DEBUG [Listener at localhost/37547] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-02-15 20:01:14,100 DEBUG [Listener at localhost/37547] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-02-15 20:01:14,100 DEBUG [Listener at localhost/37547] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-02-15 20:01:14,101 DEBUG [Listener at localhost/37547] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-02-15 20:01:14,101 DEBUG [Listener at localhost/37547] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-02-15 20:01:14,102 DEBUG [Listener at localhost/37547] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-02-15 20:01:14,102 DEBUG [Listener at localhost/37547] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-02-15 20:01:14,102 DEBUG [Listener at localhost/37547] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-02-15 20:01:14,103 DEBUG [Listener at localhost/37547] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-02-15 20:01:14,103 DEBUG [Listener at localhost/37547] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-02-15 20:01:14,109 DEBUG [Listener at localhost/37547] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.io.ImmutableBytesWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.17-SNAPSHOT.jar 2023-02-15 20:01:14,110 DEBUG [Listener at localhost/37547] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.NullWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-15 20:01:14,110 DEBUG [Listener at localhost/37547] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-15 20:01:14,111 DEBUG [Listener at localhost/37547] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-15 20:01:14,111 DEBUG [Listener at localhost/37547] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapred.lib.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-02-15 20:01:14,177 DEBUG [Listener at localhost/37547] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapred.TableSnapshotInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b60948e8-4ebf-4913-96a4-e7519f684365/hadoop-5903238406806693061.jar 2023-02-15 20:01:14,178 DEBUG [Listener at localhost/37547] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapred.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-02-15 20:01:14,227 WARN [Listener at localhost/37547] mapreduce.JobResourceUploader(142): Hadoop command-line option parsing not performed. Implement the Tool interface and execute your application with ToolRunner to remedy this. 2023-02-15 20:01:14,237 WARN [Listener at localhost/37547] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-02-15 20:01:14,248 INFO [Listener at localhost/37547] mapreduce.TableSnapshotInputFormatImpl(392): Provided Scan has DEFAULT ReadType, updating STREAM for Snapshot-based InputFormat 2023-02-15 20:01:14,627 WARN [Listener at localhost/37547] fs.FileUtil(850): Command 'ln -s /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b60948e8-4ebf-4913-96a4-e7519f684365/mapreduce.cluster.local.dir/1676491274552/libjars /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/*' failed 1 with: ln: failed to create symbolic link '/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/*': No such file or directory 2023-02-15 20:01:14,627 WARN [Listener at localhost/37547] mapred.LocalDistributedCacheManager(202): Failed to create symlink: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b60948e8-4ebf-4913-96a4-e7519f684365/mapreduce.cluster.local.dir/1676491274552/libjars <- /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/* 2023-02-15 20:01:14,797 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,j\xCA\xCA,1676491266407.30b6672c9889bbc2cc2b417a34f3f49e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 20:01:14,797 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-15 20:01:14,799 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-15 20:01:14,802 INFO [StoreOpener-30b6672c9889bbc2cc2b417a34f3f49e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 30b6672c9889bbc2cc2b417a34f3f49e 2023-02-15 20:01:14,803 DEBUG [StoreOpener-30b6672c9889bbc2cc2b417a34f3f49e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38891/user/jenkins/test-data/7cbd6db3-0023-7f08-6a1c-eea0c6f23bc1/testWithMapReduceMultiRegion/8bd4ee16-65d3-4e64-85ab-566f80ed3785/data/default/testWithMapReduce/30b6672c9889bbc2cc2b417a34f3f49e/f1 2023-02-15 20:01:14,804 INFO [StoreOpener-30b6672c9889bbc2cc2b417a34f3f49e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 30b6672c9889bbc2cc2b417a34f3f49e columnFamilyName f1 2023-02-15 20:01:14,813 DEBUG [StoreOpener-30b6672c9889bbc2cc2b417a34f3f49e-1] regionserver.HStore(539): loaded hdfs://localhost:38891/user/jenkins/test-data/7cbd6db3-0023-7f08-6a1c-eea0c6f23bc1/testWithMapReduceMultiRegion/8bd4ee16-65d3-4e64-85ab-566f80ed3785/data/default/testWithMapReduce/30b6672c9889bbc2cc2b417a34f3f49e/f1/testWithMapReduce=30b6672c9889bbc2cc2b417a34f3f49e-ec2992e2ea234979a8399c1be6782eb8 2023-02-15 20:01:14,813 INFO [StoreOpener-30b6672c9889bbc2cc2b417a34f3f49e-1] regionserver.HStore(310): Store=30b6672c9889bbc2cc2b417a34f3f49e/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 20:01:14,813 INFO [StoreOpener-30b6672c9889bbc2cc2b417a34f3f49e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 30b6672c9889bbc2cc2b417a34f3f49e 2023-02-15 20:01:14,814 DEBUG [StoreOpener-30b6672c9889bbc2cc2b417a34f3f49e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38891/user/jenkins/test-data/7cbd6db3-0023-7f08-6a1c-eea0c6f23bc1/testWithMapReduceMultiRegion/8bd4ee16-65d3-4e64-85ab-566f80ed3785/data/default/testWithMapReduce/30b6672c9889bbc2cc2b417a34f3f49e/f2 2023-02-15 20:01:14,815 INFO [StoreOpener-30b6672c9889bbc2cc2b417a34f3f49e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 30b6672c9889bbc2cc2b417a34f3f49e columnFamilyName f2 2023-02-15 20:01:14,823 DEBUG [StoreOpener-30b6672c9889bbc2cc2b417a34f3f49e-1] regionserver.HStore(539): loaded hdfs://localhost:38891/user/jenkins/test-data/7cbd6db3-0023-7f08-6a1c-eea0c6f23bc1/testWithMapReduceMultiRegion/8bd4ee16-65d3-4e64-85ab-566f80ed3785/data/default/testWithMapReduce/30b6672c9889bbc2cc2b417a34f3f49e/f2/testWithMapReduce=30b6672c9889bbc2cc2b417a34f3f49e-7f7ba19388734301a91db45ebb2ab429 2023-02-15 20:01:14,824 INFO [StoreOpener-30b6672c9889bbc2cc2b417a34f3f49e-1] regionserver.HStore(310): Store=30b6672c9889bbc2cc2b417a34f3f49e/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 20:01:14,824 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-15 20:01:14,824 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 30b6672c9889bbc2cc2b417a34f3f49e; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62318890, jitterRate=-0.07137617468833923}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-15 20:01:14,824 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 30b6672c9889bbc2cc2b417a34f3f49e: 2023-02-15 20:01:15,001 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 30b6672c9889bbc2cc2b417a34f3f49e, disabling compactions & flushes 2023-02-15 20:01:15,002 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,j\xCA\xCA,1676491266407.30b6672c9889bbc2cc2b417a34f3f49e. 2023-02-15 20:01:15,002 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,j\xCA\xCA,1676491266407.30b6672c9889bbc2cc2b417a34f3f49e. 2023-02-15 20:01:15,002 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,j\xCA\xCA,1676491266407.30b6672c9889bbc2cc2b417a34f3f49e. after waiting 0 ms 2023-02-15 20:01:15,002 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,j\xCA\xCA,1676491266407.30b6672c9889bbc2cc2b417a34f3f49e. 2023-02-15 20:01:15,009 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,j\xCA\xCA,1676491266407.30b6672c9889bbc2cc2b417a34f3f49e. 2023-02-15 20:01:15,009 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 30b6672c9889bbc2cc2b417a34f3f49e: 2023-02-15 20:01:15,027 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,aaa,1676491266407.8a2219c4f89e37dec8687cefabd9fc25.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 20:01:15,028 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-15 20:01:15,030 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-15 20:01:15,033 INFO [StoreOpener-8a2219c4f89e37dec8687cefabd9fc25-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 8a2219c4f89e37dec8687cefabd9fc25 2023-02-15 20:01:15,034 DEBUG [StoreOpener-8a2219c4f89e37dec8687cefabd9fc25-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38891/user/jenkins/test-data/7cbd6db3-0023-7f08-6a1c-eea0c6f23bc1/testWithMapReduceMultiRegion/8bd4ee16-65d3-4e64-85ab-566f80ed3785/data/default/testWithMapReduce/8a2219c4f89e37dec8687cefabd9fc25/f1 2023-02-15 20:01:15,034 INFO [StoreOpener-8a2219c4f89e37dec8687cefabd9fc25-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8a2219c4f89e37dec8687cefabd9fc25 columnFamilyName f1 2023-02-15 20:01:15,042 DEBUG [StoreOpener-8a2219c4f89e37dec8687cefabd9fc25-1] regionserver.HStore(539): loaded hdfs://localhost:38891/user/jenkins/test-data/7cbd6db3-0023-7f08-6a1c-eea0c6f23bc1/testWithMapReduceMultiRegion/8bd4ee16-65d3-4e64-85ab-566f80ed3785/data/default/testWithMapReduce/8a2219c4f89e37dec8687cefabd9fc25/f1/testWithMapReduce=8a2219c4f89e37dec8687cefabd9fc25-b147a9e48d4e4e39aa9c981c22189d7c 2023-02-15 20:01:15,042 INFO [StoreOpener-8a2219c4f89e37dec8687cefabd9fc25-1] regionserver.HStore(310): Store=8a2219c4f89e37dec8687cefabd9fc25/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 20:01:15,042 INFO [StoreOpener-8a2219c4f89e37dec8687cefabd9fc25-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 8a2219c4f89e37dec8687cefabd9fc25 2023-02-15 20:01:15,044 DEBUG [StoreOpener-8a2219c4f89e37dec8687cefabd9fc25-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38891/user/jenkins/test-data/7cbd6db3-0023-7f08-6a1c-eea0c6f23bc1/testWithMapReduceMultiRegion/8bd4ee16-65d3-4e64-85ab-566f80ed3785/data/default/testWithMapReduce/8a2219c4f89e37dec8687cefabd9fc25/f2 2023-02-15 20:01:15,044 INFO [StoreOpener-8a2219c4f89e37dec8687cefabd9fc25-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8a2219c4f89e37dec8687cefabd9fc25 columnFamilyName f2 2023-02-15 20:01:15,051 DEBUG [StoreOpener-8a2219c4f89e37dec8687cefabd9fc25-1] regionserver.HStore(539): loaded hdfs://localhost:38891/user/jenkins/test-data/7cbd6db3-0023-7f08-6a1c-eea0c6f23bc1/testWithMapReduceMultiRegion/8bd4ee16-65d3-4e64-85ab-566f80ed3785/data/default/testWithMapReduce/8a2219c4f89e37dec8687cefabd9fc25/f2/testWithMapReduce=8a2219c4f89e37dec8687cefabd9fc25-94652720be85460cba80f932503517b1 2023-02-15 20:01:15,051 INFO [StoreOpener-8a2219c4f89e37dec8687cefabd9fc25-1] regionserver.HStore(310): Store=8a2219c4f89e37dec8687cefabd9fc25/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 20:01:15,052 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-15 20:01:15,052 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 8a2219c4f89e37dec8687cefabd9fc25; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65405120, jitterRate=-0.02538776397705078}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-15 20:01:15,053 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 8a2219c4f89e37dec8687cefabd9fc25: 2023-02-15 20:01:15,162 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 8a2219c4f89e37dec8687cefabd9fc25, disabling compactions & flushes 2023-02-15 20:01:15,162 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,aaa,1676491266407.8a2219c4f89e37dec8687cefabd9fc25. 2023-02-15 20:01:15,162 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,aaa,1676491266407.8a2219c4f89e37dec8687cefabd9fc25. 2023-02-15 20:01:15,162 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,aaa,1676491266407.8a2219c4f89e37dec8687cefabd9fc25. after waiting 0 ms 2023-02-15 20:01:15,162 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,aaa,1676491266407.8a2219c4f89e37dec8687cefabd9fc25. 2023-02-15 20:01:15,165 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,aaa,1676491266407.8a2219c4f89e37dec8687cefabd9fc25. 2023-02-15 20:01:15,165 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 8a2219c4f89e37dec8687cefabd9fc25: 2023-02-15 20:01:15,172 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,wWV,1676491266407.da7189167b0a5e71ebfc52ccf8240947.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 20:01:15,172 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-15 20:01:15,175 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-15 20:01:15,179 INFO [StoreOpener-da7189167b0a5e71ebfc52ccf8240947-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region da7189167b0a5e71ebfc52ccf8240947 2023-02-15 20:01:15,180 DEBUG [StoreOpener-da7189167b0a5e71ebfc52ccf8240947-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38891/user/jenkins/test-data/7cbd6db3-0023-7f08-6a1c-eea0c6f23bc1/testWithMapReduceMultiRegion/8bd4ee16-65d3-4e64-85ab-566f80ed3785/data/default/testWithMapReduce/da7189167b0a5e71ebfc52ccf8240947/f1 2023-02-15 20:01:15,180 INFO [StoreOpener-da7189167b0a5e71ebfc52ccf8240947-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region da7189167b0a5e71ebfc52ccf8240947 columnFamilyName f1 2023-02-15 20:01:15,189 DEBUG [StoreOpener-da7189167b0a5e71ebfc52ccf8240947-1] regionserver.HStore(539): loaded hdfs://localhost:38891/user/jenkins/test-data/7cbd6db3-0023-7f08-6a1c-eea0c6f23bc1/testWithMapReduceMultiRegion/8bd4ee16-65d3-4e64-85ab-566f80ed3785/data/default/testWithMapReduce/da7189167b0a5e71ebfc52ccf8240947/f1/testWithMapReduce=da7189167b0a5e71ebfc52ccf8240947-b19871dfbf874f2d814f559e617022a3 2023-02-15 20:01:15,189 INFO [StoreOpener-da7189167b0a5e71ebfc52ccf8240947-1] regionserver.HStore(310): Store=da7189167b0a5e71ebfc52ccf8240947/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 20:01:15,189 INFO [StoreOpener-da7189167b0a5e71ebfc52ccf8240947-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region da7189167b0a5e71ebfc52ccf8240947 2023-02-15 20:01:15,190 DEBUG [StoreOpener-da7189167b0a5e71ebfc52ccf8240947-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38891/user/jenkins/test-data/7cbd6db3-0023-7f08-6a1c-eea0c6f23bc1/testWithMapReduceMultiRegion/8bd4ee16-65d3-4e64-85ab-566f80ed3785/data/default/testWithMapReduce/da7189167b0a5e71ebfc52ccf8240947/f2 2023-02-15 20:01:15,191 INFO [StoreOpener-da7189167b0a5e71ebfc52ccf8240947-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region da7189167b0a5e71ebfc52ccf8240947 columnFamilyName f2 2023-02-15 20:01:15,197 DEBUG [StoreOpener-da7189167b0a5e71ebfc52ccf8240947-1] regionserver.HStore(539): loaded hdfs://localhost:38891/user/jenkins/test-data/7cbd6db3-0023-7f08-6a1c-eea0c6f23bc1/testWithMapReduceMultiRegion/8bd4ee16-65d3-4e64-85ab-566f80ed3785/data/default/testWithMapReduce/da7189167b0a5e71ebfc52ccf8240947/f2/testWithMapReduce=da7189167b0a5e71ebfc52ccf8240947-305eda5d270a4058a64e4c581a9ab11d 2023-02-15 20:01:15,197 INFO [StoreOpener-da7189167b0a5e71ebfc52ccf8240947-1] regionserver.HStore(310): Store=da7189167b0a5e71ebfc52ccf8240947/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 20:01:15,198 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-15 20:01:15,198 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened da7189167b0a5e71ebfc52ccf8240947; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73331436, jitterRate=0.092723548412323}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-15 20:01:15,198 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for da7189167b0a5e71ebfc52ccf8240947: 2023-02-15 20:01:15,241 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing da7189167b0a5e71ebfc52ccf8240947, disabling compactions & flushes 2023-02-15 20:01:15,241 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,wWV,1676491266407.da7189167b0a5e71ebfc52ccf8240947. 2023-02-15 20:01:15,241 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,wWV,1676491266407.da7189167b0a5e71ebfc52ccf8240947. 2023-02-15 20:01:15,241 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,wWV,1676491266407.da7189167b0a5e71ebfc52ccf8240947. after waiting 0 ms 2023-02-15 20:01:15,241 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,wWV,1676491266407.da7189167b0a5e71ebfc52ccf8240947. 2023-02-15 20:01:15,244 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,wWV,1676491266407.da7189167b0a5e71ebfc52ccf8240947. 2023-02-15 20:01:15,245 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for da7189167b0a5e71ebfc52ccf8240947: 2023-02-15 20:01:15,250 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,t43,1676491266407.ce146f62338407483a61920d7170f142.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 20:01:15,250 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-15 20:01:15,251 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-15 20:01:15,253 INFO [StoreOpener-ce146f62338407483a61920d7170f142-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region ce146f62338407483a61920d7170f142 2023-02-15 20:01:15,254 DEBUG [StoreOpener-ce146f62338407483a61920d7170f142-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38891/user/jenkins/test-data/7cbd6db3-0023-7f08-6a1c-eea0c6f23bc1/testWithMapReduceMultiRegion/8bd4ee16-65d3-4e64-85ab-566f80ed3785/data/default/testWithMapReduce/ce146f62338407483a61920d7170f142/f1 2023-02-15 20:01:15,255 INFO [StoreOpener-ce146f62338407483a61920d7170f142-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ce146f62338407483a61920d7170f142 columnFamilyName f1 2023-02-15 20:01:15,266 DEBUG [StoreOpener-ce146f62338407483a61920d7170f142-1] regionserver.HStore(539): loaded hdfs://localhost:38891/user/jenkins/test-data/7cbd6db3-0023-7f08-6a1c-eea0c6f23bc1/testWithMapReduceMultiRegion/8bd4ee16-65d3-4e64-85ab-566f80ed3785/data/default/testWithMapReduce/ce146f62338407483a61920d7170f142/f1/testWithMapReduce=ce146f62338407483a61920d7170f142-3b645a76ccc943eca010c41a29ae08c8 2023-02-15 20:01:15,266 INFO [StoreOpener-ce146f62338407483a61920d7170f142-1] regionserver.HStore(310): Store=ce146f62338407483a61920d7170f142/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 20:01:15,266 INFO [StoreOpener-ce146f62338407483a61920d7170f142-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region ce146f62338407483a61920d7170f142 2023-02-15 20:01:15,267 DEBUG [StoreOpener-ce146f62338407483a61920d7170f142-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38891/user/jenkins/test-data/7cbd6db3-0023-7f08-6a1c-eea0c6f23bc1/testWithMapReduceMultiRegion/8bd4ee16-65d3-4e64-85ab-566f80ed3785/data/default/testWithMapReduce/ce146f62338407483a61920d7170f142/f2 2023-02-15 20:01:15,267 INFO [StoreOpener-ce146f62338407483a61920d7170f142-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ce146f62338407483a61920d7170f142 columnFamilyName f2 2023-02-15 20:01:15,274 DEBUG [StoreOpener-ce146f62338407483a61920d7170f142-1] regionserver.HStore(539): loaded hdfs://localhost:38891/user/jenkins/test-data/7cbd6db3-0023-7f08-6a1c-eea0c6f23bc1/testWithMapReduceMultiRegion/8bd4ee16-65d3-4e64-85ab-566f80ed3785/data/default/testWithMapReduce/ce146f62338407483a61920d7170f142/f2/testWithMapReduce=ce146f62338407483a61920d7170f142-995c8facb2294aa3a01a52aea6ce503a 2023-02-15 20:01:15,274 INFO [StoreOpener-ce146f62338407483a61920d7170f142-1] regionserver.HStore(310): Store=ce146f62338407483a61920d7170f142/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 20:01:15,275 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-15 20:01:15,275 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened ce146f62338407483a61920d7170f142; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69158332, jitterRate=0.03053945302963257}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-15 20:01:15,275 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for ce146f62338407483a61920d7170f142: 2023-02-15 20:01:15,322 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing ce146f62338407483a61920d7170f142, disabling compactions & flushes 2023-02-15 20:01:15,322 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,t43,1676491266407.ce146f62338407483a61920d7170f142. 2023-02-15 20:01:15,322 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,t43,1676491266407.ce146f62338407483a61920d7170f142. 2023-02-15 20:01:15,322 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,t43,1676491266407.ce146f62338407483a61920d7170f142. after waiting 0 ms 2023-02-15 20:01:15,322 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,t43,1676491266407.ce146f62338407483a61920d7170f142. 2023-02-15 20:01:15,325 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,t43,1676491266407.ce146f62338407483a61920d7170f142. 2023-02-15 20:01:15,326 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for ce146f62338407483a61920d7170f142: 2023-02-15 20:01:15,331 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,g\xA7\xA7,1676491266407.3506ea931c9649c226fb4c38a5165b6a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 20:01:15,331 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-15 20:01:15,337 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-15 20:01:15,340 INFO [StoreOpener-3506ea931c9649c226fb4c38a5165b6a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 3506ea931c9649c226fb4c38a5165b6a 2023-02-15 20:01:15,341 DEBUG [StoreOpener-3506ea931c9649c226fb4c38a5165b6a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38891/user/jenkins/test-data/7cbd6db3-0023-7f08-6a1c-eea0c6f23bc1/testWithMapReduceMultiRegion/8bd4ee16-65d3-4e64-85ab-566f80ed3785/data/default/testWithMapReduce/3506ea931c9649c226fb4c38a5165b6a/f1 2023-02-15 20:01:15,341 INFO [StoreOpener-3506ea931c9649c226fb4c38a5165b6a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3506ea931c9649c226fb4c38a5165b6a columnFamilyName f1 2023-02-15 20:01:15,347 DEBUG [StoreOpener-3506ea931c9649c226fb4c38a5165b6a-1] regionserver.HStore(539): loaded hdfs://localhost:38891/user/jenkins/test-data/7cbd6db3-0023-7f08-6a1c-eea0c6f23bc1/testWithMapReduceMultiRegion/8bd4ee16-65d3-4e64-85ab-566f80ed3785/data/default/testWithMapReduce/3506ea931c9649c226fb4c38a5165b6a/f1/testWithMapReduce=3506ea931c9649c226fb4c38a5165b6a-584b33569807402bab19c695007854d6 2023-02-15 20:01:15,348 INFO [StoreOpener-3506ea931c9649c226fb4c38a5165b6a-1] regionserver.HStore(310): Store=3506ea931c9649c226fb4c38a5165b6a/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 20:01:15,348 INFO [StoreOpener-3506ea931c9649c226fb4c38a5165b6a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 3506ea931c9649c226fb4c38a5165b6a 2023-02-15 20:01:15,349 DEBUG [StoreOpener-3506ea931c9649c226fb4c38a5165b6a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38891/user/jenkins/test-data/7cbd6db3-0023-7f08-6a1c-eea0c6f23bc1/testWithMapReduceMultiRegion/8bd4ee16-65d3-4e64-85ab-566f80ed3785/data/default/testWithMapReduce/3506ea931c9649c226fb4c38a5165b6a/f2 2023-02-15 20:01:15,349 INFO [StoreOpener-3506ea931c9649c226fb4c38a5165b6a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3506ea931c9649c226fb4c38a5165b6a columnFamilyName f2 2023-02-15 20:01:15,355 DEBUG [StoreOpener-3506ea931c9649c226fb4c38a5165b6a-1] regionserver.HStore(539): loaded hdfs://localhost:38891/user/jenkins/test-data/7cbd6db3-0023-7f08-6a1c-eea0c6f23bc1/testWithMapReduceMultiRegion/8bd4ee16-65d3-4e64-85ab-566f80ed3785/data/default/testWithMapReduce/3506ea931c9649c226fb4c38a5165b6a/f2/testWithMapReduce=3506ea931c9649c226fb4c38a5165b6a-1b8744dea70f47e290b386aa438b28ee 2023-02-15 20:01:15,355 INFO [StoreOpener-3506ea931c9649c226fb4c38a5165b6a-1] regionserver.HStore(310): Store=3506ea931c9649c226fb4c38a5165b6a/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 20:01:15,356 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-15 20:01:15,356 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 3506ea931c9649c226fb4c38a5165b6a; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62077760, jitterRate=-0.07496929168701172}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-15 20:01:15,356 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 3506ea931c9649c226fb4c38a5165b6a: 2023-02-15 20:01:15,430 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 3506ea931c9649c226fb4c38a5165b6a, disabling compactions & flushes 2023-02-15 20:01:15,431 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,g\xA7\xA7,1676491266407.3506ea931c9649c226fb4c38a5165b6a. 2023-02-15 20:01:15,431 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,g\xA7\xA7,1676491266407.3506ea931c9649c226fb4c38a5165b6a. 2023-02-15 20:01:15,431 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,g\xA7\xA7,1676491266407.3506ea931c9649c226fb4c38a5165b6a. after waiting 0 ms 2023-02-15 20:01:15,431 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,g\xA7\xA7,1676491266407.3506ea931c9649c226fb4c38a5165b6a. 2023-02-15 20:01:15,434 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,g\xA7\xA7,1676491266407.3506ea931c9649c226fb4c38a5165b6a. 2023-02-15 20:01:15,434 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 3506ea931c9649c226fb4c38a5165b6a: 2023-02-15 20:01:15,441 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,m\xED\xED,1676491266407.f26f31f3358f9f2d50b3c5d32cc7b35d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 20:01:15,441 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-15 20:01:15,442 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-15 20:01:15,444 INFO [StoreOpener-f26f31f3358f9f2d50b3c5d32cc7b35d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region f26f31f3358f9f2d50b3c5d32cc7b35d 2023-02-15 20:01:15,445 DEBUG [StoreOpener-f26f31f3358f9f2d50b3c5d32cc7b35d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38891/user/jenkins/test-data/7cbd6db3-0023-7f08-6a1c-eea0c6f23bc1/testWithMapReduceMultiRegion/8bd4ee16-65d3-4e64-85ab-566f80ed3785/data/default/testWithMapReduce/f26f31f3358f9f2d50b3c5d32cc7b35d/f1 2023-02-15 20:01:15,446 INFO [StoreOpener-f26f31f3358f9f2d50b3c5d32cc7b35d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f26f31f3358f9f2d50b3c5d32cc7b35d columnFamilyName f1 2023-02-15 20:01:15,452 DEBUG [StoreOpener-f26f31f3358f9f2d50b3c5d32cc7b35d-1] regionserver.HStore(539): loaded hdfs://localhost:38891/user/jenkins/test-data/7cbd6db3-0023-7f08-6a1c-eea0c6f23bc1/testWithMapReduceMultiRegion/8bd4ee16-65d3-4e64-85ab-566f80ed3785/data/default/testWithMapReduce/f26f31f3358f9f2d50b3c5d32cc7b35d/f1/testWithMapReduce=f26f31f3358f9f2d50b3c5d32cc7b35d-e9d819bfab2d44ebbd85de59dbaa3ed0 2023-02-15 20:01:15,452 INFO [StoreOpener-f26f31f3358f9f2d50b3c5d32cc7b35d-1] regionserver.HStore(310): Store=f26f31f3358f9f2d50b3c5d32cc7b35d/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 20:01:15,452 INFO [StoreOpener-f26f31f3358f9f2d50b3c5d32cc7b35d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region f26f31f3358f9f2d50b3c5d32cc7b35d 2023-02-15 20:01:15,453 DEBUG [StoreOpener-f26f31f3358f9f2d50b3c5d32cc7b35d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38891/user/jenkins/test-data/7cbd6db3-0023-7f08-6a1c-eea0c6f23bc1/testWithMapReduceMultiRegion/8bd4ee16-65d3-4e64-85ab-566f80ed3785/data/default/testWithMapReduce/f26f31f3358f9f2d50b3c5d32cc7b35d/f2 2023-02-15 20:01:15,453 INFO [StoreOpener-f26f31f3358f9f2d50b3c5d32cc7b35d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f26f31f3358f9f2d50b3c5d32cc7b35d columnFamilyName f2 2023-02-15 20:01:15,459 DEBUG [StoreOpener-f26f31f3358f9f2d50b3c5d32cc7b35d-1] regionserver.HStore(539): loaded hdfs://localhost:38891/user/jenkins/test-data/7cbd6db3-0023-7f08-6a1c-eea0c6f23bc1/testWithMapReduceMultiRegion/8bd4ee16-65d3-4e64-85ab-566f80ed3785/data/default/testWithMapReduce/f26f31f3358f9f2d50b3c5d32cc7b35d/f2/testWithMapReduce=f26f31f3358f9f2d50b3c5d32cc7b35d-47b72bdb129e429abeee819914e83fb2 2023-02-15 20:01:15,459 INFO [StoreOpener-f26f31f3358f9f2d50b3c5d32cc7b35d-1] regionserver.HStore(310): Store=f26f31f3358f9f2d50b3c5d32cc7b35d/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 20:01:15,459 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-15 20:01:15,459 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened f26f31f3358f9f2d50b3c5d32cc7b35d; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=75440770, jitterRate=0.12415507435798645}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-15 20:01:15,459 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for f26f31f3358f9f2d50b3c5d32cc7b35d: 2023-02-15 20:01:15,500 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing f26f31f3358f9f2d50b3c5d32cc7b35d, disabling compactions & flushes 2023-02-15 20:01:15,500 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,m\xED\xED,1676491266407.f26f31f3358f9f2d50b3c5d32cc7b35d. 2023-02-15 20:01:15,501 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,m\xED\xED,1676491266407.f26f31f3358f9f2d50b3c5d32cc7b35d. 2023-02-15 20:01:15,501 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,m\xED\xED,1676491266407.f26f31f3358f9f2d50b3c5d32cc7b35d. after waiting 0 ms 2023-02-15 20:01:15,501 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,m\xED\xED,1676491266407.f26f31f3358f9f2d50b3c5d32cc7b35d. 2023-02-15 20:01:15,505 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,m\xED\xED,1676491266407.f26f31f3358f9f2d50b3c5d32cc7b35d. 2023-02-15 20:01:15,505 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for f26f31f3358f9f2d50b3c5d32cc7b35d: 2023-02-15 20:01:15,510 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676491266407.77b8837eb0dd784edf4b0582f0ba0a3f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 20:01:15,510 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-15 20:01:15,516 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-15 20:01:15,519 INFO [StoreOpener-77b8837eb0dd784edf4b0582f0ba0a3f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 77b8837eb0dd784edf4b0582f0ba0a3f 2023-02-15 20:01:15,521 DEBUG [StoreOpener-77b8837eb0dd784edf4b0582f0ba0a3f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38891/user/jenkins/test-data/7cbd6db3-0023-7f08-6a1c-eea0c6f23bc1/testWithMapReduceMultiRegion/8bd4ee16-65d3-4e64-85ab-566f80ed3785/data/default/testWithMapReduce/77b8837eb0dd784edf4b0582f0ba0a3f/f1 2023-02-15 20:01:15,522 INFO [StoreOpener-77b8837eb0dd784edf4b0582f0ba0a3f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 77b8837eb0dd784edf4b0582f0ba0a3f columnFamilyName f1 2023-02-15 20:01:15,523 INFO [StoreOpener-77b8837eb0dd784edf4b0582f0ba0a3f-1] regionserver.HStore(310): Store=77b8837eb0dd784edf4b0582f0ba0a3f/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 20:01:15,523 INFO [StoreOpener-77b8837eb0dd784edf4b0582f0ba0a3f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 77b8837eb0dd784edf4b0582f0ba0a3f 2023-02-15 20:01:15,524 DEBUG [StoreOpener-77b8837eb0dd784edf4b0582f0ba0a3f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38891/user/jenkins/test-data/7cbd6db3-0023-7f08-6a1c-eea0c6f23bc1/testWithMapReduceMultiRegion/8bd4ee16-65d3-4e64-85ab-566f80ed3785/data/default/testWithMapReduce/77b8837eb0dd784edf4b0582f0ba0a3f/f2 2023-02-15 20:01:15,525 INFO [StoreOpener-77b8837eb0dd784edf4b0582f0ba0a3f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 77b8837eb0dd784edf4b0582f0ba0a3f columnFamilyName f2 2023-02-15 20:01:15,526 INFO [StoreOpener-77b8837eb0dd784edf4b0582f0ba0a3f-1] regionserver.HStore(310): Store=77b8837eb0dd784edf4b0582f0ba0a3f/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 20:01:15,526 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-15 20:01:15,526 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 77b8837eb0dd784edf4b0582f0ba0a3f; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67250427, jitterRate=0.0021094530820846558}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-15 20:01:15,526 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 77b8837eb0dd784edf4b0582f0ba0a3f: 2023-02-15 20:01:15,544 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 77b8837eb0dd784edf4b0582f0ba0a3f, disabling compactions & flushes 2023-02-15 20:01:15,545 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676491266407.77b8837eb0dd784edf4b0582f0ba0a3f. 2023-02-15 20:01:15,545 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676491266407.77b8837eb0dd784edf4b0582f0ba0a3f. 2023-02-15 20:01:15,545 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676491266407.77b8837eb0dd784edf4b0582f0ba0a3f. after waiting 0 ms 2023-02-15 20:01:15,545 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676491266407.77b8837eb0dd784edf4b0582f0ba0a3f. 2023-02-15 20:01:15,548 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,,1676491266407.77b8837eb0dd784edf4b0582f0ba0a3f. 2023-02-15 20:01:15,548 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 77b8837eb0dd784edf4b0582f0ba0a3f: 2023-02-15 20:01:15,556 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,d\x84\x84,1676491266407.cfff17411e5ee60b92c4b80249237743.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 20:01:15,556 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-15 20:01:15,557 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-15 20:01:15,560 INFO [StoreOpener-cfff17411e5ee60b92c4b80249237743-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region cfff17411e5ee60b92c4b80249237743 2023-02-15 20:01:15,561 DEBUG [StoreOpener-cfff17411e5ee60b92c4b80249237743-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38891/user/jenkins/test-data/7cbd6db3-0023-7f08-6a1c-eea0c6f23bc1/testWithMapReduceMultiRegion/8bd4ee16-65d3-4e64-85ab-566f80ed3785/data/default/testWithMapReduce/cfff17411e5ee60b92c4b80249237743/f1 2023-02-15 20:01:15,561 INFO [StoreOpener-cfff17411e5ee60b92c4b80249237743-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region cfff17411e5ee60b92c4b80249237743 columnFamilyName f1 2023-02-15 20:01:15,569 DEBUG [StoreOpener-cfff17411e5ee60b92c4b80249237743-1] regionserver.HStore(539): loaded hdfs://localhost:38891/user/jenkins/test-data/7cbd6db3-0023-7f08-6a1c-eea0c6f23bc1/testWithMapReduceMultiRegion/8bd4ee16-65d3-4e64-85ab-566f80ed3785/data/default/testWithMapReduce/cfff17411e5ee60b92c4b80249237743/f1/testWithMapReduce=cfff17411e5ee60b92c4b80249237743-2b66b94b8cac4024b68e4f193fbadd83 2023-02-15 20:01:15,570 INFO [StoreOpener-cfff17411e5ee60b92c4b80249237743-1] regionserver.HStore(310): Store=cfff17411e5ee60b92c4b80249237743/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 20:01:15,570 INFO [StoreOpener-cfff17411e5ee60b92c4b80249237743-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region cfff17411e5ee60b92c4b80249237743 2023-02-15 20:01:15,571 DEBUG [StoreOpener-cfff17411e5ee60b92c4b80249237743-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38891/user/jenkins/test-data/7cbd6db3-0023-7f08-6a1c-eea0c6f23bc1/testWithMapReduceMultiRegion/8bd4ee16-65d3-4e64-85ab-566f80ed3785/data/default/testWithMapReduce/cfff17411e5ee60b92c4b80249237743/f2 2023-02-15 20:01:15,572 INFO [StoreOpener-cfff17411e5ee60b92c4b80249237743-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region cfff17411e5ee60b92c4b80249237743 columnFamilyName f2 2023-02-15 20:01:15,583 DEBUG [StoreOpener-cfff17411e5ee60b92c4b80249237743-1] regionserver.HStore(539): loaded hdfs://localhost:38891/user/jenkins/test-data/7cbd6db3-0023-7f08-6a1c-eea0c6f23bc1/testWithMapReduceMultiRegion/8bd4ee16-65d3-4e64-85ab-566f80ed3785/data/default/testWithMapReduce/cfff17411e5ee60b92c4b80249237743/f2/testWithMapReduce=cfff17411e5ee60b92c4b80249237743-a1a93d17faa940fd860aa03d710c0091 2023-02-15 20:01:15,583 INFO [StoreOpener-cfff17411e5ee60b92c4b80249237743-1] regionserver.HStore(310): Store=cfff17411e5ee60b92c4b80249237743/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 20:01:15,583 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-15 20:01:15,583 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened cfff17411e5ee60b92c4b80249237743; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62898826, jitterRate=-0.062734454870224}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-15 20:01:15,583 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for cfff17411e5ee60b92c4b80249237743: 2023-02-15 20:01:15,688 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing cfff17411e5ee60b92c4b80249237743, disabling compactions & flushes 2023-02-15 20:01:15,688 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,d\x84\x84,1676491266407.cfff17411e5ee60b92c4b80249237743. 2023-02-15 20:01:15,688 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,d\x84\x84,1676491266407.cfff17411e5ee60b92c4b80249237743. 2023-02-15 20:01:15,688 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,d\x84\x84,1676491266407.cfff17411e5ee60b92c4b80249237743. after waiting 0 ms 2023-02-15 20:01:15,688 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,d\x84\x84,1676491266407.cfff17411e5ee60b92c4b80249237743. 2023-02-15 20:01:15,738 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,d\x84\x84,1676491266407.cfff17411e5ee60b92c4b80249237743. 2023-02-15 20:01:15,738 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for cfff17411e5ee60b92c4b80249237743: 2023-02-15 20:01:15,742 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,zz{,1676491266407.f5c7d59a05e094a402144fe6a2d882f0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 20:01:15,742 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-15 20:01:15,744 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-15 20:01:15,745 INFO [StoreOpener-f5c7d59a05e094a402144fe6a2d882f0-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region f5c7d59a05e094a402144fe6a2d882f0 2023-02-15 20:01:15,747 DEBUG [StoreOpener-f5c7d59a05e094a402144fe6a2d882f0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38891/user/jenkins/test-data/7cbd6db3-0023-7f08-6a1c-eea0c6f23bc1/testWithMapReduceMultiRegion/8bd4ee16-65d3-4e64-85ab-566f80ed3785/data/default/testWithMapReduce/f5c7d59a05e094a402144fe6a2d882f0/f1 2023-02-15 20:01:15,748 INFO [StoreOpener-f5c7d59a05e094a402144fe6a2d882f0-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f5c7d59a05e094a402144fe6a2d882f0 columnFamilyName f1 2023-02-15 20:01:15,749 INFO [StoreOpener-f5c7d59a05e094a402144fe6a2d882f0-1] regionserver.HStore(310): Store=f5c7d59a05e094a402144fe6a2d882f0/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 20:01:15,749 INFO [StoreOpener-f5c7d59a05e094a402144fe6a2d882f0-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region f5c7d59a05e094a402144fe6a2d882f0 2023-02-15 20:01:15,750 DEBUG [StoreOpener-f5c7d59a05e094a402144fe6a2d882f0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38891/user/jenkins/test-data/7cbd6db3-0023-7f08-6a1c-eea0c6f23bc1/testWithMapReduceMultiRegion/8bd4ee16-65d3-4e64-85ab-566f80ed3785/data/default/testWithMapReduce/f5c7d59a05e094a402144fe6a2d882f0/f2 2023-02-15 20:01:15,750 INFO [StoreOpener-f5c7d59a05e094a402144fe6a2d882f0-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f5c7d59a05e094a402144fe6a2d882f0 columnFamilyName f2 2023-02-15 20:01:15,751 INFO [StoreOpener-f5c7d59a05e094a402144fe6a2d882f0-1] regionserver.HStore(310): Store=f5c7d59a05e094a402144fe6a2d882f0/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 20:01:15,751 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-15 20:01:15,751 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened f5c7d59a05e094a402144fe6a2d882f0; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67461370, jitterRate=0.005252748727798462}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-15 20:01:15,751 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for f5c7d59a05e094a402144fe6a2d882f0: 2023-02-15 20:01:15,769 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing f5c7d59a05e094a402144fe6a2d882f0, disabling compactions & flushes 2023-02-15 20:01:15,770 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,zz{,1676491266407.f5c7d59a05e094a402144fe6a2d882f0. 2023-02-15 20:01:15,770 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,zz{,1676491266407.f5c7d59a05e094a402144fe6a2d882f0. 2023-02-15 20:01:15,770 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,zz{,1676491266407.f5c7d59a05e094a402144fe6a2d882f0. after waiting 0 ms 2023-02-15 20:01:15,770 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,zz{,1676491266407.f5c7d59a05e094a402144fe6a2d882f0. 2023-02-15 20:01:15,770 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,zz{,1676491266407.f5c7d59a05e094a402144fe6a2d882f0. 2023-02-15 20:01:15,770 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for f5c7d59a05e094a402144fe6a2d882f0: 2023-02-15 20:01:15,773 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,q\x11\x10,1676491266407.aac41416f1d7fc83b90c2b3432a76ce6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 20:01:15,773 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-15 20:01:15,775 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-15 20:01:15,777 INFO [StoreOpener-aac41416f1d7fc83b90c2b3432a76ce6-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region aac41416f1d7fc83b90c2b3432a76ce6 2023-02-15 20:01:15,778 DEBUG [StoreOpener-aac41416f1d7fc83b90c2b3432a76ce6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38891/user/jenkins/test-data/7cbd6db3-0023-7f08-6a1c-eea0c6f23bc1/testWithMapReduceMultiRegion/8bd4ee16-65d3-4e64-85ab-566f80ed3785/data/default/testWithMapReduce/aac41416f1d7fc83b90c2b3432a76ce6/f1 2023-02-15 20:01:15,778 INFO [StoreOpener-aac41416f1d7fc83b90c2b3432a76ce6-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region aac41416f1d7fc83b90c2b3432a76ce6 columnFamilyName f1 2023-02-15 20:01:15,784 DEBUG [StoreOpener-aac41416f1d7fc83b90c2b3432a76ce6-1] regionserver.HStore(539): loaded hdfs://localhost:38891/user/jenkins/test-data/7cbd6db3-0023-7f08-6a1c-eea0c6f23bc1/testWithMapReduceMultiRegion/8bd4ee16-65d3-4e64-85ab-566f80ed3785/data/default/testWithMapReduce/aac41416f1d7fc83b90c2b3432a76ce6/f1/testWithMapReduce=aac41416f1d7fc83b90c2b3432a76ce6-9fd9cfca86f946febf2708c1bc10bdbd 2023-02-15 20:01:15,784 INFO [StoreOpener-aac41416f1d7fc83b90c2b3432a76ce6-1] regionserver.HStore(310): Store=aac41416f1d7fc83b90c2b3432a76ce6/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 20:01:15,785 INFO [StoreOpener-aac41416f1d7fc83b90c2b3432a76ce6-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region aac41416f1d7fc83b90c2b3432a76ce6 2023-02-15 20:01:15,785 DEBUG [StoreOpener-aac41416f1d7fc83b90c2b3432a76ce6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38891/user/jenkins/test-data/7cbd6db3-0023-7f08-6a1c-eea0c6f23bc1/testWithMapReduceMultiRegion/8bd4ee16-65d3-4e64-85ab-566f80ed3785/data/default/testWithMapReduce/aac41416f1d7fc83b90c2b3432a76ce6/f2 2023-02-15 20:01:15,786 INFO [StoreOpener-aac41416f1d7fc83b90c2b3432a76ce6-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region aac41416f1d7fc83b90c2b3432a76ce6 columnFamilyName f2 2023-02-15 20:01:15,791 DEBUG [StoreOpener-aac41416f1d7fc83b90c2b3432a76ce6-1] regionserver.HStore(539): loaded hdfs://localhost:38891/user/jenkins/test-data/7cbd6db3-0023-7f08-6a1c-eea0c6f23bc1/testWithMapReduceMultiRegion/8bd4ee16-65d3-4e64-85ab-566f80ed3785/data/default/testWithMapReduce/aac41416f1d7fc83b90c2b3432a76ce6/f2/testWithMapReduce=aac41416f1d7fc83b90c2b3432a76ce6-fdf07ac3996e436f919b533a96fe4829 2023-02-15 20:01:15,791 INFO [StoreOpener-aac41416f1d7fc83b90c2b3432a76ce6-1] regionserver.HStore(310): Store=aac41416f1d7fc83b90c2b3432a76ce6/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 20:01:15,791 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-15 20:01:15,791 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened aac41416f1d7fc83b90c2b3432a76ce6; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66626105, jitterRate=-0.007193669676780701}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-15 20:01:15,791 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for aac41416f1d7fc83b90c2b3432a76ce6: 2023-02-15 20:01:15,820 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing aac41416f1d7fc83b90c2b3432a76ce6, disabling compactions & flushes 2023-02-15 20:01:15,821 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,q\x11\x10,1676491266407.aac41416f1d7fc83b90c2b3432a76ce6. 2023-02-15 20:01:15,821 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,q\x11\x10,1676491266407.aac41416f1d7fc83b90c2b3432a76ce6. 2023-02-15 20:01:15,821 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,q\x11\x10,1676491266407.aac41416f1d7fc83b90c2b3432a76ce6. after waiting 0 ms 2023-02-15 20:01:15,821 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,q\x11\x10,1676491266407.aac41416f1d7fc83b90c2b3432a76ce6. 2023-02-15 20:01:15,824 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,q\x11\x10,1676491266407.aac41416f1d7fc83b90c2b3432a76ce6. 2023-02-15 20:01:15,824 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for aac41416f1d7fc83b90c2b3432a76ce6: 2023-02-15 20:01:16,717 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39607] master.MasterRpcServices(748): Client=jenkins//172.31.14.131 delete name: "testWithMapReduceMultiRegion" 2023-02-15 20:01:16,720 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39607] snapshot.SnapshotManager(333): Deleting snapshot: testWithMapReduceMultiRegion 2023-02-15 20:01:16,724 INFO [Listener at localhost/37547] client.HBaseAdmin$15(890): Started disable of testWithMapReduce 2023-02-15 20:01:16,724 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39607] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testWithMapReduce 2023-02-15 20:01:16,730 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39607] procedure2.ProcedureExecutor(1029): Stored pid=33, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testWithMapReduce 2023-02-15 20:01:16,734 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676491276734"}]},"ts":"1676491276734"} 2023-02-15 20:01:16,736 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39607] master.MasterRpcServices(1227): Checking to see if procedure is done pid=33 2023-02-15 20:01:16,736 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=DISABLING in hbase:meta 2023-02-15 20:01:16,739 INFO [PEWorker-5] procedure.DisableTableProcedure(293): Set testWithMapReduce to state=DISABLING 2023-02-15 20:01:16,742 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=34, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=77b8837eb0dd784edf4b0582f0ba0a3f, UNASSIGN}, {pid=35, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=8a2219c4f89e37dec8687cefabd9fc25, UNASSIGN}, {pid=36, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=cfff17411e5ee60b92c4b80249237743, UNASSIGN}, {pid=37, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=3506ea931c9649c226fb4c38a5165b6a, UNASSIGN}, {pid=38, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=30b6672c9889bbc2cc2b417a34f3f49e, UNASSIGN}, {pid=39, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=f26f31f3358f9f2d50b3c5d32cc7b35d, UNASSIGN}, {pid=40, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=aac41416f1d7fc83b90c2b3432a76ce6, UNASSIGN}, {pid=41, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=ce146f62338407483a61920d7170f142, UNASSIGN}, {pid=42, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=da7189167b0a5e71ebfc52ccf8240947, UNASSIGN}, {pid=43, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=f5c7d59a05e094a402144fe6a2d882f0, UNASSIGN}] 2023-02-15 20:01:16,744 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=42, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=da7189167b0a5e71ebfc52ccf8240947, UNASSIGN 2023-02-15 20:01:16,744 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=41, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=ce146f62338407483a61920d7170f142, UNASSIGN 2023-02-15 20:01:16,744 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=40, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=aac41416f1d7fc83b90c2b3432a76ce6, UNASSIGN 2023-02-15 20:01:16,745 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=39, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=f26f31f3358f9f2d50b3c5d32cc7b35d, UNASSIGN 2023-02-15 20:01:16,745 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=43, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=f5c7d59a05e094a402144fe6a2d882f0, UNASSIGN 2023-02-15 20:01:16,746 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=42 updating hbase:meta row=da7189167b0a5e71ebfc52ccf8240947, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,33367,1676491262239 2023-02-15 20:01:16,746 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=41 updating hbase:meta row=ce146f62338407483a61920d7170f142, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,33367,1676491262239 2023-02-15 20:01:16,746 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,wWV,1676491266407.da7189167b0a5e71ebfc52ccf8240947.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676491276746"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676491276746"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676491276746"}]},"ts":"1676491276746"} 2023-02-15 20:01:16,746 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,t43,1676491266407.ce146f62338407483a61920d7170f142.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676491276746"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676491276746"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676491276746"}]},"ts":"1676491276746"} 2023-02-15 20:01:16,747 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=40 updating hbase:meta row=aac41416f1d7fc83b90c2b3432a76ce6, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,41535,1676491262190 2023-02-15 20:01:16,747 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=f5c7d59a05e094a402144fe6a2d882f0, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,41535,1676491262190 2023-02-15 20:01:16,747 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,q\\x11\\x10,1676491266407.aac41416f1d7fc83b90c2b3432a76ce6.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676491276747"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676491276747"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676491276747"}]},"ts":"1676491276747"} 2023-02-15 20:01:16,747 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,zz{,1676491266407.f5c7d59a05e094a402144fe6a2d882f0.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676491276747"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676491276747"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676491276747"}]},"ts":"1676491276747"} 2023-02-15 20:01:16,747 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=39 updating hbase:meta row=f26f31f3358f9f2d50b3c5d32cc7b35d, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,33367,1676491262239 2023-02-15 20:01:16,747 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,m\\xED\\xED,1676491266407.f26f31f3358f9f2d50b3c5d32cc7b35d.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676491276747"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676491276747"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676491276747"}]},"ts":"1676491276747"} 2023-02-15 20:01:16,749 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=44, ppid=42, state=RUNNABLE; CloseRegionProcedure da7189167b0a5e71ebfc52ccf8240947, server=jenkins-hbase4.apache.org,33367,1676491262239}] 2023-02-15 20:01:16,753 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=45, ppid=41, state=RUNNABLE; CloseRegionProcedure ce146f62338407483a61920d7170f142, server=jenkins-hbase4.apache.org,33367,1676491262239}] 2023-02-15 20:01:16,754 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=46, ppid=40, state=RUNNABLE; CloseRegionProcedure aac41416f1d7fc83b90c2b3432a76ce6, server=jenkins-hbase4.apache.org,41535,1676491262190}] 2023-02-15 20:01:16,755 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=47, ppid=43, state=RUNNABLE; CloseRegionProcedure f5c7d59a05e094a402144fe6a2d882f0, server=jenkins-hbase4.apache.org,41535,1676491262190}] 2023-02-15 20:01:16,758 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=48, ppid=39, state=RUNNABLE; CloseRegionProcedure f26f31f3358f9f2d50b3c5d32cc7b35d, server=jenkins-hbase4.apache.org,33367,1676491262239}] 2023-02-15 20:01:16,763 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=38, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=30b6672c9889bbc2cc2b417a34f3f49e, UNASSIGN 2023-02-15 20:01:16,763 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=36, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=cfff17411e5ee60b92c4b80249237743, UNASSIGN 2023-02-15 20:01:16,763 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=37, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=3506ea931c9649c226fb4c38a5165b6a, UNASSIGN 2023-02-15 20:01:16,763 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=35, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=8a2219c4f89e37dec8687cefabd9fc25, UNASSIGN 2023-02-15 20:01:16,764 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=30b6672c9889bbc2cc2b417a34f3f49e, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,33367,1676491262239 2023-02-15 20:01:16,764 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,j\\xCA\\xCA,1676491266407.30b6672c9889bbc2cc2b417a34f3f49e.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676491276764"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676491276764"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676491276764"}]},"ts":"1676491276764"} 2023-02-15 20:01:16,764 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=36 updating hbase:meta row=cfff17411e5ee60b92c4b80249237743, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,41535,1676491262190 2023-02-15 20:01:16,765 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,d\\x84\\x84,1676491266407.cfff17411e5ee60b92c4b80249237743.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676491276764"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676491276764"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676491276764"}]},"ts":"1676491276764"} 2023-02-15 20:01:16,765 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=35 updating hbase:meta row=8a2219c4f89e37dec8687cefabd9fc25, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,41535,1676491262190 2023-02-15 20:01:16,765 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=34, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=77b8837eb0dd784edf4b0582f0ba0a3f, UNASSIGN 2023-02-15 20:01:16,765 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,aaa,1676491266407.8a2219c4f89e37dec8687cefabd9fc25.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676491276765"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676491276765"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676491276765"}]},"ts":"1676491276765"} 2023-02-15 20:01:16,765 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=3506ea931c9649c226fb4c38a5165b6a, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,41535,1676491262190 2023-02-15 20:01:16,766 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,g\\xA7\\xA7,1676491266407.3506ea931c9649c226fb4c38a5165b6a.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676491276765"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676491276765"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676491276765"}]},"ts":"1676491276765"} 2023-02-15 20:01:16,766 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=34 updating hbase:meta row=77b8837eb0dd784edf4b0582f0ba0a3f, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,33367,1676491262239 2023-02-15 20:01:16,766 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=49, ppid=38, state=RUNNABLE; CloseRegionProcedure 30b6672c9889bbc2cc2b417a34f3f49e, server=jenkins-hbase4.apache.org,33367,1676491262239}] 2023-02-15 20:01:16,766 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,,1676491266407.77b8837eb0dd784edf4b0582f0ba0a3f.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676491276766"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676491276766"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676491276766"}]},"ts":"1676491276766"} 2023-02-15 20:01:16,768 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=50, ppid=36, state=RUNNABLE; CloseRegionProcedure cfff17411e5ee60b92c4b80249237743, server=jenkins-hbase4.apache.org,41535,1676491262190}] 2023-02-15 20:01:16,769 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=51, ppid=35, state=RUNNABLE; CloseRegionProcedure 8a2219c4f89e37dec8687cefabd9fc25, server=jenkins-hbase4.apache.org,41535,1676491262190}] 2023-02-15 20:01:16,770 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=52, ppid=37, state=RUNNABLE; CloseRegionProcedure 3506ea931c9649c226fb4c38a5165b6a, server=jenkins-hbase4.apache.org,41535,1676491262190}] 2023-02-15 20:01:16,772 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=53, ppid=34, state=RUNNABLE; CloseRegionProcedure 77b8837eb0dd784edf4b0582f0ba0a3f, server=jenkins-hbase4.apache.org,33367,1676491262239}] 2023-02-15 20:01:16,838 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39607] master.MasterRpcServices(1227): Checking to see if procedure is done pid=33 2023-02-15 20:01:16,913 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 30b6672c9889bbc2cc2b417a34f3f49e 2023-02-15 20:01:16,913 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 8a2219c4f89e37dec8687cefabd9fc25 2023-02-15 20:01:16,913 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 30b6672c9889bbc2cc2b417a34f3f49e, disabling compactions & flushes 2023-02-15 20:01:16,913 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 8a2219c4f89e37dec8687cefabd9fc25, disabling compactions & flushes 2023-02-15 20:01:16,913 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,j\xCA\xCA,1676491266407.30b6672c9889bbc2cc2b417a34f3f49e. 2023-02-15 20:01:16,913 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,aaa,1676491266407.8a2219c4f89e37dec8687cefabd9fc25. 2023-02-15 20:01:16,913 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,j\xCA\xCA,1676491266407.30b6672c9889bbc2cc2b417a34f3f49e. 2023-02-15 20:01:16,913 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,aaa,1676491266407.8a2219c4f89e37dec8687cefabd9fc25. 2023-02-15 20:01:16,913 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,j\xCA\xCA,1676491266407.30b6672c9889bbc2cc2b417a34f3f49e. after waiting 0 ms 2023-02-15 20:01:16,913 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,aaa,1676491266407.8a2219c4f89e37dec8687cefabd9fc25. after waiting 0 ms 2023-02-15 20:01:16,913 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,aaa,1676491266407.8a2219c4f89e37dec8687cefabd9fc25. 2023-02-15 20:01:16,913 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,j\xCA\xCA,1676491266407.30b6672c9889bbc2cc2b417a34f3f49e. 2023-02-15 20:01:16,925 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/data/default/testWithMapReduce/8a2219c4f89e37dec8687cefabd9fc25/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-15 20:01:16,925 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/data/default/testWithMapReduce/30b6672c9889bbc2cc2b417a34f3f49e/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-15 20:01:16,926 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,aaa,1676491266407.8a2219c4f89e37dec8687cefabd9fc25. 2023-02-15 20:01:16,926 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,j\xCA\xCA,1676491266407.30b6672c9889bbc2cc2b417a34f3f49e. 2023-02-15 20:01:16,926 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 8a2219c4f89e37dec8687cefabd9fc25: 2023-02-15 20:01:16,926 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 30b6672c9889bbc2cc2b417a34f3f49e: 2023-02-15 20:01:16,929 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 8a2219c4f89e37dec8687cefabd9fc25 2023-02-15 20:01:16,929 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 3506ea931c9649c226fb4c38a5165b6a 2023-02-15 20:01:16,929 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 3506ea931c9649c226fb4c38a5165b6a, disabling compactions & flushes 2023-02-15 20:01:16,929 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,g\xA7\xA7,1676491266407.3506ea931c9649c226fb4c38a5165b6a. 2023-02-15 20:01:16,929 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,g\xA7\xA7,1676491266407.3506ea931c9649c226fb4c38a5165b6a. 2023-02-15 20:01:16,929 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,g\xA7\xA7,1676491266407.3506ea931c9649c226fb4c38a5165b6a. after waiting 0 ms 2023-02-15 20:01:16,929 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,g\xA7\xA7,1676491266407.3506ea931c9649c226fb4c38a5165b6a. 2023-02-15 20:01:16,929 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=35 updating hbase:meta row=8a2219c4f89e37dec8687cefabd9fc25, regionState=CLOSED 2023-02-15 20:01:16,929 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,aaa,1676491266407.8a2219c4f89e37dec8687cefabd9fc25.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676491276929"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676491276929"}]},"ts":"1676491276929"} 2023-02-15 20:01:16,929 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 30b6672c9889bbc2cc2b417a34f3f49e 2023-02-15 20:01:16,930 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close ce146f62338407483a61920d7170f142 2023-02-15 20:01:16,931 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing ce146f62338407483a61920d7170f142, disabling compactions & flushes 2023-02-15 20:01:16,931 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,t43,1676491266407.ce146f62338407483a61920d7170f142. 2023-02-15 20:01:16,931 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,t43,1676491266407.ce146f62338407483a61920d7170f142. 2023-02-15 20:01:16,931 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,t43,1676491266407.ce146f62338407483a61920d7170f142. after waiting 0 ms 2023-02-15 20:01:16,931 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,t43,1676491266407.ce146f62338407483a61920d7170f142. 2023-02-15 20:01:16,931 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=30b6672c9889bbc2cc2b417a34f3f49e, regionState=CLOSED 2023-02-15 20:01:16,931 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,j\\xCA\\xCA,1676491266407.30b6672c9889bbc2cc2b417a34f3f49e.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676491276931"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676491276931"}]},"ts":"1676491276931"} 2023-02-15 20:01:16,935 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=51, resume processing ppid=35 2023-02-15 20:01:16,935 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=51, ppid=35, state=SUCCESS; CloseRegionProcedure 8a2219c4f89e37dec8687cefabd9fc25, server=jenkins-hbase4.apache.org,41535,1676491262190 in 164 msec 2023-02-15 20:01:16,937 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=49, resume processing ppid=38 2023-02-15 20:01:16,937 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=35, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=8a2219c4f89e37dec8687cefabd9fc25, UNASSIGN in 195 msec 2023-02-15 20:01:16,937 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=49, ppid=38, state=SUCCESS; CloseRegionProcedure 30b6672c9889bbc2cc2b417a34f3f49e, server=jenkins-hbase4.apache.org,33367,1676491262239 in 169 msec 2023-02-15 20:01:16,939 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=38, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=30b6672c9889bbc2cc2b417a34f3f49e, UNASSIGN in 197 msec 2023-02-15 20:01:16,946 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/data/default/testWithMapReduce/3506ea931c9649c226fb4c38a5165b6a/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-15 20:01:16,948 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,g\xA7\xA7,1676491266407.3506ea931c9649c226fb4c38a5165b6a. 2023-02-15 20:01:16,948 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 3506ea931c9649c226fb4c38a5165b6a: 2023-02-15 20:01:16,948 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/data/default/testWithMapReduce/ce146f62338407483a61920d7170f142/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-15 20:01:16,949 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,t43,1676491266407.ce146f62338407483a61920d7170f142. 2023-02-15 20:01:16,949 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for ce146f62338407483a61920d7170f142: 2023-02-15 20:01:16,950 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 3506ea931c9649c226fb4c38a5165b6a 2023-02-15 20:01:16,951 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close aac41416f1d7fc83b90c2b3432a76ce6 2023-02-15 20:01:16,951 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=3506ea931c9649c226fb4c38a5165b6a, regionState=CLOSED 2023-02-15 20:01:16,951 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing aac41416f1d7fc83b90c2b3432a76ce6, disabling compactions & flushes 2023-02-15 20:01:16,951 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,q\x11\x10,1676491266407.aac41416f1d7fc83b90c2b3432a76ce6. 2023-02-15 20:01:16,951 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,q\x11\x10,1676491266407.aac41416f1d7fc83b90c2b3432a76ce6. 2023-02-15 20:01:16,951 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,g\\xA7\\xA7,1676491266407.3506ea931c9649c226fb4c38a5165b6a.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676491276951"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676491276951"}]},"ts":"1676491276951"} 2023-02-15 20:01:16,951 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,q\x11\x10,1676491266407.aac41416f1d7fc83b90c2b3432a76ce6. after waiting 0 ms 2023-02-15 20:01:16,951 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,q\x11\x10,1676491266407.aac41416f1d7fc83b90c2b3432a76ce6. 2023-02-15 20:01:16,951 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed ce146f62338407483a61920d7170f142 2023-02-15 20:01:16,951 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close f26f31f3358f9f2d50b3c5d32cc7b35d 2023-02-15 20:01:16,952 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing f26f31f3358f9f2d50b3c5d32cc7b35d, disabling compactions & flushes 2023-02-15 20:01:16,952 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,m\xED\xED,1676491266407.f26f31f3358f9f2d50b3c5d32cc7b35d. 2023-02-15 20:01:16,952 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,m\xED\xED,1676491266407.f26f31f3358f9f2d50b3c5d32cc7b35d. 2023-02-15 20:01:16,952 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,m\xED\xED,1676491266407.f26f31f3358f9f2d50b3c5d32cc7b35d. after waiting 0 ms 2023-02-15 20:01:16,952 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,m\xED\xED,1676491266407.f26f31f3358f9f2d50b3c5d32cc7b35d. 2023-02-15 20:01:16,952 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=41 updating hbase:meta row=ce146f62338407483a61920d7170f142, regionState=CLOSED 2023-02-15 20:01:16,952 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,t43,1676491266407.ce146f62338407483a61920d7170f142.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676491276952"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676491276952"}]},"ts":"1676491276952"} 2023-02-15 20:01:16,956 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=52, resume processing ppid=37 2023-02-15 20:01:16,956 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=45, resume processing ppid=41 2023-02-15 20:01:16,956 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=45, ppid=41, state=SUCCESS; CloseRegionProcedure ce146f62338407483a61920d7170f142, server=jenkins-hbase4.apache.org,33367,1676491262239 in 201 msec 2023-02-15 20:01:16,956 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=52, ppid=37, state=SUCCESS; CloseRegionProcedure 3506ea931c9649c226fb4c38a5165b6a, server=jenkins-hbase4.apache.org,41535,1676491262190 in 183 msec 2023-02-15 20:01:16,957 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=37, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=3506ea931c9649c226fb4c38a5165b6a, UNASSIGN in 216 msec 2023-02-15 20:01:16,958 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=41, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=ce146f62338407483a61920d7170f142, UNASSIGN in 216 msec 2023-02-15 20:01:16,968 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/data/default/testWithMapReduce/f26f31f3358f9f2d50b3c5d32cc7b35d/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-15 20:01:16,968 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/data/default/testWithMapReduce/aac41416f1d7fc83b90c2b3432a76ce6/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-15 20:01:16,970 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,m\xED\xED,1676491266407.f26f31f3358f9f2d50b3c5d32cc7b35d. 2023-02-15 20:01:16,970 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,q\x11\x10,1676491266407.aac41416f1d7fc83b90c2b3432a76ce6. 2023-02-15 20:01:16,970 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for aac41416f1d7fc83b90c2b3432a76ce6: 2023-02-15 20:01:16,970 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for f26f31f3358f9f2d50b3c5d32cc7b35d: 2023-02-15 20:01:16,973 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed f26f31f3358f9f2d50b3c5d32cc7b35d 2023-02-15 20:01:16,973 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 77b8837eb0dd784edf4b0582f0ba0a3f 2023-02-15 20:01:16,973 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 77b8837eb0dd784edf4b0582f0ba0a3f, disabling compactions & flushes 2023-02-15 20:01:16,973 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676491266407.77b8837eb0dd784edf4b0582f0ba0a3f. 2023-02-15 20:01:16,973 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676491266407.77b8837eb0dd784edf4b0582f0ba0a3f. 2023-02-15 20:01:16,973 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676491266407.77b8837eb0dd784edf4b0582f0ba0a3f. after waiting 0 ms 2023-02-15 20:01:16,973 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676491266407.77b8837eb0dd784edf4b0582f0ba0a3f. 2023-02-15 20:01:16,973 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=39 updating hbase:meta row=f26f31f3358f9f2d50b3c5d32cc7b35d, regionState=CLOSED 2023-02-15 20:01:16,973 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,m\\xED\\xED,1676491266407.f26f31f3358f9f2d50b3c5d32cc7b35d.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676491276973"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676491276973"}]},"ts":"1676491276973"} 2023-02-15 20:01:16,974 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed aac41416f1d7fc83b90c2b3432a76ce6 2023-02-15 20:01:16,974 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close cfff17411e5ee60b92c4b80249237743 2023-02-15 20:01:16,974 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing cfff17411e5ee60b92c4b80249237743, disabling compactions & flushes 2023-02-15 20:01:16,974 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,d\x84\x84,1676491266407.cfff17411e5ee60b92c4b80249237743. 2023-02-15 20:01:16,974 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,d\x84\x84,1676491266407.cfff17411e5ee60b92c4b80249237743. 2023-02-15 20:01:16,974 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,d\x84\x84,1676491266407.cfff17411e5ee60b92c4b80249237743. after waiting 0 ms 2023-02-15 20:01:16,974 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,d\x84\x84,1676491266407.cfff17411e5ee60b92c4b80249237743. 2023-02-15 20:01:16,974 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=40 updating hbase:meta row=aac41416f1d7fc83b90c2b3432a76ce6, regionState=CLOSED 2023-02-15 20:01:16,974 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,q\\x11\\x10,1676491266407.aac41416f1d7fc83b90c2b3432a76ce6.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676491276974"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676491276974"}]},"ts":"1676491276974"} 2023-02-15 20:01:16,979 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=48, resume processing ppid=39 2023-02-15 20:01:16,979 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=48, ppid=39, state=SUCCESS; CloseRegionProcedure f26f31f3358f9f2d50b3c5d32cc7b35d, server=jenkins-hbase4.apache.org,33367,1676491262239 in 219 msec 2023-02-15 20:01:16,980 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=46, resume processing ppid=40 2023-02-15 20:01:16,980 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=46, ppid=40, state=SUCCESS; CloseRegionProcedure aac41416f1d7fc83b90c2b3432a76ce6, server=jenkins-hbase4.apache.org,41535,1676491262190 in 223 msec 2023-02-15 20:01:16,981 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=39, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=f26f31f3358f9f2d50b3c5d32cc7b35d, UNASSIGN in 239 msec 2023-02-15 20:01:16,982 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=40, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=aac41416f1d7fc83b90c2b3432a76ce6, UNASSIGN in 240 msec 2023-02-15 20:01:17,000 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/data/default/testWithMapReduce/77b8837eb0dd784edf4b0582f0ba0a3f/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-02-15 20:01:17,002 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,,1676491266407.77b8837eb0dd784edf4b0582f0ba0a3f. 2023-02-15 20:01:17,002 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 77b8837eb0dd784edf4b0582f0ba0a3f: 2023-02-15 20:01:17,004 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 77b8837eb0dd784edf4b0582f0ba0a3f 2023-02-15 20:01:17,004 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close da7189167b0a5e71ebfc52ccf8240947 2023-02-15 20:01:17,004 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing da7189167b0a5e71ebfc52ccf8240947, disabling compactions & flushes 2023-02-15 20:01:17,005 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,wWV,1676491266407.da7189167b0a5e71ebfc52ccf8240947. 2023-02-15 20:01:17,005 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,wWV,1676491266407.da7189167b0a5e71ebfc52ccf8240947. 2023-02-15 20:01:17,005 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,wWV,1676491266407.da7189167b0a5e71ebfc52ccf8240947. after waiting 0 ms 2023-02-15 20:01:17,005 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,wWV,1676491266407.da7189167b0a5e71ebfc52ccf8240947. 2023-02-15 20:01:17,006 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=34 updating hbase:meta row=77b8837eb0dd784edf4b0582f0ba0a3f, regionState=CLOSED 2023-02-15 20:01:17,006 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,,1676491266407.77b8837eb0dd784edf4b0582f0ba0a3f.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676491277005"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676491277005"}]},"ts":"1676491277005"} 2023-02-15 20:01:17,010 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=53, resume processing ppid=34 2023-02-15 20:01:17,010 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=53, ppid=34, state=SUCCESS; CloseRegionProcedure 77b8837eb0dd784edf4b0582f0ba0a3f, server=jenkins-hbase4.apache.org,33367,1676491262239 in 237 msec 2023-02-15 20:01:17,012 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=34, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=77b8837eb0dd784edf4b0582f0ba0a3f, UNASSIGN in 270 msec 2023-02-15 20:01:17,015 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/data/default/testWithMapReduce/cfff17411e5ee60b92c4b80249237743/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-15 20:01:17,016 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,d\x84\x84,1676491266407.cfff17411e5ee60b92c4b80249237743. 2023-02-15 20:01:17,017 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for cfff17411e5ee60b92c4b80249237743: 2023-02-15 20:01:17,019 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed cfff17411e5ee60b92c4b80249237743 2023-02-15 20:01:17,019 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close f5c7d59a05e094a402144fe6a2d882f0 2023-02-15 20:01:17,019 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing f5c7d59a05e094a402144fe6a2d882f0, disabling compactions & flushes 2023-02-15 20:01:17,019 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,zz{,1676491266407.f5c7d59a05e094a402144fe6a2d882f0. 2023-02-15 20:01:17,019 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,zz{,1676491266407.f5c7d59a05e094a402144fe6a2d882f0. 2023-02-15 20:01:17,019 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,zz{,1676491266407.f5c7d59a05e094a402144fe6a2d882f0. after waiting 0 ms 2023-02-15 20:01:17,019 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,zz{,1676491266407.f5c7d59a05e094a402144fe6a2d882f0. 2023-02-15 20:01:17,020 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=36 updating hbase:meta row=cfff17411e5ee60b92c4b80249237743, regionState=CLOSED 2023-02-15 20:01:17,020 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,d\\x84\\x84,1676491266407.cfff17411e5ee60b92c4b80249237743.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676491277020"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676491277020"}]},"ts":"1676491277020"} 2023-02-15 20:01:17,024 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=50, resume processing ppid=36 2023-02-15 20:01:17,024 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=50, ppid=36, state=SUCCESS; CloseRegionProcedure cfff17411e5ee60b92c4b80249237743, server=jenkins-hbase4.apache.org,41535,1676491262190 in 254 msec 2023-02-15 20:01:17,026 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=36, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=cfff17411e5ee60b92c4b80249237743, UNASSIGN in 284 msec 2023-02-15 20:01:17,040 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39607] master.MasterRpcServices(1227): Checking to see if procedure is done pid=33 2023-02-15 20:01:17,060 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/data/default/testWithMapReduce/da7189167b0a5e71ebfc52ccf8240947/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-15 20:01:17,062 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,wWV,1676491266407.da7189167b0a5e71ebfc52ccf8240947. 2023-02-15 20:01:17,062 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for da7189167b0a5e71ebfc52ccf8240947: 2023-02-15 20:01:17,064 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed da7189167b0a5e71ebfc52ccf8240947 2023-02-15 20:01:17,065 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=42 updating hbase:meta row=da7189167b0a5e71ebfc52ccf8240947, regionState=CLOSED 2023-02-15 20:01:17,065 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,wWV,1676491266407.da7189167b0a5e71ebfc52ccf8240947.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676491277065"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676491277065"}]},"ts":"1676491277065"} 2023-02-15 20:01:17,066 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/data/default/testWithMapReduce/f5c7d59a05e094a402144fe6a2d882f0/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-02-15 20:01:17,068 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,zz{,1676491266407.f5c7d59a05e094a402144fe6a2d882f0. 2023-02-15 20:01:17,068 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for f5c7d59a05e094a402144fe6a2d882f0: 2023-02-15 20:01:17,070 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed f5c7d59a05e094a402144fe6a2d882f0 2023-02-15 20:01:17,071 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=f5c7d59a05e094a402144fe6a2d882f0, regionState=CLOSED 2023-02-15 20:01:17,071 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,zz{,1676491266407.f5c7d59a05e094a402144fe6a2d882f0.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676491277071"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676491277071"}]},"ts":"1676491277071"} 2023-02-15 20:01:17,071 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=44, resume processing ppid=42 2023-02-15 20:01:17,072 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=44, ppid=42, state=SUCCESS; CloseRegionProcedure da7189167b0a5e71ebfc52ccf8240947, server=jenkins-hbase4.apache.org,33367,1676491262239 in 319 msec 2023-02-15 20:01:17,073 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=42, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=da7189167b0a5e71ebfc52ccf8240947, UNASSIGN in 330 msec 2023-02-15 20:01:17,075 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=47, resume processing ppid=43 2023-02-15 20:01:17,075 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=47, ppid=43, state=SUCCESS; CloseRegionProcedure f5c7d59a05e094a402144fe6a2d882f0, server=jenkins-hbase4.apache.org,41535,1676491262190 in 318 msec 2023-02-15 20:01:17,077 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=43, resume processing ppid=33 2023-02-15 20:01:17,077 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=43, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=f5c7d59a05e094a402144fe6a2d882f0, UNASSIGN in 333 msec 2023-02-15 20:01:17,078 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676491277078"}]},"ts":"1676491277078"} 2023-02-15 20:01:17,080 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=DISABLED in hbase:meta 2023-02-15 20:01:17,082 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testWithMapReduce to state=DISABLED 2023-02-15 20:01:17,085 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=33, state=SUCCESS; DisableTableProcedure table=testWithMapReduce in 358 msec 2023-02-15 20:01:17,342 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39607] master.MasterRpcServices(1227): Checking to see if procedure is done pid=33 2023-02-15 20:01:17,343 INFO [Listener at localhost/37547] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testWithMapReduce, procId: 33 completed 2023-02-15 20:01:17,348 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39607] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testWithMapReduce 2023-02-15 20:01:17,355 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39607] procedure2.ProcedureExecutor(1029): Stored pid=54, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testWithMapReduce 2023-02-15 20:01:17,358 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=54, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-15 20:01:17,360 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=54, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-15 20:01:17,361 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39607] master.MasterRpcServices(1227): Checking to see if procedure is done pid=54 2023-02-15 20:01:17,378 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/.tmp/data/default/testWithMapReduce/77b8837eb0dd784edf4b0582f0ba0a3f 2023-02-15 20:01:17,378 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/.tmp/data/default/testWithMapReduce/cfff17411e5ee60b92c4b80249237743 2023-02-15 20:01:17,378 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/.tmp/data/default/testWithMapReduce/30b6672c9889bbc2cc2b417a34f3f49e 2023-02-15 20:01:17,379 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/.tmp/data/default/testWithMapReduce/aac41416f1d7fc83b90c2b3432a76ce6 2023-02-15 20:01:17,379 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/.tmp/data/default/testWithMapReduce/ce146f62338407483a61920d7170f142 2023-02-15 20:01:17,379 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/.tmp/data/default/testWithMapReduce/f26f31f3358f9f2d50b3c5d32cc7b35d 2023-02-15 20:01:17,378 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/.tmp/data/default/testWithMapReduce/3506ea931c9649c226fb4c38a5165b6a 2023-02-15 20:01:17,378 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/.tmp/data/default/testWithMapReduce/8a2219c4f89e37dec8687cefabd9fc25 2023-02-15 20:01:17,385 DEBUG [HFileArchiver-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/.tmp/data/default/testWithMapReduce/77b8837eb0dd784edf4b0582f0ba0a3f/f1, FileablePath, hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/.tmp/data/default/testWithMapReduce/77b8837eb0dd784edf4b0582f0ba0a3f/f2, FileablePath, hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/.tmp/data/default/testWithMapReduce/77b8837eb0dd784edf4b0582f0ba0a3f/recovered.edits] 2023-02-15 20:01:17,385 DEBUG [HFileArchiver-1] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/.tmp/data/default/testWithMapReduce/8a2219c4f89e37dec8687cefabd9fc25/f1, FileablePath, hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/.tmp/data/default/testWithMapReduce/8a2219c4f89e37dec8687cefabd9fc25/f2, FileablePath, hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/.tmp/data/default/testWithMapReduce/8a2219c4f89e37dec8687cefabd9fc25/recovered.edits] 2023-02-15 20:01:17,387 DEBUG [HFileArchiver-6] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/.tmp/data/default/testWithMapReduce/cfff17411e5ee60b92c4b80249237743/f1, FileablePath, hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/.tmp/data/default/testWithMapReduce/cfff17411e5ee60b92c4b80249237743/f2, FileablePath, hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/.tmp/data/default/testWithMapReduce/cfff17411e5ee60b92c4b80249237743/recovered.edits] 2023-02-15 20:01:17,388 DEBUG [HFileArchiver-7] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/.tmp/data/default/testWithMapReduce/3506ea931c9649c226fb4c38a5165b6a/f1, FileablePath, hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/.tmp/data/default/testWithMapReduce/3506ea931c9649c226fb4c38a5165b6a/f2, FileablePath, hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/.tmp/data/default/testWithMapReduce/3506ea931c9649c226fb4c38a5165b6a/recovered.edits] 2023-02-15 20:01:17,388 DEBUG [HFileArchiver-8] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/.tmp/data/default/testWithMapReduce/f26f31f3358f9f2d50b3c5d32cc7b35d/f1, FileablePath, hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/.tmp/data/default/testWithMapReduce/f26f31f3358f9f2d50b3c5d32cc7b35d/f2, FileablePath, hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/.tmp/data/default/testWithMapReduce/f26f31f3358f9f2d50b3c5d32cc7b35d/recovered.edits] 2023-02-15 20:01:17,388 DEBUG [HFileArchiver-3] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/.tmp/data/default/testWithMapReduce/30b6672c9889bbc2cc2b417a34f3f49e/f1, FileablePath, hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/.tmp/data/default/testWithMapReduce/30b6672c9889bbc2cc2b417a34f3f49e/f2, FileablePath, hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/.tmp/data/default/testWithMapReduce/30b6672c9889bbc2cc2b417a34f3f49e/recovered.edits] 2023-02-15 20:01:17,388 DEBUG [HFileArchiver-2] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/.tmp/data/default/testWithMapReduce/ce146f62338407483a61920d7170f142/f1, FileablePath, hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/.tmp/data/default/testWithMapReduce/ce146f62338407483a61920d7170f142/f2, FileablePath, hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/.tmp/data/default/testWithMapReduce/ce146f62338407483a61920d7170f142/recovered.edits] 2023-02-15 20:01:17,388 DEBUG [HFileArchiver-4] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/.tmp/data/default/testWithMapReduce/aac41416f1d7fc83b90c2b3432a76ce6/f1, FileablePath, hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/.tmp/data/default/testWithMapReduce/aac41416f1d7fc83b90c2b3432a76ce6/f2, FileablePath, hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/.tmp/data/default/testWithMapReduce/aac41416f1d7fc83b90c2b3432a76ce6/recovered.edits] 2023-02-15 20:01:17,402 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/.tmp/data/default/testWithMapReduce/cfff17411e5ee60b92c4b80249237743/f1/2b66b94b8cac4024b68e4f193fbadd83 to hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/archive/data/default/testWithMapReduce/cfff17411e5ee60b92c4b80249237743/f1/2b66b94b8cac4024b68e4f193fbadd83 2023-02-15 20:01:17,403 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/.tmp/data/default/testWithMapReduce/ce146f62338407483a61920d7170f142/f1/3b645a76ccc943eca010c41a29ae08c8 to hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/archive/data/default/testWithMapReduce/ce146f62338407483a61920d7170f142/f1/3b645a76ccc943eca010c41a29ae08c8 2023-02-15 20:01:17,403 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/.tmp/data/default/testWithMapReduce/f26f31f3358f9f2d50b3c5d32cc7b35d/f1/28443b8834a64448a36d76603a7bc046 to hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/archive/data/default/testWithMapReduce/f26f31f3358f9f2d50b3c5d32cc7b35d/f1/28443b8834a64448a36d76603a7bc046 2023-02-15 20:01:17,403 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/.tmp/data/default/testWithMapReduce/8a2219c4f89e37dec8687cefabd9fc25/f1/b147a9e48d4e4e39aa9c981c22189d7c to hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/archive/data/default/testWithMapReduce/8a2219c4f89e37dec8687cefabd9fc25/f1/b147a9e48d4e4e39aa9c981c22189d7c 2023-02-15 20:01:17,403 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/.tmp/data/default/testWithMapReduce/3506ea931c9649c226fb4c38a5165b6a/f1/584b33569807402bab19c695007854d6 to hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/archive/data/default/testWithMapReduce/3506ea931c9649c226fb4c38a5165b6a/f1/584b33569807402bab19c695007854d6 2023-02-15 20:01:17,404 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/.tmp/data/default/testWithMapReduce/30b6672c9889bbc2cc2b417a34f3f49e/f1/85131266493445ac915b0c40d55c0070 to hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/archive/data/default/testWithMapReduce/30b6672c9889bbc2cc2b417a34f3f49e/f1/85131266493445ac915b0c40d55c0070 2023-02-15 20:01:17,404 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/.tmp/data/default/testWithMapReduce/aac41416f1d7fc83b90c2b3432a76ce6/f1/57d4be8d48b346c7a016b59865fd1e02 to hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/archive/data/default/testWithMapReduce/aac41416f1d7fc83b90c2b3432a76ce6/f1/57d4be8d48b346c7a016b59865fd1e02 2023-02-15 20:01:17,406 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/.tmp/data/default/testWithMapReduce/ce146f62338407483a61920d7170f142/f1/7712cf3c394d4f768b4b03d288f6a1ed to hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/archive/data/default/testWithMapReduce/ce146f62338407483a61920d7170f142/f1/7712cf3c394d4f768b4b03d288f6a1ed 2023-02-15 20:01:17,407 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/.tmp/data/default/testWithMapReduce/3506ea931c9649c226fb4c38a5165b6a/f1/6717a82d1b7c4defb86c5f60eab3cf11 to hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/archive/data/default/testWithMapReduce/3506ea931c9649c226fb4c38a5165b6a/f1/6717a82d1b7c4defb86c5f60eab3cf11 2023-02-15 20:01:17,408 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/.tmp/data/default/testWithMapReduce/cfff17411e5ee60b92c4b80249237743/f1/6bba3196e5b540e48a9df25fca510f9d to hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/archive/data/default/testWithMapReduce/cfff17411e5ee60b92c4b80249237743/f1/6bba3196e5b540e48a9df25fca510f9d 2023-02-15 20:01:17,408 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/.tmp/data/default/testWithMapReduce/30b6672c9889bbc2cc2b417a34f3f49e/f1/ec2992e2ea234979a8399c1be6782eb8 to hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/archive/data/default/testWithMapReduce/30b6672c9889bbc2cc2b417a34f3f49e/f1/ec2992e2ea234979a8399c1be6782eb8 2023-02-15 20:01:17,409 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/.tmp/data/default/testWithMapReduce/f26f31f3358f9f2d50b3c5d32cc7b35d/f1/e9d819bfab2d44ebbd85de59dbaa3ed0 to hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/archive/data/default/testWithMapReduce/f26f31f3358f9f2d50b3c5d32cc7b35d/f1/e9d819bfab2d44ebbd85de59dbaa3ed0 2023-02-15 20:01:17,410 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/.tmp/data/default/testWithMapReduce/8a2219c4f89e37dec8687cefabd9fc25/f1/eb9c2a0eb1a74c45ae7e4c7171c4590e to hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/archive/data/default/testWithMapReduce/8a2219c4f89e37dec8687cefabd9fc25/f1/eb9c2a0eb1a74c45ae7e4c7171c4590e 2023-02-15 20:01:17,410 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/.tmp/data/default/testWithMapReduce/aac41416f1d7fc83b90c2b3432a76ce6/f1/9fd9cfca86f946febf2708c1bc10bdbd to hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/archive/data/default/testWithMapReduce/aac41416f1d7fc83b90c2b3432a76ce6/f1/9fd9cfca86f946febf2708c1bc10bdbd 2023-02-15 20:01:17,410 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/.tmp/data/default/testWithMapReduce/77b8837eb0dd784edf4b0582f0ba0a3f/recovered.edits/6.seqid to hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/archive/data/default/testWithMapReduce/77b8837eb0dd784edf4b0582f0ba0a3f/recovered.edits/6.seqid 2023-02-15 20:01:17,411 DEBUG [HFileArchiver-5] backup.HFileArchiver(596): Deleted hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/.tmp/data/default/testWithMapReduce/77b8837eb0dd784edf4b0582f0ba0a3f 2023-02-15 20:01:17,411 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/.tmp/data/default/testWithMapReduce/da7189167b0a5e71ebfc52ccf8240947 2023-02-15 20:01:17,417 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/.tmp/data/default/testWithMapReduce/3506ea931c9649c226fb4c38a5165b6a/f2/1b8744dea70f47e290b386aa438b28ee to hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/archive/data/default/testWithMapReduce/3506ea931c9649c226fb4c38a5165b6a/f2/1b8744dea70f47e290b386aa438b28ee 2023-02-15 20:01:17,419 DEBUG [HFileArchiver-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/.tmp/data/default/testWithMapReduce/da7189167b0a5e71ebfc52ccf8240947/f1, FileablePath, hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/.tmp/data/default/testWithMapReduce/da7189167b0a5e71ebfc52ccf8240947/f2, FileablePath, hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/.tmp/data/default/testWithMapReduce/da7189167b0a5e71ebfc52ccf8240947/recovered.edits] 2023-02-15 20:01:17,419 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/.tmp/data/default/testWithMapReduce/ce146f62338407483a61920d7170f142/f2/995c8facb2294aa3a01a52aea6ce503a to hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/archive/data/default/testWithMapReduce/ce146f62338407483a61920d7170f142/f2/995c8facb2294aa3a01a52aea6ce503a 2023-02-15 20:01:17,420 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/.tmp/data/default/testWithMapReduce/30b6672c9889bbc2cc2b417a34f3f49e/f2/7f7ba19388734301a91db45ebb2ab429 to hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/archive/data/default/testWithMapReduce/30b6672c9889bbc2cc2b417a34f3f49e/f2/7f7ba19388734301a91db45ebb2ab429 2023-02-15 20:01:17,421 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/.tmp/data/default/testWithMapReduce/cfff17411e5ee60b92c4b80249237743/f2/a1a93d17faa940fd860aa03d710c0091 to hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/archive/data/default/testWithMapReduce/cfff17411e5ee60b92c4b80249237743/f2/a1a93d17faa940fd860aa03d710c0091 2023-02-15 20:01:17,421 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/.tmp/data/default/testWithMapReduce/aac41416f1d7fc83b90c2b3432a76ce6/f2/3669f67eb1b64ebaadc77923020a31c6 to hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/archive/data/default/testWithMapReduce/aac41416f1d7fc83b90c2b3432a76ce6/f2/3669f67eb1b64ebaadc77923020a31c6 2023-02-15 20:01:17,421 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/.tmp/data/default/testWithMapReduce/f26f31f3358f9f2d50b3c5d32cc7b35d/f2/47b72bdb129e429abeee819914e83fb2 to hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/archive/data/default/testWithMapReduce/f26f31f3358f9f2d50b3c5d32cc7b35d/f2/47b72bdb129e429abeee819914e83fb2 2023-02-15 20:01:17,423 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/.tmp/data/default/testWithMapReduce/3506ea931c9649c226fb4c38a5165b6a/f2/54dd6083f71647188cca8be14640b96a to hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/archive/data/default/testWithMapReduce/3506ea931c9649c226fb4c38a5165b6a/f2/54dd6083f71647188cca8be14640b96a 2023-02-15 20:01:17,425 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/.tmp/data/default/testWithMapReduce/8a2219c4f89e37dec8687cefabd9fc25/f2/34ef4ec0a4fa41c29b0e30b79e7e1387 to hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/archive/data/default/testWithMapReduce/8a2219c4f89e37dec8687cefabd9fc25/f2/34ef4ec0a4fa41c29b0e30b79e7e1387 2023-02-15 20:01:17,425 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/.tmp/data/default/testWithMapReduce/30b6672c9889bbc2cc2b417a34f3f49e/f2/e6b374c300554dc383a1d8e4f5c3eb51 to hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/archive/data/default/testWithMapReduce/30b6672c9889bbc2cc2b417a34f3f49e/f2/e6b374c300554dc383a1d8e4f5c3eb51 2023-02-15 20:01:17,426 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/.tmp/data/default/testWithMapReduce/aac41416f1d7fc83b90c2b3432a76ce6/f2/fdf07ac3996e436f919b533a96fe4829 to hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/archive/data/default/testWithMapReduce/aac41416f1d7fc83b90c2b3432a76ce6/f2/fdf07ac3996e436f919b533a96fe4829 2023-02-15 20:01:17,425 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/.tmp/data/default/testWithMapReduce/ce146f62338407483a61920d7170f142/f2/e0e4950437544f398559fbc97075f122 to hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/archive/data/default/testWithMapReduce/ce146f62338407483a61920d7170f142/f2/e0e4950437544f398559fbc97075f122 2023-02-15 20:01:17,426 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/.tmp/data/default/testWithMapReduce/f26f31f3358f9f2d50b3c5d32cc7b35d/f2/8bb42134d4fe49e88a7ea2822eb8e329 to hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/archive/data/default/testWithMapReduce/f26f31f3358f9f2d50b3c5d32cc7b35d/f2/8bb42134d4fe49e88a7ea2822eb8e329 2023-02-15 20:01:17,427 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/.tmp/data/default/testWithMapReduce/cfff17411e5ee60b92c4b80249237743/f2/ac50a363254a45e1bf697261d76f71cc to hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/archive/data/default/testWithMapReduce/cfff17411e5ee60b92c4b80249237743/f2/ac50a363254a45e1bf697261d76f71cc 2023-02-15 20:01:17,432 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/.tmp/data/default/testWithMapReduce/8a2219c4f89e37dec8687cefabd9fc25/f2/94652720be85460cba80f932503517b1 to hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/archive/data/default/testWithMapReduce/8a2219c4f89e37dec8687cefabd9fc25/f2/94652720be85460cba80f932503517b1 2023-02-15 20:01:17,437 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/.tmp/data/default/testWithMapReduce/3506ea931c9649c226fb4c38a5165b6a/recovered.edits/12.seqid to hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/archive/data/default/testWithMapReduce/3506ea931c9649c226fb4c38a5165b6a/recovered.edits/12.seqid 2023-02-15 20:01:17,438 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/.tmp/data/default/testWithMapReduce/da7189167b0a5e71ebfc52ccf8240947/f1/b19871dfbf874f2d814f559e617022a3 to hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/archive/data/default/testWithMapReduce/da7189167b0a5e71ebfc52ccf8240947/f1/b19871dfbf874f2d814f559e617022a3 2023-02-15 20:01:17,438 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/.tmp/data/default/testWithMapReduce/30b6672c9889bbc2cc2b417a34f3f49e/recovered.edits/12.seqid to hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/archive/data/default/testWithMapReduce/30b6672c9889bbc2cc2b417a34f3f49e/recovered.edits/12.seqid 2023-02-15 20:01:17,439 DEBUG [HFileArchiver-7] backup.HFileArchiver(596): Deleted hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/.tmp/data/default/testWithMapReduce/3506ea931c9649c226fb4c38a5165b6a 2023-02-15 20:01:17,439 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/.tmp/data/default/testWithMapReduce/f5c7d59a05e094a402144fe6a2d882f0 2023-02-15 20:01:17,439 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/.tmp/data/default/testWithMapReduce/f26f31f3358f9f2d50b3c5d32cc7b35d/recovered.edits/12.seqid to hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/archive/data/default/testWithMapReduce/f26f31f3358f9f2d50b3c5d32cc7b35d/recovered.edits/12.seqid 2023-02-15 20:01:17,440 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/.tmp/data/default/testWithMapReduce/aac41416f1d7fc83b90c2b3432a76ce6/recovered.edits/12.seqid to hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/archive/data/default/testWithMapReduce/aac41416f1d7fc83b90c2b3432a76ce6/recovered.edits/12.seqid 2023-02-15 20:01:17,441 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/.tmp/data/default/testWithMapReduce/cfff17411e5ee60b92c4b80249237743/recovered.edits/12.seqid to hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/archive/data/default/testWithMapReduce/cfff17411e5ee60b92c4b80249237743/recovered.edits/12.seqid 2023-02-15 20:01:17,442 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/.tmp/data/default/testWithMapReduce/ce146f62338407483a61920d7170f142/recovered.edits/12.seqid to hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/archive/data/default/testWithMapReduce/ce146f62338407483a61920d7170f142/recovered.edits/12.seqid 2023-02-15 20:01:17,442 DEBUG [HFileArchiver-3] backup.HFileArchiver(596): Deleted hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/.tmp/data/default/testWithMapReduce/30b6672c9889bbc2cc2b417a34f3f49e 2023-02-15 20:01:17,442 DEBUG [HFileArchiver-8] backup.HFileArchiver(596): Deleted hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/.tmp/data/default/testWithMapReduce/f26f31f3358f9f2d50b3c5d32cc7b35d 2023-02-15 20:01:17,442 DEBUG [HFileArchiver-4] backup.HFileArchiver(596): Deleted hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/.tmp/data/default/testWithMapReduce/aac41416f1d7fc83b90c2b3432a76ce6 2023-02-15 20:01:17,442 DEBUG [HFileArchiver-6] backup.HFileArchiver(596): Deleted hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/.tmp/data/default/testWithMapReduce/cfff17411e5ee60b92c4b80249237743 2023-02-15 20:01:17,443 DEBUG [HFileArchiver-2] backup.HFileArchiver(596): Deleted hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/.tmp/data/default/testWithMapReduce/ce146f62338407483a61920d7170f142 2023-02-15 20:01:17,443 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/.tmp/data/default/testWithMapReduce/da7189167b0a5e71ebfc52ccf8240947/f1/e199c168d268415c9a4609ae9b2e3670 to hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/archive/data/default/testWithMapReduce/da7189167b0a5e71ebfc52ccf8240947/f1/e199c168d268415c9a4609ae9b2e3670 2023-02-15 20:01:17,443 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/.tmp/data/default/testWithMapReduce/8a2219c4f89e37dec8687cefabd9fc25/recovered.edits/12.seqid to hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/archive/data/default/testWithMapReduce/8a2219c4f89e37dec8687cefabd9fc25/recovered.edits/12.seqid 2023-02-15 20:01:17,444 DEBUG [HFileArchiver-7] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/.tmp/data/default/testWithMapReduce/f5c7d59a05e094a402144fe6a2d882f0/f1, FileablePath, hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/.tmp/data/default/testWithMapReduce/f5c7d59a05e094a402144fe6a2d882f0/f2, FileablePath, hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/.tmp/data/default/testWithMapReduce/f5c7d59a05e094a402144fe6a2d882f0/recovered.edits] 2023-02-15 20:01:17,444 DEBUG [HFileArchiver-1] backup.HFileArchiver(596): Deleted hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/.tmp/data/default/testWithMapReduce/8a2219c4f89e37dec8687cefabd9fc25 2023-02-15 20:01:17,448 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/.tmp/data/default/testWithMapReduce/da7189167b0a5e71ebfc52ccf8240947/f2/305eda5d270a4058a64e4c581a9ab11d to hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/archive/data/default/testWithMapReduce/da7189167b0a5e71ebfc52ccf8240947/f2/305eda5d270a4058a64e4c581a9ab11d 2023-02-15 20:01:17,451 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/.tmp/data/default/testWithMapReduce/da7189167b0a5e71ebfc52ccf8240947/f2/8d25fe20ffad48609d3e9f21e91d0871 to hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/archive/data/default/testWithMapReduce/da7189167b0a5e71ebfc52ccf8240947/f2/8d25fe20ffad48609d3e9f21e91d0871 2023-02-15 20:01:17,455 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/.tmp/data/default/testWithMapReduce/f5c7d59a05e094a402144fe6a2d882f0/recovered.edits/6.seqid to hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/archive/data/default/testWithMapReduce/f5c7d59a05e094a402144fe6a2d882f0/recovered.edits/6.seqid 2023-02-15 20:01:17,456 DEBUG [HFileArchiver-7] backup.HFileArchiver(596): Deleted hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/.tmp/data/default/testWithMapReduce/f5c7d59a05e094a402144fe6a2d882f0 2023-02-15 20:01:17,458 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/.tmp/data/default/testWithMapReduce/da7189167b0a5e71ebfc52ccf8240947/recovered.edits/12.seqid to hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/archive/data/default/testWithMapReduce/da7189167b0a5e71ebfc52ccf8240947/recovered.edits/12.seqid 2023-02-15 20:01:17,458 DEBUG [HFileArchiver-5] backup.HFileArchiver(596): Deleted hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/.tmp/data/default/testWithMapReduce/da7189167b0a5e71ebfc52ccf8240947 2023-02-15 20:01:17,458 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testWithMapReduce regions 2023-02-15 20:01:17,462 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=54, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-15 20:01:17,463 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39607] master.MasterRpcServices(1227): Checking to see if procedure is done pid=54 2023-02-15 20:01:17,490 WARN [PEWorker-2] procedure.DeleteTableProcedure(384): Deleting some vestigial 10 rows of testWithMapReduce from hbase:meta 2023-02-15 20:01:17,494 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(421): Removing 'testWithMapReduce' descriptor. 2023-02-15 20:01:17,496 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=54, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-15 20:01:17,496 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(411): Removing 'testWithMapReduce' from region states. 2023-02-15 20:01:17,496 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,,1676491266407.77b8837eb0dd784edf4b0582f0ba0a3f.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676491277496"}]},"ts":"9223372036854775807"} 2023-02-15 20:01:17,496 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,aaa,1676491266407.8a2219c4f89e37dec8687cefabd9fc25.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676491277496"}]},"ts":"9223372036854775807"} 2023-02-15 20:01:17,496 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,d\\x84\\x84,1676491266407.cfff17411e5ee60b92c4b80249237743.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676491277496"}]},"ts":"9223372036854775807"} 2023-02-15 20:01:17,496 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,g\\xA7\\xA7,1676491266407.3506ea931c9649c226fb4c38a5165b6a.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676491277496"}]},"ts":"9223372036854775807"} 2023-02-15 20:01:17,496 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,j\\xCA\\xCA,1676491266407.30b6672c9889bbc2cc2b417a34f3f49e.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676491277496"}]},"ts":"9223372036854775807"} 2023-02-15 20:01:17,496 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,m\\xED\\xED,1676491266407.f26f31f3358f9f2d50b3c5d32cc7b35d.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676491277496"}]},"ts":"9223372036854775807"} 2023-02-15 20:01:17,496 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,q\\x11\\x10,1676491266407.aac41416f1d7fc83b90c2b3432a76ce6.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676491277496"}]},"ts":"9223372036854775807"} 2023-02-15 20:01:17,496 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,t43,1676491266407.ce146f62338407483a61920d7170f142.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676491277496"}]},"ts":"9223372036854775807"} 2023-02-15 20:01:17,497 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,wWV,1676491266407.da7189167b0a5e71ebfc52ccf8240947.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676491277496"}]},"ts":"9223372036854775807"} 2023-02-15 20:01:17,497 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,zz{,1676491266407.f5c7d59a05e094a402144fe6a2d882f0.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676491277496"}]},"ts":"9223372036854775807"} 2023-02-15 20:01:17,499 INFO [PEWorker-2] hbase.MetaTableAccessor(1788): Deleted 10 regions from META 2023-02-15 20:01:17,499 DEBUG [PEWorker-2] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 77b8837eb0dd784edf4b0582f0ba0a3f, NAME => 'testWithMapReduce,,1676491266407.77b8837eb0dd784edf4b0582f0ba0a3f.', STARTKEY => '', ENDKEY => 'aaa'}, {ENCODED => 8a2219c4f89e37dec8687cefabd9fc25, NAME => 'testWithMapReduce,aaa,1676491266407.8a2219c4f89e37dec8687cefabd9fc25.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'}, {ENCODED => cfff17411e5ee60b92c4b80249237743, NAME => 'testWithMapReduce,d\x84\x84,1676491266407.cfff17411e5ee60b92c4b80249237743.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'}, {ENCODED => 3506ea931c9649c226fb4c38a5165b6a, NAME => 'testWithMapReduce,g\xA7\xA7,1676491266407.3506ea931c9649c226fb4c38a5165b6a.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'}, {ENCODED => 30b6672c9889bbc2cc2b417a34f3f49e, NAME => 'testWithMapReduce,j\xCA\xCA,1676491266407.30b6672c9889bbc2cc2b417a34f3f49e.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'}, {ENCODED => f26f31f3358f9f2d50b3c5d32cc7b35d, NAME => 'testWithMapReduce,m\xED\xED,1676491266407.f26f31f3358f9f2d50b3c5d32cc7b35d.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'}, {ENCODED => aac41416f1d7fc83b90c2b3432a76ce6, NAME => 'testWithMapReduce,q\x11\x10,1676491266407.aac41416f1d7fc83b90c2b3432a76ce6.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'}, {ENCODED => ce146f62338407483a61920d7170f142, NAME => 'testWithMapReduce,t43,1676491266407.ce146f62338407483a61920d7170f142.', STARTKEY => 't43', ENDKEY => 'wWV'}, {ENCODED => da7189167b0a5e71ebfc52ccf8240947, NAME => 'testWithMapReduce,wWV,1676491266407.da7189167b0a5e71ebfc52ccf8240947.', STARTKEY => 'wWV', ENDKEY => 'zz{'}, {ENCODED => f5c7d59a05e094a402144fe6a2d882f0, NAME => 'testWithMapReduce,zz{,1676491266407.f5c7d59a05e094a402144fe6a2d882f0.', STARTKEY => 'zz{', ENDKEY => ''}] 2023-02-15 20:01:17,499 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(415): Marking 'testWithMapReduce' as deleted. 2023-02-15 20:01:17,499 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1676491277499"}]},"ts":"9223372036854775807"} 2023-02-15 20:01:17,501 INFO [PEWorker-2] hbase.MetaTableAccessor(1658): Deleted table testWithMapReduce state from META 2023-02-15 20:01:17,503 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(130): Finished pid=54, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-15 20:01:17,505 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=54, state=SUCCESS; DeleteTableProcedure table=testWithMapReduce in 154 msec 2023-02-15 20:01:17,665 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39607] master.MasterRpcServices(1227): Checking to see if procedure is done pid=54 2023-02-15 20:01:17,665 INFO [Listener at localhost/37547] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testWithMapReduce, procId: 54 completed 2023-02-15 20:01:17,666 INFO [Listener at localhost/37547] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-02-15 20:01:17,666 INFO [Listener at localhost/37547] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-15 20:01:17,666 DEBUG [Listener at localhost/37547] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x56159f41 to 127.0.0.1:53178 2023-02-15 20:01:17,666 DEBUG [Listener at localhost/37547] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-15 20:01:17,666 DEBUG [Listener at localhost/37547] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-02-15 20:01:17,666 DEBUG [Listener at localhost/37547] util.JVMClusterUtil(257): Found active master hash=272140097, stopped=false 2023-02-15 20:01:17,667 INFO [Listener at localhost/37547] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,39607,1676491260960 2023-02-15 20:01:17,671 DEBUG [Listener at localhost/37547-EventThread] zookeeper.ZKWatcher(600): regionserver:41535-0x10059926a4e0001, quorum=127.0.0.1:53178, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-15 20:01:17,671 DEBUG [Listener at localhost/37547-EventThread] zookeeper.ZKWatcher(600): regionserver:33367-0x10059926a4e0002, quorum=127.0.0.1:53178, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-15 20:01:17,671 INFO [Listener at localhost/37547] procedure2.ProcedureExecutor(629): Stopping 2023-02-15 20:01:17,671 DEBUG [Listener at localhost/37547-EventThread] zookeeper.ZKWatcher(600): master:39607-0x10059926a4e0000, quorum=127.0.0.1:53178, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-15 20:01:17,671 DEBUG [Listener at localhost/37547-EventThread] zookeeper.ZKWatcher(600): master:39607-0x10059926a4e0000, quorum=127.0.0.1:53178, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-15 20:01:17,671 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41535-0x10059926a4e0001, quorum=127.0.0.1:53178, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-15 20:01:17,671 DEBUG [Listener at localhost/37547] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4532ccb8 to 127.0.0.1:53178 2023-02-15 20:01:17,672 DEBUG [Listener at localhost/37547] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-15 20:01:17,672 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33367-0x10059926a4e0002, quorum=127.0.0.1:53178, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-15 20:01:17,672 INFO [Listener at localhost/37547] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,41535,1676491262190' ***** 2023-02-15 20:01:17,672 INFO [Listener at localhost/37547] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-15 20:01:17,672 INFO [Listener at localhost/37547] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,33367,1676491262239' ***** 2023-02-15 20:01:17,672 INFO [Listener at localhost/37547] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-15 20:01:17,673 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:39607-0x10059926a4e0000, quorum=127.0.0.1:53178, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-15 20:01:17,673 INFO [RS:1;jenkins-hbase4:33367] regionserver.HeapMemoryManager(220): Stopping 2023-02-15 20:01:17,673 INFO [RS:1;jenkins-hbase4:33367] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-15 20:01:17,673 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-15 20:01:17,673 INFO [RS:0;jenkins-hbase4:41535] regionserver.HeapMemoryManager(220): Stopping 2023-02-15 20:01:17,674 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-15 20:01:17,674 INFO [RS:1;jenkins-hbase4:33367] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-15 20:01:17,674 INFO [RS:0;jenkins-hbase4:41535] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-15 20:01:17,675 INFO [RS:1;jenkins-hbase4:33367] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,33367,1676491262239 2023-02-15 20:01:17,675 INFO [RS:0;jenkins-hbase4:41535] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-15 20:01:17,675 DEBUG [RS:1;jenkins-hbase4:33367] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x573dbd02 to 127.0.0.1:53178 2023-02-15 20:01:17,675 DEBUG [RS:1;jenkins-hbase4:33367] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-15 20:01:17,675 INFO [RS:0;jenkins-hbase4:41535] regionserver.HRegionServer(3304): Received CLOSE for 9b913a56be4572b4f2949643b7fef2ba 2023-02-15 20:01:17,675 INFO [RS:1;jenkins-hbase4:33367] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,33367,1676491262239; all regions closed. 2023-02-15 20:01:17,675 INFO [RS:0;jenkins-hbase4:41535] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,41535,1676491262190 2023-02-15 20:01:17,675 DEBUG [RS:0;jenkins-hbase4:41535] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x183c078f to 127.0.0.1:53178 2023-02-15 20:01:17,676 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 9b913a56be4572b4f2949643b7fef2ba, disabling compactions & flushes 2023-02-15 20:01:17,676 DEBUG [RS:0;jenkins-hbase4:41535] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-15 20:01:17,676 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676491265356.9b913a56be4572b4f2949643b7fef2ba. 2023-02-15 20:01:17,676 INFO [RS:0;jenkins-hbase4:41535] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-15 20:01:17,676 INFO [RS:0;jenkins-hbase4:41535] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-15 20:01:17,676 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676491265356.9b913a56be4572b4f2949643b7fef2ba. 2023-02-15 20:01:17,676 INFO [RS:0;jenkins-hbase4:41535] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-15 20:01:17,676 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676491265356.9b913a56be4572b4f2949643b7fef2ba. after waiting 0 ms 2023-02-15 20:01:17,676 INFO [RS:0;jenkins-hbase4:41535] regionserver.HRegionServer(3304): Received CLOSE for 1588230740 2023-02-15 20:01:17,676 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676491265356.9b913a56be4572b4f2949643b7fef2ba. 2023-02-15 20:01:17,676 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 9b913a56be4572b4f2949643b7fef2ba 1/1 column families, dataSize=78 B heapSize=488 B 2023-02-15 20:01:17,676 INFO [RS:0;jenkins-hbase4:41535] regionserver.HRegionServer(1475): Waiting on 2 regions to close 2023-02-15 20:01:17,676 DEBUG [RS:0;jenkins-hbase4:41535] regionserver.HRegionServer(1479): Online Regions={1588230740=hbase:meta,,1.1588230740, 9b913a56be4572b4f2949643b7fef2ba=hbase:namespace,,1676491265356.9b913a56be4572b4f2949643b7fef2ba.} 2023-02-15 20:01:17,677 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-15 20:01:17,677 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-15 20:01:17,677 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-15 20:01:17,677 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-15 20:01:17,677 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-15 20:01:17,677 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 1588230740 3/3 column families, dataSize=24.29 KB heapSize=40.20 KB 2023-02-15 20:01:17,679 DEBUG [RS:0;jenkins-hbase4:41535] regionserver.HRegionServer(1505): Waiting on 1588230740, 9b913a56be4572b4f2949643b7fef2ba 2023-02-15 20:01:17,682 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-02-15 20:01:17,682 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-02-15 20:01:17,685 DEBUG [RS:1;jenkins-hbase4:33367] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/oldWALs 2023-02-15 20:01:17,685 INFO [RS:1;jenkins-hbase4:33367] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C33367%2C1676491262239:(num 1676491265731) 2023-02-15 20:01:17,685 DEBUG [RS:1;jenkins-hbase4:33367] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-15 20:01:17,685 INFO [RS:1;jenkins-hbase4:33367] regionserver.LeaseManager(133): Closed leases 2023-02-15 20:01:17,688 INFO [RS:1;jenkins-hbase4:33367] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-02-15 20:01:17,688 INFO [RS:1;jenkins-hbase4:33367] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-15 20:01:17,688 INFO [RS:1;jenkins-hbase4:33367] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-15 20:01:17,688 INFO [RS:1;jenkins-hbase4:33367] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-15 20:01:17,688 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-15 20:01:17,689 INFO [RS:1;jenkins-hbase4:33367] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:33367 2023-02-15 20:01:17,716 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=22.08 KB at sequenceid=57 (bloomFilter=false), to=hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/data/hbase/meta/1588230740/.tmp/info/113e42066ae6479393cec08ad693016d 2023-02-15 20:01:17,719 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/data/hbase/namespace/9b913a56be4572b4f2949643b7fef2ba/.tmp/info/9f43c4f933794a85b5d60a64339d0cb3 2023-02-15 20:01:17,725 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-15 20:01:17,727 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 113e42066ae6479393cec08ad693016d 2023-02-15 20:01:17,728 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/data/hbase/namespace/9b913a56be4572b4f2949643b7fef2ba/.tmp/info/9f43c4f933794a85b5d60a64339d0cb3 as hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/data/hbase/namespace/9b913a56be4572b4f2949643b7fef2ba/info/9f43c4f933794a85b5d60a64339d0cb3 2023-02-15 20:01:17,732 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-15 20:01:17,735 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/data/hbase/namespace/9b913a56be4572b4f2949643b7fef2ba/info/9f43c4f933794a85b5d60a64339d0cb3, entries=2, sequenceid=6, filesize=4.8 K 2023-02-15 20:01:17,737 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 9b913a56be4572b4f2949643b7fef2ba in 61ms, sequenceid=6, compaction requested=false 2023-02-15 20:01:17,752 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=997 B at sequenceid=57 (bloomFilter=false), to=hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/data/hbase/meta/1588230740/.tmp/rep_barrier/50ac2976f3b64f768e7d102238861b1f 2023-02-15 20:01:17,753 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/data/hbase/namespace/9b913a56be4572b4f2949643b7fef2ba/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-02-15 20:01:17,754 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676491265356.9b913a56be4572b4f2949643b7fef2ba. 2023-02-15 20:01:17,754 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 9b913a56be4572b4f2949643b7fef2ba: 2023-02-15 20:01:17,755 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1676491265356.9b913a56be4572b4f2949643b7fef2ba. 2023-02-15 20:01:17,759 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 50ac2976f3b64f768e7d102238861b1f 2023-02-15 20:01:17,781 DEBUG [Listener at localhost/37547-EventThread] zookeeper.ZKWatcher(600): regionserver:33367-0x10059926a4e0002, quorum=127.0.0.1:53178, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,33367,1676491262239 2023-02-15 20:01:17,781 DEBUG [Listener at localhost/37547-EventThread] zookeeper.ZKWatcher(600): regionserver:33367-0x10059926a4e0002, quorum=127.0.0.1:53178, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-15 20:01:17,781 DEBUG [Listener at localhost/37547-EventThread] zookeeper.ZKWatcher(600): master:39607-0x10059926a4e0000, quorum=127.0.0.1:53178, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-15 20:01:17,781 DEBUG [Listener at localhost/37547-EventThread] zookeeper.ZKWatcher(600): regionserver:41535-0x10059926a4e0001, quorum=127.0.0.1:53178, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,33367,1676491262239 2023-02-15 20:01:17,781 DEBUG [Listener at localhost/37547-EventThread] zookeeper.ZKWatcher(600): regionserver:41535-0x10059926a4e0001, quorum=127.0.0.1:53178, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-15 20:01:17,782 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,33367,1676491262239] 2023-02-15 20:01:17,782 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,33367,1676491262239; numProcessing=1 2023-02-15 20:01:17,784 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.24 KB at sequenceid=57 (bloomFilter=false), to=hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/data/hbase/meta/1588230740/.tmp/table/085ff6d220294002aa274761b9c30a7a 2023-02-15 20:01:17,784 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,33367,1676491262239 already deleted, retry=false 2023-02-15 20:01:17,784 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,33367,1676491262239 expired; onlineServers=1 2023-02-15 20:01:17,790 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 085ff6d220294002aa274761b9c30a7a 2023-02-15 20:01:17,791 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/data/hbase/meta/1588230740/.tmp/info/113e42066ae6479393cec08ad693016d as hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/data/hbase/meta/1588230740/info/113e42066ae6479393cec08ad693016d 2023-02-15 20:01:17,801 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 113e42066ae6479393cec08ad693016d 2023-02-15 20:01:17,802 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/data/hbase/meta/1588230740/info/113e42066ae6479393cec08ad693016d, entries=30, sequenceid=57, filesize=7.9 K 2023-02-15 20:01:17,803 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/data/hbase/meta/1588230740/.tmp/rep_barrier/50ac2976f3b64f768e7d102238861b1f as hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/data/hbase/meta/1588230740/rep_barrier/50ac2976f3b64f768e7d102238861b1f 2023-02-15 20:01:17,808 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 50ac2976f3b64f768e7d102238861b1f 2023-02-15 20:01:17,809 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/data/hbase/meta/1588230740/rep_barrier/50ac2976f3b64f768e7d102238861b1f, entries=10, sequenceid=57, filesize=5.9 K 2023-02-15 20:01:17,809 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/data/hbase/meta/1588230740/.tmp/table/085ff6d220294002aa274761b9c30a7a as hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/data/hbase/meta/1588230740/table/085ff6d220294002aa274761b9c30a7a 2023-02-15 20:01:17,817 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 085ff6d220294002aa274761b9c30a7a 2023-02-15 20:01:17,818 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/data/hbase/meta/1588230740/table/085ff6d220294002aa274761b9c30a7a, entries=13, sequenceid=57, filesize=5.9 K 2023-02-15 20:01:17,819 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~24.29 KB/24876, heapSize ~40.16 KB/41120, currentSize=0 B/0 for 1588230740 in 142ms, sequenceid=57, compaction requested=false 2023-02-15 20:01:17,832 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/data/hbase/meta/1588230740/recovered.edits/60.seqid, newMaxSeqId=60, maxSeqId=1 2023-02-15 20:01:17,832 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-15 20:01:17,833 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-15 20:01:17,833 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 1588230740: 2023-02-15 20:01:17,833 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-02-15 20:01:17,880 INFO [RS:0;jenkins-hbase4:41535] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,41535,1676491262190; all regions closed. 2023-02-15 20:01:17,891 DEBUG [RS:0;jenkins-hbase4:41535] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/oldWALs 2023-02-15 20:01:17,891 INFO [RS:0;jenkins-hbase4:41535] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C41535%2C1676491262190.meta:.meta(num 1676491265051) 2023-02-15 20:01:17,897 DEBUG [RS:0;jenkins-hbase4:41535] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/oldWALs 2023-02-15 20:01:17,897 INFO [RS:0;jenkins-hbase4:41535] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C41535%2C1676491262190:(num 1676491265731) 2023-02-15 20:01:17,897 DEBUG [RS:0;jenkins-hbase4:41535] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-15 20:01:17,897 INFO [RS:0;jenkins-hbase4:41535] regionserver.LeaseManager(133): Closed leases 2023-02-15 20:01:17,897 INFO [RS:0;jenkins-hbase4:41535] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-02-15 20:01:17,898 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-15 20:01:17,898 INFO [RS:0;jenkins-hbase4:41535] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:41535 2023-02-15 20:01:17,902 DEBUG [Listener at localhost/37547-EventThread] zookeeper.ZKWatcher(600): master:39607-0x10059926a4e0000, quorum=127.0.0.1:53178, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-15 20:01:17,903 DEBUG [Listener at localhost/37547-EventThread] zookeeper.ZKWatcher(600): regionserver:41535-0x10059926a4e0001, quorum=127.0.0.1:53178, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,41535,1676491262190 2023-02-15 20:01:17,903 ERROR [Listener at localhost/37547-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@3666bbbe rejected from java.util.concurrent.ThreadPoolExecutor@325939aa[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-15 20:01:17,903 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,41535,1676491262190] 2023-02-15 20:01:17,903 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,41535,1676491262190; numProcessing=2 2023-02-15 20:01:17,905 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,41535,1676491262190 already deleted, retry=false 2023-02-15 20:01:17,906 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,41535,1676491262190 expired; onlineServers=0 2023-02-15 20:01:17,906 INFO [RegionServerTracker-0] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,39607,1676491260960' ***** 2023-02-15 20:01:17,906 INFO [RegionServerTracker-0] regionserver.HRegionServer(2310): STOPPED: Cluster shutdown set; onlineServer=0 2023-02-15 20:01:17,906 DEBUG [M:0;jenkins-hbase4:39607] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@51058d7a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-15 20:01:17,906 INFO [M:0;jenkins-hbase4:39607] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,39607,1676491260960 2023-02-15 20:01:17,906 INFO [M:0;jenkins-hbase4:39607] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,39607,1676491260960; all regions closed. 2023-02-15 20:01:17,906 DEBUG [M:0;jenkins-hbase4:39607] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-15 20:01:17,906 DEBUG [M:0;jenkins-hbase4:39607] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-02-15 20:01:17,907 DEBUG [M:0;jenkins-hbase4:39607] cleaner.HFileCleaner(317): Stopping file delete threads 2023-02-15 20:01:17,907 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676491263533] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676491263533,5,FailOnTimeoutGroup] 2023-02-15 20:01:17,908 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676491263536] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676491263536,5,FailOnTimeoutGroup] 2023-02-15 20:01:17,907 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-02-15 20:01:17,908 INFO [M:0;jenkins-hbase4:39607] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-02-15 20:01:17,909 INFO [M:0;jenkins-hbase4:39607] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-02-15 20:01:17,909 INFO [M:0;jenkins-hbase4:39607] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-02-15 20:01:17,909 DEBUG [M:0;jenkins-hbase4:39607] master.HMaster(1512): Stopping service threads 2023-02-15 20:01:17,909 INFO [M:0;jenkins-hbase4:39607] procedure2.RemoteProcedureDispatcher(118): Stopping procedure remote dispatcher 2023-02-15 20:01:17,910 ERROR [M:0;jenkins-hbase4:39607] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] Thread[HFileArchiver-1,5,PEWorkerGroup] Thread[HFileArchiver-2,5,PEWorkerGroup] Thread[HFileArchiver-3,5,PEWorkerGroup] Thread[HFileArchiver-4,5,PEWorkerGroup] Thread[HFileArchiver-5,5,PEWorkerGroup] Thread[HFileArchiver-6,5,PEWorkerGroup] Thread[HFileArchiver-7,5,PEWorkerGroup] Thread[HFileArchiver-8,5,PEWorkerGroup] 2023-02-15 20:01:17,910 DEBUG [Listener at localhost/37547-EventThread] zookeeper.ZKWatcher(600): master:39607-0x10059926a4e0000, quorum=127.0.0.1:53178, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-02-15 20:01:17,910 DEBUG [Listener at localhost/37547-EventThread] zookeeper.ZKWatcher(600): master:39607-0x10059926a4e0000, quorum=127.0.0.1:53178, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-15 20:01:17,910 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:39607-0x10059926a4e0000, quorum=127.0.0.1:53178, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-15 20:01:17,910 INFO [M:0;jenkins-hbase4:39607] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-02-15 20:01:17,911 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-02-15 20:01:17,911 DEBUG [M:0;jenkins-hbase4:39607] zookeeper.ZKUtil(398): master:39607-0x10059926a4e0000, quorum=127.0.0.1:53178, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-02-15 20:01:17,911 WARN [M:0;jenkins-hbase4:39607] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-02-15 20:01:17,911 INFO [M:0;jenkins-hbase4:39607] assignment.AssignmentManager(315): Stopping assignment manager 2023-02-15 20:01:17,912 INFO [M:0;jenkins-hbase4:39607] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-02-15 20:01:17,912 DEBUG [M:0;jenkins-hbase4:39607] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-15 20:01:17,913 INFO [M:0;jenkins-hbase4:39607] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-15 20:01:17,913 DEBUG [M:0;jenkins-hbase4:39607] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-15 20:01:17,913 DEBUG [M:0;jenkins-hbase4:39607] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-15 20:01:17,913 DEBUG [M:0;jenkins-hbase4:39607] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-15 20:01:17,913 INFO [M:0;jenkins-hbase4:39607] regionserver.HRegion(2744): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=159.23 KB heapSize=192.16 KB 2023-02-15 20:01:17,959 INFO [M:0;jenkins-hbase4:39607] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=159.23 KB at sequenceid=357 (bloomFilter=true), to=hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/7da21064166146b1a2056d39939c77cc 2023-02-15 20:01:17,965 DEBUG [M:0;jenkins-hbase4:39607] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/7da21064166146b1a2056d39939c77cc as hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/7da21064166146b1a2056d39939c77cc 2023-02-15 20:01:17,974 INFO [M:0;jenkins-hbase4:39607] regionserver.HStore(1080): Added hdfs://localhost:38891/user/jenkins/test-data/6d5e3c23-25b3-53e4-1734-4bcf471f129a/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/7da21064166146b1a2056d39939c77cc, entries=53, sequenceid=357, filesize=10.4 K 2023-02-15 20:01:17,975 INFO [M:0;jenkins-hbase4:39607] regionserver.HRegion(2947): Finished flush of dataSize ~159.23 KB/163052, heapSize ~192.14 KB/196752, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 62ms, sequenceid=357, compaction requested=false 2023-02-15 20:01:17,976 INFO [M:0;jenkins-hbase4:39607] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-15 20:01:17,977 DEBUG [M:0;jenkins-hbase4:39607] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-15 20:01:17,979 DEBUG [Listener at localhost/37547-EventThread] zookeeper.ZKWatcher(600): regionserver:33367-0x10059926a4e0002, quorum=127.0.0.1:53178, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-15 20:01:17,979 INFO [RS:1;jenkins-hbase4:33367] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,33367,1676491262239; zookeeper connection closed. 2023-02-15 20:01:17,979 ERROR [Listener at localhost/37547-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@5b103025 rejected from java.util.concurrent.ThreadPoolExecutor@5f2faf9f[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-15 20:01:17,979 DEBUG [Listener at localhost/37547-EventThread] zookeeper.ZKWatcher(600): regionserver:33367-0x10059926a4e0002, quorum=127.0.0.1:53178, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-15 20:01:17,979 ERROR [Listener at localhost/37547-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@71366508 rejected from java.util.concurrent.ThreadPoolExecutor@5f2faf9f[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-15 20:01:17,980 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@5a79d289] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@5a79d289 2023-02-15 20:01:17,985 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-15 20:01:17,985 INFO [M:0;jenkins-hbase4:39607] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-02-15 20:01:17,986 INFO [M:0;jenkins-hbase4:39607] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:39607 2023-02-15 20:01:17,993 DEBUG [M:0;jenkins-hbase4:39607] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,39607,1676491260960 already deleted, retry=false 2023-02-15 20:01:18,180 DEBUG [Listener at localhost/37547-EventThread] zookeeper.ZKWatcher(600): master:39607-0x10059926a4e0000, quorum=127.0.0.1:53178, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-15 20:01:18,180 INFO [M:0;jenkins-hbase4:39607] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,39607,1676491260960; zookeeper connection closed. 2023-02-15 20:01:18,180 ERROR [Listener at localhost/37547-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@1ff3fcb9 rejected from java.util.concurrent.ThreadPoolExecutor@59acb788[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 55] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-15 20:01:18,180 DEBUG [Listener at localhost/37547-EventThread] zookeeper.ZKWatcher(600): master:39607-0x10059926a4e0000, quorum=127.0.0.1:53178, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-15 20:01:18,180 ERROR [Listener at localhost/37547-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@7e120949 rejected from java.util.concurrent.ThreadPoolExecutor@59acb788[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 55] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-15 20:01:18,280 INFO [RS:0;jenkins-hbase4:41535] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,41535,1676491262190; zookeeper connection closed. 2023-02-15 20:01:18,280 DEBUG [Listener at localhost/37547-EventThread] zookeeper.ZKWatcher(600): regionserver:41535-0x10059926a4e0001, quorum=127.0.0.1:53178, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-15 20:01:18,280 ERROR [Listener at localhost/37547-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@45de0a36 rejected from java.util.concurrent.ThreadPoolExecutor@325939aa[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-15 20:01:18,280 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@5fc50719] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@5fc50719 2023-02-15 20:01:18,280 DEBUG [Listener at localhost/37547-EventThread] zookeeper.ZKWatcher(600): regionserver:41535-0x10059926a4e0001, quorum=127.0.0.1:53178, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-15 20:01:18,281 ERROR [Listener at localhost/37547-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@3d090777 rejected from java.util.concurrent.ThreadPoolExecutor@325939aa[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-15 20:01:18,281 INFO [Listener at localhost/37547] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 2 regionserver(s) complete 2023-02-15 20:01:18,282 WARN [Listener at localhost/37547] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-15 20:01:18,286 INFO [Listener at localhost/37547] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-15 20:01:18,391 WARN [BP-2144461072-172.31.14.131-1676491257310 heartbeating to localhost/127.0.0.1:38891] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-15 20:01:18,391 WARN [BP-2144461072-172.31.14.131-1676491257310 heartbeating to localhost/127.0.0.1:38891] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-2144461072-172.31.14.131-1676491257310 (Datanode Uuid e766ea96-9293-4c5b-a1b4-102611d32a93) service to localhost/127.0.0.1:38891 2023-02-15 20:01:18,394 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b60948e8-4ebf-4913-96a4-e7519f684365/cluster_666e4da7-14ca-5a78-fdde-1e1c92e12186/dfs/data/data3/current/BP-2144461072-172.31.14.131-1676491257310] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-15 20:01:18,394 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b60948e8-4ebf-4913-96a4-e7519f684365/cluster_666e4da7-14ca-5a78-fdde-1e1c92e12186/dfs/data/data4/current/BP-2144461072-172.31.14.131-1676491257310] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-15 20:01:18,397 WARN [Listener at localhost/37547] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-15 20:01:18,399 INFO [Listener at localhost/37547] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-15 20:01:18,502 WARN [BP-2144461072-172.31.14.131-1676491257310 heartbeating to localhost/127.0.0.1:38891] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-15 20:01:18,503 WARN [BP-2144461072-172.31.14.131-1676491257310 heartbeating to localhost/127.0.0.1:38891] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-2144461072-172.31.14.131-1676491257310 (Datanode Uuid 55ff6abd-4fd9-4214-96e2-32c1657b154f) service to localhost/127.0.0.1:38891 2023-02-15 20:01:18,503 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b60948e8-4ebf-4913-96a4-e7519f684365/cluster_666e4da7-14ca-5a78-fdde-1e1c92e12186/dfs/data/data1/current/BP-2144461072-172.31.14.131-1676491257310] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-15 20:01:18,503 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b60948e8-4ebf-4913-96a4-e7519f684365/cluster_666e4da7-14ca-5a78-fdde-1e1c92e12186/dfs/data/data2/current/BP-2144461072-172.31.14.131-1676491257310] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-15 20:01:18,545 INFO [Listener at localhost/37547] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-15 20:01:18,669 INFO [Listener at localhost/37547] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-02-15 20:01:18,746 INFO [Listener at localhost/37547] hbase.HBaseTestingUtility(1293): Minicluster is down 2023-02-15 20:01:18,762 INFO [Listener at localhost/37547] hbase.ResourceChecker(175): after: mapred.TestTableSnapshotInputFormat#testWithMapReduceMultiRegion Thread=103 (was 7) Potentially hanging thread: IPC Client (1185813668) connection to localhost/127.0.0.1:38891 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: IPC Parameter Sending Thread #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: process reaper sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1185813668) connection to localhost/127.0.0.1:38891 from jenkins.hfs.0 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: LeaseRenewer:jenkins@localhost:38891 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-3-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: master/jenkins-hbase4:0:becomeActiveMaster-MemStoreChunkPool Statistics sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: region-location-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-3 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: process reaper sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.1@localhost:38891 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-3-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ForkJoinPool-2-worker-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.ForkJoinPool.awaitWork(ForkJoinPool.java:1824) java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1693) java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175) Potentially hanging thread: HFileArchiver-6 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: region-location-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: master/jenkins-hbase4:0:becomeActiveMaster-MemStoreChunkPool Statistics sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ForkJoinPool-2-worker-5 sun.misc.Unsafe.park(Native Method) java.util.concurrent.ForkJoinPool.awaitWork(ForkJoinPool.java:1824) java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1693) java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175) Potentially hanging thread: SnapshotHandlerChoreCleaner sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/37547 java.lang.Thread.dumpThreads(Native Method) java.lang.Thread.getAllStackTraces(Thread.java:1615) org.apache.hadoop.hbase.ResourceCheckerJUnitListener$ThreadResourceAnalyzer.getVal(ResourceCheckerJUnitListener.java:49) org.apache.hadoop.hbase.ResourceChecker.fill(ResourceChecker.java:110) org.apache.hadoop.hbase.ResourceChecker.fillEndings(ResourceChecker.java:104) org.apache.hadoop.hbase.ResourceChecker.end(ResourceChecker.java:206) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.end(ResourceCheckerJUnitListener.java:165) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.testFinished(ResourceCheckerJUnitListener.java:185) org.junit.runner.notification.SynchronizedRunListener.testFinished(SynchronizedRunListener.java:87) org.junit.runner.notification.RunNotifier$9.notifyListener(RunNotifier.java:225) org.junit.runner.notification.RunNotifier$SafeNotifier.run(RunNotifier.java:72) org.junit.runner.notification.RunNotifier.fireTestFinished(RunNotifier.java:222) org.junit.internal.runners.model.EachTestNotifier.fireTestFinished(EachTestNotifier.java:38) org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:372) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) org.apache.hadoop.hbase.SystemExitRule$1.evaluate(SystemExitRule.java:39) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Parameter Sending Thread #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-4-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: org.apache.hadoop.fs.FileSystem$Statistics$StatisticsDataReferenceCleaner java.lang.Object.wait(Native Method) java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:144) java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:165) org.apache.hadoop.fs.FileSystem$Statistics$StatisticsDataReferenceCleaner.run(FileSystem.java:3693) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Monitor thread for TaskMonitor java.lang.Thread.sleep(Native Method) org.apache.hadoop.hbase.monitoring.TaskMonitor$MonitorRunnable.run(TaskMonitor.java:327) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase4.apache.org,39607,1676491260960)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-4-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: org.apache.hadoop.hdfs.PeerCache@2cb90906 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.PeerCache.run(PeerCache.java:253) org.apache.hadoop.hdfs.PeerCache.access$000(PeerCache.java:46) org.apache.hadoop.hdfs.PeerCache$1.run(PeerCache.java:124) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.0@localhost:38891 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HBase-Metrics2-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ForkJoinPool-2-worker-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.ForkJoinPool.awaitWork(ForkJoinPool.java:1824) java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1693) java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: IPC Client (1185813668) connection to localhost/127.0.0.1:38891 from jenkins.hfs.1 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: HFileArchiver-5 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-1 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-2-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-2 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Parameter Sending Thread #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: HFileArchiver-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-5-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-4-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-1-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-1-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-5-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: regionserver/jenkins-hbase4:0.procedureResultReporter sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.hadoop.hbase.regionserver.RemoteProcedureResultReporter.run(RemoteProcedureResultReporter.java:77) Potentially hanging thread: nioEventLoopGroup-2-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-3-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-4-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RpcClient-timer-pool-0 java.lang.Thread.sleep(Native Method) org.apache.hbase.thirdparty.io.netty.util.HashedWheelTimer$Worker.waitForNextTick(HashedWheelTimer.java:600) org.apache.hbase.thirdparty.io.netty.util.HashedWheelTimer$Worker.run(HashedWheelTimer.java:496) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ForkJoinPool-2-worker-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.ForkJoinPool.awaitWork(ForkJoinPool.java:1824) java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1693) java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: nioEventLoopGroup-2-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: regionserver/jenkins-hbase4:0.procedureResultReporter sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.hadoop.hbase.regionserver.RemoteProcedureResultReporter.run(RemoteProcedureResultReporter.java:77) Potentially hanging thread: RS-EventLoopGroup-1-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Timer for 'HBase' metrics system java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: nioEventLoopGroup-3-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: process reaper sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-4-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-3-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: SessionTracker java.lang.Thread.sleep(Native Method) org.apache.zookeeper.server.SessionTrackerImpl.run(SessionTrackerImpl.java:151) Potentially hanging thread: nioEventLoopGroup-5-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Idle-Rpc-Conn-Sweeper-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: process reaper sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1185813668) connection to localhost/127.0.0.1:38891 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-3-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-4-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=521 (was 240) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=282 (was 173) - SystemLoadAverage LEAK? -, ProcessCount=165 (was 165), AvailableMemoryMB=3104 (was 4105) 2023-02-15 20:01:18,771 INFO [Listener at localhost/37547] hbase.ResourceChecker(147): before: mapred.TestTableSnapshotInputFormat#testWithMapReduceAndOfflineHBaseMultiRegion Thread=103, OpenFileDescriptor=521, MaxFileDescriptor=60000, SystemLoadAverage=282, ProcessCount=165, AvailableMemoryMB=3103 2023-02-15 20:01:18,783 INFO [Listener at localhost/37547] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.log.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b60948e8-4ebf-4913-96a4-e7519f684365/hadoop.log.dir so I do NOT create it in target/test-data/c11e5f15-9142-b55b-08be-b6cf0858e875 2023-02-15 20:01:18,783 WARN [Listener at localhost/37547] hbase.HBaseTestingUtility(449): hadoop.log.dir property value differs in configuration and system: Configuration=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/../logs while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b60948e8-4ebf-4913-96a4-e7519f684365/hadoop.log.dir Erasing configuration value by system value. 2023-02-15 20:01:18,783 INFO [Listener at localhost/37547] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.tmp.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b60948e8-4ebf-4913-96a4-e7519f684365/hadoop.tmp.dir so I do NOT create it in target/test-data/c11e5f15-9142-b55b-08be-b6cf0858e875 2023-02-15 20:01:18,783 WARN [Listener at localhost/37547] hbase.HBaseTestingUtility(449): hadoop.tmp.dir property value differs in configuration and system: Configuration=/tmp/hadoop-jenkins while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b60948e8-4ebf-4913-96a4-e7519f684365/hadoop.tmp.dir Erasing configuration value by system value. 2023-02-15 20:01:18,783 DEBUG [Listener at localhost/37547] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c11e5f15-9142-b55b-08be-b6cf0858e875 2023-02-15 20:01:18,783 INFO [Listener at localhost/37547] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=2, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=true, createWALDir=false} 2023-02-15 20:01:18,783 INFO [Listener at localhost/37547] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c11e5f15-9142-b55b-08be-b6cf0858e875/cluster_af7ba18b-1f1a-67fc-11a2-24e3883bc033, deleteOnExit=true 2023-02-15 20:01:18,784 INFO [Listener at localhost/37547] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-02-15 20:01:18,784 INFO [Listener at localhost/37547] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c11e5f15-9142-b55b-08be-b6cf0858e875/test.cache.data in system properties and HBase conf 2023-02-15 20:01:18,784 INFO [Listener at localhost/37547] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c11e5f15-9142-b55b-08be-b6cf0858e875/hadoop.tmp.dir in system properties and HBase conf 2023-02-15 20:01:18,784 INFO [Listener at localhost/37547] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c11e5f15-9142-b55b-08be-b6cf0858e875/hadoop.log.dir in system properties and HBase conf 2023-02-15 20:01:18,784 INFO [Listener at localhost/37547] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c11e5f15-9142-b55b-08be-b6cf0858e875/mapreduce.cluster.local.dir in system properties and HBase conf 2023-02-15 20:01:18,785 INFO [Listener at localhost/37547] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c11e5f15-9142-b55b-08be-b6cf0858e875/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-02-15 20:01:18,785 INFO [Listener at localhost/37547] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-02-15 20:01:18,785 DEBUG [Listener at localhost/37547] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-02-15 20:01:18,785 INFO [Listener at localhost/37547] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c11e5f15-9142-b55b-08be-b6cf0858e875/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-02-15 20:01:18,785 INFO [Listener at localhost/37547] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c11e5f15-9142-b55b-08be-b6cf0858e875/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-02-15 20:01:18,785 INFO [Listener at localhost/37547] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c11e5f15-9142-b55b-08be-b6cf0858e875/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-02-15 20:01:18,785 INFO [Listener at localhost/37547] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c11e5f15-9142-b55b-08be-b6cf0858e875/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-15 20:01:18,786 INFO [Listener at localhost/37547] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c11e5f15-9142-b55b-08be-b6cf0858e875/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-02-15 20:01:18,786 INFO [Listener at localhost/37547] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c11e5f15-9142-b55b-08be-b6cf0858e875/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-02-15 20:01:18,786 INFO [Listener at localhost/37547] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c11e5f15-9142-b55b-08be-b6cf0858e875/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-15 20:01:18,786 INFO [Listener at localhost/37547] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c11e5f15-9142-b55b-08be-b6cf0858e875/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-15 20:01:18,786 INFO [Listener at localhost/37547] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c11e5f15-9142-b55b-08be-b6cf0858e875/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-02-15 20:01:18,786 INFO [Listener at localhost/37547] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c11e5f15-9142-b55b-08be-b6cf0858e875/nfs.dump.dir in system properties and HBase conf 2023-02-15 20:01:18,786 INFO [Listener at localhost/37547] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c11e5f15-9142-b55b-08be-b6cf0858e875/java.io.tmpdir in system properties and HBase conf 2023-02-15 20:01:18,786 INFO [Listener at localhost/37547] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c11e5f15-9142-b55b-08be-b6cf0858e875/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-15 20:01:18,786 INFO [Listener at localhost/37547] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c11e5f15-9142-b55b-08be-b6cf0858e875/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-02-15 20:01:18,786 INFO [Listener at localhost/37547] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c11e5f15-9142-b55b-08be-b6cf0858e875/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-02-15 20:01:18,791 WARN [Listener at localhost/37547] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-15 20:01:18,791 WARN [Listener at localhost/37547] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-15 20:01:18,838 WARN [Listener at localhost/37547] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-15 20:01:18,841 INFO [Listener at localhost/37547] log.Slf4jLog(67): jetty-6.1.26 2023-02-15 20:01:18,850 INFO [Listener at localhost/37547] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c11e5f15-9142-b55b-08be-b6cf0858e875/java.io.tmpdir/Jetty_localhost_42161_hdfs____.uaawh4/webapp 2023-02-15 20:01:18,968 INFO [Listener at localhost/37547] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:42161 2023-02-15 20:01:19,021 WARN [Listener at localhost/37547] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-15 20:01:19,021 WARN [Listener at localhost/37547] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-15 20:01:19,067 WARN [Listener at localhost/40371] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-15 20:01:19,080 WARN [Listener at localhost/40371] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-15 20:01:19,084 WARN [Listener at localhost/40371] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-15 20:01:19,085 INFO [Listener at localhost/40371] log.Slf4jLog(67): jetty-6.1.26 2023-02-15 20:01:19,091 INFO [Listener at localhost/40371] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c11e5f15-9142-b55b-08be-b6cf0858e875/java.io.tmpdir/Jetty_localhost_39131_datanode____.j7bzow/webapp 2023-02-15 20:01:19,184 INFO [Listener at localhost/40371] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:39131 2023-02-15 20:01:19,192 WARN [Listener at localhost/35261] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-15 20:01:19,214 WARN [Listener at localhost/35261] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-15 20:01:19,216 WARN [Listener at localhost/35261] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-15 20:01:19,217 INFO [Listener at localhost/35261] log.Slf4jLog(67): jetty-6.1.26 2023-02-15 20:01:19,222 INFO [Listener at localhost/35261] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c11e5f15-9142-b55b-08be-b6cf0858e875/java.io.tmpdir/Jetty_localhost_36603_datanode____43q4pp/webapp 2023-02-15 20:01:19,306 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xdf6f0f8721e27815: Processing first storage report for DS-2a1bb52d-eea7-4f57-be3b-12915a60c66e from datanode e159f7e7-7822-49e7-9fe5-5ca02092df2f 2023-02-15 20:01:19,307 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xdf6f0f8721e27815: from storage DS-2a1bb52d-eea7-4f57-be3b-12915a60c66e node DatanodeRegistration(127.0.0.1:41913, datanodeUuid=e159f7e7-7822-49e7-9fe5-5ca02092df2f, infoPort=40069, infoSecurePort=0, ipcPort=35261, storageInfo=lv=-57;cid=testClusterID;nsid=1913544296;c=1676491278794), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-15 20:01:19,307 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xdf6f0f8721e27815: Processing first storage report for DS-4536b552-777f-497e-9309-7335bf12a634 from datanode e159f7e7-7822-49e7-9fe5-5ca02092df2f 2023-02-15 20:01:19,307 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xdf6f0f8721e27815: from storage DS-4536b552-777f-497e-9309-7335bf12a634 node DatanodeRegistration(127.0.0.1:41913, datanodeUuid=e159f7e7-7822-49e7-9fe5-5ca02092df2f, infoPort=40069, infoSecurePort=0, ipcPort=35261, storageInfo=lv=-57;cid=testClusterID;nsid=1913544296;c=1676491278794), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-15 20:01:19,331 INFO [Listener at localhost/35261] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:36603 2023-02-15 20:01:19,344 WARN [Listener at localhost/43949] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-15 20:01:19,460 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x15fb0d371575ccbc: Processing first storage report for DS-e0a3376d-ff3e-4e9b-adbf-92dcfa37f723 from datanode b71f6f7e-297c-4cd3-a987-a7ffa677dd37 2023-02-15 20:01:19,460 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x15fb0d371575ccbc: from storage DS-e0a3376d-ff3e-4e9b-adbf-92dcfa37f723 node DatanodeRegistration(127.0.0.1:35923, datanodeUuid=b71f6f7e-297c-4cd3-a987-a7ffa677dd37, infoPort=36237, infoSecurePort=0, ipcPort=43949, storageInfo=lv=-57;cid=testClusterID;nsid=1913544296;c=1676491278794), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-15 20:01:19,460 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x15fb0d371575ccbc: Processing first storage report for DS-722df6f9-da98-4411-8327-4627c9d622c7 from datanode b71f6f7e-297c-4cd3-a987-a7ffa677dd37 2023-02-15 20:01:19,460 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x15fb0d371575ccbc: from storage DS-722df6f9-da98-4411-8327-4627c9d622c7 node DatanodeRegistration(127.0.0.1:35923, datanodeUuid=b71f6f7e-297c-4cd3-a987-a7ffa677dd37, infoPort=36237, infoSecurePort=0, ipcPort=43949, storageInfo=lv=-57;cid=testClusterID;nsid=1913544296;c=1676491278794), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-15 20:01:19,557 DEBUG [Listener at localhost/43949] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c11e5f15-9142-b55b-08be-b6cf0858e875 2023-02-15 20:01:19,562 INFO [Listener at localhost/43949] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c11e5f15-9142-b55b-08be-b6cf0858e875/cluster_af7ba18b-1f1a-67fc-11a2-24e3883bc033/zookeeper_0, clientPort=57384, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c11e5f15-9142-b55b-08be-b6cf0858e875/cluster_af7ba18b-1f1a-67fc-11a2-24e3883bc033/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c11e5f15-9142-b55b-08be-b6cf0858e875/cluster_af7ba18b-1f1a-67fc-11a2-24e3883bc033/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-02-15 20:01:19,564 INFO [Listener at localhost/43949] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=57384 2023-02-15 20:01:19,564 INFO [Listener at localhost/43949] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-15 20:01:19,566 INFO [Listener at localhost/43949] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-15 20:01:19,582 INFO [Listener at localhost/43949] util.FSUtils(479): Created version file at hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da with version=8 2023-02-15 20:01:19,582 INFO [Listener at localhost/43949] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-15 20:01:19,584 INFO [Listener at localhost/43949] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-15 20:01:19,585 INFO [Listener at localhost/43949] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:40371/user/jenkins/test-data/743659ce-8263-b073-8e60-8033ef08dd2c/hbase-staging 2023-02-15 20:01:19,587 INFO [Listener at localhost/43949] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-02-15 20:01:19,587 INFO [Listener at localhost/43949] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-15 20:01:19,588 INFO [Listener at localhost/43949] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-15 20:01:19,588 INFO [Listener at localhost/43949] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-15 20:01:19,588 INFO [Listener at localhost/43949] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-15 20:01:19,588 INFO [Listener at localhost/43949] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-15 20:01:19,588 INFO [Listener at localhost/43949] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-02-15 20:01:19,590 INFO [Listener at localhost/43949] ipc.NettyRpcServer(120): Bind to /172.31.14.131:36865 2023-02-15 20:01:19,590 INFO [Listener at localhost/43949] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-15 20:01:19,592 INFO [Listener at localhost/43949] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-15 20:01:19,593 INFO [Listener at localhost/43949] zookeeper.RecoverableZooKeeper(93): Process identifier=master:36865 connecting to ZooKeeper ensemble=127.0.0.1:57384 2023-02-15 20:01:19,605 DEBUG [Listener at localhost/43949-EventThread] zookeeper.ZKWatcher(600): master:368650x0, quorum=127.0.0.1:57384, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-15 20:01:19,606 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): master:36865-0x1005992b68c0000 connected 2023-02-15 20:01:19,626 DEBUG [Listener at localhost/43949] zookeeper.ZKUtil(164): master:36865-0x1005992b68c0000, quorum=127.0.0.1:57384, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-15 20:01:19,627 DEBUG [Listener at localhost/43949] zookeeper.ZKUtil(164): master:36865-0x1005992b68c0000, quorum=127.0.0.1:57384, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-15 20:01:19,627 DEBUG [Listener at localhost/43949] zookeeper.ZKUtil(164): master:36865-0x1005992b68c0000, quorum=127.0.0.1:57384, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-15 20:01:19,629 DEBUG [Listener at localhost/43949] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=36865 2023-02-15 20:01:19,630 DEBUG [Listener at localhost/43949] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=36865 2023-02-15 20:01:19,630 DEBUG [Listener at localhost/43949] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=36865 2023-02-15 20:01:19,635 DEBUG [Listener at localhost/43949] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=36865 2023-02-15 20:01:19,635 DEBUG [Listener at localhost/43949] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=36865 2023-02-15 20:01:19,635 INFO [Listener at localhost/43949] master.HMaster(444): hbase.rootdir=hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da, hbase.cluster.distributed=false 2023-02-15 20:01:19,656 INFO [Listener at localhost/43949] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-15 20:01:19,656 INFO [Listener at localhost/43949] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-15 20:01:19,656 INFO [Listener at localhost/43949] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-15 20:01:19,657 INFO [Listener at localhost/43949] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-15 20:01:19,657 INFO [Listener at localhost/43949] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-15 20:01:19,657 INFO [Listener at localhost/43949] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-15 20:01:19,657 INFO [Listener at localhost/43949] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-15 20:01:19,660 INFO [Listener at localhost/43949] ipc.NettyRpcServer(120): Bind to /172.31.14.131:33019 2023-02-15 20:01:19,660 INFO [Listener at localhost/43949] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-15 20:01:19,661 DEBUG [Listener at localhost/43949] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-15 20:01:19,662 INFO [Listener at localhost/43949] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-15 20:01:19,663 INFO [Listener at localhost/43949] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-15 20:01:19,663 INFO [Listener at localhost/43949] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:33019 connecting to ZooKeeper ensemble=127.0.0.1:57384 2023-02-15 20:01:19,667 DEBUG [Listener at localhost/43949-EventThread] zookeeper.ZKWatcher(600): regionserver:330190x0, quorum=127.0.0.1:57384, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-15 20:01:19,668 DEBUG [Listener at localhost/43949] zookeeper.ZKUtil(164): regionserver:330190x0, quorum=127.0.0.1:57384, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-15 20:01:19,668 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:33019-0x1005992b68c0001 connected 2023-02-15 20:01:19,669 DEBUG [Listener at localhost/43949] zookeeper.ZKUtil(164): regionserver:33019-0x1005992b68c0001, quorum=127.0.0.1:57384, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-15 20:01:19,669 DEBUG [Listener at localhost/43949] zookeeper.ZKUtil(164): regionserver:33019-0x1005992b68c0001, quorum=127.0.0.1:57384, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-15 20:01:19,679 DEBUG [Listener at localhost/43949] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=33019 2023-02-15 20:01:19,679 DEBUG [Listener at localhost/43949] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=33019 2023-02-15 20:01:19,679 DEBUG [Listener at localhost/43949] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=33019 2023-02-15 20:01:19,680 DEBUG [Listener at localhost/43949] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=33019 2023-02-15 20:01:19,680 DEBUG [Listener at localhost/43949] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=33019 2023-02-15 20:01:19,696 INFO [Listener at localhost/43949] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-15 20:01:19,696 INFO [Listener at localhost/43949] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-15 20:01:19,696 INFO [Listener at localhost/43949] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-15 20:01:19,696 INFO [Listener at localhost/43949] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-15 20:01:19,696 INFO [Listener at localhost/43949] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-15 20:01:19,696 INFO [Listener at localhost/43949] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-15 20:01:19,697 INFO [Listener at localhost/43949] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-15 20:01:19,717 INFO [Listener at localhost/43949] ipc.NettyRpcServer(120): Bind to /172.31.14.131:33125 2023-02-15 20:01:19,718 INFO [Listener at localhost/43949] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-15 20:01:19,761 DEBUG [Listener at localhost/43949] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-15 20:01:19,762 INFO [Listener at localhost/43949] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-15 20:01:19,763 INFO [Listener at localhost/43949] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-15 20:01:19,765 INFO [Listener at localhost/43949] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:33125 connecting to ZooKeeper ensemble=127.0.0.1:57384 2023-02-15 20:01:19,790 DEBUG [Listener at localhost/43949-EventThread] zookeeper.ZKWatcher(600): regionserver:331250x0, quorum=127.0.0.1:57384, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-15 20:01:19,791 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:33125-0x1005992b68c0002 connected 2023-02-15 20:01:19,791 DEBUG [Listener at localhost/43949] zookeeper.ZKUtil(164): regionserver:33125-0x1005992b68c0002, quorum=127.0.0.1:57384, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-15 20:01:19,792 DEBUG [Listener at localhost/43949] zookeeper.ZKUtil(164): regionserver:33125-0x1005992b68c0002, quorum=127.0.0.1:57384, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-15 20:01:19,792 DEBUG [Listener at localhost/43949] zookeeper.ZKUtil(164): regionserver:33125-0x1005992b68c0002, quorum=127.0.0.1:57384, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-15 20:01:19,797 DEBUG [Listener at localhost/43949] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=33125 2023-02-15 20:01:19,797 DEBUG [Listener at localhost/43949] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=33125 2023-02-15 20:01:19,798 DEBUG [Listener at localhost/43949] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=33125 2023-02-15 20:01:19,800 DEBUG [Listener at localhost/43949] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=33125 2023-02-15 20:01:19,800 DEBUG [Listener at localhost/43949] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=33125 2023-02-15 20:01:19,801 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,36865,1676491279587 2023-02-15 20:01:19,804 DEBUG [Listener at localhost/43949-EventThread] zookeeper.ZKWatcher(600): master:36865-0x1005992b68c0000, quorum=127.0.0.1:57384, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-15 20:01:19,804 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:36865-0x1005992b68c0000, quorum=127.0.0.1:57384, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,36865,1676491279587 2023-02-15 20:01:19,806 DEBUG [Listener at localhost/43949-EventThread] zookeeper.ZKWatcher(600): regionserver:33019-0x1005992b68c0001, quorum=127.0.0.1:57384, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-15 20:01:19,806 DEBUG [Listener at localhost/43949-EventThread] zookeeper.ZKWatcher(600): regionserver:33125-0x1005992b68c0002, quorum=127.0.0.1:57384, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-15 20:01:19,806 DEBUG [Listener at localhost/43949-EventThread] zookeeper.ZKWatcher(600): master:36865-0x1005992b68c0000, quorum=127.0.0.1:57384, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-15 20:01:19,807 DEBUG [Listener at localhost/43949-EventThread] zookeeper.ZKWatcher(600): master:36865-0x1005992b68c0000, quorum=127.0.0.1:57384, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-15 20:01:19,808 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:36865-0x1005992b68c0000, quorum=127.0.0.1:57384, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-15 20:01:19,809 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:36865-0x1005992b68c0000, quorum=127.0.0.1:57384, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-15 20:01:19,809 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,36865,1676491279587 from backup master directory 2023-02-15 20:01:19,810 DEBUG [Listener at localhost/43949-EventThread] zookeeper.ZKWatcher(600): master:36865-0x1005992b68c0000, quorum=127.0.0.1:57384, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,36865,1676491279587 2023-02-15 20:01:19,810 DEBUG [Listener at localhost/43949-EventThread] zookeeper.ZKWatcher(600): master:36865-0x1005992b68c0000, quorum=127.0.0.1:57384, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-15 20:01:19,810 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-15 20:01:19,810 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase4.apache.org,36865,1676491279587 2023-02-15 20:01:19,831 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(628): Created cluster ID file at hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/hbase.id with ID: 0907bb0f-4dec-413b-b346-c4047a2a88ff 2023-02-15 20:01:19,842 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-15 20:01:19,845 DEBUG [Listener at localhost/43949-EventThread] zookeeper.ZKWatcher(600): master:36865-0x1005992b68c0000, quorum=127.0.0.1:57384, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-15 20:01:19,858 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x3ee8615e to 127.0.0.1:57384 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-15 20:01:19,863 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@67c0892a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-15 20:01:19,863 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-15 20:01:19,864 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-02-15 20:01:19,864 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-15 20:01:19,866 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7689): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/MasterData/data/master/store-tmp 2023-02-15 20:01:19,875 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 20:01:19,875 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-15 20:01:19,875 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-15 20:01:19,875 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-15 20:01:19,875 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-15 20:01:19,875 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-15 20:01:19,875 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-15 20:01:19,875 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-15 20:01:19,876 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/MasterData/WALs/jenkins-hbase4.apache.org,36865,1676491279587 2023-02-15 20:01:19,879 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C36865%2C1676491279587, suffix=, logDir=hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/MasterData/WALs/jenkins-hbase4.apache.org,36865,1676491279587, archiveDir=hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/MasterData/oldWALs, maxLogs=10 2023-02-15 20:01:19,897 DEBUG [RS-EventLoopGroup-8-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35923,DS-e0a3376d-ff3e-4e9b-adbf-92dcfa37f723,DISK] 2023-02-15 20:01:19,898 DEBUG [RS-EventLoopGroup-8-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41913,DS-2a1bb52d-eea7-4f57-be3b-12915a60c66e,DISK] 2023-02-15 20:01:19,904 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/MasterData/WALs/jenkins-hbase4.apache.org,36865,1676491279587/jenkins-hbase4.apache.org%2C36865%2C1676491279587.1676491279879 2023-02-15 20:01:19,904 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:35923,DS-e0a3376d-ff3e-4e9b-adbf-92dcfa37f723,DISK], DatanodeInfoWithStorage[127.0.0.1:41913,DS-2a1bb52d-eea7-4f57-be3b-12915a60c66e,DISK]] 2023-02-15 20:01:19,904 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7850): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-02-15 20:01:19,905 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 20:01:19,905 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7890): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-02-15 20:01:19,905 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7893): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-02-15 20:01:19,906 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-02-15 20:01:19,907 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-02-15 20:01:19,908 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-02-15 20:01:19,908 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 20:01:19,909 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-15 20:01:19,909 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-15 20:01:19,912 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1054): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-02-15 20:01:19,916 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-15 20:01:19,917 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1071): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63408564, jitterRate=-0.05513876676559448}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-15 20:01:19,917 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(964): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-15 20:01:19,917 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-02-15 20:01:19,918 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-02-15 20:01:19,919 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-02-15 20:01:19,919 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-02-15 20:01:19,919 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 0 msec 2023-02-15 20:01:19,920 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 0 msec 2023-02-15 20:01:19,920 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(95): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-02-15 20:01:19,921 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-02-15 20:01:19,922 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-02-15 20:01:19,935 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-02-15 20:01:19,935 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-02-15 20:01:19,936 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:36865-0x1005992b68c0000, quorum=127.0.0.1:57384, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-02-15 20:01:19,936 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-02-15 20:01:19,937 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:36865-0x1005992b68c0000, quorum=127.0.0.1:57384, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-02-15 20:01:19,938 DEBUG [Listener at localhost/43949-EventThread] zookeeper.ZKWatcher(600): master:36865-0x1005992b68c0000, quorum=127.0.0.1:57384, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-15 20:01:19,939 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:36865-0x1005992b68c0000, quorum=127.0.0.1:57384, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-02-15 20:01:19,939 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:36865-0x1005992b68c0000, quorum=127.0.0.1:57384, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-02-15 20:01:19,940 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:36865-0x1005992b68c0000, quorum=127.0.0.1:57384, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-02-15 20:01:19,941 DEBUG [Listener at localhost/43949-EventThread] zookeeper.ZKWatcher(600): regionserver:33125-0x1005992b68c0002, quorum=127.0.0.1:57384, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-15 20:01:19,942 DEBUG [Listener at localhost/43949-EventThread] zookeeper.ZKWatcher(600): master:36865-0x1005992b68c0000, quorum=127.0.0.1:57384, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-15 20:01:19,941 DEBUG [Listener at localhost/43949-EventThread] zookeeper.ZKWatcher(600): regionserver:33019-0x1005992b68c0001, quorum=127.0.0.1:57384, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-15 20:01:19,942 DEBUG [Listener at localhost/43949-EventThread] zookeeper.ZKWatcher(600): master:36865-0x1005992b68c0000, quorum=127.0.0.1:57384, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-15 20:01:19,942 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase4.apache.org,36865,1676491279587, sessionid=0x1005992b68c0000, setting cluster-up flag (Was=false) 2023-02-15 20:01:19,948 DEBUG [Listener at localhost/43949-EventThread] zookeeper.ZKWatcher(600): master:36865-0x1005992b68c0000, quorum=127.0.0.1:57384, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-15 20:01:19,953 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-02-15 20:01:19,954 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,36865,1676491279587 2023-02-15 20:01:19,957 DEBUG [Listener at localhost/43949-EventThread] zookeeper.ZKWatcher(600): master:36865-0x1005992b68c0000, quorum=127.0.0.1:57384, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-15 20:01:19,962 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-02-15 20:01:19,964 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,36865,1676491279587 2023-02-15 20:01:19,965 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/.hbase-snapshot/.tmp 2023-02-15 20:01:19,967 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-02-15 20:01:19,967 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-15 20:01:19,967 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-15 20:01:19,967 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-15 20:01:19,967 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-15 20:01:19,967 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-02-15 20:01:19,967 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 20:01:19,967 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-15 20:01:19,967 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 20:01:19,971 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1676491309971 2023-02-15 20:01:19,971 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-02-15 20:01:19,971 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-02-15 20:01:19,971 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-02-15 20:01:19,971 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-02-15 20:01:19,971 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-02-15 20:01:19,971 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-02-15 20:01:19,971 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-15 20:01:19,972 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-02-15 20:01:19,972 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-02-15 20:01:19,972 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-02-15 20:01:19,972 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-02-15 20:01:19,972 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-02-15 20:01:19,973 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-15 20:01:19,976 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-02-15 20:01:19,976 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-02-15 20:01:19,977 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676491279976,5,FailOnTimeoutGroup] 2023-02-15 20:01:19,977 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676491279977,5,FailOnTimeoutGroup] 2023-02-15 20:01:19,977 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-15 20:01:19,977 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-02-15 20:01:19,977 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-02-15 20:01:19,977 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-02-15 20:01:19,988 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-15 20:01:19,989 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-15 20:01:19,989 INFO [PEWorker-1] regionserver.HRegion(7671): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da 2023-02-15 20:01:20,000 DEBUG [PEWorker-1] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 20:01:20,005 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-15 20:01:20,006 INFO [RS:1;jenkins-hbase4:33125] regionserver.HRegionServer(952): ClusterId : 0907bb0f-4dec-413b-b346-c4047a2a88ff 2023-02-15 20:01:20,006 INFO [RS:0;jenkins-hbase4:33019] regionserver.HRegionServer(952): ClusterId : 0907bb0f-4dec-413b-b346-c4047a2a88ff 2023-02-15 20:01:20,006 DEBUG [RS:1;jenkins-hbase4:33125] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-15 20:01:20,006 DEBUG [RS:0;jenkins-hbase4:33019] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-15 20:01:20,006 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/data/hbase/meta/1588230740/info 2023-02-15 20:01:20,007 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-15 20:01:20,007 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 20:01:20,007 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-15 20:01:20,008 DEBUG [RS:1;jenkins-hbase4:33125] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-15 20:01:20,008 DEBUG [RS:1;jenkins-hbase4:33125] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-15 20:01:20,008 DEBUG [RS:0;jenkins-hbase4:33019] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-15 20:01:20,008 DEBUG [RS:0;jenkins-hbase4:33019] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-15 20:01:20,009 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/data/hbase/meta/1588230740/rep_barrier 2023-02-15 20:01:20,009 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-15 20:01:20,010 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 20:01:20,010 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-15 20:01:20,011 DEBUG [RS:1;jenkins-hbase4:33125] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-15 20:01:20,011 DEBUG [RS:0;jenkins-hbase4:33019] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-15 20:01:20,013 DEBUG [RS:1;jenkins-hbase4:33125] zookeeper.ReadOnlyZKClient(139): Connect 0x3f7b78a7 to 127.0.0.1:57384 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-15 20:01:20,013 DEBUG [RS:0;jenkins-hbase4:33019] zookeeper.ReadOnlyZKClient(139): Connect 0x66f230b5 to 127.0.0.1:57384 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-15 20:01:20,013 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/data/hbase/meta/1588230740/table 2023-02-15 20:01:20,013 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-15 20:01:20,014 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 20:01:20,021 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/data/hbase/meta/1588230740 2023-02-15 20:01:20,022 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/data/hbase/meta/1588230740 2023-02-15 20:01:20,025 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-15 20:01:20,026 DEBUG [PEWorker-1] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-15 20:01:20,028 DEBUG [RS:1;jenkins-hbase4:33125] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@31bc9138, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-15 20:01:20,028 DEBUG [RS:1;jenkins-hbase4:33125] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@358313d7, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-15 20:01:20,028 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-15 20:01:20,029 INFO [PEWorker-1] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73834967, jitterRate=0.1002267450094223}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-15 20:01:20,029 DEBUG [PEWorker-1] regionserver.HRegion(964): Region open journal for 1588230740: 2023-02-15 20:01:20,029 DEBUG [PEWorker-1] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-15 20:01:20,029 INFO [PEWorker-1] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-15 20:01:20,029 DEBUG [PEWorker-1] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-15 20:01:20,029 DEBUG [PEWorker-1] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-15 20:01:20,029 DEBUG [PEWorker-1] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-15 20:01:20,029 INFO [PEWorker-1] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-15 20:01:20,030 DEBUG [PEWorker-1] regionserver.HRegion(1557): Region close journal for 1588230740: 2023-02-15 20:01:20,031 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-02-15 20:01:20,031 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-02-15 20:01:20,031 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-02-15 20:01:20,032 DEBUG [RS:0;jenkins-hbase4:33019] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6835c21b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-15 20:01:20,032 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-02-15 20:01:20,032 DEBUG [RS:0;jenkins-hbase4:33019] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6c0a5bc5, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-15 20:01:20,036 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-02-15 20:01:20,039 DEBUG [RS:1;jenkins-hbase4:33125] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:33125 2023-02-15 20:01:20,039 INFO [RS:1;jenkins-hbase4:33125] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-15 20:01:20,039 INFO [RS:1;jenkins-hbase4:33125] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-15 20:01:20,039 DEBUG [RS:1;jenkins-hbase4:33125] regionserver.HRegionServer(1023): About to register with Master. 2023-02-15 20:01:20,040 INFO [RS:1;jenkins-hbase4:33125] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,36865,1676491279587 with isa=jenkins-hbase4.apache.org/172.31.14.131:33125, startcode=1676491279695 2023-02-15 20:01:20,040 DEBUG [RS:1;jenkins-hbase4:33125] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-15 20:01:20,043 DEBUG [RS:0;jenkins-hbase4:33019] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:33019 2023-02-15 20:01:20,043 INFO [RS:0;jenkins-hbase4:33019] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-15 20:01:20,043 INFO [RS:0;jenkins-hbase4:33019] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-15 20:01:20,043 DEBUG [RS:0;jenkins-hbase4:33019] regionserver.HRegionServer(1023): About to register with Master. 2023-02-15 20:01:20,044 INFO [RS:0;jenkins-hbase4:33019] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,36865,1676491279587 with isa=jenkins-hbase4.apache.org/172.31.14.131:33019, startcode=1676491279655 2023-02-15 20:01:20,045 DEBUG [RS:0;jenkins-hbase4:33019] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-15 20:01:20,045 INFO [RS-EventLoopGroup-6-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39353, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.3 (auth:SIMPLE), service=RegionServerStatusService 2023-02-15 20:01:20,049 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36865] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,33125,1676491279695 2023-02-15 20:01:20,050 INFO [RS-EventLoopGroup-6-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52975, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.2 (auth:SIMPLE), service=RegionServerStatusService 2023-02-15 20:01:20,050 DEBUG [RS:1;jenkins-hbase4:33125] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da 2023-02-15 20:01:20,050 DEBUG [RS:1;jenkins-hbase4:33125] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:40371 2023-02-15 20:01:20,050 DEBUG [RS:1;jenkins-hbase4:33125] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-15 20:01:20,050 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36865] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,33019,1676491279655 2023-02-15 20:01:20,051 DEBUG [RS:0;jenkins-hbase4:33019] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da 2023-02-15 20:01:20,051 DEBUG [RS:0;jenkins-hbase4:33019] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:40371 2023-02-15 20:01:20,051 DEBUG [RS:0;jenkins-hbase4:33019] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-15 20:01:20,052 DEBUG [Listener at localhost/43949-EventThread] zookeeper.ZKWatcher(600): master:36865-0x1005992b68c0000, quorum=127.0.0.1:57384, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-15 20:01:20,055 DEBUG [RS:1;jenkins-hbase4:33125] zookeeper.ZKUtil(162): regionserver:33125-0x1005992b68c0002, quorum=127.0.0.1:57384, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,33125,1676491279695 2023-02-15 20:01:20,055 WARN [RS:1;jenkins-hbase4:33125] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-15 20:01:20,056 INFO [RS:1;jenkins-hbase4:33125] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-15 20:01:20,056 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,33019,1676491279655] 2023-02-15 20:01:20,056 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,33125,1676491279695] 2023-02-15 20:01:20,056 DEBUG [RS:1;jenkins-hbase4:33125] regionserver.HRegionServer(1947): logDir=hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/WALs/jenkins-hbase4.apache.org,33125,1676491279695 2023-02-15 20:01:20,056 DEBUG [RS:0;jenkins-hbase4:33019] zookeeper.ZKUtil(162): regionserver:33019-0x1005992b68c0001, quorum=127.0.0.1:57384, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,33019,1676491279655 2023-02-15 20:01:20,056 WARN [RS:0;jenkins-hbase4:33019] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-15 20:01:20,056 INFO [RS:0;jenkins-hbase4:33019] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-15 20:01:20,056 DEBUG [RS:0;jenkins-hbase4:33019] regionserver.HRegionServer(1947): logDir=hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/WALs/jenkins-hbase4.apache.org,33019,1676491279655 2023-02-15 20:01:20,061 DEBUG [RS:0;jenkins-hbase4:33019] zookeeper.ZKUtil(162): regionserver:33019-0x1005992b68c0001, quorum=127.0.0.1:57384, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,33019,1676491279655 2023-02-15 20:01:20,062 DEBUG [RS:1;jenkins-hbase4:33125] zookeeper.ZKUtil(162): regionserver:33125-0x1005992b68c0002, quorum=127.0.0.1:57384, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,33019,1676491279655 2023-02-15 20:01:20,062 DEBUG [RS:0;jenkins-hbase4:33019] zookeeper.ZKUtil(162): regionserver:33019-0x1005992b68c0001, quorum=127.0.0.1:57384, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,33125,1676491279695 2023-02-15 20:01:20,063 DEBUG [RS:1;jenkins-hbase4:33125] zookeeper.ZKUtil(162): regionserver:33125-0x1005992b68c0002, quorum=127.0.0.1:57384, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,33125,1676491279695 2023-02-15 20:01:20,063 DEBUG [RS:0;jenkins-hbase4:33019] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-15 20:01:20,063 INFO [RS:0;jenkins-hbase4:33019] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-15 20:01:20,064 DEBUG [RS:1;jenkins-hbase4:33125] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-15 20:01:20,065 INFO [RS:1;jenkins-hbase4:33125] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-15 20:01:20,067 INFO [RS:0;jenkins-hbase4:33019] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-15 20:01:20,067 INFO [RS:1;jenkins-hbase4:33125] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-15 20:01:20,068 INFO [RS:0;jenkins-hbase4:33019] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-15 20:01:20,068 INFO [RS:1;jenkins-hbase4:33125] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-15 20:01:20,068 INFO [RS:0;jenkins-hbase4:33019] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-15 20:01:20,068 INFO [RS:1;jenkins-hbase4:33125] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-15 20:01:20,068 INFO [RS:0;jenkins-hbase4:33019] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-15 20:01:20,071 INFO [RS:1;jenkins-hbase4:33125] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-15 20:01:20,072 INFO [RS:0;jenkins-hbase4:33019] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-15 20:01:20,072 INFO [RS:1;jenkins-hbase4:33125] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-15 20:01:20,072 DEBUG [RS:0;jenkins-hbase4:33019] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 20:01:20,072 DEBUG [RS:1;jenkins-hbase4:33125] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 20:01:20,072 DEBUG [RS:0;jenkins-hbase4:33019] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 20:01:20,072 DEBUG [RS:1;jenkins-hbase4:33125] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 20:01:20,072 DEBUG [RS:0;jenkins-hbase4:33019] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 20:01:20,073 DEBUG [RS:1;jenkins-hbase4:33125] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 20:01:20,073 DEBUG [RS:0;jenkins-hbase4:33019] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 20:01:20,073 DEBUG [RS:1;jenkins-hbase4:33125] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 20:01:20,073 DEBUG [RS:0;jenkins-hbase4:33019] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 20:01:20,073 DEBUG [RS:1;jenkins-hbase4:33125] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 20:01:20,073 DEBUG [RS:0;jenkins-hbase4:33019] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-15 20:01:20,073 DEBUG [RS:1;jenkins-hbase4:33125] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-15 20:01:20,073 DEBUG [RS:0;jenkins-hbase4:33019] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 20:01:20,073 DEBUG [RS:1;jenkins-hbase4:33125] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 20:01:20,073 DEBUG [RS:0;jenkins-hbase4:33019] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 20:01:20,073 DEBUG [RS:1;jenkins-hbase4:33125] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 20:01:20,073 DEBUG [RS:0;jenkins-hbase4:33019] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 20:01:20,073 DEBUG [RS:1;jenkins-hbase4:33125] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 20:01:20,073 DEBUG [RS:0;jenkins-hbase4:33019] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 20:01:20,074 DEBUG [RS:1;jenkins-hbase4:33125] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 20:01:20,079 INFO [RS:1;jenkins-hbase4:33125] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-15 20:01:20,079 INFO [RS:0;jenkins-hbase4:33019] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-15 20:01:20,079 INFO [RS:1;jenkins-hbase4:33125] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-15 20:01:20,079 INFO [RS:0;jenkins-hbase4:33019] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-15 20:01:20,080 INFO [RS:1;jenkins-hbase4:33125] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-15 20:01:20,080 INFO [RS:0;jenkins-hbase4:33019] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-15 20:01:20,096 INFO [RS:0;jenkins-hbase4:33019] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-15 20:01:20,096 INFO [RS:1;jenkins-hbase4:33125] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-15 20:01:20,096 INFO [RS:0;jenkins-hbase4:33019] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,33019,1676491279655-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-15 20:01:20,097 INFO [RS:1;jenkins-hbase4:33125] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,33125,1676491279695-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-15 20:01:20,113 INFO [RS:0;jenkins-hbase4:33019] regionserver.Replication(203): jenkins-hbase4.apache.org,33019,1676491279655 started 2023-02-15 20:01:20,113 INFO [RS:0;jenkins-hbase4:33019] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,33019,1676491279655, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:33019, sessionid=0x1005992b68c0001 2023-02-15 20:01:20,113 DEBUG [RS:0;jenkins-hbase4:33019] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-15 20:01:20,113 DEBUG [RS:0;jenkins-hbase4:33019] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,33019,1676491279655 2023-02-15 20:01:20,113 DEBUG [RS:0;jenkins-hbase4:33019] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,33019,1676491279655' 2023-02-15 20:01:20,113 DEBUG [RS:0;jenkins-hbase4:33019] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-15 20:01:20,114 INFO [RS:1;jenkins-hbase4:33125] regionserver.Replication(203): jenkins-hbase4.apache.org,33125,1676491279695 started 2023-02-15 20:01:20,114 INFO [RS:1;jenkins-hbase4:33125] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,33125,1676491279695, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:33125, sessionid=0x1005992b68c0002 2023-02-15 20:01:20,114 DEBUG [RS:1;jenkins-hbase4:33125] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-15 20:01:20,114 DEBUG [RS:1;jenkins-hbase4:33125] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,33125,1676491279695 2023-02-15 20:01:20,114 DEBUG [RS:1;jenkins-hbase4:33125] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,33125,1676491279695' 2023-02-15 20:01:20,114 DEBUG [RS:1;jenkins-hbase4:33125] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-15 20:01:20,114 DEBUG [RS:0;jenkins-hbase4:33019] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-15 20:01:20,114 DEBUG [RS:1;jenkins-hbase4:33125] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-15 20:01:20,115 DEBUG [RS:0;jenkins-hbase4:33019] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-15 20:01:20,115 DEBUG [RS:1;jenkins-hbase4:33125] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-15 20:01:20,115 DEBUG [RS:1;jenkins-hbase4:33125] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-15 20:01:20,115 DEBUG [RS:1;jenkins-hbase4:33125] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,33125,1676491279695 2023-02-15 20:01:20,115 DEBUG [RS:1;jenkins-hbase4:33125] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,33125,1676491279695' 2023-02-15 20:01:20,115 DEBUG [RS:1;jenkins-hbase4:33125] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-15 20:01:20,115 DEBUG [RS:0;jenkins-hbase4:33019] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-15 20:01:20,115 DEBUG [RS:0;jenkins-hbase4:33019] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,33019,1676491279655 2023-02-15 20:01:20,115 DEBUG [RS:0;jenkins-hbase4:33019] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,33019,1676491279655' 2023-02-15 20:01:20,115 DEBUG [RS:0;jenkins-hbase4:33019] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-15 20:01:20,115 DEBUG [RS:1;jenkins-hbase4:33125] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-15 20:01:20,115 DEBUG [RS:0;jenkins-hbase4:33019] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-15 20:01:20,115 DEBUG [RS:1;jenkins-hbase4:33125] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-15 20:01:20,116 INFO [RS:1;jenkins-hbase4:33125] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-15 20:01:20,116 INFO [RS:1;jenkins-hbase4:33125] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-15 20:01:20,116 DEBUG [RS:0;jenkins-hbase4:33019] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-15 20:01:20,116 INFO [RS:0;jenkins-hbase4:33019] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-15 20:01:20,116 INFO [RS:0;jenkins-hbase4:33019] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-15 20:01:20,187 DEBUG [jenkins-hbase4:36865] assignment.AssignmentManager(2178): Processing assignQueue; systemServersCount=2, allServersCount=2 2023-02-15 20:01:20,187 DEBUG [jenkins-hbase4:36865] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-15 20:01:20,189 DEBUG [jenkins-hbase4:36865] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-15 20:01:20,189 DEBUG [jenkins-hbase4:36865] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-15 20:01:20,189 DEBUG [jenkins-hbase4:36865] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-15 20:01:20,190 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,33125,1676491279695, state=OPENING 2023-02-15 20:01:20,191 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-02-15 20:01:20,193 DEBUG [Listener at localhost/43949-EventThread] zookeeper.ZKWatcher(600): master:36865-0x1005992b68c0000, quorum=127.0.0.1:57384, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-15 20:01:20,193 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,33125,1676491279695}] 2023-02-15 20:01:20,193 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-15 20:01:20,347 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,33125,1676491279695 2023-02-15 20:01:20,348 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-15 20:01:20,350 INFO [RS-EventLoopGroup-8-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55356, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-15 20:01:20,354 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:meta,,1.1588230740 2023-02-15 20:01:20,355 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-15 20:01:20,356 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C33125%2C1676491279695.meta, suffix=.meta, logDir=hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/WALs/jenkins-hbase4.apache.org,33125,1676491279695, archiveDir=hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/oldWALs, maxLogs=32 2023-02-15 20:01:20,376 DEBUG [RS-EventLoopGroup-8-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35923,DS-e0a3376d-ff3e-4e9b-adbf-92dcfa37f723,DISK] 2023-02-15 20:01:20,376 DEBUG [RS-EventLoopGroup-8-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41913,DS-2a1bb52d-eea7-4f57-be3b-12915a60c66e,DISK] 2023-02-15 20:01:20,379 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/WALs/jenkins-hbase4.apache.org,33125,1676491279695/jenkins-hbase4.apache.org%2C33125%2C1676491279695.meta.1676491280357.meta 2023-02-15 20:01:20,379 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:35923,DS-e0a3376d-ff3e-4e9b-adbf-92dcfa37f723,DISK], DatanodeInfoWithStorage[127.0.0.1:41913,DS-2a1bb52d-eea7-4f57-be3b-12915a60c66e,DISK]] 2023-02-15 20:01:20,379 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-02-15 20:01:20,379 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-02-15 20:01:20,379 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8546): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-02-15 20:01:20,380 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-02-15 20:01:20,380 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-02-15 20:01:20,380 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 20:01:20,381 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 1588230740 2023-02-15 20:01:20,381 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 1588230740 2023-02-15 20:01:20,384 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-15 20:01:20,385 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/data/hbase/meta/1588230740/info 2023-02-15 20:01:20,385 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/data/hbase/meta/1588230740/info 2023-02-15 20:01:20,385 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-15 20:01:20,386 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 20:01:20,386 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-15 20:01:20,387 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/data/hbase/meta/1588230740/rep_barrier 2023-02-15 20:01:20,387 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/data/hbase/meta/1588230740/rep_barrier 2023-02-15 20:01:20,387 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-15 20:01:20,388 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 20:01:20,388 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-15 20:01:20,389 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/data/hbase/meta/1588230740/table 2023-02-15 20:01:20,389 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/data/hbase/meta/1588230740/table 2023-02-15 20:01:20,389 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-15 20:01:20,390 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 20:01:20,390 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/data/hbase/meta/1588230740 2023-02-15 20:01:20,392 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/data/hbase/meta/1588230740 2023-02-15 20:01:20,394 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-15 20:01:20,396 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-15 20:01:20,397 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72546027, jitterRate=0.0810200423002243}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-15 20:01:20,397 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 1588230740: 2023-02-15 20:01:20,401 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1676491280347 2023-02-15 20:01:20,406 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:meta,,1.1588230740 2023-02-15 20:01:20,406 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:meta,,1.1588230740 2023-02-15 20:01:20,407 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,33125,1676491279695, state=OPEN 2023-02-15 20:01:20,409 DEBUG [Listener at localhost/43949-EventThread] zookeeper.ZKWatcher(600): master:36865-0x1005992b68c0000, quorum=127.0.0.1:57384, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-02-15 20:01:20,409 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-15 20:01:20,411 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-02-15 20:01:20,411 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,33125,1676491279695 in 216 msec 2023-02-15 20:01:20,413 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-02-15 20:01:20,413 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 380 msec 2023-02-15 20:01:20,414 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 447 msec 2023-02-15 20:01:20,415 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1676491280414, completionTime=-1 2023-02-15 20:01:20,415 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=2; waited=0ms, expected min=2 server(s), max=2 server(s), master is running 2023-02-15 20:01:20,415 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1519): Joining cluster... 2023-02-15 20:01:20,417 DEBUG [hconnection-0x5e987904-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-15 20:01:20,419 INFO [RS-EventLoopGroup-8-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55362, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-15 20:01:20,421 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1531): Number of RegionServers=2 2023-02-15 20:01:20,421 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1676491340421 2023-02-15 20:01:20,421 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1676491400421 2023-02-15 20:01:20,421 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1538): Joined the cluster in 6 msec 2023-02-15 20:01:20,428 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,36865,1676491279587-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-15 20:01:20,428 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,36865,1676491279587-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-15 20:01:20,428 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,36865,1676491279587-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-15 20:01:20,428 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:36865, period=300000, unit=MILLISECONDS is enabled. 2023-02-15 20:01:20,428 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-02-15 20:01:20,428 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-02-15 20:01:20,428 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-15 20:01:20,429 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-02-15 20:01:20,433 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-02-15 20:01:20,434 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-02-15 20:01:20,434 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-15 20:01:20,436 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/.tmp/data/hbase/namespace/a83d31acd8a067180d7240b93343a9e6 2023-02-15 20:01:20,437 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/.tmp/data/hbase/namespace/a83d31acd8a067180d7240b93343a9e6 empty. 2023-02-15 20:01:20,438 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/.tmp/data/hbase/namespace/a83d31acd8a067180d7240b93343a9e6 2023-02-15 20:01:20,438 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-02-15 20:01:20,456 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-02-15 20:01:20,458 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7671): creating {ENCODED => a83d31acd8a067180d7240b93343a9e6, NAME => 'hbase:namespace,,1676491280428.a83d31acd8a067180d7240b93343a9e6.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/.tmp 2023-02-15 20:01:20,479 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676491280428.a83d31acd8a067180d7240b93343a9e6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 20:01:20,480 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1603): Closing a83d31acd8a067180d7240b93343a9e6, disabling compactions & flushes 2023-02-15 20:01:20,480 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676491280428.a83d31acd8a067180d7240b93343a9e6. 2023-02-15 20:01:20,480 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676491280428.a83d31acd8a067180d7240b93343a9e6. 2023-02-15 20:01:20,480 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676491280428.a83d31acd8a067180d7240b93343a9e6. after waiting 0 ms 2023-02-15 20:01:20,480 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676491280428.a83d31acd8a067180d7240b93343a9e6. 2023-02-15 20:01:20,480 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676491280428.a83d31acd8a067180d7240b93343a9e6. 2023-02-15 20:01:20,480 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1557): Region close journal for a83d31acd8a067180d7240b93343a9e6: 2023-02-15 20:01:20,483 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-02-15 20:01:20,484 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1676491280428.a83d31acd8a067180d7240b93343a9e6.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676491280484"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676491280484"}]},"ts":"1676491280484"} 2023-02-15 20:01:20,488 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-15 20:01:20,489 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-15 20:01:20,490 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676491280489"}]},"ts":"1676491280489"} 2023-02-15 20:01:20,492 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-02-15 20:01:20,497 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-15 20:01:20,498 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-15 20:01:20,498 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-15 20:01:20,498 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-15 20:01:20,498 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=a83d31acd8a067180d7240b93343a9e6, ASSIGN}] 2023-02-15 20:01:20,501 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=a83d31acd8a067180d7240b93343a9e6, ASSIGN 2023-02-15 20:01:20,502 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=a83d31acd8a067180d7240b93343a9e6, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,33019,1676491279655; forceNewPlan=false, retain=false 2023-02-15 20:01:20,653 INFO [jenkins-hbase4:36865] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-15 20:01:20,654 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=a83d31acd8a067180d7240b93343a9e6, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,33019,1676491279655 2023-02-15 20:01:20,654 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1676491280428.a83d31acd8a067180d7240b93343a9e6.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676491280654"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676491280654"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676491280654"}]},"ts":"1676491280654"} 2023-02-15 20:01:20,656 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure a83d31acd8a067180d7240b93343a9e6, server=jenkins-hbase4.apache.org,33019,1676491279655}] 2023-02-15 20:01:20,809 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,33019,1676491279655 2023-02-15 20:01:20,809 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-15 20:01:20,812 INFO [RS-EventLoopGroup-7-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36088, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-15 20:01:20,816 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:namespace,,1676491280428.a83d31acd8a067180d7240b93343a9e6. 2023-02-15 20:01:20,818 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C33019%2C1676491279655, suffix=, logDir=hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/WALs/jenkins-hbase4.apache.org,33019,1676491279655, archiveDir=hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/oldWALs, maxLogs=32 2023-02-15 20:01:20,837 DEBUG [RS-EventLoopGroup-8-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41913,DS-2a1bb52d-eea7-4f57-be3b-12915a60c66e,DISK] 2023-02-15 20:01:20,837 DEBUG [RS-EventLoopGroup-8-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35923,DS-e0a3376d-ff3e-4e9b-adbf-92dcfa37f723,DISK] 2023-02-15 20:01:20,839 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/WALs/jenkins-hbase4.apache.org,33019,1676491279655/jenkins-hbase4.apache.org%2C33019%2C1676491279655.1676491280819 2023-02-15 20:01:20,839 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:41913,DS-2a1bb52d-eea7-4f57-be3b-12915a60c66e,DISK], DatanodeInfoWithStorage[127.0.0.1:35923,DS-e0a3376d-ff3e-4e9b-adbf-92dcfa37f723,DISK]] 2023-02-15 20:01:20,839 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => a83d31acd8a067180d7240b93343a9e6, NAME => 'hbase:namespace,,1676491280428.a83d31acd8a067180d7240b93343a9e6.', STARTKEY => '', ENDKEY => ''} 2023-02-15 20:01:20,839 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace a83d31acd8a067180d7240b93343a9e6 2023-02-15 20:01:20,839 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676491280428.a83d31acd8a067180d7240b93343a9e6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 20:01:20,840 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for a83d31acd8a067180d7240b93343a9e6 2023-02-15 20:01:20,840 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for a83d31acd8a067180d7240b93343a9e6 2023-02-15 20:01:20,841 INFO [StoreOpener-a83d31acd8a067180d7240b93343a9e6-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region a83d31acd8a067180d7240b93343a9e6 2023-02-15 20:01:20,842 DEBUG [StoreOpener-a83d31acd8a067180d7240b93343a9e6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/data/hbase/namespace/a83d31acd8a067180d7240b93343a9e6/info 2023-02-15 20:01:20,842 DEBUG [StoreOpener-a83d31acd8a067180d7240b93343a9e6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/data/hbase/namespace/a83d31acd8a067180d7240b93343a9e6/info 2023-02-15 20:01:20,842 INFO [StoreOpener-a83d31acd8a067180d7240b93343a9e6-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a83d31acd8a067180d7240b93343a9e6 columnFamilyName info 2023-02-15 20:01:20,843 INFO [StoreOpener-a83d31acd8a067180d7240b93343a9e6-1] regionserver.HStore(310): Store=a83d31acd8a067180d7240b93343a9e6/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 20:01:20,844 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/data/hbase/namespace/a83d31acd8a067180d7240b93343a9e6 2023-02-15 20:01:20,844 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/data/hbase/namespace/a83d31acd8a067180d7240b93343a9e6 2023-02-15 20:01:20,847 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for a83d31acd8a067180d7240b93343a9e6 2023-02-15 20:01:20,848 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/data/hbase/namespace/a83d31acd8a067180d7240b93343a9e6/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-15 20:01:20,849 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened a83d31acd8a067180d7240b93343a9e6; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71588141, jitterRate=0.06674642860889435}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-15 20:01:20,849 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for a83d31acd8a067180d7240b93343a9e6: 2023-02-15 20:01:20,850 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:namespace,,1676491280428.a83d31acd8a067180d7240b93343a9e6., pid=6, masterSystemTime=1676491280809 2023-02-15 20:01:20,853 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:namespace,,1676491280428.a83d31acd8a067180d7240b93343a9e6. 2023-02-15 20:01:20,854 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:namespace,,1676491280428.a83d31acd8a067180d7240b93343a9e6. 2023-02-15 20:01:20,854 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=a83d31acd8a067180d7240b93343a9e6, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,33019,1676491279655 2023-02-15 20:01:20,854 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1676491280428.a83d31acd8a067180d7240b93343a9e6.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676491280854"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676491280854"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676491280854"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676491280854"}]},"ts":"1676491280854"} 2023-02-15 20:01:20,857 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-02-15 20:01:20,857 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure a83d31acd8a067180d7240b93343a9e6, server=jenkins-hbase4.apache.org,33019,1676491279655 in 200 msec 2023-02-15 20:01:20,859 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-02-15 20:01:20,859 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=a83d31acd8a067180d7240b93343a9e6, ASSIGN in 359 msec 2023-02-15 20:01:20,860 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-15 20:01:20,860 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676491280860"}]},"ts":"1676491280860"} 2023-02-15 20:01:20,861 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-02-15 20:01:20,864 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-02-15 20:01:20,865 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 436 msec 2023-02-15 20:01:20,931 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:36865-0x1005992b68c0000, quorum=127.0.0.1:57384, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-02-15 20:01:20,932 DEBUG [Listener at localhost/43949-EventThread] zookeeper.ZKWatcher(600): master:36865-0x1005992b68c0000, quorum=127.0.0.1:57384, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-02-15 20:01:20,932 DEBUG [Listener at localhost/43949-EventThread] zookeeper.ZKWatcher(600): master:36865-0x1005992b68c0000, quorum=127.0.0.1:57384, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-15 20:01:20,936 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-15 20:01:20,939 INFO [RS-EventLoopGroup-7-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36092, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-15 20:01:20,941 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-02-15 20:01:20,949 DEBUG [Listener at localhost/43949-EventThread] zookeeper.ZKWatcher(600): master:36865-0x1005992b68c0000, quorum=127.0.0.1:57384, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-15 20:01:20,952 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 11 msec 2023-02-15 20:01:20,963 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-02-15 20:01:20,969 DEBUG [Listener at localhost/43949-EventThread] zookeeper.ZKWatcher(600): master:36865-0x1005992b68c0000, quorum=127.0.0.1:57384, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-15 20:01:20,972 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 9 msec 2023-02-15 20:01:20,977 DEBUG [Listener at localhost/43949-EventThread] zookeeper.ZKWatcher(600): master:36865-0x1005992b68c0000, quorum=127.0.0.1:57384, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-02-15 20:01:20,979 DEBUG [Listener at localhost/43949-EventThread] zookeeper.ZKWatcher(600): master:36865-0x1005992b68c0000, quorum=127.0.0.1:57384, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-02-15 20:01:20,979 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 1.169sec 2023-02-15 20:01:20,980 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-02-15 20:01:20,980 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-02-15 20:01:20,980 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-02-15 20:01:20,980 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,36865,1676491279587-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-02-15 20:01:20,980 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,36865,1676491279587-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-02-15 20:01:20,982 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-02-15 20:01:21,006 DEBUG [Listener at localhost/43949] zookeeper.ReadOnlyZKClient(139): Connect 0x25d0ebdc to 127.0.0.1:57384 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-15 20:01:21,010 DEBUG [Listener at localhost/43949] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3969272f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-15 20:01:21,012 DEBUG [hconnection-0x3c970f61-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-15 20:01:21,014 INFO [RS-EventLoopGroup-8-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55372, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-15 20:01:21,015 INFO [Listener at localhost/43949] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,36865,1676491279587 2023-02-15 20:01:21,015 DEBUG [Listener at localhost/43949] mapreduce.TableSnapshotInputFormatTestBase(193): Ensuring table doesn't exist. 2023-02-15 20:01:21,017 DEBUG [Listener at localhost/43949] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-15 20:01:21,019 INFO [RS-EventLoopGroup-6-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37916, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-15 20:01:21,019 INFO [Listener at localhost/43949] client.HBaseAdmin$15(890): Started disable of testWithMapReduce 2023-02-15 20:01:21,020 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36865] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testWithMapReduce 2023-02-15 20:01:21,020 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36865] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.TableNotFoundException: testWithMapReduce at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.checkTableModifiable(AbstractStateMachineTableProcedure.java:125) at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.preflightChecks(AbstractStateMachineTableProcedure.java:157) at org.apache.hadoop.hbase.master.procedure.DisableTableProcedure.(DisableTableProcedure.java:78) at org.apache.hadoop.hbase.master.HMaster$11.run(HMaster.java:2429) at org.apache.hadoop.hbase.master.procedure.MasterProcedureUtil.submitProcedure(MasterProcedureUtil.java:132) at org.apache.hadoop.hbase.master.HMaster.disableTable(HMaster.java:2413) at org.apache.hadoop.hbase.master.MasterRpcServices.disableTable(MasterRpcServices.java:784) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-02-15 20:01:21,020 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36865] ipc.CallRunner(144): callId: 2 service: MasterService methodName: DisableTable size: 77 connection: 172.31.14.131:37916 deadline: 1676491341020, exception=org.apache.hadoop.hbase.TableNotFoundException: testWithMapReduce 2023-02-15 20:01:21,020 INFO [Listener at localhost/43949] mapreduce.TableSnapshotInputFormatTestBase(199): creating table 'testWithMapReduce' 2023-02-15 20:01:21,022 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36865] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-15 20:01:21,024 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36865] procedure2.ProcedureExecutor(1029): Stored pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testWithMapReduce 2023-02-15 20:01:21,026 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_PRE_OPERATION 2023-02-15 20:01:21,026 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36865] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testWithMapReduce" procId is: 10 2023-02-15 20:01:21,026 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-15 20:01:21,027 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36865] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-15 20:01:21,035 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/.tmp/data/default/testWithMapReduce/9fdf60e81d6a22352a6acb2fcb8c9f3e 2023-02-15 20:01:21,035 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/.tmp/data/default/testWithMapReduce/1486d61d8d2fe0efe2a608c7110b6c7d 2023-02-15 20:01:21,035 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/.tmp/data/default/testWithMapReduce/bd3ac405f939af16962e576b69a6c71b 2023-02-15 20:01:21,035 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/.tmp/data/default/testWithMapReduce/296941d2565b5d20cfd81aec8ac11565 2023-02-15 20:01:21,035 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/.tmp/data/default/testWithMapReduce/97b529ba0e37421e99fb43de9d23d817 2023-02-15 20:01:21,035 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/.tmp/data/default/testWithMapReduce/2f6827bb8b2d8e3d5d25320352d1e239 2023-02-15 20:01:21,035 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/.tmp/data/default/testWithMapReduce/dae437d89db301633beda20a6a7029ef 2023-02-15 20:01:21,035 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/.tmp/data/default/testWithMapReduce/2a1c7014d8c6c818f8ea2f67ef6b2118 2023-02-15 20:01:21,035 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/.tmp/data/default/testWithMapReduce/9fdf60e81d6a22352a6acb2fcb8c9f3e empty. 2023-02-15 20:01:21,035 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/.tmp/data/default/testWithMapReduce/1486d61d8d2fe0efe2a608c7110b6c7d empty. 2023-02-15 20:01:21,036 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/.tmp/data/default/testWithMapReduce/bd3ac405f939af16962e576b69a6c71b empty. 2023-02-15 20:01:21,036 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/.tmp/data/default/testWithMapReduce/2f6827bb8b2d8e3d5d25320352d1e239 empty. 2023-02-15 20:01:21,036 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/.tmp/data/default/testWithMapReduce/97b529ba0e37421e99fb43de9d23d817 empty. 2023-02-15 20:01:21,036 DEBUG [HFileArchiver-6] backup.HFileArchiver(153): Directory hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/.tmp/data/default/testWithMapReduce/2a1c7014d8c6c818f8ea2f67ef6b2118 empty. 2023-02-15 20:01:21,036 DEBUG [HFileArchiver-5] backup.HFileArchiver(153): Directory hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/.tmp/data/default/testWithMapReduce/296941d2565b5d20cfd81aec8ac11565 empty. 2023-02-15 20:01:21,036 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/.tmp/data/default/testWithMapReduce/bd3ac405f939af16962e576b69a6c71b 2023-02-15 20:01:21,036 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/.tmp/data/default/testWithMapReduce/69ce6540f755e21eae3d289ad231610b 2023-02-15 20:01:21,036 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/.tmp/data/default/testWithMapReduce/1486d61d8d2fe0efe2a608c7110b6c7d 2023-02-15 20:01:21,037 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/.tmp/data/default/testWithMapReduce/2241125b7d23be16c4949dc36e627f50 2023-02-15 20:01:21,037 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/.tmp/data/default/testWithMapReduce/9fdf60e81d6a22352a6acb2fcb8c9f3e 2023-02-15 20:01:21,037 DEBUG [HFileArchiver-5] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/.tmp/data/default/testWithMapReduce/296941d2565b5d20cfd81aec8ac11565 2023-02-15 20:01:21,037 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/.tmp/data/default/testWithMapReduce/dae437d89db301633beda20a6a7029ef empty. 2023-02-15 20:01:21,037 DEBUG [HFileArchiver-6] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/.tmp/data/default/testWithMapReduce/2a1c7014d8c6c818f8ea2f67ef6b2118 2023-02-15 20:01:21,037 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/.tmp/data/default/testWithMapReduce/2241125b7d23be16c4949dc36e627f50 empty. 2023-02-15 20:01:21,037 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/.tmp/data/default/testWithMapReduce/97b529ba0e37421e99fb43de9d23d817 2023-02-15 20:01:21,037 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/.tmp/data/default/testWithMapReduce/2f6827bb8b2d8e3d5d25320352d1e239 2023-02-15 20:01:21,037 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/.tmp/data/default/testWithMapReduce/69ce6540f755e21eae3d289ad231610b empty. 2023-02-15 20:01:21,037 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/.tmp/data/default/testWithMapReduce/dae437d89db301633beda20a6a7029ef 2023-02-15 20:01:21,038 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/.tmp/data/default/testWithMapReduce/2241125b7d23be16c4949dc36e627f50 2023-02-15 20:01:21,038 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/.tmp/data/default/testWithMapReduce/69ce6540f755e21eae3d289ad231610b 2023-02-15 20:01:21,038 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testWithMapReduce regions 2023-02-15 20:01:21,053 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/.tmp/data/default/testWithMapReduce/.tabledesc/.tableinfo.0000000001 2023-02-15 20:01:21,054 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(7671): creating {ENCODED => 9fdf60e81d6a22352a6acb2fcb8c9f3e, NAME => 'testWithMapReduce,,1676491281022.9fdf60e81d6a22352a6acb2fcb8c9f3e.', STARTKEY => '', ENDKEY => 'aaa'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/.tmp 2023-02-15 20:01:21,054 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(7671): creating {ENCODED => dae437d89db301633beda20a6a7029ef, NAME => 'testWithMapReduce,aaa,1676491281022.dae437d89db301633beda20a6a7029ef.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/.tmp 2023-02-15 20:01:21,061 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(7671): creating {ENCODED => 2a1c7014d8c6c818f8ea2f67ef6b2118, NAME => 'testWithMapReduce,d\x84\x84,1676491281022.2a1c7014d8c6c818f8ea2f67ef6b2118.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/.tmp 2023-02-15 20:01:21,077 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,aaa,1676491281022.dae437d89db301633beda20a6a7029ef.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 20:01:21,077 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1603): Closing dae437d89db301633beda20a6a7029ef, disabling compactions & flushes 2023-02-15 20:01:21,078 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,aaa,1676491281022.dae437d89db301633beda20a6a7029ef. 2023-02-15 20:01:21,078 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,aaa,1676491281022.dae437d89db301633beda20a6a7029ef. 2023-02-15 20:01:21,078 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,aaa,1676491281022.dae437d89db301633beda20a6a7029ef. after waiting 0 ms 2023-02-15 20:01:21,078 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,aaa,1676491281022.dae437d89db301633beda20a6a7029ef. 2023-02-15 20:01:21,078 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,aaa,1676491281022.dae437d89db301633beda20a6a7029ef. 2023-02-15 20:01:21,078 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1557): Region close journal for dae437d89db301633beda20a6a7029ef: 2023-02-15 20:01:21,078 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676491281022.9fdf60e81d6a22352a6acb2fcb8c9f3e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 20:01:21,078 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1603): Closing 9fdf60e81d6a22352a6acb2fcb8c9f3e, disabling compactions & flushes 2023-02-15 20:01:21,078 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(7671): creating {ENCODED => 2f6827bb8b2d8e3d5d25320352d1e239, NAME => 'testWithMapReduce,g\xA7\xA7,1676491281022.2f6827bb8b2d8e3d5d25320352d1e239.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/.tmp 2023-02-15 20:01:21,078 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676491281022.9fdf60e81d6a22352a6acb2fcb8c9f3e. 2023-02-15 20:01:21,078 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676491281022.9fdf60e81d6a22352a6acb2fcb8c9f3e. 2023-02-15 20:01:21,079 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676491281022.9fdf60e81d6a22352a6acb2fcb8c9f3e. after waiting 0 ms 2023-02-15 20:01:21,079 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676491281022.9fdf60e81d6a22352a6acb2fcb8c9f3e. 2023-02-15 20:01:21,079 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,,1676491281022.9fdf60e81d6a22352a6acb2fcb8c9f3e. 2023-02-15 20:01:21,079 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1557): Region close journal for 9fdf60e81d6a22352a6acb2fcb8c9f3e: 2023-02-15 20:01:21,079 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(7671): creating {ENCODED => 1486d61d8d2fe0efe2a608c7110b6c7d, NAME => 'testWithMapReduce,j\xCA\xCA,1676491281022.1486d61d8d2fe0efe2a608c7110b6c7d.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/.tmp 2023-02-15 20:01:21,080 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,d\x84\x84,1676491281022.2a1c7014d8c6c818f8ea2f67ef6b2118.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 20:01:21,080 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1603): Closing 2a1c7014d8c6c818f8ea2f67ef6b2118, disabling compactions & flushes 2023-02-15 20:01:21,080 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,d\x84\x84,1676491281022.2a1c7014d8c6c818f8ea2f67ef6b2118. 2023-02-15 20:01:21,080 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,d\x84\x84,1676491281022.2a1c7014d8c6c818f8ea2f67ef6b2118. 2023-02-15 20:01:21,080 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,d\x84\x84,1676491281022.2a1c7014d8c6c818f8ea2f67ef6b2118. after waiting 0 ms 2023-02-15 20:01:21,080 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,d\x84\x84,1676491281022.2a1c7014d8c6c818f8ea2f67ef6b2118. 2023-02-15 20:01:21,080 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,d\x84\x84,1676491281022.2a1c7014d8c6c818f8ea2f67ef6b2118. 2023-02-15 20:01:21,080 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1557): Region close journal for 2a1c7014d8c6c818f8ea2f67ef6b2118: 2023-02-15 20:01:21,081 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(7671): creating {ENCODED => 97b529ba0e37421e99fb43de9d23d817, NAME => 'testWithMapReduce,m\xED\xED,1676491281022.97b529ba0e37421e99fb43de9d23d817.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/.tmp 2023-02-15 20:01:21,106 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,j\xCA\xCA,1676491281022.1486d61d8d2fe0efe2a608c7110b6c7d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 20:01:21,106 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,g\xA7\xA7,1676491281022.2f6827bb8b2d8e3d5d25320352d1e239.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 20:01:21,106 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1603): Closing 1486d61d8d2fe0efe2a608c7110b6c7d, disabling compactions & flushes 2023-02-15 20:01:21,106 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1603): Closing 2f6827bb8b2d8e3d5d25320352d1e239, disabling compactions & flushes 2023-02-15 20:01:21,106 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,j\xCA\xCA,1676491281022.1486d61d8d2fe0efe2a608c7110b6c7d. 2023-02-15 20:01:21,106 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,g\xA7\xA7,1676491281022.2f6827bb8b2d8e3d5d25320352d1e239. 2023-02-15 20:01:21,106 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,g\xA7\xA7,1676491281022.2f6827bb8b2d8e3d5d25320352d1e239. 2023-02-15 20:01:21,106 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,j\xCA\xCA,1676491281022.1486d61d8d2fe0efe2a608c7110b6c7d. 2023-02-15 20:01:21,106 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,g\xA7\xA7,1676491281022.2f6827bb8b2d8e3d5d25320352d1e239. after waiting 0 ms 2023-02-15 20:01:21,106 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,j\xCA\xCA,1676491281022.1486d61d8d2fe0efe2a608c7110b6c7d. after waiting 0 ms 2023-02-15 20:01:21,106 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,g\xA7\xA7,1676491281022.2f6827bb8b2d8e3d5d25320352d1e239. 2023-02-15 20:01:21,106 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,j\xCA\xCA,1676491281022.1486d61d8d2fe0efe2a608c7110b6c7d. 2023-02-15 20:01:21,106 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,g\xA7\xA7,1676491281022.2f6827bb8b2d8e3d5d25320352d1e239. 2023-02-15 20:01:21,107 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,j\xCA\xCA,1676491281022.1486d61d8d2fe0efe2a608c7110b6c7d. 2023-02-15 20:01:21,107 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1557): Region close journal for 1486d61d8d2fe0efe2a608c7110b6c7d: 2023-02-15 20:01:21,107 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1557): Region close journal for 2f6827bb8b2d8e3d5d25320352d1e239: 2023-02-15 20:01:21,107 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(7671): creating {ENCODED => 296941d2565b5d20cfd81aec8ac11565, NAME => 'testWithMapReduce,q\x11\x10,1676491281022.296941d2565b5d20cfd81aec8ac11565.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/.tmp 2023-02-15 20:01:21,107 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(7671): creating {ENCODED => bd3ac405f939af16962e576b69a6c71b, NAME => 'testWithMapReduce,t43,1676491281022.bd3ac405f939af16962e576b69a6c71b.', STARTKEY => 't43', ENDKEY => 'wWV'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/.tmp 2023-02-15 20:01:21,108 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,m\xED\xED,1676491281022.97b529ba0e37421e99fb43de9d23d817.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 20:01:21,108 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1603): Closing 97b529ba0e37421e99fb43de9d23d817, disabling compactions & flushes 2023-02-15 20:01:21,108 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,m\xED\xED,1676491281022.97b529ba0e37421e99fb43de9d23d817. 2023-02-15 20:01:21,108 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,m\xED\xED,1676491281022.97b529ba0e37421e99fb43de9d23d817. 2023-02-15 20:01:21,108 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,m\xED\xED,1676491281022.97b529ba0e37421e99fb43de9d23d817. after waiting 0 ms 2023-02-15 20:01:21,108 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,m\xED\xED,1676491281022.97b529ba0e37421e99fb43de9d23d817. 2023-02-15 20:01:21,108 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,m\xED\xED,1676491281022.97b529ba0e37421e99fb43de9d23d817. 2023-02-15 20:01:21,108 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1557): Region close journal for 97b529ba0e37421e99fb43de9d23d817: 2023-02-15 20:01:21,108 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(7671): creating {ENCODED => 69ce6540f755e21eae3d289ad231610b, NAME => 'testWithMapReduce,wWV,1676491281022.69ce6540f755e21eae3d289ad231610b.', STARTKEY => 'wWV', ENDKEY => 'zz{'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/.tmp 2023-02-15 20:01:21,116 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,t43,1676491281022.bd3ac405f939af16962e576b69a6c71b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 20:01:21,116 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1603): Closing bd3ac405f939af16962e576b69a6c71b, disabling compactions & flushes 2023-02-15 20:01:21,116 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,t43,1676491281022.bd3ac405f939af16962e576b69a6c71b. 2023-02-15 20:01:21,116 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,t43,1676491281022.bd3ac405f939af16962e576b69a6c71b. 2023-02-15 20:01:21,116 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,t43,1676491281022.bd3ac405f939af16962e576b69a6c71b. after waiting 0 ms 2023-02-15 20:01:21,116 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,t43,1676491281022.bd3ac405f939af16962e576b69a6c71b. 2023-02-15 20:01:21,116 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,t43,1676491281022.bd3ac405f939af16962e576b69a6c71b. 2023-02-15 20:01:21,116 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1557): Region close journal for bd3ac405f939af16962e576b69a6c71b: 2023-02-15 20:01:21,118 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(7671): creating {ENCODED => 2241125b7d23be16c4949dc36e627f50, NAME => 'testWithMapReduce,zz{,1676491281022.2241125b7d23be16c4949dc36e627f50.', STARTKEY => 'zz{', ENDKEY => ''}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/.tmp 2023-02-15 20:01:21,118 INFO [RS:1;jenkins-hbase4:33125] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C33125%2C1676491279695, suffix=, logDir=hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/WALs/jenkins-hbase4.apache.org,33125,1676491279695, archiveDir=hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/oldWALs, maxLogs=32 2023-02-15 20:01:21,120 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,wWV,1676491281022.69ce6540f755e21eae3d289ad231610b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 20:01:21,120 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1603): Closing 69ce6540f755e21eae3d289ad231610b, disabling compactions & flushes 2023-02-15 20:01:21,121 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,wWV,1676491281022.69ce6540f755e21eae3d289ad231610b. 2023-02-15 20:01:21,121 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,wWV,1676491281022.69ce6540f755e21eae3d289ad231610b. 2023-02-15 20:01:21,121 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,wWV,1676491281022.69ce6540f755e21eae3d289ad231610b. after waiting 0 ms 2023-02-15 20:01:21,121 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,wWV,1676491281022.69ce6540f755e21eae3d289ad231610b. 2023-02-15 20:01:21,121 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,wWV,1676491281022.69ce6540f755e21eae3d289ad231610b. 2023-02-15 20:01:21,121 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1557): Region close journal for 69ce6540f755e21eae3d289ad231610b: 2023-02-15 20:01:21,129 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36865] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-15 20:01:21,132 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,q\x11\x10,1676491281022.296941d2565b5d20cfd81aec8ac11565.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 20:01:21,132 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1603): Closing 296941d2565b5d20cfd81aec8ac11565, disabling compactions & flushes 2023-02-15 20:01:21,132 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,q\x11\x10,1676491281022.296941d2565b5d20cfd81aec8ac11565. 2023-02-15 20:01:21,132 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,q\x11\x10,1676491281022.296941d2565b5d20cfd81aec8ac11565. 2023-02-15 20:01:21,132 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,q\x11\x10,1676491281022.296941d2565b5d20cfd81aec8ac11565. after waiting 0 ms 2023-02-15 20:01:21,132 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,q\x11\x10,1676491281022.296941d2565b5d20cfd81aec8ac11565. 2023-02-15 20:01:21,132 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,q\x11\x10,1676491281022.296941d2565b5d20cfd81aec8ac11565. 2023-02-15 20:01:21,132 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1557): Region close journal for 296941d2565b5d20cfd81aec8ac11565: 2023-02-15 20:01:21,137 DEBUG [RS-EventLoopGroup-8-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41913,DS-2a1bb52d-eea7-4f57-be3b-12915a60c66e,DISK] 2023-02-15 20:01:21,137 DEBUG [RS-EventLoopGroup-8-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35923,DS-e0a3376d-ff3e-4e9b-adbf-92dcfa37f723,DISK] 2023-02-15 20:01:21,138 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,zz{,1676491281022.2241125b7d23be16c4949dc36e627f50.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 20:01:21,138 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1603): Closing 2241125b7d23be16c4949dc36e627f50, disabling compactions & flushes 2023-02-15 20:01:21,138 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,zz{,1676491281022.2241125b7d23be16c4949dc36e627f50. 2023-02-15 20:01:21,138 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,zz{,1676491281022.2241125b7d23be16c4949dc36e627f50. 2023-02-15 20:01:21,138 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,zz{,1676491281022.2241125b7d23be16c4949dc36e627f50. after waiting 0 ms 2023-02-15 20:01:21,138 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,zz{,1676491281022.2241125b7d23be16c4949dc36e627f50. 2023-02-15 20:01:21,138 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,zz{,1676491281022.2241125b7d23be16c4949dc36e627f50. 2023-02-15 20:01:21,138 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1557): Region close journal for 2241125b7d23be16c4949dc36e627f50: 2023-02-15 20:01:21,140 INFO [RS:1;jenkins-hbase4:33125] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/WALs/jenkins-hbase4.apache.org,33125,1676491279695/jenkins-hbase4.apache.org%2C33125%2C1676491279695.1676491281120 2023-02-15 20:01:21,140 DEBUG [RS:1;jenkins-hbase4:33125] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:41913,DS-2a1bb52d-eea7-4f57-be3b-12915a60c66e,DISK], DatanodeInfoWithStorage[127.0.0.1:35923,DS-e0a3376d-ff3e-4e9b-adbf-92dcfa37f723,DISK]] 2023-02-15 20:01:21,142 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_ADD_TO_META 2023-02-15 20:01:21,143 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,aaa,1676491281022.dae437d89db301633beda20a6a7029ef.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676491281142"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676491281142"}]},"ts":"1676491281142"} 2023-02-15 20:01:21,143 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,,1676491281022.9fdf60e81d6a22352a6acb2fcb8c9f3e.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676491281142"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676491281142"}]},"ts":"1676491281142"} 2023-02-15 20:01:21,143 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,d\\x84\\x84,1676491281022.2a1c7014d8c6c818f8ea2f67ef6b2118.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676491281142"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676491281142"}]},"ts":"1676491281142"} 2023-02-15 20:01:21,143 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,j\\xCA\\xCA,1676491281022.1486d61d8d2fe0efe2a608c7110b6c7d.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676491281142"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676491281142"}]},"ts":"1676491281142"} 2023-02-15 20:01:21,143 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,g\\xA7\\xA7,1676491281022.2f6827bb8b2d8e3d5d25320352d1e239.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676491281142"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676491281142"}]},"ts":"1676491281142"} 2023-02-15 20:01:21,143 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,m\\xED\\xED,1676491281022.97b529ba0e37421e99fb43de9d23d817.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676491281142"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676491281142"}]},"ts":"1676491281142"} 2023-02-15 20:01:21,144 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,t43,1676491281022.bd3ac405f939af16962e576b69a6c71b.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676491281142"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676491281142"}]},"ts":"1676491281142"} 2023-02-15 20:01:21,144 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,wWV,1676491281022.69ce6540f755e21eae3d289ad231610b.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676491281142"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676491281142"}]},"ts":"1676491281142"} 2023-02-15 20:01:21,144 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,q\\x11\\x10,1676491281022.296941d2565b5d20cfd81aec8ac11565.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676491281142"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676491281142"}]},"ts":"1676491281142"} 2023-02-15 20:01:21,144 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,zz{,1676491281022.2241125b7d23be16c4949dc36e627f50.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676491281142"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676491281142"}]},"ts":"1676491281142"} 2023-02-15 20:01:21,146 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 10 regions to meta. 2023-02-15 20:01:21,147 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-15 20:01:21,148 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676491281148"}]},"ts":"1676491281148"} 2023-02-15 20:01:21,149 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=ENABLING in hbase:meta 2023-02-15 20:01:21,153 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-15 20:01:21,160 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-15 20:01:21,160 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-15 20:01:21,160 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-15 20:01:21,160 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=9fdf60e81d6a22352a6acb2fcb8c9f3e, ASSIGN}, {pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=dae437d89db301633beda20a6a7029ef, ASSIGN}, {pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=2a1c7014d8c6c818f8ea2f67ef6b2118, ASSIGN}, {pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=2f6827bb8b2d8e3d5d25320352d1e239, ASSIGN}, {pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=1486d61d8d2fe0efe2a608c7110b6c7d, ASSIGN}, {pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=97b529ba0e37421e99fb43de9d23d817, ASSIGN}, {pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=296941d2565b5d20cfd81aec8ac11565, ASSIGN}, {pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=bd3ac405f939af16962e576b69a6c71b, ASSIGN}, {pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=69ce6540f755e21eae3d289ad231610b, ASSIGN}, {pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=2241125b7d23be16c4949dc36e627f50, ASSIGN}] 2023-02-15 20:01:21,163 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=dae437d89db301633beda20a6a7029ef, ASSIGN 2023-02-15 20:01:21,163 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=9fdf60e81d6a22352a6acb2fcb8c9f3e, ASSIGN 2023-02-15 20:01:21,163 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=2a1c7014d8c6c818f8ea2f67ef6b2118, ASSIGN 2023-02-15 20:01:21,164 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=2241125b7d23be16c4949dc36e627f50, ASSIGN 2023-02-15 20:01:21,164 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=dae437d89db301633beda20a6a7029ef, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,33019,1676491279655; forceNewPlan=false, retain=false 2023-02-15 20:01:21,164 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=69ce6540f755e21eae3d289ad231610b, ASSIGN 2023-02-15 20:01:21,164 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=9fdf60e81d6a22352a6acb2fcb8c9f3e, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,33125,1676491279695; forceNewPlan=false, retain=false 2023-02-15 20:01:21,164 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=2a1c7014d8c6c818f8ea2f67ef6b2118, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,33019,1676491279655; forceNewPlan=false, retain=false 2023-02-15 20:01:21,165 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=2241125b7d23be16c4949dc36e627f50, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,33125,1676491279695; forceNewPlan=false, retain=false 2023-02-15 20:01:21,165 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=bd3ac405f939af16962e576b69a6c71b, ASSIGN 2023-02-15 20:01:21,165 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=69ce6540f755e21eae3d289ad231610b, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,33125,1676491279695; forceNewPlan=false, retain=false 2023-02-15 20:01:21,166 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=296941d2565b5d20cfd81aec8ac11565, ASSIGN 2023-02-15 20:01:21,166 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=97b529ba0e37421e99fb43de9d23d817, ASSIGN 2023-02-15 20:01:21,166 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=1486d61d8d2fe0efe2a608c7110b6c7d, ASSIGN 2023-02-15 20:01:21,166 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=bd3ac405f939af16962e576b69a6c71b, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,33019,1676491279655; forceNewPlan=false, retain=false 2023-02-15 20:01:21,167 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=296941d2565b5d20cfd81aec8ac11565, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,33019,1676491279655; forceNewPlan=false, retain=false 2023-02-15 20:01:21,167 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=97b529ba0e37421e99fb43de9d23d817, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,33125,1676491279695; forceNewPlan=false, retain=false 2023-02-15 20:01:21,167 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=1486d61d8d2fe0efe2a608c7110b6c7d, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,33125,1676491279695; forceNewPlan=false, retain=false 2023-02-15 20:01:21,167 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=2f6827bb8b2d8e3d5d25320352d1e239, ASSIGN 2023-02-15 20:01:21,168 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=2f6827bb8b2d8e3d5d25320352d1e239, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,33019,1676491279655; forceNewPlan=false, retain=false 2023-02-15 20:01:21,315 INFO [jenkins-hbase4:36865] balancer.BaseLoadBalancer(1545): Reassigned 10 regions. 10 retained the pre-restart assignment. 2023-02-15 20:01:21,318 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=97b529ba0e37421e99fb43de9d23d817, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,33125,1676491279695 2023-02-15 20:01:21,319 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=19 updating hbase:meta row=69ce6540f755e21eae3d289ad231610b, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,33125,1676491279695 2023-02-15 20:01:21,318 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=9fdf60e81d6a22352a6acb2fcb8c9f3e, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,33125,1676491279695 2023-02-15 20:01:21,319 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,m\\xED\\xED,1676491281022.97b529ba0e37421e99fb43de9d23d817.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676491281318"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676491281318"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676491281318"}]},"ts":"1676491281318"} 2023-02-15 20:01:21,319 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,wWV,1676491281022.69ce6540f755e21eae3d289ad231610b.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676491281318"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676491281318"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676491281318"}]},"ts":"1676491281318"} 2023-02-15 20:01:21,318 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=1486d61d8d2fe0efe2a608c7110b6c7d, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,33125,1676491279695 2023-02-15 20:01:21,318 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=2241125b7d23be16c4949dc36e627f50, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,33125,1676491279695 2023-02-15 20:01:21,319 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,,1676491281022.9fdf60e81d6a22352a6acb2fcb8c9f3e.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676491281318"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676491281318"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676491281318"}]},"ts":"1676491281318"} 2023-02-15 20:01:21,319 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,zz{,1676491281022.2241125b7d23be16c4949dc36e627f50.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676491281318"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676491281318"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676491281318"}]},"ts":"1676491281318"} 2023-02-15 20:01:21,319 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,j\\xCA\\xCA,1676491281022.1486d61d8d2fe0efe2a608c7110b6c7d.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676491281318"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676491281318"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676491281318"}]},"ts":"1676491281318"} 2023-02-15 20:01:21,321 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=21, ppid=16, state=RUNNABLE; OpenRegionProcedure 97b529ba0e37421e99fb43de9d23d817, server=jenkins-hbase4.apache.org,33125,1676491279695}] 2023-02-15 20:01:21,322 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=22, ppid=19, state=RUNNABLE; OpenRegionProcedure 69ce6540f755e21eae3d289ad231610b, server=jenkins-hbase4.apache.org,33125,1676491279695}] 2023-02-15 20:01:21,323 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=23, ppid=11, state=RUNNABLE; OpenRegionProcedure 9fdf60e81d6a22352a6acb2fcb8c9f3e, server=jenkins-hbase4.apache.org,33125,1676491279695}] 2023-02-15 20:01:21,326 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=24, ppid=20, state=RUNNABLE; OpenRegionProcedure 2241125b7d23be16c4949dc36e627f50, server=jenkins-hbase4.apache.org,33125,1676491279695}] 2023-02-15 20:01:21,327 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=25, ppid=15, state=RUNNABLE; OpenRegionProcedure 1486d61d8d2fe0efe2a608c7110b6c7d, server=jenkins-hbase4.apache.org,33125,1676491279695}] 2023-02-15 20:01:21,327 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=17 updating hbase:meta row=296941d2565b5d20cfd81aec8ac11565, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,33019,1676491279655 2023-02-15 20:01:21,328 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,q\\x11\\x10,1676491281022.296941d2565b5d20cfd81aec8ac11565.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676491281327"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676491281327"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676491281327"}]},"ts":"1676491281327"} 2023-02-15 20:01:21,329 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=18 updating hbase:meta row=bd3ac405f939af16962e576b69a6c71b, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,33019,1676491279655 2023-02-15 20:01:21,329 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,t43,1676491281022.bd3ac405f939af16962e576b69a6c71b.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676491281329"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676491281329"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676491281329"}]},"ts":"1676491281329"} 2023-02-15 20:01:21,329 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=2f6827bb8b2d8e3d5d25320352d1e239, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,33019,1676491279655 2023-02-15 20:01:21,329 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,g\\xA7\\xA7,1676491281022.2f6827bb8b2d8e3d5d25320352d1e239.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676491281329"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676491281329"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676491281329"}]},"ts":"1676491281329"} 2023-02-15 20:01:21,332 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=26, ppid=17, state=RUNNABLE; OpenRegionProcedure 296941d2565b5d20cfd81aec8ac11565, server=jenkins-hbase4.apache.org,33019,1676491279655}] 2023-02-15 20:01:21,332 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36865] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-15 20:01:21,333 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=12 updating hbase:meta row=dae437d89db301633beda20a6a7029ef, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,33019,1676491279655 2023-02-15 20:01:21,333 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=27, ppid=18, state=RUNNABLE; OpenRegionProcedure bd3ac405f939af16962e576b69a6c71b, server=jenkins-hbase4.apache.org,33019,1676491279655}] 2023-02-15 20:01:21,333 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,aaa,1676491281022.dae437d89db301633beda20a6a7029ef.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676491281333"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676491281333"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676491281333"}]},"ts":"1676491281333"} 2023-02-15 20:01:21,334 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=28, ppid=14, state=RUNNABLE; OpenRegionProcedure 2f6827bb8b2d8e3d5d25320352d1e239, server=jenkins-hbase4.apache.org,33019,1676491279655}] 2023-02-15 20:01:21,334 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=2a1c7014d8c6c818f8ea2f67ef6b2118, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,33019,1676491279655 2023-02-15 20:01:21,335 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,d\\x84\\x84,1676491281022.2a1c7014d8c6c818f8ea2f67ef6b2118.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676491281334"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676491281334"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676491281334"}]},"ts":"1676491281334"} 2023-02-15 20:01:21,335 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=29, ppid=12, state=RUNNABLE; OpenRegionProcedure dae437d89db301633beda20a6a7029ef, server=jenkins-hbase4.apache.org,33019,1676491279655}] 2023-02-15 20:01:21,337 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=30, ppid=13, state=RUNNABLE; OpenRegionProcedure 2a1c7014d8c6c818f8ea2f67ef6b2118, server=jenkins-hbase4.apache.org,33019,1676491279655}] 2023-02-15 20:01:21,478 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,,1676491281022.9fdf60e81d6a22352a6acb2fcb8c9f3e. 2023-02-15 20:01:21,478 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 9fdf60e81d6a22352a6acb2fcb8c9f3e, NAME => 'testWithMapReduce,,1676491281022.9fdf60e81d6a22352a6acb2fcb8c9f3e.', STARTKEY => '', ENDKEY => 'aaa'} 2023-02-15 20:01:21,479 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 9fdf60e81d6a22352a6acb2fcb8c9f3e 2023-02-15 20:01:21,479 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676491281022.9fdf60e81d6a22352a6acb2fcb8c9f3e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 20:01:21,479 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 9fdf60e81d6a22352a6acb2fcb8c9f3e 2023-02-15 20:01:21,479 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 9fdf60e81d6a22352a6acb2fcb8c9f3e 2023-02-15 20:01:21,480 INFO [StoreOpener-9fdf60e81d6a22352a6acb2fcb8c9f3e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 9fdf60e81d6a22352a6acb2fcb8c9f3e 2023-02-15 20:01:21,481 DEBUG [StoreOpener-9fdf60e81d6a22352a6acb2fcb8c9f3e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/data/default/testWithMapReduce/9fdf60e81d6a22352a6acb2fcb8c9f3e/f1 2023-02-15 20:01:21,481 DEBUG [StoreOpener-9fdf60e81d6a22352a6acb2fcb8c9f3e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/data/default/testWithMapReduce/9fdf60e81d6a22352a6acb2fcb8c9f3e/f1 2023-02-15 20:01:21,482 INFO [StoreOpener-9fdf60e81d6a22352a6acb2fcb8c9f3e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9fdf60e81d6a22352a6acb2fcb8c9f3e columnFamilyName f1 2023-02-15 20:01:21,482 INFO [StoreOpener-9fdf60e81d6a22352a6acb2fcb8c9f3e-1] regionserver.HStore(310): Store=9fdf60e81d6a22352a6acb2fcb8c9f3e/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 20:01:21,482 INFO [StoreOpener-9fdf60e81d6a22352a6acb2fcb8c9f3e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 9fdf60e81d6a22352a6acb2fcb8c9f3e 2023-02-15 20:01:21,484 DEBUG [StoreOpener-9fdf60e81d6a22352a6acb2fcb8c9f3e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/data/default/testWithMapReduce/9fdf60e81d6a22352a6acb2fcb8c9f3e/f2 2023-02-15 20:01:21,484 DEBUG [StoreOpener-9fdf60e81d6a22352a6acb2fcb8c9f3e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/data/default/testWithMapReduce/9fdf60e81d6a22352a6acb2fcb8c9f3e/f2 2023-02-15 20:01:21,484 INFO [StoreOpener-9fdf60e81d6a22352a6acb2fcb8c9f3e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9fdf60e81d6a22352a6acb2fcb8c9f3e columnFamilyName f2 2023-02-15 20:01:21,484 INFO [StoreOpener-9fdf60e81d6a22352a6acb2fcb8c9f3e-1] regionserver.HStore(310): Store=9fdf60e81d6a22352a6acb2fcb8c9f3e/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 20:01:21,485 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/data/default/testWithMapReduce/9fdf60e81d6a22352a6acb2fcb8c9f3e 2023-02-15 20:01:21,486 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/data/default/testWithMapReduce/9fdf60e81d6a22352a6acb2fcb8c9f3e 2023-02-15 20:01:21,487 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,d\x84\x84,1676491281022.2a1c7014d8c6c818f8ea2f67ef6b2118. 2023-02-15 20:01:21,487 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 2a1c7014d8c6c818f8ea2f67ef6b2118, NAME => 'testWithMapReduce,d\x84\x84,1676491281022.2a1c7014d8c6c818f8ea2f67ef6b2118.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'} 2023-02-15 20:01:21,487 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-15 20:01:21,488 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 2a1c7014d8c6c818f8ea2f67ef6b2118 2023-02-15 20:01:21,488 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,d\x84\x84,1676491281022.2a1c7014d8c6c818f8ea2f67ef6b2118.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 20:01:21,488 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 2a1c7014d8c6c818f8ea2f67ef6b2118 2023-02-15 20:01:21,488 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 2a1c7014d8c6c818f8ea2f67ef6b2118 2023-02-15 20:01:21,489 INFO [StoreOpener-2a1c7014d8c6c818f8ea2f67ef6b2118-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 2a1c7014d8c6c818f8ea2f67ef6b2118 2023-02-15 20:01:21,489 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 9fdf60e81d6a22352a6acb2fcb8c9f3e 2023-02-15 20:01:21,490 DEBUG [StoreOpener-2a1c7014d8c6c818f8ea2f67ef6b2118-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/data/default/testWithMapReduce/2a1c7014d8c6c818f8ea2f67ef6b2118/f1 2023-02-15 20:01:21,490 DEBUG [StoreOpener-2a1c7014d8c6c818f8ea2f67ef6b2118-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/data/default/testWithMapReduce/2a1c7014d8c6c818f8ea2f67ef6b2118/f1 2023-02-15 20:01:21,490 INFO [StoreOpener-2a1c7014d8c6c818f8ea2f67ef6b2118-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2a1c7014d8c6c818f8ea2f67ef6b2118 columnFamilyName f1 2023-02-15 20:01:21,492 INFO [StoreOpener-2a1c7014d8c6c818f8ea2f67ef6b2118-1] regionserver.HStore(310): Store=2a1c7014d8c6c818f8ea2f67ef6b2118/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 20:01:21,492 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/data/default/testWithMapReduce/9fdf60e81d6a22352a6acb2fcb8c9f3e/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-15 20:01:21,492 INFO [StoreOpener-2a1c7014d8c6c818f8ea2f67ef6b2118-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 2a1c7014d8c6c818f8ea2f67ef6b2118 2023-02-15 20:01:21,492 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 9fdf60e81d6a22352a6acb2fcb8c9f3e; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=58871635, jitterRate=-0.12274427711963654}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-15 20:01:21,492 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 9fdf60e81d6a22352a6acb2fcb8c9f3e: 2023-02-15 20:01:21,493 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,,1676491281022.9fdf60e81d6a22352a6acb2fcb8c9f3e., pid=23, masterSystemTime=1676491281474 2023-02-15 20:01:21,493 DEBUG [StoreOpener-2a1c7014d8c6c818f8ea2f67ef6b2118-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/data/default/testWithMapReduce/2a1c7014d8c6c818f8ea2f67ef6b2118/f2 2023-02-15 20:01:21,493 DEBUG [StoreOpener-2a1c7014d8c6c818f8ea2f67ef6b2118-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/data/default/testWithMapReduce/2a1c7014d8c6c818f8ea2f67ef6b2118/f2 2023-02-15 20:01:21,494 INFO [StoreOpener-2a1c7014d8c6c818f8ea2f67ef6b2118-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2a1c7014d8c6c818f8ea2f67ef6b2118 columnFamilyName f2 2023-02-15 20:01:21,494 INFO [StoreOpener-2a1c7014d8c6c818f8ea2f67ef6b2118-1] regionserver.HStore(310): Store=2a1c7014d8c6c818f8ea2f67ef6b2118/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 20:01:21,495 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,,1676491281022.9fdf60e81d6a22352a6acb2fcb8c9f3e. 2023-02-15 20:01:21,495 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,,1676491281022.9fdf60e81d6a22352a6acb2fcb8c9f3e. 2023-02-15 20:01:21,495 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,wWV,1676491281022.69ce6540f755e21eae3d289ad231610b. 2023-02-15 20:01:21,495 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 69ce6540f755e21eae3d289ad231610b, NAME => 'testWithMapReduce,wWV,1676491281022.69ce6540f755e21eae3d289ad231610b.', STARTKEY => 'wWV', ENDKEY => 'zz{'} 2023-02-15 20:01:21,496 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 69ce6540f755e21eae3d289ad231610b 2023-02-15 20:01:21,496 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=9fdf60e81d6a22352a6acb2fcb8c9f3e, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,33125,1676491279695 2023-02-15 20:01:21,496 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,wWV,1676491281022.69ce6540f755e21eae3d289ad231610b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 20:01:21,496 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 69ce6540f755e21eae3d289ad231610b 2023-02-15 20:01:21,496 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 69ce6540f755e21eae3d289ad231610b 2023-02-15 20:01:21,496 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,,1676491281022.9fdf60e81d6a22352a6acb2fcb8c9f3e.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676491281495"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676491281495"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676491281495"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676491281495"}]},"ts":"1676491281495"} 2023-02-15 20:01:21,496 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/data/default/testWithMapReduce/2a1c7014d8c6c818f8ea2f67ef6b2118 2023-02-15 20:01:21,497 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/data/default/testWithMapReduce/2a1c7014d8c6c818f8ea2f67ef6b2118 2023-02-15 20:01:21,497 INFO [StoreOpener-69ce6540f755e21eae3d289ad231610b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 69ce6540f755e21eae3d289ad231610b 2023-02-15 20:01:21,498 DEBUG [StoreOpener-69ce6540f755e21eae3d289ad231610b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/data/default/testWithMapReduce/69ce6540f755e21eae3d289ad231610b/f1 2023-02-15 20:01:21,499 DEBUG [StoreOpener-69ce6540f755e21eae3d289ad231610b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/data/default/testWithMapReduce/69ce6540f755e21eae3d289ad231610b/f1 2023-02-15 20:01:21,499 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-15 20:01:21,499 INFO [StoreOpener-69ce6540f755e21eae3d289ad231610b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 69ce6540f755e21eae3d289ad231610b columnFamilyName f1 2023-02-15 20:01:21,499 INFO [StoreOpener-69ce6540f755e21eae3d289ad231610b-1] regionserver.HStore(310): Store=69ce6540f755e21eae3d289ad231610b/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 20:01:21,499 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=23, resume processing ppid=11 2023-02-15 20:01:21,500 INFO [StoreOpener-69ce6540f755e21eae3d289ad231610b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 69ce6540f755e21eae3d289ad231610b 2023-02-15 20:01:21,500 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=23, ppid=11, state=SUCCESS; OpenRegionProcedure 9fdf60e81d6a22352a6acb2fcb8c9f3e, server=jenkins-hbase4.apache.org,33125,1676491279695 in 175 msec 2023-02-15 20:01:21,500 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 2a1c7014d8c6c818f8ea2f67ef6b2118 2023-02-15 20:01:21,501 DEBUG [StoreOpener-69ce6540f755e21eae3d289ad231610b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/data/default/testWithMapReduce/69ce6540f755e21eae3d289ad231610b/f2 2023-02-15 20:01:21,501 DEBUG [StoreOpener-69ce6540f755e21eae3d289ad231610b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/data/default/testWithMapReduce/69ce6540f755e21eae3d289ad231610b/f2 2023-02-15 20:01:21,501 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=9fdf60e81d6a22352a6acb2fcb8c9f3e, ASSIGN in 340 msec 2023-02-15 20:01:21,501 INFO [StoreOpener-69ce6540f755e21eae3d289ad231610b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 69ce6540f755e21eae3d289ad231610b columnFamilyName f2 2023-02-15 20:01:21,502 INFO [StoreOpener-69ce6540f755e21eae3d289ad231610b-1] regionserver.HStore(310): Store=69ce6540f755e21eae3d289ad231610b/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 20:01:21,503 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/data/default/testWithMapReduce/69ce6540f755e21eae3d289ad231610b 2023-02-15 20:01:21,503 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/data/default/testWithMapReduce/69ce6540f755e21eae3d289ad231610b 2023-02-15 20:01:21,503 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/data/default/testWithMapReduce/2a1c7014d8c6c818f8ea2f67ef6b2118/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-15 20:01:21,504 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 2a1c7014d8c6c818f8ea2f67ef6b2118; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66588007, jitterRate=-0.007761374115943909}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-15 20:01:21,504 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 2a1c7014d8c6c818f8ea2f67ef6b2118: 2023-02-15 20:01:21,504 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,d\x84\x84,1676491281022.2a1c7014d8c6c818f8ea2f67ef6b2118., pid=30, masterSystemTime=1676491281484 2023-02-15 20:01:21,505 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-15 20:01:21,506 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,d\x84\x84,1676491281022.2a1c7014d8c6c818f8ea2f67ef6b2118. 2023-02-15 20:01:21,506 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,d\x84\x84,1676491281022.2a1c7014d8c6c818f8ea2f67ef6b2118. 2023-02-15 20:01:21,506 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,q\x11\x10,1676491281022.296941d2565b5d20cfd81aec8ac11565. 2023-02-15 20:01:21,506 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 296941d2565b5d20cfd81aec8ac11565, NAME => 'testWithMapReduce,q\x11\x10,1676491281022.296941d2565b5d20cfd81aec8ac11565.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'} 2023-02-15 20:01:21,506 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 69ce6540f755e21eae3d289ad231610b 2023-02-15 20:01:21,506 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=2a1c7014d8c6c818f8ea2f67ef6b2118, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,33019,1676491279655 2023-02-15 20:01:21,506 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 296941d2565b5d20cfd81aec8ac11565 2023-02-15 20:01:21,506 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,d\\x84\\x84,1676491281022.2a1c7014d8c6c818f8ea2f67ef6b2118.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676491281506"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676491281506"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676491281506"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676491281506"}]},"ts":"1676491281506"} 2023-02-15 20:01:21,506 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,q\x11\x10,1676491281022.296941d2565b5d20cfd81aec8ac11565.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 20:01:21,506 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 296941d2565b5d20cfd81aec8ac11565 2023-02-15 20:01:21,506 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 296941d2565b5d20cfd81aec8ac11565 2023-02-15 20:01:21,508 INFO [StoreOpener-296941d2565b5d20cfd81aec8ac11565-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 296941d2565b5d20cfd81aec8ac11565 2023-02-15 20:01:21,508 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/data/default/testWithMapReduce/69ce6540f755e21eae3d289ad231610b/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-15 20:01:21,509 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 69ce6540f755e21eae3d289ad231610b; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65271152, jitterRate=-0.027384042739868164}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-15 20:01:21,509 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 69ce6540f755e21eae3d289ad231610b: 2023-02-15 20:01:21,509 DEBUG [StoreOpener-296941d2565b5d20cfd81aec8ac11565-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/data/default/testWithMapReduce/296941d2565b5d20cfd81aec8ac11565/f1 2023-02-15 20:01:21,509 DEBUG [StoreOpener-296941d2565b5d20cfd81aec8ac11565-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/data/default/testWithMapReduce/296941d2565b5d20cfd81aec8ac11565/f1 2023-02-15 20:01:21,510 INFO [StoreOpener-296941d2565b5d20cfd81aec8ac11565-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 296941d2565b5d20cfd81aec8ac11565 columnFamilyName f1 2023-02-15 20:01:21,510 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,wWV,1676491281022.69ce6540f755e21eae3d289ad231610b., pid=22, masterSystemTime=1676491281474 2023-02-15 20:01:21,510 INFO [StoreOpener-296941d2565b5d20cfd81aec8ac11565-1] regionserver.HStore(310): Store=296941d2565b5d20cfd81aec8ac11565/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 20:01:21,510 INFO [StoreOpener-296941d2565b5d20cfd81aec8ac11565-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 296941d2565b5d20cfd81aec8ac11565 2023-02-15 20:01:21,511 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=30, resume processing ppid=13 2023-02-15 20:01:21,511 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=30, ppid=13, state=SUCCESS; OpenRegionProcedure 2a1c7014d8c6c818f8ea2f67ef6b2118, server=jenkins-hbase4.apache.org,33019,1676491279655 in 172 msec 2023-02-15 20:01:21,512 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,wWV,1676491281022.69ce6540f755e21eae3d289ad231610b. 2023-02-15 20:01:21,512 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,wWV,1676491281022.69ce6540f755e21eae3d289ad231610b. 2023-02-15 20:01:21,512 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,m\xED\xED,1676491281022.97b529ba0e37421e99fb43de9d23d817. 2023-02-15 20:01:21,512 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 97b529ba0e37421e99fb43de9d23d817, NAME => 'testWithMapReduce,m\xED\xED,1676491281022.97b529ba0e37421e99fb43de9d23d817.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'} 2023-02-15 20:01:21,512 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=13, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=2a1c7014d8c6c818f8ea2f67ef6b2118, ASSIGN in 351 msec 2023-02-15 20:01:21,512 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 97b529ba0e37421e99fb43de9d23d817 2023-02-15 20:01:21,512 DEBUG [StoreOpener-296941d2565b5d20cfd81aec8ac11565-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/data/default/testWithMapReduce/296941d2565b5d20cfd81aec8ac11565/f2 2023-02-15 20:01:21,512 DEBUG [StoreOpener-296941d2565b5d20cfd81aec8ac11565-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/data/default/testWithMapReduce/296941d2565b5d20cfd81aec8ac11565/f2 2023-02-15 20:01:21,512 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=19 updating hbase:meta row=69ce6540f755e21eae3d289ad231610b, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,33125,1676491279695 2023-02-15 20:01:21,512 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,m\xED\xED,1676491281022.97b529ba0e37421e99fb43de9d23d817.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 20:01:21,513 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 97b529ba0e37421e99fb43de9d23d817 2023-02-15 20:01:21,513 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 97b529ba0e37421e99fb43de9d23d817 2023-02-15 20:01:21,513 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,wWV,1676491281022.69ce6540f755e21eae3d289ad231610b.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676491281512"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676491281512"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676491281512"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676491281512"}]},"ts":"1676491281512"} 2023-02-15 20:01:21,513 INFO [StoreOpener-296941d2565b5d20cfd81aec8ac11565-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 296941d2565b5d20cfd81aec8ac11565 columnFamilyName f2 2023-02-15 20:01:21,513 INFO [StoreOpener-296941d2565b5d20cfd81aec8ac11565-1] regionserver.HStore(310): Store=296941d2565b5d20cfd81aec8ac11565/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 20:01:21,514 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/data/default/testWithMapReduce/296941d2565b5d20cfd81aec8ac11565 2023-02-15 20:01:21,515 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/data/default/testWithMapReduce/296941d2565b5d20cfd81aec8ac11565 2023-02-15 20:01:21,515 INFO [StoreOpener-97b529ba0e37421e99fb43de9d23d817-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 97b529ba0e37421e99fb43de9d23d817 2023-02-15 20:01:21,516 DEBUG [StoreOpener-97b529ba0e37421e99fb43de9d23d817-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/data/default/testWithMapReduce/97b529ba0e37421e99fb43de9d23d817/f1 2023-02-15 20:01:21,516 DEBUG [StoreOpener-97b529ba0e37421e99fb43de9d23d817-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/data/default/testWithMapReduce/97b529ba0e37421e99fb43de9d23d817/f1 2023-02-15 20:01:21,516 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=22, resume processing ppid=19 2023-02-15 20:01:21,516 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=22, ppid=19, state=SUCCESS; OpenRegionProcedure 69ce6540f755e21eae3d289ad231610b, server=jenkins-hbase4.apache.org,33125,1676491279695 in 192 msec 2023-02-15 20:01:21,516 INFO [StoreOpener-97b529ba0e37421e99fb43de9d23d817-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 97b529ba0e37421e99fb43de9d23d817 columnFamilyName f1 2023-02-15 20:01:21,517 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-15 20:01:21,517 INFO [StoreOpener-97b529ba0e37421e99fb43de9d23d817-1] regionserver.HStore(310): Store=97b529ba0e37421e99fb43de9d23d817/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 20:01:21,517 INFO [StoreOpener-97b529ba0e37421e99fb43de9d23d817-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 97b529ba0e37421e99fb43de9d23d817 2023-02-15 20:01:21,518 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=19, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=69ce6540f755e21eae3d289ad231610b, ASSIGN in 356 msec 2023-02-15 20:01:21,518 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 296941d2565b5d20cfd81aec8ac11565 2023-02-15 20:01:21,518 DEBUG [StoreOpener-97b529ba0e37421e99fb43de9d23d817-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/data/default/testWithMapReduce/97b529ba0e37421e99fb43de9d23d817/f2 2023-02-15 20:01:21,518 DEBUG [StoreOpener-97b529ba0e37421e99fb43de9d23d817-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/data/default/testWithMapReduce/97b529ba0e37421e99fb43de9d23d817/f2 2023-02-15 20:01:21,519 INFO [StoreOpener-97b529ba0e37421e99fb43de9d23d817-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 97b529ba0e37421e99fb43de9d23d817 columnFamilyName f2 2023-02-15 20:01:21,519 INFO [StoreOpener-97b529ba0e37421e99fb43de9d23d817-1] regionserver.HStore(310): Store=97b529ba0e37421e99fb43de9d23d817/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 20:01:21,520 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/data/default/testWithMapReduce/97b529ba0e37421e99fb43de9d23d817 2023-02-15 20:01:21,520 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/data/default/testWithMapReduce/296941d2565b5d20cfd81aec8ac11565/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-15 20:01:21,520 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/data/default/testWithMapReduce/97b529ba0e37421e99fb43de9d23d817 2023-02-15 20:01:21,521 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 296941d2565b5d20cfd81aec8ac11565; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70412307, jitterRate=0.04922513663768768}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-15 20:01:21,521 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 296941d2565b5d20cfd81aec8ac11565: 2023-02-15 20:01:21,521 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,q\x11\x10,1676491281022.296941d2565b5d20cfd81aec8ac11565., pid=26, masterSystemTime=1676491281484 2023-02-15 20:01:21,522 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-15 20:01:21,523 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,q\x11\x10,1676491281022.296941d2565b5d20cfd81aec8ac11565. 2023-02-15 20:01:21,523 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,q\x11\x10,1676491281022.296941d2565b5d20cfd81aec8ac11565. 2023-02-15 20:01:21,523 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,g\xA7\xA7,1676491281022.2f6827bb8b2d8e3d5d25320352d1e239. 2023-02-15 20:01:21,523 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 2f6827bb8b2d8e3d5d25320352d1e239, NAME => 'testWithMapReduce,g\xA7\xA7,1676491281022.2f6827bb8b2d8e3d5d25320352d1e239.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'} 2023-02-15 20:01:21,523 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 2f6827bb8b2d8e3d5d25320352d1e239 2023-02-15 20:01:21,523 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=17 updating hbase:meta row=296941d2565b5d20cfd81aec8ac11565, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,33019,1676491279655 2023-02-15 20:01:21,523 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,g\xA7\xA7,1676491281022.2f6827bb8b2d8e3d5d25320352d1e239.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 20:01:21,523 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 2f6827bb8b2d8e3d5d25320352d1e239 2023-02-15 20:01:21,523 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,q\\x11\\x10,1676491281022.296941d2565b5d20cfd81aec8ac11565.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676491281523"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676491281523"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676491281523"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676491281523"}]},"ts":"1676491281523"} 2023-02-15 20:01:21,523 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 2f6827bb8b2d8e3d5d25320352d1e239 2023-02-15 20:01:21,524 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 97b529ba0e37421e99fb43de9d23d817 2023-02-15 20:01:21,525 INFO [StoreOpener-2f6827bb8b2d8e3d5d25320352d1e239-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 2f6827bb8b2d8e3d5d25320352d1e239 2023-02-15 20:01:21,526 DEBUG [StoreOpener-2f6827bb8b2d8e3d5d25320352d1e239-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/data/default/testWithMapReduce/2f6827bb8b2d8e3d5d25320352d1e239/f1 2023-02-15 20:01:21,526 DEBUG [StoreOpener-2f6827bb8b2d8e3d5d25320352d1e239-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/data/default/testWithMapReduce/2f6827bb8b2d8e3d5d25320352d1e239/f1 2023-02-15 20:01:21,526 INFO [StoreOpener-2f6827bb8b2d8e3d5d25320352d1e239-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2f6827bb8b2d8e3d5d25320352d1e239 columnFamilyName f1 2023-02-15 20:01:21,526 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/data/default/testWithMapReduce/97b529ba0e37421e99fb43de9d23d817/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-15 20:01:21,527 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=26, resume processing ppid=17 2023-02-15 20:01:21,527 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=26, ppid=17, state=SUCCESS; OpenRegionProcedure 296941d2565b5d20cfd81aec8ac11565, server=jenkins-hbase4.apache.org,33019,1676491279655 in 195 msec 2023-02-15 20:01:21,527 INFO [StoreOpener-2f6827bb8b2d8e3d5d25320352d1e239-1] regionserver.HStore(310): Store=2f6827bb8b2d8e3d5d25320352d1e239/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 20:01:21,527 INFO [StoreOpener-2f6827bb8b2d8e3d5d25320352d1e239-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 2f6827bb8b2d8e3d5d25320352d1e239 2023-02-15 20:01:21,527 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 97b529ba0e37421e99fb43de9d23d817; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74879217, jitterRate=0.11578728258609772}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-15 20:01:21,527 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 97b529ba0e37421e99fb43de9d23d817: 2023-02-15 20:01:21,528 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,m\xED\xED,1676491281022.97b529ba0e37421e99fb43de9d23d817., pid=21, masterSystemTime=1676491281474 2023-02-15 20:01:21,528 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=296941d2565b5d20cfd81aec8ac11565, ASSIGN in 367 msec 2023-02-15 20:01:21,528 DEBUG [StoreOpener-2f6827bb8b2d8e3d5d25320352d1e239-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/data/default/testWithMapReduce/2f6827bb8b2d8e3d5d25320352d1e239/f2 2023-02-15 20:01:21,528 DEBUG [StoreOpener-2f6827bb8b2d8e3d5d25320352d1e239-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/data/default/testWithMapReduce/2f6827bb8b2d8e3d5d25320352d1e239/f2 2023-02-15 20:01:21,529 INFO [StoreOpener-2f6827bb8b2d8e3d5d25320352d1e239-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2f6827bb8b2d8e3d5d25320352d1e239 columnFamilyName f2 2023-02-15 20:01:21,529 INFO [StoreOpener-2f6827bb8b2d8e3d5d25320352d1e239-1] regionserver.HStore(310): Store=2f6827bb8b2d8e3d5d25320352d1e239/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 20:01:21,529 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,m\xED\xED,1676491281022.97b529ba0e37421e99fb43de9d23d817. 2023-02-15 20:01:21,529 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,m\xED\xED,1676491281022.97b529ba0e37421e99fb43de9d23d817. 2023-02-15 20:01:21,530 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,j\xCA\xCA,1676491281022.1486d61d8d2fe0efe2a608c7110b6c7d. 2023-02-15 20:01:21,530 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1486d61d8d2fe0efe2a608c7110b6c7d, NAME => 'testWithMapReduce,j\xCA\xCA,1676491281022.1486d61d8d2fe0efe2a608c7110b6c7d.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'} 2023-02-15 20:01:21,530 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=97b529ba0e37421e99fb43de9d23d817, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,33125,1676491279695 2023-02-15 20:01:21,530 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 1486d61d8d2fe0efe2a608c7110b6c7d 2023-02-15 20:01:21,530 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/data/default/testWithMapReduce/2f6827bb8b2d8e3d5d25320352d1e239 2023-02-15 20:01:21,530 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,m\\xED\\xED,1676491281022.97b529ba0e37421e99fb43de9d23d817.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676491281530"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676491281530"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676491281530"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676491281530"}]},"ts":"1676491281530"} 2023-02-15 20:01:21,530 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,j\xCA\xCA,1676491281022.1486d61d8d2fe0efe2a608c7110b6c7d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 20:01:21,530 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 1486d61d8d2fe0efe2a608c7110b6c7d 2023-02-15 20:01:21,530 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 1486d61d8d2fe0efe2a608c7110b6c7d 2023-02-15 20:01:21,530 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/data/default/testWithMapReduce/2f6827bb8b2d8e3d5d25320352d1e239 2023-02-15 20:01:21,531 INFO [StoreOpener-1486d61d8d2fe0efe2a608c7110b6c7d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 1486d61d8d2fe0efe2a608c7110b6c7d 2023-02-15 20:01:21,533 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-15 20:01:21,533 DEBUG [StoreOpener-1486d61d8d2fe0efe2a608c7110b6c7d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/data/default/testWithMapReduce/1486d61d8d2fe0efe2a608c7110b6c7d/f1 2023-02-15 20:01:21,533 DEBUG [StoreOpener-1486d61d8d2fe0efe2a608c7110b6c7d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/data/default/testWithMapReduce/1486d61d8d2fe0efe2a608c7110b6c7d/f1 2023-02-15 20:01:21,533 INFO [StoreOpener-1486d61d8d2fe0efe2a608c7110b6c7d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1486d61d8d2fe0efe2a608c7110b6c7d columnFamilyName f1 2023-02-15 20:01:21,534 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 2f6827bb8b2d8e3d5d25320352d1e239 2023-02-15 20:01:21,534 INFO [StoreOpener-1486d61d8d2fe0efe2a608c7110b6c7d-1] regionserver.HStore(310): Store=1486d61d8d2fe0efe2a608c7110b6c7d/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 20:01:21,534 INFO [StoreOpener-1486d61d8d2fe0efe2a608c7110b6c7d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 1486d61d8d2fe0efe2a608c7110b6c7d 2023-02-15 20:01:21,534 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=21, resume processing ppid=16 2023-02-15 20:01:21,535 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=21, ppid=16, state=SUCCESS; OpenRegionProcedure 97b529ba0e37421e99fb43de9d23d817, server=jenkins-hbase4.apache.org,33125,1676491279695 in 210 msec 2023-02-15 20:01:21,536 DEBUG [StoreOpener-1486d61d8d2fe0efe2a608c7110b6c7d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/data/default/testWithMapReduce/1486d61d8d2fe0efe2a608c7110b6c7d/f2 2023-02-15 20:01:21,536 DEBUG [StoreOpener-1486d61d8d2fe0efe2a608c7110b6c7d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/data/default/testWithMapReduce/1486d61d8d2fe0efe2a608c7110b6c7d/f2 2023-02-15 20:01:21,536 INFO [StoreOpener-1486d61d8d2fe0efe2a608c7110b6c7d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1486d61d8d2fe0efe2a608c7110b6c7d columnFamilyName f2 2023-02-15 20:01:21,536 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/data/default/testWithMapReduce/2f6827bb8b2d8e3d5d25320352d1e239/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-15 20:01:21,537 INFO [StoreOpener-1486d61d8d2fe0efe2a608c7110b6c7d-1] regionserver.HStore(310): Store=1486d61d8d2fe0efe2a608c7110b6c7d/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 20:01:21,537 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 2f6827bb8b2d8e3d5d25320352d1e239; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70710476, jitterRate=0.053668200969696045}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-15 20:01:21,537 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 2f6827bb8b2d8e3d5d25320352d1e239: 2023-02-15 20:01:21,537 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/data/default/testWithMapReduce/1486d61d8d2fe0efe2a608c7110b6c7d 2023-02-15 20:01:21,538 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/data/default/testWithMapReduce/1486d61d8d2fe0efe2a608c7110b6c7d 2023-02-15 20:01:21,539 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-15 20:01:21,540 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 1486d61d8d2fe0efe2a608c7110b6c7d 2023-02-15 20:01:21,543 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/data/default/testWithMapReduce/1486d61d8d2fe0efe2a608c7110b6c7d/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-15 20:01:21,543 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=97b529ba0e37421e99fb43de9d23d817, ASSIGN in 374 msec 2023-02-15 20:01:21,543 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 1486d61d8d2fe0efe2a608c7110b6c7d; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69819718, jitterRate=0.040394872426986694}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-15 20:01:21,543 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 1486d61d8d2fe0efe2a608c7110b6c7d: 2023-02-15 20:01:21,544 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,g\xA7\xA7,1676491281022.2f6827bb8b2d8e3d5d25320352d1e239., pid=28, masterSystemTime=1676491281484 2023-02-15 20:01:21,544 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,j\xCA\xCA,1676491281022.1486d61d8d2fe0efe2a608c7110b6c7d., pid=25, masterSystemTime=1676491281474 2023-02-15 20:01:21,546 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,g\xA7\xA7,1676491281022.2f6827bb8b2d8e3d5d25320352d1e239. 2023-02-15 20:01:21,546 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,g\xA7\xA7,1676491281022.2f6827bb8b2d8e3d5d25320352d1e239. 2023-02-15 20:01:21,546 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=2f6827bb8b2d8e3d5d25320352d1e239, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,33019,1676491279655 2023-02-15 20:01:21,546 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,aaa,1676491281022.dae437d89db301633beda20a6a7029ef. 2023-02-15 20:01:21,546 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,j\xCA\xCA,1676491281022.1486d61d8d2fe0efe2a608c7110b6c7d. 2023-02-15 20:01:21,546 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,g\\xA7\\xA7,1676491281022.2f6827bb8b2d8e3d5d25320352d1e239.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676491281546"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676491281546"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676491281546"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676491281546"}]},"ts":"1676491281546"} 2023-02-15 20:01:21,547 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => dae437d89db301633beda20a6a7029ef, NAME => 'testWithMapReduce,aaa,1676491281022.dae437d89db301633beda20a6a7029ef.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'} 2023-02-15 20:01:21,547 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=1486d61d8d2fe0efe2a608c7110b6c7d, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,33125,1676491279695 2023-02-15 20:01:21,547 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,j\xCA\xCA,1676491281022.1486d61d8d2fe0efe2a608c7110b6c7d. 2023-02-15 20:01:21,547 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,j\\xCA\\xCA,1676491281022.1486d61d8d2fe0efe2a608c7110b6c7d.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676491281547"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676491281547"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676491281547"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676491281547"}]},"ts":"1676491281547"} 2023-02-15 20:01:21,547 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce dae437d89db301633beda20a6a7029ef 2023-02-15 20:01:21,547 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,zz{,1676491281022.2241125b7d23be16c4949dc36e627f50. 2023-02-15 20:01:21,547 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,aaa,1676491281022.dae437d89db301633beda20a6a7029ef.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 20:01:21,547 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 2241125b7d23be16c4949dc36e627f50, NAME => 'testWithMapReduce,zz{,1676491281022.2241125b7d23be16c4949dc36e627f50.', STARTKEY => 'zz{', ENDKEY => ''} 2023-02-15 20:01:21,547 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for dae437d89db301633beda20a6a7029ef 2023-02-15 20:01:21,548 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for dae437d89db301633beda20a6a7029ef 2023-02-15 20:01:21,548 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 2241125b7d23be16c4949dc36e627f50 2023-02-15 20:01:21,548 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,zz{,1676491281022.2241125b7d23be16c4949dc36e627f50.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 20:01:21,548 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 2241125b7d23be16c4949dc36e627f50 2023-02-15 20:01:21,548 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 2241125b7d23be16c4949dc36e627f50 2023-02-15 20:01:21,549 INFO [StoreOpener-dae437d89db301633beda20a6a7029ef-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region dae437d89db301633beda20a6a7029ef 2023-02-15 20:01:21,552 INFO [StoreOpener-2241125b7d23be16c4949dc36e627f50-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 2241125b7d23be16c4949dc36e627f50 2023-02-15 20:01:21,552 DEBUG [StoreOpener-dae437d89db301633beda20a6a7029ef-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/data/default/testWithMapReduce/dae437d89db301633beda20a6a7029ef/f1 2023-02-15 20:01:21,552 DEBUG [StoreOpener-dae437d89db301633beda20a6a7029ef-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/data/default/testWithMapReduce/dae437d89db301633beda20a6a7029ef/f1 2023-02-15 20:01:21,553 INFO [StoreOpener-dae437d89db301633beda20a6a7029ef-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region dae437d89db301633beda20a6a7029ef columnFamilyName f1 2023-02-15 20:01:21,553 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=28, resume processing ppid=14 2023-02-15 20:01:21,553 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=28, ppid=14, state=SUCCESS; OpenRegionProcedure 2f6827bb8b2d8e3d5d25320352d1e239, server=jenkins-hbase4.apache.org,33019,1676491279655 in 217 msec 2023-02-15 20:01:21,554 INFO [StoreOpener-dae437d89db301633beda20a6a7029ef-1] regionserver.HStore(310): Store=dae437d89db301633beda20a6a7029ef/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 20:01:21,554 INFO [StoreOpener-dae437d89db301633beda20a6a7029ef-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region dae437d89db301633beda20a6a7029ef 2023-02-15 20:01:21,554 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=25, resume processing ppid=15 2023-02-15 20:01:21,555 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=25, ppid=15, state=SUCCESS; OpenRegionProcedure 1486d61d8d2fe0efe2a608c7110b6c7d, server=jenkins-hbase4.apache.org,33125,1676491279695 in 225 msec 2023-02-15 20:01:21,555 DEBUG [StoreOpener-2241125b7d23be16c4949dc36e627f50-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/data/default/testWithMapReduce/2241125b7d23be16c4949dc36e627f50/f1 2023-02-15 20:01:21,555 DEBUG [StoreOpener-2241125b7d23be16c4949dc36e627f50-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/data/default/testWithMapReduce/2241125b7d23be16c4949dc36e627f50/f1 2023-02-15 20:01:21,555 INFO [StoreOpener-2241125b7d23be16c4949dc36e627f50-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2241125b7d23be16c4949dc36e627f50 columnFamilyName f1 2023-02-15 20:01:21,555 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=14, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=2f6827bb8b2d8e3d5d25320352d1e239, ASSIGN in 393 msec 2023-02-15 20:01:21,556 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=15, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=1486d61d8d2fe0efe2a608c7110b6c7d, ASSIGN in 395 msec 2023-02-15 20:01:21,556 INFO [StoreOpener-2241125b7d23be16c4949dc36e627f50-1] regionserver.HStore(310): Store=2241125b7d23be16c4949dc36e627f50/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 20:01:21,556 INFO [StoreOpener-2241125b7d23be16c4949dc36e627f50-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 2241125b7d23be16c4949dc36e627f50 2023-02-15 20:01:21,557 DEBUG [StoreOpener-dae437d89db301633beda20a6a7029ef-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/data/default/testWithMapReduce/dae437d89db301633beda20a6a7029ef/f2 2023-02-15 20:01:21,557 DEBUG [StoreOpener-dae437d89db301633beda20a6a7029ef-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/data/default/testWithMapReduce/dae437d89db301633beda20a6a7029ef/f2 2023-02-15 20:01:21,557 INFO [StoreOpener-dae437d89db301633beda20a6a7029ef-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region dae437d89db301633beda20a6a7029ef columnFamilyName f2 2023-02-15 20:01:21,558 INFO [StoreOpener-dae437d89db301633beda20a6a7029ef-1] regionserver.HStore(310): Store=dae437d89db301633beda20a6a7029ef/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 20:01:21,558 DEBUG [StoreOpener-2241125b7d23be16c4949dc36e627f50-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/data/default/testWithMapReduce/2241125b7d23be16c4949dc36e627f50/f2 2023-02-15 20:01:21,558 DEBUG [StoreOpener-2241125b7d23be16c4949dc36e627f50-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/data/default/testWithMapReduce/2241125b7d23be16c4949dc36e627f50/f2 2023-02-15 20:01:21,559 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/data/default/testWithMapReduce/dae437d89db301633beda20a6a7029ef 2023-02-15 20:01:21,559 INFO [StoreOpener-2241125b7d23be16c4949dc36e627f50-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2241125b7d23be16c4949dc36e627f50 columnFamilyName f2 2023-02-15 20:01:21,559 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/data/default/testWithMapReduce/dae437d89db301633beda20a6a7029ef 2023-02-15 20:01:21,559 INFO [StoreOpener-2241125b7d23be16c4949dc36e627f50-1] regionserver.HStore(310): Store=2241125b7d23be16c4949dc36e627f50/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 20:01:21,560 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/data/default/testWithMapReduce/2241125b7d23be16c4949dc36e627f50 2023-02-15 20:01:21,560 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/data/default/testWithMapReduce/2241125b7d23be16c4949dc36e627f50 2023-02-15 20:01:21,561 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-15 20:01:21,562 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for dae437d89db301633beda20a6a7029ef 2023-02-15 20:01:21,562 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-15 20:01:21,563 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 2241125b7d23be16c4949dc36e627f50 2023-02-15 20:01:21,564 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/data/default/testWithMapReduce/dae437d89db301633beda20a6a7029ef/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-15 20:01:21,564 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened dae437d89db301633beda20a6a7029ef; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64723897, jitterRate=-0.03553877770900726}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-15 20:01:21,565 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for dae437d89db301633beda20a6a7029ef: 2023-02-15 20:01:21,565 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/data/default/testWithMapReduce/2241125b7d23be16c4949dc36e627f50/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-15 20:01:21,565 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,aaa,1676491281022.dae437d89db301633beda20a6a7029ef., pid=29, masterSystemTime=1676491281484 2023-02-15 20:01:21,565 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 2241125b7d23be16c4949dc36e627f50; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63377070, jitterRate=-0.05560806393623352}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-15 20:01:21,566 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 2241125b7d23be16c4949dc36e627f50: 2023-02-15 20:01:21,566 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,zz{,1676491281022.2241125b7d23be16c4949dc36e627f50., pid=24, masterSystemTime=1676491281474 2023-02-15 20:01:21,567 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,aaa,1676491281022.dae437d89db301633beda20a6a7029ef. 2023-02-15 20:01:21,567 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,aaa,1676491281022.dae437d89db301633beda20a6a7029ef. 2023-02-15 20:01:21,567 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,t43,1676491281022.bd3ac405f939af16962e576b69a6c71b. 2023-02-15 20:01:21,567 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => bd3ac405f939af16962e576b69a6c71b, NAME => 'testWithMapReduce,t43,1676491281022.bd3ac405f939af16962e576b69a6c71b.', STARTKEY => 't43', ENDKEY => 'wWV'} 2023-02-15 20:01:21,567 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=12 updating hbase:meta row=dae437d89db301633beda20a6a7029ef, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,33019,1676491279655 2023-02-15 20:01:21,567 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,aaa,1676491281022.dae437d89db301633beda20a6a7029ef.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676491281567"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676491281567"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676491281567"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676491281567"}]},"ts":"1676491281567"} 2023-02-15 20:01:21,568 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce bd3ac405f939af16962e576b69a6c71b 2023-02-15 20:01:21,568 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,zz{,1676491281022.2241125b7d23be16c4949dc36e627f50. 2023-02-15 20:01:21,568 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,zz{,1676491281022.2241125b7d23be16c4949dc36e627f50. 2023-02-15 20:01:21,568 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,t43,1676491281022.bd3ac405f939af16962e576b69a6c71b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 20:01:21,568 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for bd3ac405f939af16962e576b69a6c71b 2023-02-15 20:01:21,568 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for bd3ac405f939af16962e576b69a6c71b 2023-02-15 20:01:21,569 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=2241125b7d23be16c4949dc36e627f50, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,33125,1676491279695 2023-02-15 20:01:21,569 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,zz{,1676491281022.2241125b7d23be16c4949dc36e627f50.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676491281568"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676491281568"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676491281568"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676491281568"}]},"ts":"1676491281568"} 2023-02-15 20:01:21,571 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=29, resume processing ppid=12 2023-02-15 20:01:21,571 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=29, ppid=12, state=SUCCESS; OpenRegionProcedure dae437d89db301633beda20a6a7029ef, server=jenkins-hbase4.apache.org,33019,1676491279655 in 234 msec 2023-02-15 20:01:21,573 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=24, resume processing ppid=20 2023-02-15 20:01:21,573 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=12, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=dae437d89db301633beda20a6a7029ef, ASSIGN in 411 msec 2023-02-15 20:01:21,573 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=24, ppid=20, state=SUCCESS; OpenRegionProcedure 2241125b7d23be16c4949dc36e627f50, server=jenkins-hbase4.apache.org,33125,1676491279695 in 245 msec 2023-02-15 20:01:21,573 INFO [StoreOpener-bd3ac405f939af16962e576b69a6c71b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region bd3ac405f939af16962e576b69a6c71b 2023-02-15 20:01:21,574 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=20, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=2241125b7d23be16c4949dc36e627f50, ASSIGN in 413 msec 2023-02-15 20:01:21,574 DEBUG [StoreOpener-bd3ac405f939af16962e576b69a6c71b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/data/default/testWithMapReduce/bd3ac405f939af16962e576b69a6c71b/f1 2023-02-15 20:01:21,575 DEBUG [StoreOpener-bd3ac405f939af16962e576b69a6c71b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/data/default/testWithMapReduce/bd3ac405f939af16962e576b69a6c71b/f1 2023-02-15 20:01:21,575 INFO [StoreOpener-bd3ac405f939af16962e576b69a6c71b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region bd3ac405f939af16962e576b69a6c71b columnFamilyName f1 2023-02-15 20:01:21,575 INFO [StoreOpener-bd3ac405f939af16962e576b69a6c71b-1] regionserver.HStore(310): Store=bd3ac405f939af16962e576b69a6c71b/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 20:01:21,575 INFO [StoreOpener-bd3ac405f939af16962e576b69a6c71b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region bd3ac405f939af16962e576b69a6c71b 2023-02-15 20:01:21,576 DEBUG [StoreOpener-bd3ac405f939af16962e576b69a6c71b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/data/default/testWithMapReduce/bd3ac405f939af16962e576b69a6c71b/f2 2023-02-15 20:01:21,577 DEBUG [StoreOpener-bd3ac405f939af16962e576b69a6c71b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/data/default/testWithMapReduce/bd3ac405f939af16962e576b69a6c71b/f2 2023-02-15 20:01:21,577 INFO [StoreOpener-bd3ac405f939af16962e576b69a6c71b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region bd3ac405f939af16962e576b69a6c71b columnFamilyName f2 2023-02-15 20:01:21,577 INFO [StoreOpener-bd3ac405f939af16962e576b69a6c71b-1] regionserver.HStore(310): Store=bd3ac405f939af16962e576b69a6c71b/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 20:01:21,578 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/data/default/testWithMapReduce/bd3ac405f939af16962e576b69a6c71b 2023-02-15 20:01:21,578 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/data/default/testWithMapReduce/bd3ac405f939af16962e576b69a6c71b 2023-02-15 20:01:21,580 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-15 20:01:21,581 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for bd3ac405f939af16962e576b69a6c71b 2023-02-15 20:01:21,583 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/data/default/testWithMapReduce/bd3ac405f939af16962e576b69a6c71b/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-15 20:01:21,583 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened bd3ac405f939af16962e576b69a6c71b; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69228754, jitterRate=0.03158882260322571}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-15 20:01:21,583 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for bd3ac405f939af16962e576b69a6c71b: 2023-02-15 20:01:21,584 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,t43,1676491281022.bd3ac405f939af16962e576b69a6c71b., pid=27, masterSystemTime=1676491281484 2023-02-15 20:01:21,586 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,t43,1676491281022.bd3ac405f939af16962e576b69a6c71b. 2023-02-15 20:01:21,586 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,t43,1676491281022.bd3ac405f939af16962e576b69a6c71b. 2023-02-15 20:01:21,586 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=18 updating hbase:meta row=bd3ac405f939af16962e576b69a6c71b, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,33019,1676491279655 2023-02-15 20:01:21,586 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,t43,1676491281022.bd3ac405f939af16962e576b69a6c71b.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676491281586"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676491281586"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676491281586"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676491281586"}]},"ts":"1676491281586"} 2023-02-15 20:01:21,590 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=27, resume processing ppid=18 2023-02-15 20:01:21,590 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=27, ppid=18, state=SUCCESS; OpenRegionProcedure bd3ac405f939af16962e576b69a6c71b, server=jenkins-hbase4.apache.org,33019,1676491279655 in 255 msec 2023-02-15 20:01:21,592 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=18, resume processing ppid=10 2023-02-15 20:01:21,592 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=18, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=bd3ac405f939af16962e576b69a6c71b, ASSIGN in 430 msec 2023-02-15 20:01:21,592 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-15 20:01:21,593 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676491281592"}]},"ts":"1676491281592"} 2023-02-15 20:01:21,594 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=ENABLED in hbase:meta 2023-02-15 20:01:21,596 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_POST_OPERATION 2023-02-15 20:01:21,598 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=10, state=SUCCESS; CreateTableProcedure table=testWithMapReduce in 573 msec 2023-02-15 20:01:21,634 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36865] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-15 20:01:21,634 INFO [Listener at localhost/43949] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testWithMapReduce, procId: 10 completed 2023-02-15 20:01:21,634 DEBUG [Listener at localhost/43949] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testWithMapReduce get assigned. Timeout = 60000ms 2023-02-15 20:01:21,635 INFO [Listener at localhost/43949] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-15 20:01:21,638 INFO [Listener at localhost/43949] hbase.HBaseTestingUtility(3484): All regions for table testWithMapReduce assigned to meta. Checking AM states. 2023-02-15 20:01:21,639 INFO [Listener at localhost/43949] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-15 20:01:21,639 INFO [Listener at localhost/43949] hbase.HBaseTestingUtility(3504): All regions for table testWithMapReduce assigned. 2023-02-15 20:01:21,639 INFO [Listener at localhost/43949] mapreduce.TableSnapshotInputFormatTestBase(207): put some stuff in the table 2023-02-15 20:01:21,695 DEBUG [hconnection-0x3c970f61-shared-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-15 20:01:21,709 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33125] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 6760 Client: jenkins//172.31.14.131 first region in multi=testWithMapReduce,j\xCA\xCA,1676491281022.1486d61d8d2fe0efe2a608c7110b6c7d. 2023-02-15 20:01:21,712 INFO [RS-EventLoopGroup-7-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36100, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-15 20:01:21,724 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33019] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 10816 Client: jenkins//172.31.14.131 first region in multi=testWithMapReduce,aaa,1676491281022.dae437d89db301633beda20a6a7029ef. 2023-02-15 20:01:21,839 INFO [Listener at localhost/43949] mapreduce.TableSnapshotInputFormatTestBase(214): snapshot 2023-02-15 20:01:21,839 INFO [Listener at localhost/43949] snapshot.SnapshotTestingUtils(396): taking snapshot. 2023-02-15 20:01:21,841 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36865] master.MasterRpcServices(1580): Client=jenkins//172.31.14.131 snapshot request for:{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-15 20:01:21,841 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36865] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1676491281841 (current time:1676491281841). 2023-02-15 20:01:21,841 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36865] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-02-15 20:01:21,841 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36865] zookeeper.ReadOnlyZKClient(139): Connect 0x6514d04f to 127.0.0.1:57384 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-15 20:01:21,848 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36865] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4d1f5d2f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-15 20:01:21,849 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36865] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-15 20:01:21,850 INFO [RS-EventLoopGroup-8-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55378, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-15 20:01:21,851 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36865] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6514d04f to 127.0.0.1:57384 2023-02-15 20:01:21,851 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36865] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-15 20:01:21,852 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36865] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-02-15 20:01:21,852 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36865] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-15 20:01:21,854 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36865] procedure2.ProcedureExecutor(1029): Stored pid=31, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-15 20:01:21,855 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=31, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-15 20:01:21,856 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=31, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE; timeout=600000, timestamp=1676491881856 2023-02-15 20:01:21,856 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36865] snapshot.SnapshotManager(653): Started snapshot: { ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-15 20:01:21,856 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot testWithMapReduceAndOfflineHBaseMultiRegion C_M_SNAPSHOT_TABLE on table testWithMapReduce 2023-02-15 20:01:21,857 DEBUG [Listener at localhost/43949] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-02-15 20:01:21,857 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=31, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-15 20:01:21,857 DEBUG [Listener at localhost/43949] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-02-15 20:01:21,858 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-15 20:01:21,859 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=31, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE in 4 msec 2023-02-15 20:01:21,859 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-15 20:01:21,860 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=32, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED; timeout=600000, timestamp=1676491881860 2023-02-15 20:01:21,874 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 20:01:21,874 INFO [(jenkins-hbase4.apache.org,36865,1676491279587)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' 2023-02-15 20:01:21,875 DEBUG [(jenkins-hbase4.apache.org,36865,1676491279587)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-15 20:01:21,875 DEBUG [(jenkins-hbase4.apache.org,36865,1676491279587)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' starting 'acquire' 2023-02-15 20:01:21,875 DEBUG [(jenkins-hbase4.apache.org,36865,1676491279587)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMapReduceAndOfflineHBaseMultiRegion', kicking off acquire phase on members. 2023-02-15 20:01:21,876 DEBUG [(jenkins-hbase4.apache.org,36865,1676491279587)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36865-0x1005992b68c0000, quorum=127.0.0.1:57384, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 20:01:21,876 DEBUG [(jenkins-hbase4.apache.org,36865,1676491279587)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 20:01:21,877 DEBUG [Listener at localhost/43949-EventThread] zookeeper.ZKWatcher(600): regionserver:33125-0x1005992b68c0002, quorum=127.0.0.1:57384, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-15 20:01:21,877 DEBUG [Listener at localhost/43949-EventThread] zookeeper.ZKWatcher(600): regionserver:33019-0x1005992b68c0001, quorum=127.0.0.1:57384, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-15 20:01:21,877 DEBUG [(jenkins-hbase4.apache.org,36865,1676491279587)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,33019,1676491279655 2023-02-15 20:01:21,877 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-15 20:01:21,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-15 20:01:21,877 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-15 20:01:21,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-15 20:01:21,878 DEBUG [(jenkins-hbase4.apache.org,36865,1676491279587)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36865-0x1005992b68c0000, quorum=127.0.0.1:57384, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,33019,1676491279655 2023-02-15 20:01:21,878 DEBUG [(jenkins-hbase4.apache.org,36865,1676491279587)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,33125,1676491279695 2023-02-15 20:01:21,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 20:01:21,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 20:01:21,878 DEBUG [(jenkins-hbase4.apache.org,36865,1676491279587)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36865-0x1005992b68c0000, quorum=127.0.0.1:57384, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,33125,1676491279695 2023-02-15 20:01:21,878 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33019-0x1005992b68c0001, quorum=127.0.0.1:57384, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 20:01:21,878 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33125-0x1005992b68c0002, quorum=127.0.0.1:57384, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 20:01:21,878 DEBUG [(jenkins-hbase4.apache.org,36865,1676491279587)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-15 20:01:21,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 81 2023-02-15 20:01:21,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 81 2023-02-15 20:01:21,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 20:01:21,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 20:01:21,879 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMapReduceAndOfflineHBaseMultiRegion from table testWithMapReduce type FLUSH 2023-02-15 20:01:21,879 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMapReduceAndOfflineHBaseMultiRegion from table testWithMapReduce type FLUSH 2023-02-15 20:01:21,879 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 20:01:21,879 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 20:01:21,880 DEBUG [member: 'jenkins-hbase4.apache.org,33125,1676491279695' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' with timeout 300000ms 2023-02-15 20:01:21,880 DEBUG [member: 'jenkins-hbase4.apache.org,33125,1676491279695' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-15 20:01:21,880 DEBUG [member: 'jenkins-hbase4.apache.org,33125,1676491279695' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' starting 'acquire' stage 2023-02-15 20:01:21,880 DEBUG [member: 'jenkins-hbase4.apache.org,33125,1676491279695' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' locally acquired 2023-02-15 20:01:21,880 DEBUG [member: 'jenkins-hbase4.apache.org,33125,1676491279695' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33125,1676491279695' joining acquired barrier for procedure (testWithMapReduceAndOfflineHBaseMultiRegion) in zk 2023-02-15 20:01:21,880 DEBUG [member: 'jenkins-hbase4.apache.org,33019,1676491279655' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' with timeout 300000ms 2023-02-15 20:01:21,880 DEBUG [member: 'jenkins-hbase4.apache.org,33019,1676491279655' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-15 20:01:21,881 DEBUG [member: 'jenkins-hbase4.apache.org,33019,1676491279655' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' starting 'acquire' stage 2023-02-15 20:01:21,881 DEBUG [member: 'jenkins-hbase4.apache.org,33019,1676491279655' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' locally acquired 2023-02-15 20:01:21,881 DEBUG [member: 'jenkins-hbase4.apache.org,33019,1676491279655' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33019,1676491279655' joining acquired barrier for procedure (testWithMapReduceAndOfflineHBaseMultiRegion) in zk 2023-02-15 20:01:21,882 DEBUG [Listener at localhost/43949-EventThread] zookeeper.ZKWatcher(600): master:36865-0x1005992b68c0000, quorum=127.0.0.1:57384, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,33125,1676491279695 2023-02-15 20:01:21,882 DEBUG [member: 'jenkins-hbase4.apache.org,33125,1676491279695' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 20:01:21,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,33125,1676491279695 2023-02-15 20:01:21,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-15 20:01:21,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-15 20:01:21,883 DEBUG [Listener at localhost/43949-EventThread] zookeeper.ZKWatcher(600): master:36865-0x1005992b68c0000, quorum=127.0.0.1:57384, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,33019,1676491279655 2023-02-15 20:01:21,883 DEBUG [member: 'jenkins-hbase4.apache.org,33125,1676491279695' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33125-0x1005992b68c0002, quorum=127.0.0.1:57384, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 20:01:21,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-15 20:01:21,883 DEBUG [member: 'jenkins-hbase4.apache.org,33019,1676491279655' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 20:01:21,883 DEBUG [member: 'jenkins-hbase4.apache.org,33125,1676491279695' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-15 20:01:21,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-15 20:01:21,884 DEBUG [member: 'jenkins-hbase4.apache.org,33019,1676491279655' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33019-0x1005992b68c0001, quorum=127.0.0.1:57384, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 20:01:21,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 20:01:21,888 DEBUG [member: 'jenkins-hbase4.apache.org,33019,1676491279655' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-15 20:01:21,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33019,1676491279655 2023-02-15 20:01:21,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33125,1676491279695 2023-02-15 20:01:21,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-15 20:01:21,889 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,33125,1676491279695' joining acquired barrier for procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' on coordinator 2023-02-15 20:01:21,889 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6e27c3e2[Count = 1] remaining members to acquire global barrier 2023-02-15 20:01:21,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,33019,1676491279655 2023-02-15 20:01:21,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-15 20:01:21,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-15 20:01:21,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-15 20:01:21,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-15 20:01:21,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 20:01:21,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33019,1676491279655 2023-02-15 20:01:21,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33125,1676491279695 2023-02-15 20:01:21,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-15 20:01:21,892 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,33019,1676491279655' joining acquired barrier for procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' on coordinator 2023-02-15 20:01:21,892 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6e27c3e2[Count = 0] remaining members to acquire global barrier 2023-02-15 20:01:21,892 DEBUG [(jenkins-hbase4.apache.org,36865,1676491279587)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' starting 'in-barrier' execution. 2023-02-15 20:01:21,892 DEBUG [(jenkins-hbase4.apache.org,36865,1676491279587)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 20:01:21,894 DEBUG [Listener at localhost/43949-EventThread] zookeeper.ZKWatcher(600): regionserver:33019-0x1005992b68c0001, quorum=127.0.0.1:57384, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 20:01:21,894 DEBUG [Listener at localhost/43949-EventThread] zookeeper.ZKWatcher(600): regionserver:33125-0x1005992b68c0002, quorum=127.0.0.1:57384, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 20:01:21,894 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 20:01:21,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 20:01:21,895 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 20:01:21,895 DEBUG [(jenkins-hbase4.apache.org,36865,1676491279587)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36865-0x1005992b68c0000, quorum=127.0.0.1:57384, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,33125,1676491279695 2023-02-15 20:01:21,895 DEBUG [member: 'jenkins-hbase4.apache.org,33019,1676491279655' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' received 'reached' from coordinator. 2023-02-15 20:01:21,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 20:01:21,895 DEBUG [member: 'jenkins-hbase4.apache.org,33125,1676491279695' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' received 'reached' from coordinator. 2023-02-15 20:01:21,895 DEBUG [rs(jenkins-hbase4.apache.org,33019,1676491279655)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,d\x84\x84,1676491281022.2a1c7014d8c6c818f8ea2f67ef6b2118. 2023-02-15 20:01:21,895 DEBUG [rs(jenkins-hbase4.apache.org,33019,1676491279655)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,d\x84\x84,1676491281022.2a1c7014d8c6c818f8ea2f67ef6b2118. started... 2023-02-15 20:01:21,895 DEBUG [rs(jenkins-hbase4.apache.org,33019,1676491279655)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,t43,1676491281022.bd3ac405f939af16962e576b69a6c71b. 2023-02-15 20:01:21,895 DEBUG [rs(jenkins-hbase4.apache.org,33019,1676491279655)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,t43,1676491281022.bd3ac405f939af16962e576b69a6c71b. started... 2023-02-15 20:01:21,896 DEBUG [rs(jenkins-hbase4.apache.org,33125,1676491279695)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,,1676491281022.9fdf60e81d6a22352a6acb2fcb8c9f3e. 2023-02-15 20:01:21,896 INFO [rs(jenkins-hbase4.apache.org,33019,1676491279655)-snapshot-pool-1] regionserver.HRegion(2744): Flushing bd3ac405f939af16962e576b69a6c71b 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-15 20:01:21,896 DEBUG [rs(jenkins-hbase4.apache.org,33019,1676491279655)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,aaa,1676491281022.dae437d89db301633beda20a6a7029ef. 2023-02-15 20:01:21,897 DEBUG [rs(jenkins-hbase4.apache.org,33019,1676491279655)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,aaa,1676491281022.dae437d89db301633beda20a6a7029ef. started... 2023-02-15 20:01:21,896 DEBUG [rs(jenkins-hbase4.apache.org,33125,1676491279695)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,,1676491281022.9fdf60e81d6a22352a6acb2fcb8c9f3e. started... 2023-02-15 20:01:21,896 DEBUG [member: 'jenkins-hbase4.apache.org,33019,1676491279655' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 5 regions 2023-02-15 20:01:21,897 DEBUG [member: 'jenkins-hbase4.apache.org,33125,1676491279695' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 5 regions 2023-02-15 20:01:21,897 DEBUG [rs(jenkins-hbase4.apache.org,33125,1676491279695)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 9fdf60e81d6a22352a6acb2fcb8c9f3e: 2023-02-15 20:01:21,896 INFO [rs(jenkins-hbase4.apache.org,33019,1676491279655)-snapshot-pool-0] regionserver.HRegion(2744): Flushing 2a1c7014d8c6c818f8ea2f67ef6b2118 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-15 20:01:21,898 DEBUG [rs(jenkins-hbase4.apache.org,33125,1676491279695)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,,1676491281022.9fdf60e81d6a22352a6acb2fcb8c9f3e.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 20:01:21,898 DEBUG [rs(jenkins-hbase4.apache.org,33125,1676491279695)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-15 20:01:21,897 DEBUG [member: 'jenkins-hbase4.apache.org,33125,1676491279695' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-15 20:01:21,898 INFO [rs(jenkins-hbase4.apache.org,33019,1676491279655)-snapshot-pool-2] regionserver.HRegion(2744): Flushing dae437d89db301633beda20a6a7029ef 2/2 column families, dataSize=158.44 KB heapSize=549.75 KB 2023-02-15 20:01:21,898 DEBUG [rs(jenkins-hbase4.apache.org,33125,1676491279695)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-15 20:01:21,899 DEBUG [rs(jenkins-hbase4.apache.org,33125,1676491279695)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-15 20:01:21,897 DEBUG [rs(jenkins-hbase4.apache.org,33125,1676491279695)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,zz{,1676491281022.2241125b7d23be16c4949dc36e627f50. 2023-02-15 20:01:21,897 DEBUG [member: 'jenkins-hbase4.apache.org,33019,1676491279655' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-15 20:01:21,897 DEBUG [rs(jenkins-hbase4.apache.org,33125,1676491279695)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,wWV,1676491281022.69ce6540f755e21eae3d289ad231610b. 2023-02-15 20:01:21,900 DEBUG [rs(jenkins-hbase4.apache.org,33125,1676491279695)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,zz{,1676491281022.2241125b7d23be16c4949dc36e627f50. started... 2023-02-15 20:01:21,900 DEBUG [rs(jenkins-hbase4.apache.org,33125,1676491279695)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,wWV,1676491281022.69ce6540f755e21eae3d289ad231610b. started... 2023-02-15 20:01:21,901 DEBUG [(jenkins-hbase4.apache.org,36865,1676491279587)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36865-0x1005992b68c0000, quorum=127.0.0.1:57384, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,33019,1676491279655 2023-02-15 20:01:21,901 DEBUG [(jenkins-hbase4.apache.org,36865,1676491279587)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-15 20:01:21,904 DEBUG [rs(jenkins-hbase4.apache.org,33125,1676491279695)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for 2241125b7d23be16c4949dc36e627f50: 2023-02-15 20:01:21,904 INFO [rs(jenkins-hbase4.apache.org,33125,1676491279695)-snapshot-pool-1] regionserver.HRegion(2744): Flushing 69ce6540f755e21eae3d289ad231610b 2/2 column families, dataSize=158.44 KB heapSize=549.75 KB 2023-02-15 20:01:21,904 DEBUG [rs(jenkins-hbase4.apache.org,33125,1676491279695)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,zz{,1676491281022.2241125b7d23be16c4949dc36e627f50.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 20:01:21,904 DEBUG [rs(jenkins-hbase4.apache.org,33125,1676491279695)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-15 20:01:21,905 DEBUG [rs(jenkins-hbase4.apache.org,33125,1676491279695)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-15 20:01:21,905 DEBUG [rs(jenkins-hbase4.apache.org,33125,1676491279695)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-15 20:01:21,947 DEBUG [rs(jenkins-hbase4.apache.org,33125,1676491279695)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,zz{,1676491281022.2241125b7d23be16c4949dc36e627f50. completed. 2023-02-15 20:01:21,947 DEBUG [rs(jenkins-hbase4.apache.org,33125,1676491279695)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,zz{,1676491281022.2241125b7d23be16c4949dc36e627f50. 2023-02-15 20:01:21,947 DEBUG [rs(jenkins-hbase4.apache.org,33125,1676491279695)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,m\xED\xED,1676491281022.97b529ba0e37421e99fb43de9d23d817. 2023-02-15 20:01:21,947 DEBUG [member: 'jenkins-hbase4.apache.org,33125,1676491279695' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/5 local region snapshots. 2023-02-15 20:01:21,947 DEBUG [rs(jenkins-hbase4.apache.org,33125,1676491279695)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,m\xED\xED,1676491281022.97b529ba0e37421e99fb43de9d23d817. started... 2023-02-15 20:01:21,956 INFO [rs(jenkins-hbase4.apache.org,33125,1676491279695)-snapshot-pool-2] regionserver.HRegion(2744): Flushing 97b529ba0e37421e99fb43de9d23d817 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-15 20:01:21,958 INFO [rs(jenkins-hbase4.apache.org,33125,1676491279695)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/data/default/testWithMapReduce/69ce6540f755e21eae3d289ad231610b/.tmp/f1/e5f6c27caca2460f87a952d21f5687bc 2023-02-15 20:01:21,958 DEBUG [Listener at localhost/43949] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-15 20:01:21,960 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36865] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-15 20:01:21,960 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36865] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-15 20:01:21,960 DEBUG [Listener at localhost/43949] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-02-15 20:01:21,963 INFO [rs(jenkins-hbase4.apache.org,33019,1676491279655)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/data/default/testWithMapReduce/bd3ac405f939af16962e576b69a6c71b/.tmp/f1/e061b466566641ce84e5637aff6e87d4 2023-02-15 20:01:21,984 DEBUG [rs(jenkins-hbase4.apache.org,33125,1676491279695)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,,1676491281022.9fdf60e81d6a22352a6acb2fcb8c9f3e. completed. 2023-02-15 20:01:21,984 DEBUG [rs(jenkins-hbase4.apache.org,33125,1676491279695)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,,1676491281022.9fdf60e81d6a22352a6acb2fcb8c9f3e. 2023-02-15 20:01:21,984 DEBUG [rs(jenkins-hbase4.apache.org,33125,1676491279695)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,j\xCA\xCA,1676491281022.1486d61d8d2fe0efe2a608c7110b6c7d. 2023-02-15 20:01:21,984 DEBUG [member: 'jenkins-hbase4.apache.org,33125,1676491279695' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 2/5 local region snapshots. 2023-02-15 20:01:21,984 DEBUG [rs(jenkins-hbase4.apache.org,33125,1676491279695)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,j\xCA\xCA,1676491281022.1486d61d8d2fe0efe2a608c7110b6c7d. started... 2023-02-15 20:01:21,984 INFO [rs(jenkins-hbase4.apache.org,33125,1676491279695)-snapshot-pool-0] regionserver.HRegion(2744): Flushing 1486d61d8d2fe0efe2a608c7110b6c7d 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-15 20:01:21,988 INFO [rs(jenkins-hbase4.apache.org,33019,1676491279655)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/data/default/testWithMapReduce/2a1c7014d8c6c818f8ea2f67ef6b2118/.tmp/f1/23d33b83df074886bcad94456fae89f1 2023-02-15 20:01:22,012 INFO [rs(jenkins-hbase4.apache.org,33019,1676491279655)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/data/default/testWithMapReduce/dae437d89db301633beda20a6a7029ef/.tmp/f1/594cc29e1efe4b82a77293865b824b63 2023-02-15 20:01:22,037 INFO [rs(jenkins-hbase4.apache.org,33125,1676491279695)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/data/default/testWithMapReduce/97b529ba0e37421e99fb43de9d23d817/.tmp/f1/31b2ff03534b4586a751a4d981d67074 2023-02-15 20:01:22,054 INFO [rs(jenkins-hbase4.apache.org,33125,1676491279695)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/data/default/testWithMapReduce/69ce6540f755e21eae3d289ad231610b/.tmp/f2/1eedc5ffee284d0aa5210a5ab40bb91c 2023-02-15 20:01:22,058 INFO [rs(jenkins-hbase4.apache.org,33019,1676491279655)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/data/default/testWithMapReduce/bd3ac405f939af16962e576b69a6c71b/.tmp/f2/4df29d784f394edcafca4e683f7852fa 2023-02-15 20:01:22,059 INFO [rs(jenkins-hbase4.apache.org,33125,1676491279695)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/data/default/testWithMapReduce/1486d61d8d2fe0efe2a608c7110b6c7d/.tmp/f1/de28b0ab497640e590f6f466e3019c49 2023-02-15 20:01:22,065 DEBUG [rs(jenkins-hbase4.apache.org,33019,1676491279655)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/data/default/testWithMapReduce/bd3ac405f939af16962e576b69a6c71b/.tmp/f1/e061b466566641ce84e5637aff6e87d4 as hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/data/default/testWithMapReduce/bd3ac405f939af16962e576b69a6c71b/f1/e061b466566641ce84e5637aff6e87d4 2023-02-15 20:01:22,072 DEBUG [rs(jenkins-hbase4.apache.org,33125,1676491279695)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/data/default/testWithMapReduce/69ce6540f755e21eae3d289ad231610b/.tmp/f1/e5f6c27caca2460f87a952d21f5687bc as hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/data/default/testWithMapReduce/69ce6540f755e21eae3d289ad231610b/f1/e5f6c27caca2460f87a952d21f5687bc 2023-02-15 20:01:22,075 INFO [rs(jenkins-hbase4.apache.org,33019,1676491279655)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/data/default/testWithMapReduce/2a1c7014d8c6c818f8ea2f67ef6b2118/.tmp/f2/52f1540918dd49b6b7dc0f3174528264 2023-02-15 20:01:22,076 INFO [rs(jenkins-hbase4.apache.org,33019,1676491279655)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/data/default/testWithMapReduce/bd3ac405f939af16962e576b69a6c71b/f1/e061b466566641ce84e5637aff6e87d4, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-15 20:01:22,080 DEBUG [rs(jenkins-hbase4.apache.org,33019,1676491279655)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/data/default/testWithMapReduce/bd3ac405f939af16962e576b69a6c71b/.tmp/f2/4df29d784f394edcafca4e683f7852fa as hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/data/default/testWithMapReduce/bd3ac405f939af16962e576b69a6c71b/f2/4df29d784f394edcafca4e683f7852fa 2023-02-15 20:01:22,084 DEBUG [rs(jenkins-hbase4.apache.org,33019,1676491279655)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/data/default/testWithMapReduce/2a1c7014d8c6c818f8ea2f67ef6b2118/.tmp/f1/23d33b83df074886bcad94456fae89f1 as hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/data/default/testWithMapReduce/2a1c7014d8c6c818f8ea2f67ef6b2118/f1/23d33b83df074886bcad94456fae89f1 2023-02-15 20:01:22,092 INFO [rs(jenkins-hbase4.apache.org,33125,1676491279695)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/data/default/testWithMapReduce/69ce6540f755e21eae3d289ad231610b/f1/e5f6c27caca2460f87a952d21f5687bc, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-15 20:01:22,092 INFO [rs(jenkins-hbase4.apache.org,33019,1676491279655)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/data/default/testWithMapReduce/2a1c7014d8c6c818f8ea2f67ef6b2118/f1/23d33b83df074886bcad94456fae89f1, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-15 20:01:22,093 DEBUG [rs(jenkins-hbase4.apache.org,33125,1676491279695)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/data/default/testWithMapReduce/69ce6540f755e21eae3d289ad231610b/.tmp/f2/1eedc5ffee284d0aa5210a5ab40bb91c as hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/data/default/testWithMapReduce/69ce6540f755e21eae3d289ad231610b/f2/1eedc5ffee284d0aa5210a5ab40bb91c 2023-02-15 20:01:22,094 DEBUG [rs(jenkins-hbase4.apache.org,33019,1676491279655)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/data/default/testWithMapReduce/2a1c7014d8c6c818f8ea2f67ef6b2118/.tmp/f2/52f1540918dd49b6b7dc0f3174528264 as hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/data/default/testWithMapReduce/2a1c7014d8c6c818f8ea2f67ef6b2118/f2/52f1540918dd49b6b7dc0f3174528264 2023-02-15 20:01:22,095 INFO [rs(jenkins-hbase4.apache.org,33019,1676491279655)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/data/default/testWithMapReduce/dae437d89db301633beda20a6a7029ef/.tmp/f2/b2caa048c0fc4ce4816c15496b0e136b 2023-02-15 20:01:22,101 INFO [rs(jenkins-hbase4.apache.org,33125,1676491279695)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/data/default/testWithMapReduce/69ce6540f755e21eae3d289ad231610b/f2/1eedc5ffee284d0aa5210a5ab40bb91c, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-15 20:01:22,101 INFO [rs(jenkins-hbase4.apache.org,33019,1676491279655)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/data/default/testWithMapReduce/2a1c7014d8c6c818f8ea2f67ef6b2118/f2/52f1540918dd49b6b7dc0f3174528264, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-15 20:01:22,102 INFO [rs(jenkins-hbase4.apache.org,33125,1676491279695)-snapshot-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~158.44 KB/162240, heapSize ~549.72 KB/562912, currentSize=0 B/0 for 69ce6540f755e21eae3d289ad231610b in 198ms, sequenceid=5, compaction requested=false 2023-02-15 20:01:22,102 INFO [rs(jenkins-hbase4.apache.org,33019,1676491279655)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 2a1c7014d8c6c818f8ea2f67ef6b2118 in 206ms, sequenceid=5, compaction requested=false 2023-02-15 20:01:22,102 DEBUG [rs(jenkins-hbase4.apache.org,33125,1676491279695)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for 69ce6540f755e21eae3d289ad231610b: 2023-02-15 20:01:22,103 DEBUG [rs(jenkins-hbase4.apache.org,33019,1676491279655)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 2a1c7014d8c6c818f8ea2f67ef6b2118: 2023-02-15 20:01:22,103 DEBUG [rs(jenkins-hbase4.apache.org,33125,1676491279695)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,wWV,1676491281022.69ce6540f755e21eae3d289ad231610b.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 20:01:22,103 DEBUG [rs(jenkins-hbase4.apache.org,33019,1676491279655)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,d\x84\x84,1676491281022.2a1c7014d8c6c818f8ea2f67ef6b2118.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 20:01:22,103 DEBUG [rs(jenkins-hbase4.apache.org,33125,1676491279695)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-15 20:01:22,103 DEBUG [rs(jenkins-hbase4.apache.org,33019,1676491279655)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-15 20:01:22,103 DEBUG [rs(jenkins-hbase4.apache.org,33125,1676491279695)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/data/default/testWithMapReduce/69ce6540f755e21eae3d289ad231610b/f1/e5f6c27caca2460f87a952d21f5687bc] hfiles 2023-02-15 20:01:22,103 DEBUG [rs(jenkins-hbase4.apache.org,33019,1676491279655)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/data/default/testWithMapReduce/2a1c7014d8c6c818f8ea2f67ef6b2118/f1/23d33b83df074886bcad94456fae89f1] hfiles 2023-02-15 20:01:22,103 DEBUG [rs(jenkins-hbase4.apache.org,33125,1676491279695)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/data/default/testWithMapReduce/69ce6540f755e21eae3d289ad231610b/f1/e5f6c27caca2460f87a952d21f5687bc for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 20:01:22,103 DEBUG [rs(jenkins-hbase4.apache.org,33019,1676491279655)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/data/default/testWithMapReduce/2a1c7014d8c6c818f8ea2f67ef6b2118/f1/23d33b83df074886bcad94456fae89f1 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 20:01:22,103 DEBUG [rs(jenkins-hbase4.apache.org,33125,1676491279695)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/data/default/testWithMapReduce/69ce6540f755e21eae3d289ad231610b/f2/1eedc5ffee284d0aa5210a5ab40bb91c] hfiles 2023-02-15 20:01:22,103 DEBUG [rs(jenkins-hbase4.apache.org,33019,1676491279655)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/data/default/testWithMapReduce/2a1c7014d8c6c818f8ea2f67ef6b2118/f2/52f1540918dd49b6b7dc0f3174528264] hfiles 2023-02-15 20:01:22,103 DEBUG [rs(jenkins-hbase4.apache.org,33125,1676491279695)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/data/default/testWithMapReduce/69ce6540f755e21eae3d289ad231610b/f2/1eedc5ffee284d0aa5210a5ab40bb91c for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 20:01:22,103 DEBUG [rs(jenkins-hbase4.apache.org,33019,1676491279655)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/data/default/testWithMapReduce/2a1c7014d8c6c818f8ea2f67ef6b2118/f2/52f1540918dd49b6b7dc0f3174528264 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 20:01:22,105 INFO [rs(jenkins-hbase4.apache.org,33019,1676491279655)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/data/default/testWithMapReduce/bd3ac405f939af16962e576b69a6c71b/f2/4df29d784f394edcafca4e683f7852fa, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-15 20:01:22,106 INFO [rs(jenkins-hbase4.apache.org,33019,1676491279655)-snapshot-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for bd3ac405f939af16962e576b69a6c71b in 210ms, sequenceid=5, compaction requested=false 2023-02-15 20:01:22,106 DEBUG [rs(jenkins-hbase4.apache.org,33019,1676491279655)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for bd3ac405f939af16962e576b69a6c71b: 2023-02-15 20:01:22,106 DEBUG [rs(jenkins-hbase4.apache.org,33019,1676491279655)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,t43,1676491281022.bd3ac405f939af16962e576b69a6c71b.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 20:01:22,106 DEBUG [rs(jenkins-hbase4.apache.org,33019,1676491279655)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-15 20:01:22,106 DEBUG [rs(jenkins-hbase4.apache.org,33019,1676491279655)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/data/default/testWithMapReduce/bd3ac405f939af16962e576b69a6c71b/f1/e061b466566641ce84e5637aff6e87d4] hfiles 2023-02-15 20:01:22,106 DEBUG [rs(jenkins-hbase4.apache.org,33019,1676491279655)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/data/default/testWithMapReduce/bd3ac405f939af16962e576b69a6c71b/f1/e061b466566641ce84e5637aff6e87d4 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 20:01:22,106 DEBUG [rs(jenkins-hbase4.apache.org,33019,1676491279655)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/data/default/testWithMapReduce/bd3ac405f939af16962e576b69a6c71b/f2/4df29d784f394edcafca4e683f7852fa] hfiles 2023-02-15 20:01:22,106 DEBUG [rs(jenkins-hbase4.apache.org,33019,1676491279655)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/data/default/testWithMapReduce/bd3ac405f939af16962e576b69a6c71b/f2/4df29d784f394edcafca4e683f7852fa for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 20:01:22,112 DEBUG [rs(jenkins-hbase4.apache.org,33019,1676491279655)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/data/default/testWithMapReduce/dae437d89db301633beda20a6a7029ef/.tmp/f1/594cc29e1efe4b82a77293865b824b63 as hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/data/default/testWithMapReduce/dae437d89db301633beda20a6a7029ef/f1/594cc29e1efe4b82a77293865b824b63 2023-02-15 20:01:22,127 INFO [rs(jenkins-hbase4.apache.org,33019,1676491279655)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/data/default/testWithMapReduce/dae437d89db301633beda20a6a7029ef/f1/594cc29e1efe4b82a77293865b824b63, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-15 20:01:22,128 DEBUG [rs(jenkins-hbase4.apache.org,33019,1676491279655)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/data/default/testWithMapReduce/dae437d89db301633beda20a6a7029ef/.tmp/f2/b2caa048c0fc4ce4816c15496b0e136b as hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/data/default/testWithMapReduce/dae437d89db301633beda20a6a7029ef/f2/b2caa048c0fc4ce4816c15496b0e136b 2023-02-15 20:01:22,142 INFO [rs(jenkins-hbase4.apache.org,33019,1676491279655)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/data/default/testWithMapReduce/dae437d89db301633beda20a6a7029ef/f2/b2caa048c0fc4ce4816c15496b0e136b, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-15 20:01:22,143 INFO [rs(jenkins-hbase4.apache.org,33019,1676491279655)-snapshot-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~158.44 KB/162240, heapSize ~549.72 KB/562912, currentSize=0 B/0 for dae437d89db301633beda20a6a7029ef in 245ms, sequenceid=5, compaction requested=false 2023-02-15 20:01:22,143 DEBUG [rs(jenkins-hbase4.apache.org,33019,1676491279655)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for dae437d89db301633beda20a6a7029ef: 2023-02-15 20:01:22,143 DEBUG [rs(jenkins-hbase4.apache.org,33019,1676491279655)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,aaa,1676491281022.dae437d89db301633beda20a6a7029ef.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 20:01:22,143 DEBUG [rs(jenkins-hbase4.apache.org,33019,1676491279655)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-15 20:01:22,144 DEBUG [rs(jenkins-hbase4.apache.org,33019,1676491279655)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/data/default/testWithMapReduce/dae437d89db301633beda20a6a7029ef/f1/594cc29e1efe4b82a77293865b824b63] hfiles 2023-02-15 20:01:22,144 DEBUG [rs(jenkins-hbase4.apache.org,33019,1676491279655)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/data/default/testWithMapReduce/dae437d89db301633beda20a6a7029ef/f1/594cc29e1efe4b82a77293865b824b63 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 20:01:22,144 DEBUG [rs(jenkins-hbase4.apache.org,33019,1676491279655)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/data/default/testWithMapReduce/dae437d89db301633beda20a6a7029ef/f2/b2caa048c0fc4ce4816c15496b0e136b] hfiles 2023-02-15 20:01:22,144 DEBUG [rs(jenkins-hbase4.apache.org,33019,1676491279655)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/data/default/testWithMapReduce/dae437d89db301633beda20a6a7029ef/f2/b2caa048c0fc4ce4816c15496b0e136b for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 20:01:22,149 INFO [rs(jenkins-hbase4.apache.org,33125,1676491279695)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/data/default/testWithMapReduce/1486d61d8d2fe0efe2a608c7110b6c7d/.tmp/f2/35f8711edfdb4222926a2aec3e6ab181 2023-02-15 20:01:22,156 DEBUG [rs(jenkins-hbase4.apache.org,33125,1676491279695)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,wWV,1676491281022.69ce6540f755e21eae3d289ad231610b. completed. 2023-02-15 20:01:22,156 DEBUG [rs(jenkins-hbase4.apache.org,33125,1676491279695)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,wWV,1676491281022.69ce6540f755e21eae3d289ad231610b. 2023-02-15 20:01:22,156 DEBUG [member: 'jenkins-hbase4.apache.org,33125,1676491279695' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 3/5 local region snapshots. 2023-02-15 20:01:22,160 DEBUG [Listener at localhost/43949] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-15 20:01:22,162 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36865] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-15 20:01:22,162 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36865] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-15 20:01:22,163 DEBUG [Listener at localhost/43949] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-02-15 20:01:22,164 DEBUG [rs(jenkins-hbase4.apache.org,33019,1676491279655)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,d\x84\x84,1676491281022.2a1c7014d8c6c818f8ea2f67ef6b2118. completed. 2023-02-15 20:01:22,164 DEBUG [rs(jenkins-hbase4.apache.org,33019,1676491279655)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,d\x84\x84,1676491281022.2a1c7014d8c6c818f8ea2f67ef6b2118. 2023-02-15 20:01:22,164 DEBUG [rs(jenkins-hbase4.apache.org,33019,1676491279655)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,q\x11\x10,1676491281022.296941d2565b5d20cfd81aec8ac11565. 2023-02-15 20:01:22,164 DEBUG [member: 'jenkins-hbase4.apache.org,33019,1676491279655' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/5 local region snapshots. 2023-02-15 20:01:22,164 DEBUG [rs(jenkins-hbase4.apache.org,33019,1676491279655)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,q\x11\x10,1676491281022.296941d2565b5d20cfd81aec8ac11565. started... 2023-02-15 20:01:22,165 INFO [rs(jenkins-hbase4.apache.org,33019,1676491279655)-snapshot-pool-0] regionserver.HRegion(2744): Flushing 296941d2565b5d20cfd81aec8ac11565 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-15 20:01:22,165 DEBUG [rs(jenkins-hbase4.apache.org,33125,1676491279695)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/data/default/testWithMapReduce/1486d61d8d2fe0efe2a608c7110b6c7d/.tmp/f1/de28b0ab497640e590f6f466e3019c49 as hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/data/default/testWithMapReduce/1486d61d8d2fe0efe2a608c7110b6c7d/f1/de28b0ab497640e590f6f466e3019c49 2023-02-15 20:01:22,172 INFO [rs(jenkins-hbase4.apache.org,33125,1676491279695)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/data/default/testWithMapReduce/1486d61d8d2fe0efe2a608c7110b6c7d/f1/de28b0ab497640e590f6f466e3019c49, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-15 20:01:22,173 DEBUG [rs(jenkins-hbase4.apache.org,33125,1676491279695)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/data/default/testWithMapReduce/1486d61d8d2fe0efe2a608c7110b6c7d/.tmp/f2/35f8711edfdb4222926a2aec3e6ab181 as hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/data/default/testWithMapReduce/1486d61d8d2fe0efe2a608c7110b6c7d/f2/35f8711edfdb4222926a2aec3e6ab181 2023-02-15 20:01:22,180 DEBUG [rs(jenkins-hbase4.apache.org,33019,1676491279655)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,t43,1676491281022.bd3ac405f939af16962e576b69a6c71b. completed. 2023-02-15 20:01:22,180 DEBUG [rs(jenkins-hbase4.apache.org,33019,1676491279655)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,t43,1676491281022.bd3ac405f939af16962e576b69a6c71b. 2023-02-15 20:01:22,180 DEBUG [rs(jenkins-hbase4.apache.org,33019,1676491279655)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,g\xA7\xA7,1676491281022.2f6827bb8b2d8e3d5d25320352d1e239. 2023-02-15 20:01:22,180 DEBUG [rs(jenkins-hbase4.apache.org,33019,1676491279655)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,g\xA7\xA7,1676491281022.2f6827bb8b2d8e3d5d25320352d1e239. started... 2023-02-15 20:01:22,180 INFO [rs(jenkins-hbase4.apache.org,33019,1676491279655)-snapshot-pool-1] regionserver.HRegion(2744): Flushing 2f6827bb8b2d8e3d5d25320352d1e239 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-15 20:01:22,181 DEBUG [member: 'jenkins-hbase4.apache.org,33019,1676491279655' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 2/5 local region snapshots. 2023-02-15 20:01:22,183 INFO [rs(jenkins-hbase4.apache.org,33125,1676491279695)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/data/default/testWithMapReduce/1486d61d8d2fe0efe2a608c7110b6c7d/f2/35f8711edfdb4222926a2aec3e6ab181, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-15 20:01:22,185 INFO [rs(jenkins-hbase4.apache.org,33125,1676491279695)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 1486d61d8d2fe0efe2a608c7110b6c7d in 200ms, sequenceid=5, compaction requested=false 2023-02-15 20:01:22,185 DEBUG [rs(jenkins-hbase4.apache.org,33125,1676491279695)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 1486d61d8d2fe0efe2a608c7110b6c7d: 2023-02-15 20:01:22,185 DEBUG [rs(jenkins-hbase4.apache.org,33125,1676491279695)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,j\xCA\xCA,1676491281022.1486d61d8d2fe0efe2a608c7110b6c7d.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 20:01:22,185 DEBUG [rs(jenkins-hbase4.apache.org,33125,1676491279695)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-15 20:01:22,185 DEBUG [rs(jenkins-hbase4.apache.org,33125,1676491279695)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/data/default/testWithMapReduce/1486d61d8d2fe0efe2a608c7110b6c7d/f1/de28b0ab497640e590f6f466e3019c49] hfiles 2023-02-15 20:01:22,185 DEBUG [rs(jenkins-hbase4.apache.org,33125,1676491279695)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/data/default/testWithMapReduce/1486d61d8d2fe0efe2a608c7110b6c7d/f1/de28b0ab497640e590f6f466e3019c49 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 20:01:22,185 DEBUG [rs(jenkins-hbase4.apache.org,33125,1676491279695)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/data/default/testWithMapReduce/1486d61d8d2fe0efe2a608c7110b6c7d/f2/35f8711edfdb4222926a2aec3e6ab181] hfiles 2023-02-15 20:01:22,185 DEBUG [rs(jenkins-hbase4.apache.org,33125,1676491279695)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/data/default/testWithMapReduce/1486d61d8d2fe0efe2a608c7110b6c7d/f2/35f8711edfdb4222926a2aec3e6ab181 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 20:01:22,191 DEBUG [rs(jenkins-hbase4.apache.org,33019,1676491279655)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,aaa,1676491281022.dae437d89db301633beda20a6a7029ef. completed. 2023-02-15 20:01:22,191 DEBUG [rs(jenkins-hbase4.apache.org,33019,1676491279655)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,aaa,1676491281022.dae437d89db301633beda20a6a7029ef. 2023-02-15 20:01:22,191 DEBUG [member: 'jenkins-hbase4.apache.org,33019,1676491279655' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 3/5 local region snapshots. 2023-02-15 20:01:22,199 INFO [rs(jenkins-hbase4.apache.org,33019,1676491279655)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/data/default/testWithMapReduce/296941d2565b5d20cfd81aec8ac11565/.tmp/f1/57f05d0842a74ba98a471fe3065929c4 2023-02-15 20:01:22,213 INFO [rs(jenkins-hbase4.apache.org,33019,1676491279655)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/data/default/testWithMapReduce/2f6827bb8b2d8e3d5d25320352d1e239/.tmp/f1/92d7cc4cd31942629f77cf21178cc2d6 2023-02-15 20:01:22,221 DEBUG [rs(jenkins-hbase4.apache.org,33125,1676491279695)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,j\xCA\xCA,1676491281022.1486d61d8d2fe0efe2a608c7110b6c7d. completed. 2023-02-15 20:01:22,221 DEBUG [rs(jenkins-hbase4.apache.org,33125,1676491279695)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,j\xCA\xCA,1676491281022.1486d61d8d2fe0efe2a608c7110b6c7d. 2023-02-15 20:01:22,221 DEBUG [member: 'jenkins-hbase4.apache.org,33125,1676491279695' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 4/5 local region snapshots. 2023-02-15 20:01:22,235 INFO [rs(jenkins-hbase4.apache.org,33019,1676491279655)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/data/default/testWithMapReduce/296941d2565b5d20cfd81aec8ac11565/.tmp/f2/4e45595a7c04411e96f207fccb0aade2 2023-02-15 20:01:22,241 DEBUG [rs(jenkins-hbase4.apache.org,33019,1676491279655)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/data/default/testWithMapReduce/296941d2565b5d20cfd81aec8ac11565/.tmp/f1/57f05d0842a74ba98a471fe3065929c4 as hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/data/default/testWithMapReduce/296941d2565b5d20cfd81aec8ac11565/f1/57f05d0842a74ba98a471fe3065929c4 2023-02-15 20:01:22,246 INFO [rs(jenkins-hbase4.apache.org,33019,1676491279655)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/data/default/testWithMapReduce/296941d2565b5d20cfd81aec8ac11565/f1/57f05d0842a74ba98a471fe3065929c4, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-15 20:01:22,247 DEBUG [rs(jenkins-hbase4.apache.org,33019,1676491279655)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/data/default/testWithMapReduce/296941d2565b5d20cfd81aec8ac11565/.tmp/f2/4e45595a7c04411e96f207fccb0aade2 as hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/data/default/testWithMapReduce/296941d2565b5d20cfd81aec8ac11565/f2/4e45595a7c04411e96f207fccb0aade2 2023-02-15 20:01:22,248 INFO [rs(jenkins-hbase4.apache.org,33019,1676491279655)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/data/default/testWithMapReduce/2f6827bb8b2d8e3d5d25320352d1e239/.tmp/f2/5b1da113e4194abcba98b6f99fc34cb8 2023-02-15 20:01:22,254 INFO [rs(jenkins-hbase4.apache.org,33019,1676491279655)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/data/default/testWithMapReduce/296941d2565b5d20cfd81aec8ac11565/f2/4e45595a7c04411e96f207fccb0aade2, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-15 20:01:22,255 INFO [rs(jenkins-hbase4.apache.org,33019,1676491279655)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 296941d2565b5d20cfd81aec8ac11565 in 90ms, sequenceid=5, compaction requested=false 2023-02-15 20:01:22,255 DEBUG [rs(jenkins-hbase4.apache.org,33019,1676491279655)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 296941d2565b5d20cfd81aec8ac11565: 2023-02-15 20:01:22,256 DEBUG [rs(jenkins-hbase4.apache.org,33019,1676491279655)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,q\x11\x10,1676491281022.296941d2565b5d20cfd81aec8ac11565.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 20:01:22,256 DEBUG [rs(jenkins-hbase4.apache.org,33019,1676491279655)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-15 20:01:22,256 DEBUG [rs(jenkins-hbase4.apache.org,33019,1676491279655)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/data/default/testWithMapReduce/296941d2565b5d20cfd81aec8ac11565/f1/57f05d0842a74ba98a471fe3065929c4] hfiles 2023-02-15 20:01:22,256 DEBUG [rs(jenkins-hbase4.apache.org,33019,1676491279655)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/data/default/testWithMapReduce/296941d2565b5d20cfd81aec8ac11565/f1/57f05d0842a74ba98a471fe3065929c4 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 20:01:22,256 DEBUG [rs(jenkins-hbase4.apache.org,33019,1676491279655)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/data/default/testWithMapReduce/296941d2565b5d20cfd81aec8ac11565/f2/4e45595a7c04411e96f207fccb0aade2] hfiles 2023-02-15 20:01:22,256 DEBUG [rs(jenkins-hbase4.apache.org,33019,1676491279655)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/data/default/testWithMapReduce/296941d2565b5d20cfd81aec8ac11565/f2/4e45595a7c04411e96f207fccb0aade2 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 20:01:22,257 DEBUG [rs(jenkins-hbase4.apache.org,33019,1676491279655)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/data/default/testWithMapReduce/2f6827bb8b2d8e3d5d25320352d1e239/.tmp/f1/92d7cc4cd31942629f77cf21178cc2d6 as hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/data/default/testWithMapReduce/2f6827bb8b2d8e3d5d25320352d1e239/f1/92d7cc4cd31942629f77cf21178cc2d6 2023-02-15 20:01:22,263 INFO [rs(jenkins-hbase4.apache.org,33019,1676491279655)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/data/default/testWithMapReduce/2f6827bb8b2d8e3d5d25320352d1e239/f1/92d7cc4cd31942629f77cf21178cc2d6, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-15 20:01:22,264 DEBUG [rs(jenkins-hbase4.apache.org,33019,1676491279655)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/data/default/testWithMapReduce/2f6827bb8b2d8e3d5d25320352d1e239/.tmp/f2/5b1da113e4194abcba98b6f99fc34cb8 as hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/data/default/testWithMapReduce/2f6827bb8b2d8e3d5d25320352d1e239/f2/5b1da113e4194abcba98b6f99fc34cb8 2023-02-15 20:01:22,268 DEBUG [rs(jenkins-hbase4.apache.org,33019,1676491279655)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,q\x11\x10,1676491281022.296941d2565b5d20cfd81aec8ac11565. completed. 2023-02-15 20:01:22,268 DEBUG [rs(jenkins-hbase4.apache.org,33019,1676491279655)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,q\x11\x10,1676491281022.296941d2565b5d20cfd81aec8ac11565. 2023-02-15 20:01:22,268 DEBUG [member: 'jenkins-hbase4.apache.org,33019,1676491279655' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 4/5 local region snapshots. 2023-02-15 20:01:22,271 INFO [rs(jenkins-hbase4.apache.org,33019,1676491279655)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/data/default/testWithMapReduce/2f6827bb8b2d8e3d5d25320352d1e239/f2/5b1da113e4194abcba98b6f99fc34cb8, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-15 20:01:22,272 INFO [rs(jenkins-hbase4.apache.org,33019,1676491279655)-snapshot-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 2f6827bb8b2d8e3d5d25320352d1e239 in 92ms, sequenceid=5, compaction requested=false 2023-02-15 20:01:22,272 DEBUG [rs(jenkins-hbase4.apache.org,33019,1676491279655)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for 2f6827bb8b2d8e3d5d25320352d1e239: 2023-02-15 20:01:22,272 DEBUG [rs(jenkins-hbase4.apache.org,33019,1676491279655)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,g\xA7\xA7,1676491281022.2f6827bb8b2d8e3d5d25320352d1e239.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 20:01:22,272 DEBUG [rs(jenkins-hbase4.apache.org,33019,1676491279655)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-15 20:01:22,272 DEBUG [rs(jenkins-hbase4.apache.org,33019,1676491279655)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/data/default/testWithMapReduce/2f6827bb8b2d8e3d5d25320352d1e239/f1/92d7cc4cd31942629f77cf21178cc2d6] hfiles 2023-02-15 20:01:22,272 DEBUG [rs(jenkins-hbase4.apache.org,33019,1676491279655)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/data/default/testWithMapReduce/2f6827bb8b2d8e3d5d25320352d1e239/f1/92d7cc4cd31942629f77cf21178cc2d6 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 20:01:22,272 DEBUG [rs(jenkins-hbase4.apache.org,33019,1676491279655)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/data/default/testWithMapReduce/2f6827bb8b2d8e3d5d25320352d1e239/f2/5b1da113e4194abcba98b6f99fc34cb8] hfiles 2023-02-15 20:01:22,272 DEBUG [rs(jenkins-hbase4.apache.org,33019,1676491279655)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/data/default/testWithMapReduce/2f6827bb8b2d8e3d5d25320352d1e239/f2/5b1da113e4194abcba98b6f99fc34cb8 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 20:01:22,284 DEBUG [rs(jenkins-hbase4.apache.org,33019,1676491279655)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,g\xA7\xA7,1676491281022.2f6827bb8b2d8e3d5d25320352d1e239. completed. 2023-02-15 20:01:22,284 DEBUG [rs(jenkins-hbase4.apache.org,33019,1676491279655)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,g\xA7\xA7,1676491281022.2f6827bb8b2d8e3d5d25320352d1e239. 2023-02-15 20:01:22,284 DEBUG [member: 'jenkins-hbase4.apache.org,33019,1676491279655' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 5/5 local region snapshots. 2023-02-15 20:01:22,284 DEBUG [member: 'jenkins-hbase4.apache.org,33019,1676491279655' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 5 local region snapshots. 2023-02-15 20:01:22,284 DEBUG [member: 'jenkins-hbase4.apache.org,33019,1676491279655' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,33019,1676491279655 2023-02-15 20:01:22,284 DEBUG [member: 'jenkins-hbase4.apache.org,33019,1676491279655' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' locally completed 2023-02-15 20:01:22,284 DEBUG [member: 'jenkins-hbase4.apache.org,33019,1676491279655' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' completed for member 'jenkins-hbase4.apache.org,33019,1676491279655' in zk 2023-02-15 20:01:22,286 DEBUG [member: 'jenkins-hbase4.apache.org,33019,1676491279655' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' has notified controller of completion 2023-02-15 20:01:22,286 DEBUG [Listener at localhost/43949-EventThread] zookeeper.ZKWatcher(600): master:36865-0x1005992b68c0000, quorum=127.0.0.1:57384, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,33019,1676491279655 2023-02-15 20:01:22,286 DEBUG [member: 'jenkins-hbase4.apache.org,33019,1676491279655' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-15 20:01:22,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,33019,1676491279655 2023-02-15 20:01:22,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-15 20:01:22,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-15 20:01:22,286 DEBUG [member: 'jenkins-hbase4.apache.org,33019,1676491279655' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' completed. 2023-02-15 20:01:22,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-15 20:01:22,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-15 20:01:22,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 20:01:22,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33019,1676491279655 2023-02-15 20:01:22,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33125,1676491279695 2023-02-15 20:01:22,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-15 20:01:22,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 20:01:22,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33019,1676491279655 2023-02-15 20:01:22,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' member 'jenkins-hbase4.apache.org,33019,1676491279655': 2023-02-15 20:01:22,290 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,33019,1676491279655' released barrier for procedure'testWithMapReduceAndOfflineHBaseMultiRegion', counting down latch. Waiting for 1 more 2023-02-15 20:01:22,463 DEBUG [Listener at localhost/43949] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-15 20:01:22,465 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36865] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-15 20:01:22,465 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36865] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-15 20:01:22,465 DEBUG [Listener at localhost/43949] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-02-15 20:01:22,553 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-datanode.properties,hadoop-metrics2.properties 2023-02-15 20:01:22,559 INFO [rs(jenkins-hbase4.apache.org,33125,1676491279695)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/data/default/testWithMapReduce/97b529ba0e37421e99fb43de9d23d817/.tmp/f2/b71d28cc99fb44eba8165e9e0657a35f 2023-02-15 20:01:22,567 DEBUG [rs(jenkins-hbase4.apache.org,33125,1676491279695)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/data/default/testWithMapReduce/97b529ba0e37421e99fb43de9d23d817/.tmp/f1/31b2ff03534b4586a751a4d981d67074 as hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/data/default/testWithMapReduce/97b529ba0e37421e99fb43de9d23d817/f1/31b2ff03534b4586a751a4d981d67074 2023-02-15 20:01:22,576 INFO [rs(jenkins-hbase4.apache.org,33125,1676491279695)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/data/default/testWithMapReduce/97b529ba0e37421e99fb43de9d23d817/f1/31b2ff03534b4586a751a4d981d67074, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-15 20:01:22,577 DEBUG [rs(jenkins-hbase4.apache.org,33125,1676491279695)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/data/default/testWithMapReduce/97b529ba0e37421e99fb43de9d23d817/.tmp/f2/b71d28cc99fb44eba8165e9e0657a35f as hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/data/default/testWithMapReduce/97b529ba0e37421e99fb43de9d23d817/f2/b71d28cc99fb44eba8165e9e0657a35f 2023-02-15 20:01:22,584 INFO [rs(jenkins-hbase4.apache.org,33125,1676491279695)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/data/default/testWithMapReduce/97b529ba0e37421e99fb43de9d23d817/f2/b71d28cc99fb44eba8165e9e0657a35f, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-15 20:01:22,585 INFO [rs(jenkins-hbase4.apache.org,33125,1676491279695)-snapshot-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 97b529ba0e37421e99fb43de9d23d817 in 630ms, sequenceid=5, compaction requested=false 2023-02-15 20:01:22,586 DEBUG [rs(jenkins-hbase4.apache.org,33125,1676491279695)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for 97b529ba0e37421e99fb43de9d23d817: 2023-02-15 20:01:22,586 DEBUG [rs(jenkins-hbase4.apache.org,33125,1676491279695)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,m\xED\xED,1676491281022.97b529ba0e37421e99fb43de9d23d817.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 20:01:22,586 DEBUG [rs(jenkins-hbase4.apache.org,33125,1676491279695)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-15 20:01:22,586 DEBUG [rs(jenkins-hbase4.apache.org,33125,1676491279695)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/data/default/testWithMapReduce/97b529ba0e37421e99fb43de9d23d817/f1/31b2ff03534b4586a751a4d981d67074] hfiles 2023-02-15 20:01:22,586 DEBUG [rs(jenkins-hbase4.apache.org,33125,1676491279695)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/data/default/testWithMapReduce/97b529ba0e37421e99fb43de9d23d817/f1/31b2ff03534b4586a751a4d981d67074 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 20:01:22,586 DEBUG [rs(jenkins-hbase4.apache.org,33125,1676491279695)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/data/default/testWithMapReduce/97b529ba0e37421e99fb43de9d23d817/f2/b71d28cc99fb44eba8165e9e0657a35f] hfiles 2023-02-15 20:01:22,586 DEBUG [rs(jenkins-hbase4.apache.org,33125,1676491279695)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/data/default/testWithMapReduce/97b529ba0e37421e99fb43de9d23d817/f2/b71d28cc99fb44eba8165e9e0657a35f for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 20:01:22,965 DEBUG [Listener at localhost/43949] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-15 20:01:22,967 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36865] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-15 20:01:22,967 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36865] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-15 20:01:22,968 DEBUG [Listener at localhost/43949] client.HBaseAdmin(2428): (#5) Sleeping: 1000ms while waiting for snapshot completion. 2023-02-15 20:01:23,251 DEBUG [rs(jenkins-hbase4.apache.org,33125,1676491279695)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,m\xED\xED,1676491281022.97b529ba0e37421e99fb43de9d23d817. completed. 2023-02-15 20:01:23,251 DEBUG [rs(jenkins-hbase4.apache.org,33125,1676491279695)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,m\xED\xED,1676491281022.97b529ba0e37421e99fb43de9d23d817. 2023-02-15 20:01:23,251 DEBUG [member: 'jenkins-hbase4.apache.org,33125,1676491279695' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 5/5 local region snapshots. 2023-02-15 20:01:23,251 DEBUG [member: 'jenkins-hbase4.apache.org,33125,1676491279695' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 5 local region snapshots. 2023-02-15 20:01:23,251 DEBUG [member: 'jenkins-hbase4.apache.org,33125,1676491279695' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,33125,1676491279695 2023-02-15 20:01:23,251 DEBUG [member: 'jenkins-hbase4.apache.org,33125,1676491279695' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' locally completed 2023-02-15 20:01:23,251 DEBUG [member: 'jenkins-hbase4.apache.org,33125,1676491279695' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' completed for member 'jenkins-hbase4.apache.org,33125,1676491279695' in zk 2023-02-15 20:01:23,254 DEBUG [member: 'jenkins-hbase4.apache.org,33125,1676491279695' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' has notified controller of completion 2023-02-15 20:01:23,254 DEBUG [Listener at localhost/43949-EventThread] zookeeper.ZKWatcher(600): master:36865-0x1005992b68c0000, quorum=127.0.0.1:57384, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,33125,1676491279695 2023-02-15 20:01:23,254 DEBUG [member: 'jenkins-hbase4.apache.org,33125,1676491279695' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-15 20:01:23,254 DEBUG [member: 'jenkins-hbase4.apache.org,33125,1676491279695' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' completed. 2023-02-15 20:01:23,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,33125,1676491279695 2023-02-15 20:01:23,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-15 20:01:23,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-15 20:01:23,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-15 20:01:23,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-15 20:01:23,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 20:01:23,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33019,1676491279655 2023-02-15 20:01:23,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33125,1676491279695 2023-02-15 20:01:23,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-15 20:01:23,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 20:01:23,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33019,1676491279655 2023-02-15 20:01:23,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33125,1676491279695 2023-02-15 20:01:23,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' member 'jenkins-hbase4.apache.org,33125,1676491279695': 2023-02-15 20:01:23,258 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,33125,1676491279695' released barrier for procedure'testWithMapReduceAndOfflineHBaseMultiRegion', counting down latch. Waiting for 0 more 2023-02-15 20:01:23,258 INFO [(jenkins-hbase4.apache.org,36865,1676491279587)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' execution completed 2023-02-15 20:01:23,258 DEBUG [(jenkins-hbase4.apache.org,36865,1676491279587)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-15 20:01:23,258 DEBUG [(jenkins-hbase4.apache.org,36865,1676491279587)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-15 20:01:23,258 DEBUG [(jenkins-hbase4.apache.org,36865,1676491279587)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 20:01:23,258 INFO [(jenkins-hbase4.apache.org,36865,1676491279587)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMapReduceAndOfflineHBaseMultiRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-02-15 20:01:23,260 DEBUG [Listener at localhost/43949-EventThread] zookeeper.ZKWatcher(600): regionserver:33125-0x1005992b68c0002, quorum=127.0.0.1:57384, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 20:01:23,260 DEBUG [Listener at localhost/43949-EventThread] zookeeper.ZKWatcher(600): master:36865-0x1005992b68c0000, quorum=127.0.0.1:57384, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 20:01:23,260 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 20:01:23,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 20:01:23,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 20:01:23,260 DEBUG [Listener at localhost/43949-EventThread] zookeeper.ZKWatcher(600): regionserver:33125-0x1005992b68c0002, quorum=127.0.0.1:57384, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-15 20:01:23,260 DEBUG [Listener at localhost/43949-EventThread] zookeeper.ZKWatcher(600): regionserver:33019-0x1005992b68c0001, quorum=127.0.0.1:57384, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 20:01:23,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-15 20:01:23,260 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 20:01:23,260 DEBUG [Listener at localhost/43949-EventThread] zookeeper.ZKWatcher(600): regionserver:33019-0x1005992b68c0001, quorum=127.0.0.1:57384, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-15 20:01:23,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 20:01:23,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-15 20:01:23,260 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-15 20:01:23,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-15 20:01:23,260 DEBUG [(jenkins-hbase4.apache.org,36865,1676491279587)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36865-0x1005992b68c0000, quorum=127.0.0.1:57384, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,33019,1676491279655 2023-02-15 20:01:23,261 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-15 20:01:23,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-15 20:01:23,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-15 20:01:23,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 20:01:23,261 DEBUG [(jenkins-hbase4.apache.org,36865,1676491279587)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36865-0x1005992b68c0000, quorum=127.0.0.1:57384, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,33125,1676491279695 2023-02-15 20:01:23,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 20:01:23,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 20:01:23,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-15 20:01:23,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 20:01:23,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33019,1676491279655 2023-02-15 20:01:23,262 DEBUG [(jenkins-hbase4.apache.org,36865,1676491279587)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36865-0x1005992b68c0000, quorum=127.0.0.1:57384, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,33019,1676491279655 2023-02-15 20:01:23,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33125,1676491279695 2023-02-15 20:01:23,263 DEBUG [(jenkins-hbase4.apache.org,36865,1676491279587)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36865-0x1005992b68c0000, quorum=127.0.0.1:57384, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,33125,1676491279695 2023-02-15 20:01:23,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-15 20:01:23,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 20:01:23,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33019,1676491279655 2023-02-15 20:01:23,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33125,1676491279695 2023-02-15 20:01:23,269 DEBUG [Listener at localhost/43949-EventThread] zookeeper.ZKWatcher(600): master:36865-0x1005992b68c0000, quorum=127.0.0.1:57384, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,33125,1676491279695 2023-02-15 20:01:23,269 DEBUG [Listener at localhost/43949-EventThread] zookeeper.ZKWatcher(600): regionserver:33125-0x1005992b68c0002, quorum=127.0.0.1:57384, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-15 20:01:23,269 DEBUG [Listener at localhost/43949-EventThread] zookeeper.ZKWatcher(600): regionserver:33019-0x1005992b68c0001, quorum=127.0.0.1:57384, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-15 20:01:23,269 DEBUG [Listener at localhost/43949-EventThread] zookeeper.ZKWatcher(600): master:36865-0x1005992b68c0000, quorum=127.0.0.1:57384, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 20:01:23,269 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-15 20:01:23,270 DEBUG [Listener at localhost/43949-EventThread] zookeeper.ZKWatcher(600): regionserver:33019-0x1005992b68c0001, quorum=127.0.0.1:57384, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-15 20:01:23,270 DEBUG [Listener at localhost/43949-EventThread] zookeeper.ZKWatcher(600): master:36865-0x1005992b68c0000, quorum=127.0.0.1:57384, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,33019,1676491279655 2023-02-15 20:01:23,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-15 20:01:23,269 DEBUG [Listener at localhost/43949-EventThread] zookeeper.ZKWatcher(600): regionserver:33125-0x1005992b68c0002, quorum=127.0.0.1:57384, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-15 20:01:23,270 DEBUG [(jenkins-hbase4.apache.org,36865,1676491279587)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-15 20:01:23,269 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-15 20:01:23,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-15 20:01:23,270 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 20:01:23,270 DEBUG [Listener at localhost/43949-EventThread] zookeeper.ZKWatcher(600): master:36865-0x1005992b68c0000, quorum=127.0.0.1:57384, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 20:01:23,271 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 20:01:23,271 DEBUG [Listener at localhost/43949-EventThread] zookeeper.ZKWatcher(600): master:36865-0x1005992b68c0000, quorum=127.0.0.1:57384, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,33125,1676491279695 2023-02-15 20:01:23,271 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-15 20:01:23,271 DEBUG [Listener at localhost/43949-EventThread] zookeeper.ZKWatcher(600): master:36865-0x1005992b68c0000, quorum=127.0.0.1:57384, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 20:01:23,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-15 20:01:23,271 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-15 20:01:23,271 DEBUG [Listener at localhost/43949-EventThread] zookeeper.ZKWatcher(600): master:36865-0x1005992b68c0000, quorum=127.0.0.1:57384, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,33019,1676491279655 2023-02-15 20:01:23,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-15 20:01:23,271 DEBUG [Listener at localhost/43949-EventThread] zookeeper.ZKWatcher(600): master:36865-0x1005992b68c0000, quorum=127.0.0.1:57384, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 20:01:23,271 DEBUG [Listener at localhost/43949-EventThread] zookeeper.ZKWatcher(600): master:36865-0x1005992b68c0000, quorum=127.0.0.1:57384, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 20:01:23,272 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/.hbase-snapshot/.tmp/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 20:01:23,311 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/.hbase-snapshot/.tmp/testWithMapReduceAndOfflineHBaseMultiRegion to hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/.hbase-snapshot/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 20:01:23,339 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot testWithMapReduceAndOfflineHBaseMultiRegion of table testWithMapReduce completed 2023-02-15 20:01:23,339 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/.hbase-snapshot/.tmp/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 20:01:23,339 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/.hbase-snapshot/.tmp/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 20:01:23,340 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot testWithMapReduceAndOfflineHBaseMultiRegion C_M_SNAPSHOT_TABLE on table testWithMapReduce at 1676491281856Consolidate snapshot: testWithMapReduceAndOfflineHBaseMultiRegion at 1676491283271 (+1415 ms)Loading Region manifests for testWithMapReduceAndOfflineHBaseMultiRegion at 1676491283271Writing data manifest for testWithMapReduceAndOfflineHBaseMultiRegion at 1676491283282 (+11 ms)Verifying snapshot: testWithMapReduceAndOfflineHBaseMultiRegion at 1676491283293 (+11 ms)Snapshot testWithMapReduceAndOfflineHBaseMultiRegion of table testWithMapReduce completed at 1676491283339 (+46 ms) 2023-02-15 20:01:23,341 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=32, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-15 20:01:23,343 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=32, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED in 1.4840 sec 2023-02-15 20:01:23,968 DEBUG [Listener at localhost/43949] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-15 20:01:23,970 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36865] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-15 20:01:23,970 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36865] snapshot.SnapshotManager(401): Snapshot '{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' has completed, notifying client. 2023-02-15 20:01:23,970 INFO [Listener at localhost/43949] snapshot.SnapshotTestingUtils(399): Confirming snapshot exists. 2023-02-15 20:01:23,975 INFO [Listener at localhost/43949] snapshot.SnapshotTestingUtils(406): validating snapshot. 2023-02-15 20:01:23,983 INFO [Listener at localhost/43949] mapreduce.TableSnapshotInputFormatTestBase(218): load different values 2023-02-15 20:01:24,022 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33125] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 6760 Client: jenkins//172.31.14.131 first region in multi=testWithMapReduce,j\xCA\xCA,1676491281022.1486d61d8d2fe0efe2a608c7110b6c7d. 2023-02-15 20:01:24,028 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33019] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 10816 Client: jenkins//172.31.14.131 first region in multi=testWithMapReduce,aaa,1676491281022.dae437d89db301633beda20a6a7029ef. 2023-02-15 20:01:24,105 INFO [Listener at localhost/43949] mapreduce.TableSnapshotInputFormatTestBase(222): cause flush to create new files in the region 2023-02-15 20:01:24,110 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36865] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-15 20:01:24,113 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36865] procedure.ProcedureCoordinator(165): Submitting procedure testWithMapReduce 2023-02-15 20:01:24,115 INFO [(jenkins-hbase4.apache.org,36865,1676491279587)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMapReduce' 2023-02-15 20:01:24,115 DEBUG [(jenkins-hbase4.apache.org,36865,1676491279587)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-15 20:01:24,116 DEBUG [(jenkins-hbase4.apache.org,36865,1676491279587)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMapReduce' starting 'acquire' 2023-02-15 20:01:24,116 DEBUG [(jenkins-hbase4.apache.org,36865,1676491279587)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMapReduce', kicking off acquire phase on members. 2023-02-15 20:01:24,117 DEBUG [(jenkins-hbase4.apache.org,36865,1676491279587)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36865-0x1005992b68c0000, quorum=127.0.0.1:57384, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-15 20:01:24,117 DEBUG [(jenkins-hbase4.apache.org,36865,1676491279587)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-15 20:01:24,118 DEBUG [Listener at localhost/43949-EventThread] zookeeper.ZKWatcher(600): regionserver:33125-0x1005992b68c0002, quorum=127.0.0.1:57384, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-15 20:01:24,118 DEBUG [Listener at localhost/43949-EventThread] zookeeper.ZKWatcher(600): regionserver:33019-0x1005992b68c0001, quorum=127.0.0.1:57384, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-15 20:01:24,118 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-15 20:01:24,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-15 20:01:24,118 DEBUG [(jenkins-hbase4.apache.org,36865,1676491279587)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,33019,1676491279655 2023-02-15 20:01:24,118 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-15 20:01:24,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-15 20:01:24,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-15 20:01:24,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-15 20:01:24,119 DEBUG [(jenkins-hbase4.apache.org,36865,1676491279587)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36865-0x1005992b68c0000, quorum=127.0.0.1:57384, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,33019,1676491279655 2023-02-15 20:01:24,119 DEBUG [(jenkins-hbase4.apache.org,36865,1676491279587)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,33125,1676491279695 2023-02-15 20:01:24,119 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33125-0x1005992b68c0002, quorum=127.0.0.1:57384, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-15 20:01:24,119 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33019-0x1005992b68c0001, quorum=127.0.0.1:57384, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-15 20:01:24,120 DEBUG [(jenkins-hbase4.apache.org,36865,1676491279587)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36865-0x1005992b68c0000, quorum=127.0.0.1:57384, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,33125,1676491279695 2023-02-15 20:01:24,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-15 20:01:24,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-15 20:01:24,120 DEBUG [(jenkins-hbase4.apache.org,36865,1676491279587)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-15 20:01:24,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-15 20:01:24,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-15 20:01:24,120 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMapReduce 2023-02-15 20:01:24,120 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMapReduce 2023-02-15 20:01:24,120 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduce 2023-02-15 20:01:24,120 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduce 2023-02-15 20:01:24,124 DEBUG [member: 'jenkins-hbase4.apache.org,33125,1676491279695' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduce' with timeout 60000ms 2023-02-15 20:01:24,124 DEBUG [member: 'jenkins-hbase4.apache.org,33019,1676491279655' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduce' with timeout 60000ms 2023-02-15 20:01:24,124 DEBUG [member: 'jenkins-hbase4.apache.org,33019,1676491279655' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-15 20:01:24,124 DEBUG [member: 'jenkins-hbase4.apache.org,33125,1676491279695' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-15 20:01:24,125 DEBUG [member: 'jenkins-hbase4.apache.org,33019,1676491279655' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduce' starting 'acquire' stage 2023-02-15 20:01:24,125 DEBUG [member: 'jenkins-hbase4.apache.org,33125,1676491279695' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduce' starting 'acquire' stage 2023-02-15 20:01:24,126 DEBUG [rs(jenkins-hbase4.apache.org,33019,1676491279655)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,d\x84\x84,1676491281022.2a1c7014d8c6c818f8ea2f67ef6b2118. 2023-02-15 20:01:24,127 DEBUG [rs(jenkins-hbase4.apache.org,33019,1676491279655)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,d\x84\x84,1676491281022.2a1c7014d8c6c818f8ea2f67ef6b2118. started... 2023-02-15 20:01:24,127 INFO [rs(jenkins-hbase4.apache.org,33019,1676491279655)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 2a1c7014d8c6c818f8ea2f67ef6b2118 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-15 20:01:24,128 DEBUG [rs(jenkins-hbase4.apache.org,33125,1676491279695)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,,1676491281022.9fdf60e81d6a22352a6acb2fcb8c9f3e. 2023-02-15 20:01:24,128 DEBUG [rs(jenkins-hbase4.apache.org,33125,1676491279695)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,,1676491281022.9fdf60e81d6a22352a6acb2fcb8c9f3e. started... 2023-02-15 20:01:24,129 DEBUG [rs(jenkins-hbase4.apache.org,33019,1676491279655)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,t43,1676491281022.bd3ac405f939af16962e576b69a6c71b. 2023-02-15 20:01:24,129 DEBUG [rs(jenkins-hbase4.apache.org,33125,1676491279695)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 9fdf60e81d6a22352a6acb2fcb8c9f3e: 2023-02-15 20:01:24,129 DEBUG [rs(jenkins-hbase4.apache.org,33019,1676491279655)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,t43,1676491281022.bd3ac405f939af16962e576b69a6c71b. started... 2023-02-15 20:01:24,129 DEBUG [rs(jenkins-hbase4.apache.org,33125,1676491279695)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,,1676491281022.9fdf60e81d6a22352a6acb2fcb8c9f3e. 2023-02-15 20:01:24,129 DEBUG [rs(jenkins-hbase4.apache.org,33125,1676491279695)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,wWV,1676491281022.69ce6540f755e21eae3d289ad231610b. 2023-02-15 20:01:24,129 DEBUG [rs(jenkins-hbase4.apache.org,33125,1676491279695)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,wWV,1676491281022.69ce6540f755e21eae3d289ad231610b. started... 2023-02-15 20:01:24,129 INFO [rs(jenkins-hbase4.apache.org,33019,1676491279655)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing bd3ac405f939af16962e576b69a6c71b 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-15 20:01:24,129 INFO [rs(jenkins-hbase4.apache.org,33125,1676491279695)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 69ce6540f755e21eae3d289ad231610b 2/2 column families, dataSize=248.22 KB heapSize=634.25 KB 2023-02-15 20:01:24,130 DEBUG [member: 'jenkins-hbase4.apache.org,33125,1676491279695' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 5 regions 2023-02-15 20:01:24,130 DEBUG [member: 'jenkins-hbase4.apache.org,33125,1676491279695' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-15 20:01:24,130 DEBUG [rs(jenkins-hbase4.apache.org,33125,1676491279695)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,m\xED\xED,1676491281022.97b529ba0e37421e99fb43de9d23d817. 2023-02-15 20:01:24,131 DEBUG [member: 'jenkins-hbase4.apache.org,33125,1676491279695' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/5 local region flush tasks. 2023-02-15 20:01:24,131 DEBUG [rs(jenkins-hbase4.apache.org,33019,1676491279655)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,aaa,1676491281022.dae437d89db301633beda20a6a7029ef. 2023-02-15 20:01:24,131 DEBUG [rs(jenkins-hbase4.apache.org,33125,1676491279695)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,zz{,1676491281022.2241125b7d23be16c4949dc36e627f50. 2023-02-15 20:01:24,131 DEBUG [member: 'jenkins-hbase4.apache.org,33019,1676491279655' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 5 regions 2023-02-15 20:01:24,132 DEBUG [member: 'jenkins-hbase4.apache.org,33019,1676491279655' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-15 20:01:24,131 DEBUG [rs(jenkins-hbase4.apache.org,33125,1676491279695)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,zz{,1676491281022.2241125b7d23be16c4949dc36e627f50. started... 2023-02-15 20:01:24,131 DEBUG [rs(jenkins-hbase4.apache.org,33019,1676491279655)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,aaa,1676491281022.dae437d89db301633beda20a6a7029ef. started... 2023-02-15 20:01:24,131 DEBUG [rs(jenkins-hbase4.apache.org,33125,1676491279695)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,m\xED\xED,1676491281022.97b529ba0e37421e99fb43de9d23d817. started... 2023-02-15 20:01:24,133 INFO [rs(jenkins-hbase4.apache.org,33019,1676491279655)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing dae437d89db301633beda20a6a7029ef 2/2 column families, dataSize=248.22 KB heapSize=634.25 KB 2023-02-15 20:01:24,133 INFO [rs(jenkins-hbase4.apache.org,33125,1676491279695)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 97b529ba0e37421e99fb43de9d23d817 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-15 20:01:24,133 DEBUG [rs(jenkins-hbase4.apache.org,33125,1676491279695)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 2241125b7d23be16c4949dc36e627f50: 2023-02-15 20:01:24,133 DEBUG [rs(jenkins-hbase4.apache.org,33125,1676491279695)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,zz{,1676491281022.2241125b7d23be16c4949dc36e627f50. 2023-02-15 20:01:24,136 DEBUG [rs(jenkins-hbase4.apache.org,33125,1676491279695)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,j\xCA\xCA,1676491281022.1486d61d8d2fe0efe2a608c7110b6c7d. 2023-02-15 20:01:24,136 DEBUG [member: 'jenkins-hbase4.apache.org,33125,1676491279695' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/5 local region flush tasks. 2023-02-15 20:01:24,137 DEBUG [rs(jenkins-hbase4.apache.org,33125,1676491279695)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,j\xCA\xCA,1676491281022.1486d61d8d2fe0efe2a608c7110b6c7d. started... 2023-02-15 20:01:24,137 INFO [rs(jenkins-hbase4.apache.org,33125,1676491279695)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 1486d61d8d2fe0efe2a608c7110b6c7d 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-15 20:01:24,168 INFO [rs(jenkins-hbase4.apache.org,33019,1676491279655)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/data/default/testWithMapReduce/2a1c7014d8c6c818f8ea2f67ef6b2118/.tmp/f1/288506a592344f008f89c77b3a488a09 2023-02-15 20:01:24,178 INFO [rs(jenkins-hbase4.apache.org,33125,1676491279695)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/data/default/testWithMapReduce/69ce6540f755e21eae3d289ad231610b/.tmp/f1/9a475823702840c2b64f9cf56139a2a4 2023-02-15 20:01:24,192 INFO [rs(jenkins-hbase4.apache.org,33019,1676491279655)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/data/default/testWithMapReduce/bd3ac405f939af16962e576b69a6c71b/.tmp/f1/9f781d1c9afc4a26bf42fc9059ab84b8 2023-02-15 20:01:24,200 INFO [rs(jenkins-hbase4.apache.org,33125,1676491279695)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/data/default/testWithMapReduce/97b529ba0e37421e99fb43de9d23d817/.tmp/f1/ca008fefdb23459f96ad2032d24996f3 2023-02-15 20:01:24,204 INFO [rs(jenkins-hbase4.apache.org,33125,1676491279695)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/data/default/testWithMapReduce/1486d61d8d2fe0efe2a608c7110b6c7d/.tmp/f1/5a4ae29f891b49a7ad990ab7ccf1fb0d 2023-02-15 20:01:24,232 INFO [rs(jenkins-hbase4.apache.org,33019,1676491279655)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/data/default/testWithMapReduce/2a1c7014d8c6c818f8ea2f67ef6b2118/.tmp/f2/07461035c56e4dbbb8630026497fc2d0 2023-02-15 20:01:24,238 DEBUG [rs(jenkins-hbase4.apache.org,33019,1676491279655)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/data/default/testWithMapReduce/2a1c7014d8c6c818f8ea2f67ef6b2118/.tmp/f1/288506a592344f008f89c77b3a488a09 as hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/data/default/testWithMapReduce/2a1c7014d8c6c818f8ea2f67ef6b2118/f1/288506a592344f008f89c77b3a488a09 2023-02-15 20:01:24,241 INFO [rs(jenkins-hbase4.apache.org,33019,1676491279655)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/data/default/testWithMapReduce/dae437d89db301633beda20a6a7029ef/.tmp/f1/e686000a2c22415f976a06b31caef570 2023-02-15 20:01:24,241 INFO [rs(jenkins-hbase4.apache.org,33125,1676491279695)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/data/default/testWithMapReduce/69ce6540f755e21eae3d289ad231610b/.tmp/f2/28e454d39d1647f68f2d7dc8bf029c61 2023-02-15 20:01:24,246 INFO [rs(jenkins-hbase4.apache.org,33019,1676491279655)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/data/default/testWithMapReduce/2a1c7014d8c6c818f8ea2f67ef6b2118/f1/288506a592344f008f89c77b3a488a09, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-15 20:01:24,247 DEBUG [rs(jenkins-hbase4.apache.org,33019,1676491279655)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/data/default/testWithMapReduce/2a1c7014d8c6c818f8ea2f67ef6b2118/.tmp/f2/07461035c56e4dbbb8630026497fc2d0 as hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/data/default/testWithMapReduce/2a1c7014d8c6c818f8ea2f67ef6b2118/f2/07461035c56e4dbbb8630026497fc2d0 2023-02-15 20:01:24,248 DEBUG [rs(jenkins-hbase4.apache.org,33125,1676491279695)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/data/default/testWithMapReduce/69ce6540f755e21eae3d289ad231610b/.tmp/f1/9a475823702840c2b64f9cf56139a2a4 as hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/data/default/testWithMapReduce/69ce6540f755e21eae3d289ad231610b/f1/9a475823702840c2b64f9cf56139a2a4 2023-02-15 20:01:24,253 INFO [rs(jenkins-hbase4.apache.org,33125,1676491279695)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/data/default/testWithMapReduce/69ce6540f755e21eae3d289ad231610b/f1/9a475823702840c2b64f9cf56139a2a4, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-15 20:01:24,254 DEBUG [rs(jenkins-hbase4.apache.org,33125,1676491279695)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/data/default/testWithMapReduce/69ce6540f755e21eae3d289ad231610b/.tmp/f2/28e454d39d1647f68f2d7dc8bf029c61 as hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/data/default/testWithMapReduce/69ce6540f755e21eae3d289ad231610b/f2/28e454d39d1647f68f2d7dc8bf029c61 2023-02-15 20:01:24,255 INFO [rs(jenkins-hbase4.apache.org,33019,1676491279655)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/data/default/testWithMapReduce/2a1c7014d8c6c818f8ea2f67ef6b2118/f2/07461035c56e4dbbb8630026497fc2d0, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-15 20:01:24,256 INFO [rs(jenkins-hbase4.apache.org,33019,1676491279655)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 2a1c7014d8c6c818f8ea2f67ef6b2118 in 129ms, sequenceid=9, compaction requested=false 2023-02-15 20:01:24,256 DEBUG [rs(jenkins-hbase4.apache.org,33019,1676491279655)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testWithMapReduce' 2023-02-15 20:01:24,257 DEBUG [rs(jenkins-hbase4.apache.org,33019,1676491279655)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 2a1c7014d8c6c818f8ea2f67ef6b2118: 2023-02-15 20:01:24,257 DEBUG [rs(jenkins-hbase4.apache.org,33019,1676491279655)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,d\x84\x84,1676491281022.2a1c7014d8c6c818f8ea2f67ef6b2118. 2023-02-15 20:01:24,260 INFO [rs(jenkins-hbase4.apache.org,33125,1676491279695)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/data/default/testWithMapReduce/69ce6540f755e21eae3d289ad231610b/f2/28e454d39d1647f68f2d7dc8bf029c61, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-15 20:01:24,261 INFO [rs(jenkins-hbase4.apache.org,33125,1676491279695)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~248.22 KB/254176, heapSize ~634.22 KB/649440, currentSize=0 B/0 for 69ce6540f755e21eae3d289ad231610b in 132ms, sequenceid=9, compaction requested=false 2023-02-15 20:01:24,265 DEBUG [rs(jenkins-hbase4.apache.org,33125,1676491279695)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 69ce6540f755e21eae3d289ad231610b: 2023-02-15 20:01:24,265 DEBUG [rs(jenkins-hbase4.apache.org,33125,1676491279695)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,wWV,1676491281022.69ce6540f755e21eae3d289ad231610b. 2023-02-15 20:01:24,265 DEBUG [member: 'jenkins-hbase4.apache.org,33125,1676491279695' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/5 local region flush tasks. 2023-02-15 20:01:24,268 DEBUG [member: 'jenkins-hbase4.apache.org,33019,1676491279655' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/5 local region flush tasks. 2023-02-15 20:01:24,268 DEBUG [rs(jenkins-hbase4.apache.org,33019,1676491279655)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,q\x11\x10,1676491281022.296941d2565b5d20cfd81aec8ac11565. 2023-02-15 20:01:24,268 DEBUG [rs(jenkins-hbase4.apache.org,33019,1676491279655)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,q\x11\x10,1676491281022.296941d2565b5d20cfd81aec8ac11565. started... 2023-02-15 20:01:24,268 INFO [rs(jenkins-hbase4.apache.org,33019,1676491279655)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 296941d2565b5d20cfd81aec8ac11565 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-15 20:01:24,275 INFO [rs(jenkins-hbase4.apache.org,33125,1676491279695)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/data/default/testWithMapReduce/97b529ba0e37421e99fb43de9d23d817/.tmp/f2/62e26e9917fb4e3fa67e79d5123a4ed9 2023-02-15 20:01:24,279 INFO [rs(jenkins-hbase4.apache.org,33125,1676491279695)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/data/default/testWithMapReduce/1486d61d8d2fe0efe2a608c7110b6c7d/.tmp/f2/94f127fb83ce46dc9430066b4bbd7084 2023-02-15 20:01:24,280 INFO [rs(jenkins-hbase4.apache.org,33019,1676491279655)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/data/default/testWithMapReduce/bd3ac405f939af16962e576b69a6c71b/.tmp/f2/f455fa0d50424335a1916a172e5effa0 2023-02-15 20:01:24,287 DEBUG [rs(jenkins-hbase4.apache.org,33125,1676491279695)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/data/default/testWithMapReduce/97b529ba0e37421e99fb43de9d23d817/.tmp/f1/ca008fefdb23459f96ad2032d24996f3 as hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/data/default/testWithMapReduce/97b529ba0e37421e99fb43de9d23d817/f1/ca008fefdb23459f96ad2032d24996f3 2023-02-15 20:01:24,288 DEBUG [rs(jenkins-hbase4.apache.org,33125,1676491279695)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/data/default/testWithMapReduce/1486d61d8d2fe0efe2a608c7110b6c7d/.tmp/f1/5a4ae29f891b49a7ad990ab7ccf1fb0d as hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/data/default/testWithMapReduce/1486d61d8d2fe0efe2a608c7110b6c7d/f1/5a4ae29f891b49a7ad990ab7ccf1fb0d 2023-02-15 20:01:24,292 INFO [rs(jenkins-hbase4.apache.org,33019,1676491279655)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/data/default/testWithMapReduce/dae437d89db301633beda20a6a7029ef/.tmp/f2/363686351bff4e97bc0171501422cc36 2023-02-15 20:01:24,293 DEBUG [rs(jenkins-hbase4.apache.org,33019,1676491279655)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/data/default/testWithMapReduce/bd3ac405f939af16962e576b69a6c71b/.tmp/f1/9f781d1c9afc4a26bf42fc9059ab84b8 as hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/data/default/testWithMapReduce/bd3ac405f939af16962e576b69a6c71b/f1/9f781d1c9afc4a26bf42fc9059ab84b8 2023-02-15 20:01:24,296 INFO [rs(jenkins-hbase4.apache.org,33125,1676491279695)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/data/default/testWithMapReduce/97b529ba0e37421e99fb43de9d23d817/f1/ca008fefdb23459f96ad2032d24996f3, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-15 20:01:24,298 DEBUG [rs(jenkins-hbase4.apache.org,33125,1676491279695)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/data/default/testWithMapReduce/97b529ba0e37421e99fb43de9d23d817/.tmp/f2/62e26e9917fb4e3fa67e79d5123a4ed9 as hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/data/default/testWithMapReduce/97b529ba0e37421e99fb43de9d23d817/f2/62e26e9917fb4e3fa67e79d5123a4ed9 2023-02-15 20:01:24,299 DEBUG [rs(jenkins-hbase4.apache.org,33019,1676491279655)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/data/default/testWithMapReduce/dae437d89db301633beda20a6a7029ef/.tmp/f1/e686000a2c22415f976a06b31caef570 as hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/data/default/testWithMapReduce/dae437d89db301633beda20a6a7029ef/f1/e686000a2c22415f976a06b31caef570 2023-02-15 20:01:24,300 INFO [rs(jenkins-hbase4.apache.org,33019,1676491279655)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/data/default/testWithMapReduce/bd3ac405f939af16962e576b69a6c71b/f1/9f781d1c9afc4a26bf42fc9059ab84b8, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-15 20:01:24,301 DEBUG [rs(jenkins-hbase4.apache.org,33019,1676491279655)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/data/default/testWithMapReduce/bd3ac405f939af16962e576b69a6c71b/.tmp/f2/f455fa0d50424335a1916a172e5effa0 as hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/data/default/testWithMapReduce/bd3ac405f939af16962e576b69a6c71b/f2/f455fa0d50424335a1916a172e5effa0 2023-02-15 20:01:24,305 INFO [rs(jenkins-hbase4.apache.org,33019,1676491279655)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/data/default/testWithMapReduce/dae437d89db301633beda20a6a7029ef/f1/e686000a2c22415f976a06b31caef570, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-15 20:01:24,305 INFO [rs(jenkins-hbase4.apache.org,33125,1676491279695)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/data/default/testWithMapReduce/97b529ba0e37421e99fb43de9d23d817/f2/62e26e9917fb4e3fa67e79d5123a4ed9, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-15 20:01:24,306 DEBUG [rs(jenkins-hbase4.apache.org,33019,1676491279655)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/data/default/testWithMapReduce/dae437d89db301633beda20a6a7029ef/.tmp/f2/363686351bff4e97bc0171501422cc36 as hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/data/default/testWithMapReduce/dae437d89db301633beda20a6a7029ef/f2/363686351bff4e97bc0171501422cc36 2023-02-15 20:01:24,307 INFO [rs(jenkins-hbase4.apache.org,33125,1676491279695)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 97b529ba0e37421e99fb43de9d23d817 in 174ms, sequenceid=9, compaction requested=false 2023-02-15 20:01:24,307 DEBUG [rs(jenkins-hbase4.apache.org,33125,1676491279695)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 97b529ba0e37421e99fb43de9d23d817: 2023-02-15 20:01:24,307 DEBUG [rs(jenkins-hbase4.apache.org,33125,1676491279695)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,m\xED\xED,1676491281022.97b529ba0e37421e99fb43de9d23d817. 2023-02-15 20:01:24,307 DEBUG [member: 'jenkins-hbase4.apache.org,33125,1676491279695' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 4/5 local region flush tasks. 2023-02-15 20:01:24,310 INFO [rs(jenkins-hbase4.apache.org,33125,1676491279695)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/data/default/testWithMapReduce/1486d61d8d2fe0efe2a608c7110b6c7d/f1/5a4ae29f891b49a7ad990ab7ccf1fb0d, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-15 20:01:24,311 DEBUG [rs(jenkins-hbase4.apache.org,33125,1676491279695)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/data/default/testWithMapReduce/1486d61d8d2fe0efe2a608c7110b6c7d/.tmp/f2/94f127fb83ce46dc9430066b4bbd7084 as hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/data/default/testWithMapReduce/1486d61d8d2fe0efe2a608c7110b6c7d/f2/94f127fb83ce46dc9430066b4bbd7084 2023-02-15 20:01:24,317 INFO [rs(jenkins-hbase4.apache.org,33019,1676491279655)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/data/default/testWithMapReduce/bd3ac405f939af16962e576b69a6c71b/f2/f455fa0d50424335a1916a172e5effa0, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-15 20:01:24,317 INFO [rs(jenkins-hbase4.apache.org,33019,1676491279655)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/data/default/testWithMapReduce/dae437d89db301633beda20a6a7029ef/f2/363686351bff4e97bc0171501422cc36, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-15 20:01:24,318 INFO [rs(jenkins-hbase4.apache.org,33019,1676491279655)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for bd3ac405f939af16962e576b69a6c71b in 189ms, sequenceid=9, compaction requested=false 2023-02-15 20:01:24,318 INFO [rs(jenkins-hbase4.apache.org,33019,1676491279655)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~248.22 KB/254176, heapSize ~634.22 KB/649440, currentSize=0 B/0 for dae437d89db301633beda20a6a7029ef in 185ms, sequenceid=9, compaction requested=false 2023-02-15 20:01:24,318 DEBUG [rs(jenkins-hbase4.apache.org,33019,1676491279655)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for bd3ac405f939af16962e576b69a6c71b: 2023-02-15 20:01:24,318 DEBUG [rs(jenkins-hbase4.apache.org,33019,1676491279655)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for dae437d89db301633beda20a6a7029ef: 2023-02-15 20:01:24,318 DEBUG [rs(jenkins-hbase4.apache.org,33019,1676491279655)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,t43,1676491281022.bd3ac405f939af16962e576b69a6c71b. 2023-02-15 20:01:24,318 DEBUG [rs(jenkins-hbase4.apache.org,33019,1676491279655)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,aaa,1676491281022.dae437d89db301633beda20a6a7029ef. 2023-02-15 20:01:24,318 DEBUG [member: 'jenkins-hbase4.apache.org,33019,1676491279655' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/5 local region flush tasks. 2023-02-15 20:01:24,318 DEBUG [member: 'jenkins-hbase4.apache.org,33019,1676491279655' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/5 local region flush tasks. 2023-02-15 20:01:24,318 DEBUG [rs(jenkins-hbase4.apache.org,33019,1676491279655)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,g\xA7\xA7,1676491281022.2f6827bb8b2d8e3d5d25320352d1e239. 2023-02-15 20:01:24,318 DEBUG [rs(jenkins-hbase4.apache.org,33019,1676491279655)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,g\xA7\xA7,1676491281022.2f6827bb8b2d8e3d5d25320352d1e239. started... 2023-02-15 20:01:24,318 INFO [rs(jenkins-hbase4.apache.org,33019,1676491279655)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 2f6827bb8b2d8e3d5d25320352d1e239 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-15 20:01:24,322 INFO [rs(jenkins-hbase4.apache.org,33125,1676491279695)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/data/default/testWithMapReduce/1486d61d8d2fe0efe2a608c7110b6c7d/f2/94f127fb83ce46dc9430066b4bbd7084, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-15 20:01:24,322 INFO [rs(jenkins-hbase4.apache.org,33125,1676491279695)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 1486d61d8d2fe0efe2a608c7110b6c7d in 185ms, sequenceid=9, compaction requested=false 2023-02-15 20:01:24,323 DEBUG [rs(jenkins-hbase4.apache.org,33125,1676491279695)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 1486d61d8d2fe0efe2a608c7110b6c7d: 2023-02-15 20:01:24,323 DEBUG [rs(jenkins-hbase4.apache.org,33125,1676491279695)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,j\xCA\xCA,1676491281022.1486d61d8d2fe0efe2a608c7110b6c7d. 2023-02-15 20:01:24,323 DEBUG [member: 'jenkins-hbase4.apache.org,33125,1676491279695' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 5/5 local region flush tasks. 2023-02-15 20:01:24,323 DEBUG [member: 'jenkins-hbase4.apache.org,33125,1676491279695' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 5 local region flush tasks. 2023-02-15 20:01:24,323 DEBUG [member: 'jenkins-hbase4.apache.org,33125,1676491279695' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,33125,1676491279695 2023-02-15 20:01:24,324 DEBUG [member: 'jenkins-hbase4.apache.org,33125,1676491279695' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduce' locally acquired 2023-02-15 20:01:24,324 DEBUG [member: 'jenkins-hbase4.apache.org,33125,1676491279695' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33125,1676491279695' joining acquired barrier for procedure (testWithMapReduce) in zk 2023-02-15 20:01:24,326 DEBUG [member: 'jenkins-hbase4.apache.org,33125,1676491279695' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-15 20:01:24,326 DEBUG [Listener at localhost/43949-EventThread] zookeeper.ZKWatcher(600): master:36865-0x1005992b68c0000, quorum=127.0.0.1:57384, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,33125,1676491279695 2023-02-15 20:01:24,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,33125,1676491279695 2023-02-15 20:01:24,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-15 20:01:24,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-15 20:01:24,326 DEBUG [member: 'jenkins-hbase4.apache.org,33125,1676491279695' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33125-0x1005992b68c0002, quorum=127.0.0.1:57384, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce 2023-02-15 20:01:24,326 DEBUG [member: 'jenkins-hbase4.apache.org,33125,1676491279695' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduce' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-15 20:01:24,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-15 20:01:24,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-15 20:01:24,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-15 20:01:24,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33125,1676491279695 2023-02-15 20:01:24,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-15 20:01:24,328 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,33125,1676491279695' joining acquired barrier for procedure 'testWithMapReduce' on coordinator 2023-02-15 20:01:24,328 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6a184afe[Count = 1] remaining members to acquire global barrier 2023-02-15 20:01:24,328 INFO [rs(jenkins-hbase4.apache.org,33019,1676491279655)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/data/default/testWithMapReduce/296941d2565b5d20cfd81aec8ac11565/.tmp/f1/7629326f26b64ca78d3afd47af73c1dd 2023-02-15 20:01:24,343 INFO [rs(jenkins-hbase4.apache.org,33019,1676491279655)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/data/default/testWithMapReduce/2f6827bb8b2d8e3d5d25320352d1e239/.tmp/f1/254806f0d30e4dc2bbab574b63d30cb5 2023-02-15 20:01:24,351 INFO [rs(jenkins-hbase4.apache.org,33019,1676491279655)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/data/default/testWithMapReduce/296941d2565b5d20cfd81aec8ac11565/.tmp/f2/c676ae11f8624f2f90a360363593ab3f 2023-02-15 20:01:24,356 DEBUG [rs(jenkins-hbase4.apache.org,33019,1676491279655)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/data/default/testWithMapReduce/296941d2565b5d20cfd81aec8ac11565/.tmp/f1/7629326f26b64ca78d3afd47af73c1dd as hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/data/default/testWithMapReduce/296941d2565b5d20cfd81aec8ac11565/f1/7629326f26b64ca78d3afd47af73c1dd 2023-02-15 20:01:24,362 INFO [rs(jenkins-hbase4.apache.org,33019,1676491279655)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/data/default/testWithMapReduce/296941d2565b5d20cfd81aec8ac11565/f1/7629326f26b64ca78d3afd47af73c1dd, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-15 20:01:24,362 DEBUG [rs(jenkins-hbase4.apache.org,33019,1676491279655)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/data/default/testWithMapReduce/296941d2565b5d20cfd81aec8ac11565/.tmp/f2/c676ae11f8624f2f90a360363593ab3f as hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/data/default/testWithMapReduce/296941d2565b5d20cfd81aec8ac11565/f2/c676ae11f8624f2f90a360363593ab3f 2023-02-15 20:01:24,366 INFO [rs(jenkins-hbase4.apache.org,33019,1676491279655)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/data/default/testWithMapReduce/2f6827bb8b2d8e3d5d25320352d1e239/.tmp/f2/b698ad2ea47341d68bd9ea7453b9780b 2023-02-15 20:01:24,368 INFO [rs(jenkins-hbase4.apache.org,33019,1676491279655)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/data/default/testWithMapReduce/296941d2565b5d20cfd81aec8ac11565/f2/c676ae11f8624f2f90a360363593ab3f, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-15 20:01:24,369 INFO [rs(jenkins-hbase4.apache.org,33019,1676491279655)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 296941d2565b5d20cfd81aec8ac11565 in 101ms, sequenceid=9, compaction requested=false 2023-02-15 20:01:24,369 DEBUG [rs(jenkins-hbase4.apache.org,33019,1676491279655)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 296941d2565b5d20cfd81aec8ac11565: 2023-02-15 20:01:24,369 DEBUG [rs(jenkins-hbase4.apache.org,33019,1676491279655)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,q\x11\x10,1676491281022.296941d2565b5d20cfd81aec8ac11565. 2023-02-15 20:01:24,369 DEBUG [member: 'jenkins-hbase4.apache.org,33019,1676491279655' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 4/5 local region flush tasks. 2023-02-15 20:01:24,371 DEBUG [rs(jenkins-hbase4.apache.org,33019,1676491279655)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/data/default/testWithMapReduce/2f6827bb8b2d8e3d5d25320352d1e239/.tmp/f1/254806f0d30e4dc2bbab574b63d30cb5 as hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/data/default/testWithMapReduce/2f6827bb8b2d8e3d5d25320352d1e239/f1/254806f0d30e4dc2bbab574b63d30cb5 2023-02-15 20:01:24,377 INFO [rs(jenkins-hbase4.apache.org,33019,1676491279655)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/data/default/testWithMapReduce/2f6827bb8b2d8e3d5d25320352d1e239/f1/254806f0d30e4dc2bbab574b63d30cb5, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-15 20:01:24,377 DEBUG [rs(jenkins-hbase4.apache.org,33019,1676491279655)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/data/default/testWithMapReduce/2f6827bb8b2d8e3d5d25320352d1e239/.tmp/f2/b698ad2ea47341d68bd9ea7453b9780b as hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/data/default/testWithMapReduce/2f6827bb8b2d8e3d5d25320352d1e239/f2/b698ad2ea47341d68bd9ea7453b9780b 2023-02-15 20:01:24,382 INFO [rs(jenkins-hbase4.apache.org,33019,1676491279655)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/data/default/testWithMapReduce/2f6827bb8b2d8e3d5d25320352d1e239/f2/b698ad2ea47341d68bd9ea7453b9780b, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-15 20:01:24,383 INFO [rs(jenkins-hbase4.apache.org,33019,1676491279655)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 2f6827bb8b2d8e3d5d25320352d1e239 in 65ms, sequenceid=9, compaction requested=false 2023-02-15 20:01:24,383 DEBUG [rs(jenkins-hbase4.apache.org,33019,1676491279655)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 2f6827bb8b2d8e3d5d25320352d1e239: 2023-02-15 20:01:24,383 DEBUG [rs(jenkins-hbase4.apache.org,33019,1676491279655)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,g\xA7\xA7,1676491281022.2f6827bb8b2d8e3d5d25320352d1e239. 2023-02-15 20:01:24,383 DEBUG [member: 'jenkins-hbase4.apache.org,33019,1676491279655' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 5/5 local region flush tasks. 2023-02-15 20:01:24,384 DEBUG [member: 'jenkins-hbase4.apache.org,33019,1676491279655' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 5 local region flush tasks. 2023-02-15 20:01:24,384 DEBUG [member: 'jenkins-hbase4.apache.org,33019,1676491279655' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,33019,1676491279655 2023-02-15 20:01:24,384 DEBUG [member: 'jenkins-hbase4.apache.org,33019,1676491279655' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduce' locally acquired 2023-02-15 20:01:24,384 DEBUG [member: 'jenkins-hbase4.apache.org,33019,1676491279655' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33019,1676491279655' joining acquired barrier for procedure (testWithMapReduce) in zk 2023-02-15 20:01:24,385 DEBUG [Listener at localhost/43949-EventThread] zookeeper.ZKWatcher(600): master:36865-0x1005992b68c0000, quorum=127.0.0.1:57384, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,33019,1676491279655 2023-02-15 20:01:24,385 DEBUG [member: 'jenkins-hbase4.apache.org,33019,1676491279655' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-15 20:01:24,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,33019,1676491279655 2023-02-15 20:01:24,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-15 20:01:24,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-15 20:01:24,386 DEBUG [member: 'jenkins-hbase4.apache.org,33019,1676491279655' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33019-0x1005992b68c0001, quorum=127.0.0.1:57384, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce 2023-02-15 20:01:24,386 DEBUG [member: 'jenkins-hbase4.apache.org,33019,1676491279655' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduce' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-15 20:01:24,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-15 20:01:24,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-15 20:01:24,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-15 20:01:24,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33019,1676491279655 2023-02-15 20:01:24,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33125,1676491279695 2023-02-15 20:01:24,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-15 20:01:24,388 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,33019,1676491279655' joining acquired barrier for procedure 'testWithMapReduce' on coordinator 2023-02-15 20:01:24,388 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6a184afe[Count = 0] remaining members to acquire global barrier 2023-02-15 20:01:24,388 DEBUG [(jenkins-hbase4.apache.org,36865,1676491279587)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMapReduce' starting 'in-barrier' execution. 2023-02-15 20:01:24,388 DEBUG [(jenkins-hbase4.apache.org,36865,1676491279587)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-15 20:01:24,390 DEBUG [Listener at localhost/43949-EventThread] zookeeper.ZKWatcher(600): regionserver:33125-0x1005992b68c0002, quorum=127.0.0.1:57384, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-15 20:01:24,390 DEBUG [Listener at localhost/43949-EventThread] zookeeper.ZKWatcher(600): regionserver:33019-0x1005992b68c0001, quorum=127.0.0.1:57384, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-15 20:01:24,390 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-15 20:01:24,390 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-15 20:01:24,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-15 20:01:24,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-15 20:01:24,390 DEBUG [member: 'jenkins-hbase4.apache.org,33125,1676491279695' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduce' received 'reached' from coordinator. 2023-02-15 20:01:24,390 DEBUG [member: 'jenkins-hbase4.apache.org,33019,1676491279655' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduce' received 'reached' from coordinator. 2023-02-15 20:01:24,390 DEBUG [(jenkins-hbase4.apache.org,36865,1676491279587)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36865-0x1005992b68c0000, quorum=127.0.0.1:57384, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,33125,1676491279695 2023-02-15 20:01:24,390 DEBUG [member: 'jenkins-hbase4.apache.org,33019,1676491279655' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduce' locally completed 2023-02-15 20:01:24,390 DEBUG [member: 'jenkins-hbase4.apache.org,33019,1676491279655' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduce' completed for member 'jenkins-hbase4.apache.org,33019,1676491279655' in zk 2023-02-15 20:01:24,390 DEBUG [member: 'jenkins-hbase4.apache.org,33125,1676491279695' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduce' locally completed 2023-02-15 20:01:24,390 DEBUG [member: 'jenkins-hbase4.apache.org,33125,1676491279695' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduce' completed for member 'jenkins-hbase4.apache.org,33125,1676491279695' in zk 2023-02-15 20:01:24,391 DEBUG [(jenkins-hbase4.apache.org,36865,1676491279587)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36865-0x1005992b68c0000, quorum=127.0.0.1:57384, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,33019,1676491279655 2023-02-15 20:01:24,391 DEBUG [(jenkins-hbase4.apache.org,36865,1676491279587)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-15 20:01:24,392 DEBUG [member: 'jenkins-hbase4.apache.org,33019,1676491279655' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduce' has notified controller of completion 2023-02-15 20:01:24,392 DEBUG [Listener at localhost/43949-EventThread] zookeeper.ZKWatcher(600): master:36865-0x1005992b68c0000, quorum=127.0.0.1:57384, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,33019,1676491279655 2023-02-15 20:01:24,392 DEBUG [member: 'jenkins-hbase4.apache.org,33019,1676491279655' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-15 20:01:24,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,33019,1676491279655 2023-02-15 20:01:24,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-15 20:01:24,392 DEBUG [member: 'jenkins-hbase4.apache.org,33019,1676491279655' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduce' completed. 2023-02-15 20:01:24,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-15 20:01:24,393 DEBUG [member: 'jenkins-hbase4.apache.org,33125,1676491279695' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduce' has notified controller of completion 2023-02-15 20:01:24,393 DEBUG [Listener at localhost/43949-EventThread] zookeeper.ZKWatcher(600): master:36865-0x1005992b68c0000, quorum=127.0.0.1:57384, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,33125,1676491279695 2023-02-15 20:01:24,393 DEBUG [member: 'jenkins-hbase4.apache.org,33125,1676491279695' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-15 20:01:24,393 DEBUG [member: 'jenkins-hbase4.apache.org,33125,1676491279695' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduce' completed. 2023-02-15 20:01:24,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-15 20:01:24,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-15 20:01:24,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-15 20:01:24,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33019,1676491279655 2023-02-15 20:01:24,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33125,1676491279695 2023-02-15 20:01:24,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-15 20:01:24,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-15 20:01:24,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33019,1676491279655 2023-02-15 20:01:24,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33125,1676491279695 2023-02-15 20:01:24,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduce' member 'jenkins-hbase4.apache.org,33019,1676491279655': 2023-02-15 20:01:24,397 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,33019,1676491279655' released barrier for procedure'testWithMapReduce', counting down latch. Waiting for 1 more 2023-02-15 20:01:24,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,33125,1676491279695 2023-02-15 20:01:24,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-15 20:01:24,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-15 20:01:24,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-15 20:01:24,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-15 20:01:24,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-15 20:01:24,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33019,1676491279655 2023-02-15 20:01:24,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33125,1676491279695 2023-02-15 20:01:24,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-15 20:01:24,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-15 20:01:24,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33019,1676491279655 2023-02-15 20:01:24,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33125,1676491279695 2023-02-15 20:01:24,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduce' member 'jenkins-hbase4.apache.org,33125,1676491279695': 2023-02-15 20:01:24,399 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,33125,1676491279695' released barrier for procedure'testWithMapReduce', counting down latch. Waiting for 0 more 2023-02-15 20:01:24,399 INFO [(jenkins-hbase4.apache.org,36865,1676491279587)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMapReduce' execution completed 2023-02-15 20:01:24,399 DEBUG [(jenkins-hbase4.apache.org,36865,1676491279587)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-15 20:01:24,399 DEBUG [(jenkins-hbase4.apache.org,36865,1676491279587)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-15 20:01:24,399 DEBUG [(jenkins-hbase4.apache.org,36865,1676491279587)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMapReduce 2023-02-15 20:01:24,399 INFO [(jenkins-hbase4.apache.org,36865,1676491279587)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMapReduceincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-15 20:01:24,401 DEBUG [Listener at localhost/43949-EventThread] zookeeper.ZKWatcher(600): master:36865-0x1005992b68c0000, quorum=127.0.0.1:57384, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-15 20:01:24,401 DEBUG [Listener at localhost/43949-EventThread] zookeeper.ZKWatcher(600): regionserver:33019-0x1005992b68c0001, quorum=127.0.0.1:57384, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-15 20:01:24,401 DEBUG [Listener at localhost/43949-EventThread] zookeeper.ZKWatcher(600): regionserver:33125-0x1005992b68c0002, quorum=127.0.0.1:57384, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-15 20:01:24,401 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-15 20:01:24,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-15 20:01:24,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-15 20:01:24,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-15 20:01:24,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-15 20:01:24,401 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-15 20:01:24,401 DEBUG [Listener at localhost/43949-EventThread] zookeeper.ZKWatcher(600): regionserver:33125-0x1005992b68c0002, quorum=127.0.0.1:57384, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-15 20:01:24,401 DEBUG [Listener at localhost/43949-EventThread] zookeeper.ZKWatcher(600): regionserver:33019-0x1005992b68c0001, quorum=127.0.0.1:57384, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-15 20:01:24,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-15 20:01:24,401 DEBUG [(jenkins-hbase4.apache.org,36865,1676491279587)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36865-0x1005992b68c0000, quorum=127.0.0.1:57384, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,33019,1676491279655 2023-02-15 20:01:24,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-15 20:01:24,402 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-15 20:01:24,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-15 20:01:24,402 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-15 20:01:24,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-15 20:01:24,402 DEBUG [(jenkins-hbase4.apache.org,36865,1676491279587)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36865-0x1005992b68c0000, quorum=127.0.0.1:57384, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,33125,1676491279695 2023-02-15 20:01:24,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-15 20:01:24,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-15 20:01:24,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-15 20:01:24,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-15 20:01:24,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-15 20:01:24,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33019,1676491279655 2023-02-15 20:01:24,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33125,1676491279695 2023-02-15 20:01:24,404 DEBUG [(jenkins-hbase4.apache.org,36865,1676491279587)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36865-0x1005992b68c0000, quorum=127.0.0.1:57384, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,33019,1676491279655 2023-02-15 20:01:24,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-15 20:01:24,404 DEBUG [(jenkins-hbase4.apache.org,36865,1676491279587)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36865-0x1005992b68c0000, quorum=127.0.0.1:57384, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,33125,1676491279695 2023-02-15 20:01:24,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-15 20:01:24,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33019,1676491279655 2023-02-15 20:01:24,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33125,1676491279695 2023-02-15 20:01:24,408 DEBUG [Listener at localhost/43949-EventThread] zookeeper.ZKWatcher(600): master:36865-0x1005992b68c0000, quorum=127.0.0.1:57384, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,33125,1676491279695 2023-02-15 20:01:24,408 DEBUG [Listener at localhost/43949-EventThread] zookeeper.ZKWatcher(600): master:36865-0x1005992b68c0000, quorum=127.0.0.1:57384, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-15 20:01:24,408 DEBUG [Listener at localhost/43949-EventThread] zookeeper.ZKWatcher(600): master:36865-0x1005992b68c0000, quorum=127.0.0.1:57384, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,33019,1676491279655 2023-02-15 20:01:24,408 DEBUG [Listener at localhost/43949-EventThread] zookeeper.ZKWatcher(600): master:36865-0x1005992b68c0000, quorum=127.0.0.1:57384, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-15 20:01:24,408 DEBUG [Listener at localhost/43949-EventThread] zookeeper.ZKWatcher(600): master:36865-0x1005992b68c0000, quorum=127.0.0.1:57384, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,33125,1676491279695 2023-02-15 20:01:24,408 DEBUG [Listener at localhost/43949-EventThread] zookeeper.ZKWatcher(600): master:36865-0x1005992b68c0000, quorum=127.0.0.1:57384, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-15 20:01:24,408 DEBUG [Listener at localhost/43949-EventThread] zookeeper.ZKWatcher(600): master:36865-0x1005992b68c0000, quorum=127.0.0.1:57384, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,33019,1676491279655 2023-02-15 20:01:24,408 DEBUG [Listener at localhost/43949-EventThread] zookeeper.ZKWatcher(600): master:36865-0x1005992b68c0000, quorum=127.0.0.1:57384, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-15 20:01:24,408 DEBUG [Listener at localhost/43949-EventThread] zookeeper.ZKWatcher(600): master:36865-0x1005992b68c0000, quorum=127.0.0.1:57384, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-15 20:01:24,408 DEBUG [Listener at localhost/43949-EventThread] zookeeper.ZKWatcher(600): regionserver:33125-0x1005992b68c0002, quorum=127.0.0.1:57384, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-15 20:01:24,408 DEBUG [Listener at localhost/43949-EventThread] zookeeper.ZKWatcher(600): regionserver:33125-0x1005992b68c0002, quorum=127.0.0.1:57384, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-15 20:01:24,408 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-15 20:01:24,408 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36865] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testWithMapReduce' 2023-02-15 20:01:24,409 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36865] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-15 20:01:24,408 DEBUG [(jenkins-hbase4.apache.org,36865,1676491279587)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-15 20:01:24,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-15 20:01:24,410 DEBUG [Listener at localhost/43949] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testWithMapReduce'' to complete. (max 20000 ms per retry) 2023-02-15 20:01:24,410 DEBUG [Listener at localhost/43949] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-15 20:01:24,410 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-15 20:01:24,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-15 20:01:24,412 DEBUG [Listener at localhost/43949-EventThread] zookeeper.ZKWatcher(600): regionserver:33019-0x1005992b68c0001, quorum=127.0.0.1:57384, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-15 20:01:24,412 DEBUG [Listener at localhost/43949-EventThread] zookeeper.ZKWatcher(600): regionserver:33019-0x1005992b68c0001, quorum=127.0.0.1:57384, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-15 20:01:24,412 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-15 20:01:24,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-15 20:01:24,412 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-15 20:01:24,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-15 20:01:24,510 DEBUG [Listener at localhost/43949] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-15 20:01:24,512 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36865] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-15 20:01:24,512 INFO [Listener at localhost/43949] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-15 20:01:24,512 DEBUG [Listener at localhost/43949] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x25d0ebdc to 127.0.0.1:57384 2023-02-15 20:01:24,513 DEBUG [Listener at localhost/43949] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-15 20:01:24,513 DEBUG [Listener at localhost/43949] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-02-15 20:01:24,513 DEBUG [Listener at localhost/43949] util.JVMClusterUtil(257): Found active master hash=292349426, stopped=false 2023-02-15 20:01:24,513 INFO [Listener at localhost/43949] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,36865,1676491279587 2023-02-15 20:01:24,514 DEBUG [Listener at localhost/43949-EventThread] zookeeper.ZKWatcher(600): master:36865-0x1005992b68c0000, quorum=127.0.0.1:57384, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-15 20:01:24,514 INFO [Listener at localhost/43949] procedure2.ProcedureExecutor(629): Stopping 2023-02-15 20:01:24,514 DEBUG [Listener at localhost/43949-EventThread] zookeeper.ZKWatcher(600): regionserver:33019-0x1005992b68c0001, quorum=127.0.0.1:57384, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-15 20:01:24,514 DEBUG [Listener at localhost/43949-EventThread] zookeeper.ZKWatcher(600): regionserver:33125-0x1005992b68c0002, quorum=127.0.0.1:57384, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-15 20:01:24,514 DEBUG [Listener at localhost/43949-EventThread] zookeeper.ZKWatcher(600): master:36865-0x1005992b68c0000, quorum=127.0.0.1:57384, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-15 20:01:24,516 DEBUG [Listener at localhost/43949] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3ee8615e to 127.0.0.1:57384 2023-02-15 20:01:24,516 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:36865-0x1005992b68c0000, quorum=127.0.0.1:57384, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-15 20:01:24,516 DEBUG [Listener at localhost/43949] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-15 20:01:24,516 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33125-0x1005992b68c0002, quorum=127.0.0.1:57384, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-15 20:01:24,516 INFO [Listener at localhost/43949] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,33019,1676491279655' ***** 2023-02-15 20:01:24,516 INFO [Listener at localhost/43949] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-15 20:01:24,516 INFO [Listener at localhost/43949] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,33125,1676491279695' ***** 2023-02-15 20:01:24,516 INFO [Listener at localhost/43949] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-15 20:01:24,517 INFO [RS:0;jenkins-hbase4:33019] regionserver.HeapMemoryManager(220): Stopping 2023-02-15 20:01:24,517 INFO [RS:1;jenkins-hbase4:33125] regionserver.HeapMemoryManager(220): Stopping 2023-02-15 20:01:24,517 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-15 20:01:24,517 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-15 20:01:24,516 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33019-0x1005992b68c0001, quorum=127.0.0.1:57384, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-15 20:01:24,517 INFO [RS:1;jenkins-hbase4:33125] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-15 20:01:24,517 INFO [RS:0;jenkins-hbase4:33019] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-15 20:01:24,518 INFO [RS:1;jenkins-hbase4:33125] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-15 20:01:24,518 INFO [RS:0;jenkins-hbase4:33019] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-15 20:01:24,518 INFO [RS:1;jenkins-hbase4:33125] regionserver.HRegionServer(3304): Received CLOSE for 9fdf60e81d6a22352a6acb2fcb8c9f3e 2023-02-15 20:01:24,518 INFO [RS:0;jenkins-hbase4:33019] regionserver.HRegionServer(3304): Received CLOSE for a83d31acd8a067180d7240b93343a9e6 2023-02-15 20:01:24,519 INFO [RS:1;jenkins-hbase4:33125] regionserver.HRegionServer(3304): Received CLOSE for 69ce6540f755e21eae3d289ad231610b 2023-02-15 20:01:24,519 INFO [RS:0;jenkins-hbase4:33019] regionserver.HRegionServer(3304): Received CLOSE for 2a1c7014d8c6c818f8ea2f67ef6b2118 2023-02-15 20:01:24,519 INFO [RS:1;jenkins-hbase4:33125] regionserver.HRegionServer(3304): Received CLOSE for 2241125b7d23be16c4949dc36e627f50 2023-02-15 20:01:24,519 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing a83d31acd8a067180d7240b93343a9e6, disabling compactions & flushes 2023-02-15 20:01:24,519 INFO [RS:1;jenkins-hbase4:33125] regionserver.HRegionServer(3304): Received CLOSE for 97b529ba0e37421e99fb43de9d23d817 2023-02-15 20:01:24,519 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676491280428.a83d31acd8a067180d7240b93343a9e6. 2023-02-15 20:01:24,519 INFO [RS:1;jenkins-hbase4:33125] regionserver.HRegionServer(3304): Received CLOSE for 1486d61d8d2fe0efe2a608c7110b6c7d 2023-02-15 20:01:24,519 INFO [RS:0;jenkins-hbase4:33019] regionserver.HRegionServer(3304): Received CLOSE for bd3ac405f939af16962e576b69a6c71b 2023-02-15 20:01:24,519 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 9fdf60e81d6a22352a6acb2fcb8c9f3e, disabling compactions & flushes 2023-02-15 20:01:24,519 INFO [RS:0;jenkins-hbase4:33019] regionserver.HRegionServer(3304): Received CLOSE for dae437d89db301633beda20a6a7029ef 2023-02-15 20:01:24,519 INFO [RS:1;jenkins-hbase4:33125] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,33125,1676491279695 2023-02-15 20:01:24,519 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676491280428.a83d31acd8a067180d7240b93343a9e6. 2023-02-15 20:01:24,519 DEBUG [RS:1;jenkins-hbase4:33125] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3f7b78a7 to 127.0.0.1:57384 2023-02-15 20:01:24,519 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676491280428.a83d31acd8a067180d7240b93343a9e6. after waiting 0 ms 2023-02-15 20:01:24,519 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676491280428.a83d31acd8a067180d7240b93343a9e6. 2023-02-15 20:01:24,519 INFO [RS:0;jenkins-hbase4:33019] regionserver.HRegionServer(3304): Received CLOSE for 296941d2565b5d20cfd81aec8ac11565 2023-02-15 20:01:24,519 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676491281022.9fdf60e81d6a22352a6acb2fcb8c9f3e. 2023-02-15 20:01:24,519 INFO [RS:0;jenkins-hbase4:33019] regionserver.HRegionServer(3304): Received CLOSE for 2f6827bb8b2d8e3d5d25320352d1e239 2023-02-15 20:01:24,519 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing a83d31acd8a067180d7240b93343a9e6 1/1 column families, dataSize=78 B heapSize=488 B 2023-02-15 20:01:24,519 DEBUG [RS:1;jenkins-hbase4:33125] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-15 20:01:24,520 INFO [RS:0;jenkins-hbase4:33019] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,33019,1676491279655 2023-02-15 20:01:24,519 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676491281022.9fdf60e81d6a22352a6acb2fcb8c9f3e. 2023-02-15 20:01:24,520 DEBUG [RS:0;jenkins-hbase4:33019] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x66f230b5 to 127.0.0.1:57384 2023-02-15 20:01:24,520 INFO [RS:1;jenkins-hbase4:33125] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-15 20:01:24,520 DEBUG [RS:0;jenkins-hbase4:33019] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-15 20:01:24,520 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676491281022.9fdf60e81d6a22352a6acb2fcb8c9f3e. after waiting 0 ms 2023-02-15 20:01:24,520 INFO [RS:0;jenkins-hbase4:33019] regionserver.HRegionServer(1475): Waiting on 6 regions to close 2023-02-15 20:01:24,520 INFO [RS:1;jenkins-hbase4:33125] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-15 20:01:24,520 DEBUG [RS:0;jenkins-hbase4:33019] regionserver.HRegionServer(1479): Online Regions={a83d31acd8a067180d7240b93343a9e6=hbase:namespace,,1676491280428.a83d31acd8a067180d7240b93343a9e6., 2a1c7014d8c6c818f8ea2f67ef6b2118=testWithMapReduce,d\x84\x84,1676491281022.2a1c7014d8c6c818f8ea2f67ef6b2118., bd3ac405f939af16962e576b69a6c71b=testWithMapReduce,t43,1676491281022.bd3ac405f939af16962e576b69a6c71b., dae437d89db301633beda20a6a7029ef=testWithMapReduce,aaa,1676491281022.dae437d89db301633beda20a6a7029ef., 296941d2565b5d20cfd81aec8ac11565=testWithMapReduce,q\x11\x10,1676491281022.296941d2565b5d20cfd81aec8ac11565., 2f6827bb8b2d8e3d5d25320352d1e239=testWithMapReduce,g\xA7\xA7,1676491281022.2f6827bb8b2d8e3d5d25320352d1e239.} 2023-02-15 20:01:24,520 INFO [RS:1;jenkins-hbase4:33125] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-15 20:01:24,520 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676491281022.9fdf60e81d6a22352a6acb2fcb8c9f3e. 2023-02-15 20:01:24,520 DEBUG [RS:0;jenkins-hbase4:33019] regionserver.HRegionServer(1505): Waiting on 296941d2565b5d20cfd81aec8ac11565, 2a1c7014d8c6c818f8ea2f67ef6b2118, 2f6827bb8b2d8e3d5d25320352d1e239, a83d31acd8a067180d7240b93343a9e6, bd3ac405f939af16962e576b69a6c71b, dae437d89db301633beda20a6a7029ef 2023-02-15 20:01:24,520 INFO [RS:1;jenkins-hbase4:33125] regionserver.HRegionServer(3304): Received CLOSE for 1588230740 2023-02-15 20:01:24,520 INFO [RS:1;jenkins-hbase4:33125] regionserver.HRegionServer(1475): Waiting on 6 regions to close 2023-02-15 20:01:24,521 DEBUG [RS:1;jenkins-hbase4:33125] regionserver.HRegionServer(1479): Online Regions={9fdf60e81d6a22352a6acb2fcb8c9f3e=testWithMapReduce,,1676491281022.9fdf60e81d6a22352a6acb2fcb8c9f3e., 69ce6540f755e21eae3d289ad231610b=testWithMapReduce,wWV,1676491281022.69ce6540f755e21eae3d289ad231610b., 2241125b7d23be16c4949dc36e627f50=testWithMapReduce,zz{,1676491281022.2241125b7d23be16c4949dc36e627f50., 1588230740=hbase:meta,,1.1588230740, 97b529ba0e37421e99fb43de9d23d817=testWithMapReduce,m\xED\xED,1676491281022.97b529ba0e37421e99fb43de9d23d817., 1486d61d8d2fe0efe2a608c7110b6c7d=testWithMapReduce,j\xCA\xCA,1676491281022.1486d61d8d2fe0efe2a608c7110b6c7d.} 2023-02-15 20:01:24,521 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-15 20:01:24,521 DEBUG [RS:1;jenkins-hbase4:33125] regionserver.HRegionServer(1505): Waiting on 1486d61d8d2fe0efe2a608c7110b6c7d, 1588230740, 2241125b7d23be16c4949dc36e627f50, 69ce6540f755e21eae3d289ad231610b, 97b529ba0e37421e99fb43de9d23d817, 9fdf60e81d6a22352a6acb2fcb8c9f3e 2023-02-15 20:01:24,521 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-15 20:01:24,521 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-15 20:01:24,521 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-15 20:01:24,521 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-15 20:01:24,521 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 1588230740 3/3 column families, dataSize=13.95 KB heapSize=23.05 KB 2023-02-15 20:01:24,532 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-15 20:01:24,532 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-15 20:01:24,537 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/data/default/testWithMapReduce/9fdf60e81d6a22352a6acb2fcb8c9f3e/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-02-15 20:01:24,541 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,,1676491281022.9fdf60e81d6a22352a6acb2fcb8c9f3e. 2023-02-15 20:01:24,541 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 9fdf60e81d6a22352a6acb2fcb8c9f3e: 2023-02-15 20:01:24,541 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,,1676491281022.9fdf60e81d6a22352a6acb2fcb8c9f3e. 2023-02-15 20:01:24,541 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 69ce6540f755e21eae3d289ad231610b, disabling compactions & flushes 2023-02-15 20:01:24,541 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,wWV,1676491281022.69ce6540f755e21eae3d289ad231610b. 2023-02-15 20:01:24,541 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,wWV,1676491281022.69ce6540f755e21eae3d289ad231610b. 2023-02-15 20:01:24,541 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,wWV,1676491281022.69ce6540f755e21eae3d289ad231610b. after waiting 0 ms 2023-02-15 20:01:24,541 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,wWV,1676491281022.69ce6540f755e21eae3d289ad231610b. 2023-02-15 20:01:24,548 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=13.76 KB at sequenceid=32 (bloomFilter=false), to=hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/data/hbase/meta/1588230740/.tmp/info/a1035260f6b840a3b4bee5d9e0372153 2023-02-15 20:01:24,560 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/data/hbase/namespace/a83d31acd8a067180d7240b93343a9e6/.tmp/info/832e0e18502f4032aead102aa37cf80f 2023-02-15 20:01:24,569 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/data/hbase/namespace/a83d31acd8a067180d7240b93343a9e6/.tmp/info/832e0e18502f4032aead102aa37cf80f as hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/data/hbase/namespace/a83d31acd8a067180d7240b93343a9e6/info/832e0e18502f4032aead102aa37cf80f 2023-02-15 20:01:24,572 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/data/default/testWithMapReduce/69ce6540f755e21eae3d289ad231610b/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-15 20:01:24,574 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,wWV,1676491281022.69ce6540f755e21eae3d289ad231610b. 2023-02-15 20:01:24,574 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 69ce6540f755e21eae3d289ad231610b: 2023-02-15 20:01:24,574 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/data/hbase/namespace/a83d31acd8a067180d7240b93343a9e6/info/832e0e18502f4032aead102aa37cf80f, entries=2, sequenceid=6, filesize=4.8 K 2023-02-15 20:01:24,574 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,wWV,1676491281022.69ce6540f755e21eae3d289ad231610b. 2023-02-15 20:01:24,574 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 2241125b7d23be16c4949dc36e627f50, disabling compactions & flushes 2023-02-15 20:01:24,574 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,zz{,1676491281022.2241125b7d23be16c4949dc36e627f50. 2023-02-15 20:01:24,574 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,zz{,1676491281022.2241125b7d23be16c4949dc36e627f50. 2023-02-15 20:01:24,574 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,zz{,1676491281022.2241125b7d23be16c4949dc36e627f50. after waiting 0 ms 2023-02-15 20:01:24,574 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,zz{,1676491281022.2241125b7d23be16c4949dc36e627f50. 2023-02-15 20:01:24,578 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for a83d31acd8a067180d7240b93343a9e6 in 59ms, sequenceid=6, compaction requested=false 2023-02-15 20:01:24,578 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-02-15 20:01:24,583 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/data/default/testWithMapReduce/2241125b7d23be16c4949dc36e627f50/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-02-15 20:01:24,584 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,zz{,1676491281022.2241125b7d23be16c4949dc36e627f50. 2023-02-15 20:01:24,584 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 2241125b7d23be16c4949dc36e627f50: 2023-02-15 20:01:24,584 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,zz{,1676491281022.2241125b7d23be16c4949dc36e627f50. 2023-02-15 20:01:24,585 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 97b529ba0e37421e99fb43de9d23d817, disabling compactions & flushes 2023-02-15 20:01:24,585 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,m\xED\xED,1676491281022.97b529ba0e37421e99fb43de9d23d817. 2023-02-15 20:01:24,585 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,m\xED\xED,1676491281022.97b529ba0e37421e99fb43de9d23d817. 2023-02-15 20:01:24,585 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,m\xED\xED,1676491281022.97b529ba0e37421e99fb43de9d23d817. after waiting 0 ms 2023-02-15 20:01:24,585 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,m\xED\xED,1676491281022.97b529ba0e37421e99fb43de9d23d817. 2023-02-15 20:01:24,585 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=192 B at sequenceid=32 (bloomFilter=false), to=hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/data/hbase/meta/1588230740/.tmp/table/e0903b973dab4d98a820af6e610e5b81 2023-02-15 20:01:24,585 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/data/hbase/namespace/a83d31acd8a067180d7240b93343a9e6/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-02-15 20:01:24,586 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676491280428.a83d31acd8a067180d7240b93343a9e6. 2023-02-15 20:01:24,587 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for a83d31acd8a067180d7240b93343a9e6: 2023-02-15 20:01:24,588 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1676491280428.a83d31acd8a067180d7240b93343a9e6. 2023-02-15 20:01:24,589 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 2a1c7014d8c6c818f8ea2f67ef6b2118, disabling compactions & flushes 2023-02-15 20:01:24,589 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,d\x84\x84,1676491281022.2a1c7014d8c6c818f8ea2f67ef6b2118. 2023-02-15 20:01:24,590 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,d\x84\x84,1676491281022.2a1c7014d8c6c818f8ea2f67ef6b2118. 2023-02-15 20:01:24,592 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,d\x84\x84,1676491281022.2a1c7014d8c6c818f8ea2f67ef6b2118. after waiting 0 ms 2023-02-15 20:01:24,592 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,d\x84\x84,1676491281022.2a1c7014d8c6c818f8ea2f67ef6b2118. 2023-02-15 20:01:24,602 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/data/default/testWithMapReduce/97b529ba0e37421e99fb43de9d23d817/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-15 20:01:24,603 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,m\xED\xED,1676491281022.97b529ba0e37421e99fb43de9d23d817. 2023-02-15 20:01:24,603 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 97b529ba0e37421e99fb43de9d23d817: 2023-02-15 20:01:24,603 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/data/hbase/meta/1588230740/.tmp/info/a1035260f6b840a3b4bee5d9e0372153 as hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/data/hbase/meta/1588230740/info/a1035260f6b840a3b4bee5d9e0372153 2023-02-15 20:01:24,603 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,m\xED\xED,1676491281022.97b529ba0e37421e99fb43de9d23d817. 2023-02-15 20:01:24,603 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 1486d61d8d2fe0efe2a608c7110b6c7d, disabling compactions & flushes 2023-02-15 20:01:24,603 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,j\xCA\xCA,1676491281022.1486d61d8d2fe0efe2a608c7110b6c7d. 2023-02-15 20:01:24,603 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,j\xCA\xCA,1676491281022.1486d61d8d2fe0efe2a608c7110b6c7d. 2023-02-15 20:01:24,604 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,j\xCA\xCA,1676491281022.1486d61d8d2fe0efe2a608c7110b6c7d. after waiting 0 ms 2023-02-15 20:01:24,604 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,j\xCA\xCA,1676491281022.1486d61d8d2fe0efe2a608c7110b6c7d. 2023-02-15 20:01:24,604 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/data/default/testWithMapReduce/2a1c7014d8c6c818f8ea2f67ef6b2118/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-15 20:01:24,607 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,d\x84\x84,1676491281022.2a1c7014d8c6c818f8ea2f67ef6b2118. 2023-02-15 20:01:24,609 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 2a1c7014d8c6c818f8ea2f67ef6b2118: 2023-02-15 20:01:24,609 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,d\x84\x84,1676491281022.2a1c7014d8c6c818f8ea2f67ef6b2118. 2023-02-15 20:01:24,610 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing bd3ac405f939af16962e576b69a6c71b, disabling compactions & flushes 2023-02-15 20:01:24,610 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,t43,1676491281022.bd3ac405f939af16962e576b69a6c71b. 2023-02-15 20:01:24,610 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,t43,1676491281022.bd3ac405f939af16962e576b69a6c71b. 2023-02-15 20:01:24,610 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,t43,1676491281022.bd3ac405f939af16962e576b69a6c71b. after waiting 0 ms 2023-02-15 20:01:24,610 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,t43,1676491281022.bd3ac405f939af16962e576b69a6c71b. 2023-02-15 20:01:24,618 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/data/hbase/meta/1588230740/info/a1035260f6b840a3b4bee5d9e0372153, entries=110, sequenceid=32, filesize=18.7 K 2023-02-15 20:01:24,620 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/data/hbase/meta/1588230740/.tmp/table/e0903b973dab4d98a820af6e610e5b81 as hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/data/hbase/meta/1588230740/table/e0903b973dab4d98a820af6e610e5b81 2023-02-15 20:01:24,622 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/data/default/testWithMapReduce/1486d61d8d2fe0efe2a608c7110b6c7d/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-15 20:01:24,624 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,j\xCA\xCA,1676491281022.1486d61d8d2fe0efe2a608c7110b6c7d. 2023-02-15 20:01:24,624 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/data/default/testWithMapReduce/bd3ac405f939af16962e576b69a6c71b/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-15 20:01:24,624 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 1486d61d8d2fe0efe2a608c7110b6c7d: 2023-02-15 20:01:24,624 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,j\xCA\xCA,1676491281022.1486d61d8d2fe0efe2a608c7110b6c7d. 2023-02-15 20:01:24,627 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,t43,1676491281022.bd3ac405f939af16962e576b69a6c71b. 2023-02-15 20:01:24,627 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for bd3ac405f939af16962e576b69a6c71b: 2023-02-15 20:01:24,627 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,t43,1676491281022.bd3ac405f939af16962e576b69a6c71b. 2023-02-15 20:01:24,627 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing dae437d89db301633beda20a6a7029ef, disabling compactions & flushes 2023-02-15 20:01:24,627 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,aaa,1676491281022.dae437d89db301633beda20a6a7029ef. 2023-02-15 20:01:24,627 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,aaa,1676491281022.dae437d89db301633beda20a6a7029ef. 2023-02-15 20:01:24,627 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,aaa,1676491281022.dae437d89db301633beda20a6a7029ef. after waiting 0 ms 2023-02-15 20:01:24,627 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,aaa,1676491281022.dae437d89db301633beda20a6a7029ef. 2023-02-15 20:01:24,628 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/data/hbase/meta/1588230740/table/e0903b973dab4d98a820af6e610e5b81, entries=4, sequenceid=32, filesize=4.8 K 2023-02-15 20:01:24,629 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~13.95 KB/14280, heapSize ~22.77 KB/23312, currentSize=0 B/0 for 1588230740 in 108ms, sequenceid=32, compaction requested=false 2023-02-15 20:01:24,629 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-02-15 20:01:24,640 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/data/default/testWithMapReduce/dae437d89db301633beda20a6a7029ef/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-15 20:01:24,641 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/data/hbase/meta/1588230740/recovered.edits/35.seqid, newMaxSeqId=35, maxSeqId=1 2023-02-15 20:01:24,641 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-15 20:01:24,642 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-15 20:01:24,642 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 1588230740: 2023-02-15 20:01:24,642 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-02-15 20:01:24,642 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,aaa,1676491281022.dae437d89db301633beda20a6a7029ef. 2023-02-15 20:01:24,643 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for dae437d89db301633beda20a6a7029ef: 2023-02-15 20:01:24,643 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,aaa,1676491281022.dae437d89db301633beda20a6a7029ef. 2023-02-15 20:01:24,643 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 296941d2565b5d20cfd81aec8ac11565, disabling compactions & flushes 2023-02-15 20:01:24,643 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,q\x11\x10,1676491281022.296941d2565b5d20cfd81aec8ac11565. 2023-02-15 20:01:24,643 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,q\x11\x10,1676491281022.296941d2565b5d20cfd81aec8ac11565. 2023-02-15 20:01:24,643 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,q\x11\x10,1676491281022.296941d2565b5d20cfd81aec8ac11565. after waiting 0 ms 2023-02-15 20:01:24,643 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,q\x11\x10,1676491281022.296941d2565b5d20cfd81aec8ac11565. 2023-02-15 20:01:24,648 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/data/default/testWithMapReduce/296941d2565b5d20cfd81aec8ac11565/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-15 20:01:24,648 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,q\x11\x10,1676491281022.296941d2565b5d20cfd81aec8ac11565. 2023-02-15 20:01:24,648 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 296941d2565b5d20cfd81aec8ac11565: 2023-02-15 20:01:24,648 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,q\x11\x10,1676491281022.296941d2565b5d20cfd81aec8ac11565. 2023-02-15 20:01:24,649 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 2f6827bb8b2d8e3d5d25320352d1e239, disabling compactions & flushes 2023-02-15 20:01:24,649 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,g\xA7\xA7,1676491281022.2f6827bb8b2d8e3d5d25320352d1e239. 2023-02-15 20:01:24,649 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,g\xA7\xA7,1676491281022.2f6827bb8b2d8e3d5d25320352d1e239. 2023-02-15 20:01:24,649 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,g\xA7\xA7,1676491281022.2f6827bb8b2d8e3d5d25320352d1e239. after waiting 0 ms 2023-02-15 20:01:24,649 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,g\xA7\xA7,1676491281022.2f6827bb8b2d8e3d5d25320352d1e239. 2023-02-15 20:01:24,659 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/data/default/testWithMapReduce/2f6827bb8b2d8e3d5d25320352d1e239/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-15 20:01:24,660 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,g\xA7\xA7,1676491281022.2f6827bb8b2d8e3d5d25320352d1e239. 2023-02-15 20:01:24,660 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 2f6827bb8b2d8e3d5d25320352d1e239: 2023-02-15 20:01:24,660 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,g\xA7\xA7,1676491281022.2f6827bb8b2d8e3d5d25320352d1e239. 2023-02-15 20:01:24,720 INFO [RS:0;jenkins-hbase4:33019] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,33019,1676491279655; all regions closed. 2023-02-15 20:01:24,721 INFO [RS:1;jenkins-hbase4:33125] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,33125,1676491279695; all regions closed. 2023-02-15 20:01:24,728 DEBUG [RS:0;jenkins-hbase4:33019] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/oldWALs 2023-02-15 20:01:24,728 INFO [RS:0;jenkins-hbase4:33019] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C33019%2C1676491279655:(num 1676491280819) 2023-02-15 20:01:24,728 DEBUG [RS:0;jenkins-hbase4:33019] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-15 20:01:24,728 INFO [RS:0;jenkins-hbase4:33019] regionserver.LeaseManager(133): Closed leases 2023-02-15 20:01:24,729 INFO [RS:0;jenkins-hbase4:33019] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-02-15 20:01:24,729 INFO [RS:0;jenkins-hbase4:33019] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-15 20:01:24,729 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-15 20:01:24,729 INFO [RS:0;jenkins-hbase4:33019] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-15 20:01:24,729 INFO [RS:0;jenkins-hbase4:33019] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-15 20:01:24,730 INFO [RS:0;jenkins-hbase4:33019] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:33019 2023-02-15 20:01:24,732 DEBUG [RS:1;jenkins-hbase4:33125] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/oldWALs 2023-02-15 20:01:24,732 INFO [RS:1;jenkins-hbase4:33125] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C33125%2C1676491279695.meta:.meta(num 1676491280357) 2023-02-15 20:01:24,732 DEBUG [Listener at localhost/43949-EventThread] zookeeper.ZKWatcher(600): master:36865-0x1005992b68c0000, quorum=127.0.0.1:57384, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-15 20:01:24,732 DEBUG [Listener at localhost/43949-EventThread] zookeeper.ZKWatcher(600): regionserver:33125-0x1005992b68c0002, quorum=127.0.0.1:57384, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,33019,1676491279655 2023-02-15 20:01:24,733 DEBUG [Listener at localhost/43949-EventThread] zookeeper.ZKWatcher(600): regionserver:33125-0x1005992b68c0002, quorum=127.0.0.1:57384, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-15 20:01:24,733 DEBUG [Listener at localhost/43949-EventThread] zookeeper.ZKWatcher(600): regionserver:33019-0x1005992b68c0001, quorum=127.0.0.1:57384, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,33019,1676491279655 2023-02-15 20:01:24,733 ERROR [Listener at localhost/43949-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@1d625776 rejected from java.util.concurrent.ThreadPoolExecutor@195dc002[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-15 20:01:24,733 DEBUG [Listener at localhost/43949-EventThread] zookeeper.ZKWatcher(600): regionserver:33019-0x1005992b68c0001, quorum=127.0.0.1:57384, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-15 20:01:24,733 ERROR [Listener at localhost/43949-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@629f838f rejected from java.util.concurrent.ThreadPoolExecutor@195dc002[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-15 20:01:24,735 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,33019,1676491279655] 2023-02-15 20:01:24,735 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,33019,1676491279655; numProcessing=1 2023-02-15 20:01:24,737 WARN [Close-WAL-Writer-0] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(641): complete file /user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/WALs/jenkins-hbase4.apache.org,33125,1676491279695/jenkins-hbase4.apache.org%2C33125%2C1676491279695.1676491281120 not finished, retry = 0 2023-02-15 20:01:24,737 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,33019,1676491279655 already deleted, retry=false 2023-02-15 20:01:24,737 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,33019,1676491279655 expired; onlineServers=1 2023-02-15 20:01:24,839 DEBUG [RS:1;jenkins-hbase4:33125] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/oldWALs 2023-02-15 20:01:24,839 INFO [RS:1;jenkins-hbase4:33125] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C33125%2C1676491279695:(num 1676491281120) 2023-02-15 20:01:24,839 DEBUG [RS:1;jenkins-hbase4:33125] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-15 20:01:24,840 INFO [RS:1;jenkins-hbase4:33125] regionserver.LeaseManager(133): Closed leases 2023-02-15 20:01:24,840 INFO [RS:1;jenkins-hbase4:33125] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-02-15 20:01:24,840 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-15 20:01:24,841 INFO [RS:1;jenkins-hbase4:33125] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:33125 2023-02-15 20:01:24,843 DEBUG [Listener at localhost/43949-EventThread] zookeeper.ZKWatcher(600): master:36865-0x1005992b68c0000, quorum=127.0.0.1:57384, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-15 20:01:24,843 DEBUG [Listener at localhost/43949-EventThread] zookeeper.ZKWatcher(600): regionserver:33125-0x1005992b68c0002, quorum=127.0.0.1:57384, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,33125,1676491279695 2023-02-15 20:01:24,843 ERROR [Listener at localhost/43949-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@55645f17 rejected from java.util.concurrent.ThreadPoolExecutor@515bd163[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-15 20:01:24,845 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,33125,1676491279695] 2023-02-15 20:01:24,845 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,33125,1676491279695; numProcessing=2 2023-02-15 20:01:24,846 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,33125,1676491279695 already deleted, retry=false 2023-02-15 20:01:24,846 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,33125,1676491279695 expired; onlineServers=0 2023-02-15 20:01:24,847 INFO [RegionServerTracker-0] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,36865,1676491279587' ***** 2023-02-15 20:01:24,847 INFO [RegionServerTracker-0] regionserver.HRegionServer(2310): STOPPED: Cluster shutdown set; onlineServer=0 2023-02-15 20:01:24,848 DEBUG [M:0;jenkins-hbase4:36865] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5051efc9, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-15 20:01:24,848 INFO [M:0;jenkins-hbase4:36865] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,36865,1676491279587 2023-02-15 20:01:24,848 INFO [M:0;jenkins-hbase4:36865] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,36865,1676491279587; all regions closed. 2023-02-15 20:01:24,848 DEBUG [M:0;jenkins-hbase4:36865] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-15 20:01:24,848 DEBUG [M:0;jenkins-hbase4:36865] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-02-15 20:01:24,848 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-02-15 20:01:24,848 DEBUG [M:0;jenkins-hbase4:36865] cleaner.HFileCleaner(317): Stopping file delete threads 2023-02-15 20:01:24,848 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676491279977] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676491279977,5,FailOnTimeoutGroup] 2023-02-15 20:01:24,848 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676491279976] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676491279976,5,FailOnTimeoutGroup] 2023-02-15 20:01:24,848 INFO [M:0;jenkins-hbase4:36865] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-02-15 20:01:24,849 INFO [M:0;jenkins-hbase4:36865] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-02-15 20:01:24,849 INFO [M:0;jenkins-hbase4:36865] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-02-15 20:01:24,849 DEBUG [Listener at localhost/43949-EventThread] zookeeper.ZKWatcher(600): master:36865-0x1005992b68c0000, quorum=127.0.0.1:57384, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-02-15 20:01:24,849 DEBUG [M:0;jenkins-hbase4:36865] master.HMaster(1512): Stopping service threads 2023-02-15 20:01:24,849 DEBUG [Listener at localhost/43949-EventThread] zookeeper.ZKWatcher(600): master:36865-0x1005992b68c0000, quorum=127.0.0.1:57384, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-15 20:01:24,850 INFO [M:0;jenkins-hbase4:36865] procedure2.RemoteProcedureDispatcher(118): Stopping procedure remote dispatcher 2023-02-15 20:01:24,850 ERROR [M:0;jenkins-hbase4:36865] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-02-15 20:01:24,850 INFO [M:0;jenkins-hbase4:36865] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-02-15 20:01:24,850 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:36865-0x1005992b68c0000, quorum=127.0.0.1:57384, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-15 20:01:24,850 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-02-15 20:01:24,851 DEBUG [M:0;jenkins-hbase4:36865] zookeeper.ZKUtil(398): master:36865-0x1005992b68c0000, quorum=127.0.0.1:57384, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-02-15 20:01:24,851 WARN [M:0;jenkins-hbase4:36865] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-02-15 20:01:24,851 INFO [M:0;jenkins-hbase4:36865] assignment.AssignmentManager(315): Stopping assignment manager 2023-02-15 20:01:24,851 INFO [M:0;jenkins-hbase4:36865] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-02-15 20:01:24,851 DEBUG [M:0;jenkins-hbase4:36865] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-15 20:01:24,851 INFO [M:0;jenkins-hbase4:36865] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-15 20:01:24,851 DEBUG [M:0;jenkins-hbase4:36865] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-15 20:01:24,851 DEBUG [M:0;jenkins-hbase4:36865] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-15 20:01:24,851 DEBUG [M:0;jenkins-hbase4:36865] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-15 20:01:24,851 INFO [M:0;jenkins-hbase4:36865] regionserver.HRegion(2744): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=100.95 KB heapSize=120.63 KB 2023-02-15 20:01:24,861 INFO [M:0;jenkins-hbase4:36865] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=100.95 KB at sequenceid=218 (bloomFilter=true), to=hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/3c0bfc088d1148dea3acde66debc01c6 2023-02-15 20:01:24,865 DEBUG [M:0;jenkins-hbase4:36865] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/3c0bfc088d1148dea3acde66debc01c6 as hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/3c0bfc088d1148dea3acde66debc01c6 2023-02-15 20:01:24,869 INFO [M:0;jenkins-hbase4:36865] regionserver.HStore(1080): Added hdfs://localhost:40371/user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/3c0bfc088d1148dea3acde66debc01c6, entries=31, sequenceid=218, filesize=9.0 K 2023-02-15 20:01:24,870 INFO [M:0;jenkins-hbase4:36865] regionserver.HRegion(2947): Finished flush of dataSize ~100.95 KB/103374, heapSize ~120.62 KB/123512, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 19ms, sequenceid=218, compaction requested=false 2023-02-15 20:01:24,871 INFO [M:0;jenkins-hbase4:36865] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-15 20:01:24,871 DEBUG [M:0;jenkins-hbase4:36865] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-15 20:01:24,874 WARN [Close-WAL-Writer-0] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(641): complete file /user/jenkins/test-data/95b27ebd-fb6e-6605-8870-c37bea5a46da/MasterData/WALs/jenkins-hbase4.apache.org,36865,1676491279587/jenkins-hbase4.apache.org%2C36865%2C1676491279587.1676491279879 not finished, retry = 0 2023-02-15 20:01:24,975 INFO [M:0;jenkins-hbase4:36865] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-02-15 20:01:24,975 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-15 20:01:24,976 INFO [M:0;jenkins-hbase4:36865] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:36865 2023-02-15 20:01:24,980 DEBUG [M:0;jenkins-hbase4:36865] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,36865,1676491279587 already deleted, retry=false 2023-02-15 20:01:25,017 DEBUG [Listener at localhost/43949-EventThread] zookeeper.ZKWatcher(600): regionserver:33125-0x1005992b68c0002, quorum=127.0.0.1:57384, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-15 20:01:25,017 INFO [RS:1;jenkins-hbase4:33125] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,33125,1676491279695; zookeeper connection closed. 2023-02-15 20:01:25,017 ERROR [Listener at localhost/43949-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@52ec0696 rejected from java.util.concurrent.ThreadPoolExecutor@515bd163[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-15 20:01:25,017 DEBUG [Listener at localhost/43949-EventThread] zookeeper.ZKWatcher(600): regionserver:33125-0x1005992b68c0002, quorum=127.0.0.1:57384, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-15 20:01:25,017 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@50a1e220] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@50a1e220 2023-02-15 20:01:25,017 ERROR [Listener at localhost/43949-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@2a586a31 rejected from java.util.concurrent.ThreadPoolExecutor@515bd163[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-15 20:01:25,117 DEBUG [Listener at localhost/43949-EventThread] zookeeper.ZKWatcher(600): regionserver:33019-0x1005992b68c0001, quorum=127.0.0.1:57384, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-15 20:01:25,117 INFO [RS:0;jenkins-hbase4:33019] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,33019,1676491279655; zookeeper connection closed. 2023-02-15 20:01:25,117 ERROR [Listener at localhost/43949-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@1ae32126 rejected from java.util.concurrent.ThreadPoolExecutor@195dc002[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-15 20:01:25,118 DEBUG [Listener at localhost/43949-EventThread] zookeeper.ZKWatcher(600): regionserver:33019-0x1005992b68c0001, quorum=127.0.0.1:57384, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-15 20:01:25,118 ERROR [Listener at localhost/43949-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@22edddf8 rejected from java.util.concurrent.ThreadPoolExecutor@195dc002[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-15 20:01:25,131 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@715462fa] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@715462fa 2023-02-15 20:01:25,131 INFO [Listener at localhost/43949] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 2 regionserver(s) complete 2023-02-15 20:01:25,217 DEBUG [Listener at localhost/43949-EventThread] zookeeper.ZKWatcher(600): master:36865-0x1005992b68c0000, quorum=127.0.0.1:57384, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-15 20:01:25,217 INFO [M:0;jenkins-hbase4:36865] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,36865,1676491279587; zookeeper connection closed. 2023-02-15 20:01:25,218 ERROR [Listener at localhost/43949-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@4b69542c rejected from java.util.concurrent.ThreadPoolExecutor@4f56d999[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 55] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-15 20:01:25,218 DEBUG [Listener at localhost/43949-EventThread] zookeeper.ZKWatcher(600): master:36865-0x1005992b68c0000, quorum=127.0.0.1:57384, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-15 20:01:25,219 ERROR [Listener at localhost/43949-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@3add9c4e rejected from java.util.concurrent.ThreadPoolExecutor@4f56d999[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 55] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-15 20:01:25,305 DEBUG [Listener at localhost/43949] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapred.TestTableSnapshotInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c11e5f15-9142-b55b-08be-b6cf0858e875/hadoop-6479849161006238551.jar 2023-02-15 20:01:25,309 INFO [Listener at localhost/43949] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "testWithMapReduceAndOfflineHBaseMultiRegion" table: "testWithMapReduce" creation_time: 1676491281841 type: FLUSH version: 2 ttl: 0 2023-02-15 20:01:25,309 DEBUG [Listener at localhost/43949] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost:40371/user/jenkins/test-data/743659ce-8263-b073-8e60-8033ef08dd2c/testWithMapReduceAndOfflineHBaseMultiRegion/296c0b3e-d6da-4cf1-bdc4-c441f21ef899/data/default/testWithMapReduce 2023-02-15 20:01:25,309 INFO [Listener at localhost/43949] snapshot.RestoreSnapshotHelper(239): region to add: 9fdf60e81d6a22352a6acb2fcb8c9f3e 2023-02-15 20:01:25,309 INFO [Listener at localhost/43949] snapshot.RestoreSnapshotHelper(239): region to add: 2a1c7014d8c6c818f8ea2f67ef6b2118 2023-02-15 20:01:25,309 INFO [Listener at localhost/43949] snapshot.RestoreSnapshotHelper(239): region to add: bd3ac405f939af16962e576b69a6c71b 2023-02-15 20:01:25,309 INFO [Listener at localhost/43949] snapshot.RestoreSnapshotHelper(239): region to add: 2241125b7d23be16c4949dc36e627f50 2023-02-15 20:01:25,309 INFO [Listener at localhost/43949] snapshot.RestoreSnapshotHelper(239): region to add: 69ce6540f755e21eae3d289ad231610b 2023-02-15 20:01:25,310 INFO [Listener at localhost/43949] snapshot.RestoreSnapshotHelper(239): region to add: dae437d89db301633beda20a6a7029ef 2023-02-15 20:01:25,310 INFO [Listener at localhost/43949] snapshot.RestoreSnapshotHelper(239): region to add: 296941d2565b5d20cfd81aec8ac11565 2023-02-15 20:01:25,310 INFO [Listener at localhost/43949] snapshot.RestoreSnapshotHelper(239): region to add: 2f6827bb8b2d8e3d5d25320352d1e239 2023-02-15 20:01:25,310 INFO [Listener at localhost/43949] snapshot.RestoreSnapshotHelper(239): region to add: 1486d61d8d2fe0efe2a608c7110b6c7d 2023-02-15 20:01:25,310 INFO [Listener at localhost/43949] snapshot.RestoreSnapshotHelper(239): region to add: 97b529ba0e37421e99fb43de9d23d817 2023-02-15 20:01:25,310 INFO [Listener at localhost/43949] snapshot.RestoreSnapshotHelper(585): clone region=9fdf60e81d6a22352a6acb2fcb8c9f3e as 9fdf60e81d6a22352a6acb2fcb8c9f3e in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 20:01:25,310 INFO [Listener at localhost/43949] snapshot.RestoreSnapshotHelper(585): clone region=2a1c7014d8c6c818f8ea2f67ef6b2118 as 2a1c7014d8c6c818f8ea2f67ef6b2118 in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 20:01:25,310 INFO [Listener at localhost/43949] snapshot.RestoreSnapshotHelper(585): clone region=bd3ac405f939af16962e576b69a6c71b as bd3ac405f939af16962e576b69a6c71b in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 20:01:25,310 INFO [Listener at localhost/43949] snapshot.RestoreSnapshotHelper(585): clone region=2241125b7d23be16c4949dc36e627f50 as 2241125b7d23be16c4949dc36e627f50 in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 20:01:25,310 INFO [Listener at localhost/43949] snapshot.RestoreSnapshotHelper(585): clone region=69ce6540f755e21eae3d289ad231610b as 69ce6540f755e21eae3d289ad231610b in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 20:01:25,310 INFO [Listener at localhost/43949] snapshot.RestoreSnapshotHelper(585): clone region=dae437d89db301633beda20a6a7029ef as dae437d89db301633beda20a6a7029ef in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 20:01:25,310 INFO [Listener at localhost/43949] snapshot.RestoreSnapshotHelper(585): clone region=296941d2565b5d20cfd81aec8ac11565 as 296941d2565b5d20cfd81aec8ac11565 in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 20:01:25,310 INFO [Listener at localhost/43949] snapshot.RestoreSnapshotHelper(585): clone region=2f6827bb8b2d8e3d5d25320352d1e239 as 2f6827bb8b2d8e3d5d25320352d1e239 in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 20:01:25,310 INFO [Listener at localhost/43949] snapshot.RestoreSnapshotHelper(585): clone region=1486d61d8d2fe0efe2a608c7110b6c7d as 1486d61d8d2fe0efe2a608c7110b6c7d in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 20:01:25,310 INFO [Listener at localhost/43949] snapshot.RestoreSnapshotHelper(585): clone region=97b529ba0e37421e99fb43de9d23d817 as 97b529ba0e37421e99fb43de9d23d817 in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 20:01:25,311 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(7671): creating {ENCODED => bd3ac405f939af16962e576b69a6c71b, NAME => 'testWithMapReduce,t43,1676491281022.bd3ac405f939af16962e576b69a6c71b.', STARTKEY => 't43', ENDKEY => 'wWV'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40371/user/jenkins/test-data/743659ce-8263-b073-8e60-8033ef08dd2c/testWithMapReduceAndOfflineHBaseMultiRegion/296c0b3e-d6da-4cf1-bdc4-c441f21ef899 2023-02-15 20:01:25,312 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(7671): creating {ENCODED => 9fdf60e81d6a22352a6acb2fcb8c9f3e, NAME => 'testWithMapReduce,,1676491281022.9fdf60e81d6a22352a6acb2fcb8c9f3e.', STARTKEY => '', ENDKEY => 'aaa'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40371/user/jenkins/test-data/743659ce-8263-b073-8e60-8033ef08dd2c/testWithMapReduceAndOfflineHBaseMultiRegion/296c0b3e-d6da-4cf1-bdc4-c441f21ef899 2023-02-15 20:01:25,312 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(7671): creating {ENCODED => 2a1c7014d8c6c818f8ea2f67ef6b2118, NAME => 'testWithMapReduce,d\x84\x84,1676491281022.2a1c7014d8c6c818f8ea2f67ef6b2118.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40371/user/jenkins/test-data/743659ce-8263-b073-8e60-8033ef08dd2c/testWithMapReduceAndOfflineHBaseMultiRegion/296c0b3e-d6da-4cf1-bdc4-c441f21ef899 2023-02-15 20:01:25,313 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(7671): creating {ENCODED => dae437d89db301633beda20a6a7029ef, NAME => 'testWithMapReduce,aaa,1676491281022.dae437d89db301633beda20a6a7029ef.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40371/user/jenkins/test-data/743659ce-8263-b073-8e60-8033ef08dd2c/testWithMapReduceAndOfflineHBaseMultiRegion/296c0b3e-d6da-4cf1-bdc4-c441f21ef899 2023-02-15 20:01:25,313 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(7671): creating {ENCODED => 69ce6540f755e21eae3d289ad231610b, NAME => 'testWithMapReduce,wWV,1676491281022.69ce6540f755e21eae3d289ad231610b.', STARTKEY => 'wWV', ENDKEY => 'zz{'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40371/user/jenkins/test-data/743659ce-8263-b073-8e60-8033ef08dd2c/testWithMapReduceAndOfflineHBaseMultiRegion/296c0b3e-d6da-4cf1-bdc4-c441f21ef899 2023-02-15 20:01:25,313 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(7671): creating {ENCODED => 2241125b7d23be16c4949dc36e627f50, NAME => 'testWithMapReduce,zz{,1676491281022.2241125b7d23be16c4949dc36e627f50.', STARTKEY => 'zz{', ENDKEY => ''}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40371/user/jenkins/test-data/743659ce-8263-b073-8e60-8033ef08dd2c/testWithMapReduceAndOfflineHBaseMultiRegion/296c0b3e-d6da-4cf1-bdc4-c441f21ef899 2023-02-15 20:01:25,316 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(7671): creating {ENCODED => 296941d2565b5d20cfd81aec8ac11565, NAME => 'testWithMapReduce,q\x11\x10,1676491281022.296941d2565b5d20cfd81aec8ac11565.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40371/user/jenkins/test-data/743659ce-8263-b073-8e60-8033ef08dd2c/testWithMapReduceAndOfflineHBaseMultiRegion/296c0b3e-d6da-4cf1-bdc4-c441f21ef899 2023-02-15 20:01:25,317 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(7671): creating {ENCODED => 2f6827bb8b2d8e3d5d25320352d1e239, NAME => 'testWithMapReduce,g\xA7\xA7,1676491281022.2f6827bb8b2d8e3d5d25320352d1e239.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40371/user/jenkins/test-data/743659ce-8263-b073-8e60-8033ef08dd2c/testWithMapReduceAndOfflineHBaseMultiRegion/296c0b3e-d6da-4cf1-bdc4-c441f21ef899 2023-02-15 20:01:25,335 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,t43,1676491281022.bd3ac405f939af16962e576b69a6c71b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 20:01:25,335 INFO [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(628): Adding HFileLink e061b466566641ce84e5637aff6e87d4 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-15 20:01:25,340 INFO [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 4df29d784f394edcafca4e683f7852fa from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-15 20:01:25,348 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676491281022.9fdf60e81d6a22352a6acb2fcb8c9f3e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 20:01:25,349 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1603): Closing 9fdf60e81d6a22352a6acb2fcb8c9f3e, disabling compactions & flushes 2023-02-15 20:01:25,349 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676491281022.9fdf60e81d6a22352a6acb2fcb8c9f3e. 2023-02-15 20:01:25,349 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676491281022.9fdf60e81d6a22352a6acb2fcb8c9f3e. 2023-02-15 20:01:25,349 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676491281022.9fdf60e81d6a22352a6acb2fcb8c9f3e. after waiting 0 ms 2023-02-15 20:01:25,349 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676491281022.9fdf60e81d6a22352a6acb2fcb8c9f3e. 2023-02-15 20:01:25,349 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,,1676491281022.9fdf60e81d6a22352a6acb2fcb8c9f3e. 2023-02-15 20:01:25,349 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1557): Region close journal for 9fdf60e81d6a22352a6acb2fcb8c9f3e: 2023-02-15 20:01:25,349 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(7671): creating {ENCODED => 1486d61d8d2fe0efe2a608c7110b6c7d, NAME => 'testWithMapReduce,j\xCA\xCA,1676491281022.1486d61d8d2fe0efe2a608c7110b6c7d.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40371/user/jenkins/test-data/743659ce-8263-b073-8e60-8033ef08dd2c/testWithMapReduceAndOfflineHBaseMultiRegion/296c0b3e-d6da-4cf1-bdc4-c441f21ef899 2023-02-15 20:01:25,356 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,d\x84\x84,1676491281022.2a1c7014d8c6c818f8ea2f67ef6b2118.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 20:01:25,356 INFO [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 23d33b83df074886bcad94456fae89f1 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-15 20:01:25,356 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1603): Closing bd3ac405f939af16962e576b69a6c71b, disabling compactions & flushes 2023-02-15 20:01:25,357 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,t43,1676491281022.bd3ac405f939af16962e576b69a6c71b. 2023-02-15 20:01:25,357 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,t43,1676491281022.bd3ac405f939af16962e576b69a6c71b. 2023-02-15 20:01:25,357 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,t43,1676491281022.bd3ac405f939af16962e576b69a6c71b. after waiting 0 ms 2023-02-15 20:01:25,357 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,t43,1676491281022.bd3ac405f939af16962e576b69a6c71b. 2023-02-15 20:01:25,357 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,t43,1676491281022.bd3ac405f939af16962e576b69a6c71b. 2023-02-15 20:01:25,357 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1557): Region close journal for bd3ac405f939af16962e576b69a6c71b: 2023-02-15 20:01:25,357 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(7671): creating {ENCODED => 97b529ba0e37421e99fb43de9d23d817, NAME => 'testWithMapReduce,m\xED\xED,1676491281022.97b529ba0e37421e99fb43de9d23d817.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40371/user/jenkins/test-data/743659ce-8263-b073-8e60-8033ef08dd2c/testWithMapReduceAndOfflineHBaseMultiRegion/296c0b3e-d6da-4cf1-bdc4-c441f21ef899 2023-02-15 20:01:25,358 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(865): Instantiated testWithMapReduce,zz{,1676491281022.2241125b7d23be16c4949dc36e627f50.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 20:01:25,358 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1603): Closing 2241125b7d23be16c4949dc36e627f50, disabling compactions & flushes 2023-02-15 20:01:25,358 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(1625): Closing region testWithMapReduce,zz{,1676491281022.2241125b7d23be16c4949dc36e627f50. 2023-02-15 20:01:25,358 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,zz{,1676491281022.2241125b7d23be16c4949dc36e627f50. 2023-02-15 20:01:25,358 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,zz{,1676491281022.2241125b7d23be16c4949dc36e627f50. after waiting 0 ms 2023-02-15 20:01:25,358 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,zz{,1676491281022.2241125b7d23be16c4949dc36e627f50. 2023-02-15 20:01:25,358 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(1837): Closed testWithMapReduce,zz{,1676491281022.2241125b7d23be16c4949dc36e627f50. 2023-02-15 20:01:25,358 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1557): Region close journal for 2241125b7d23be16c4949dc36e627f50: 2023-02-15 20:01:25,364 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(865): Instantiated testWithMapReduce,q\x11\x10,1676491281022.296941d2565b5d20cfd81aec8ac11565.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 20:01:25,364 INFO [RestoreSnapshot-pool-6] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 57f05d0842a74ba98a471fe3065929c4 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-15 20:01:25,366 INFO [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 52f1540918dd49b6b7dc0f3174528264 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-15 20:01:25,368 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(865): Instantiated testWithMapReduce,g\xA7\xA7,1676491281022.2f6827bb8b2d8e3d5d25320352d1e239.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 20:01:25,368 INFO [RestoreSnapshot-pool-7] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 92d7cc4cd31942629f77cf21178cc2d6 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-15 20:01:25,372 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(865): Instantiated testWithMapReduce,aaa,1676491281022.dae437d89db301633beda20a6a7029ef.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 20:01:25,372 INFO [RestoreSnapshot-pool-5] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 594cc29e1efe4b82a77293865b824b63 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-15 20:01:25,372 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1603): Closing 2a1c7014d8c6c818f8ea2f67ef6b2118, disabling compactions & flushes 2023-02-15 20:01:25,372 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,d\x84\x84,1676491281022.2a1c7014d8c6c818f8ea2f67ef6b2118. 2023-02-15 20:01:25,373 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,d\x84\x84,1676491281022.2a1c7014d8c6c818f8ea2f67ef6b2118. 2023-02-15 20:01:25,373 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,d\x84\x84,1676491281022.2a1c7014d8c6c818f8ea2f67ef6b2118. after waiting 0 ms 2023-02-15 20:01:25,373 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,d\x84\x84,1676491281022.2a1c7014d8c6c818f8ea2f67ef6b2118. 2023-02-15 20:01:25,373 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,d\x84\x84,1676491281022.2a1c7014d8c6c818f8ea2f67ef6b2118. 2023-02-15 20:01:25,373 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1557): Region close journal for 2a1c7014d8c6c818f8ea2f67ef6b2118: 2023-02-15 20:01:25,373 INFO [RestoreSnapshot-pool-6] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 4e45595a7c04411e96f207fccb0aade2 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-15 20:01:25,373 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(865): Instantiated testWithMapReduce,wWV,1676491281022.69ce6540f755e21eae3d289ad231610b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 20:01:25,373 INFO [RestoreSnapshot-pool-4] snapshot.RestoreSnapshotHelper(628): Adding HFileLink e5f6c27caca2460f87a952d21f5687bc from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-15 20:01:25,374 INFO [RestoreSnapshot-pool-7] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 5b1da113e4194abcba98b6f99fc34cb8 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-15 20:01:25,380 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,j\xCA\xCA,1676491281022.1486d61d8d2fe0efe2a608c7110b6c7d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 20:01:25,380 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink de28b0ab497640e590f6f466e3019c49 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-15 20:01:25,382 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1603): Closing 2f6827bb8b2d8e3d5d25320352d1e239, disabling compactions & flushes 2023-02-15 20:01:25,382 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(1625): Closing region testWithMapReduce,g\xA7\xA7,1676491281022.2f6827bb8b2d8e3d5d25320352d1e239. 2023-02-15 20:01:25,382 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,g\xA7\xA7,1676491281022.2f6827bb8b2d8e3d5d25320352d1e239. 2023-02-15 20:01:25,382 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,g\xA7\xA7,1676491281022.2f6827bb8b2d8e3d5d25320352d1e239. after waiting 0 ms 2023-02-15 20:01:25,382 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,g\xA7\xA7,1676491281022.2f6827bb8b2d8e3d5d25320352d1e239. 2023-02-15 20:01:25,382 INFO [RestoreSnapshot-pool-5] snapshot.RestoreSnapshotHelper(628): Adding HFileLink b2caa048c0fc4ce4816c15496b0e136b from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-15 20:01:25,382 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(1837): Closed testWithMapReduce,g\xA7\xA7,1676491281022.2f6827bb8b2d8e3d5d25320352d1e239. 2023-02-15 20:01:25,382 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1557): Region close journal for 2f6827bb8b2d8e3d5d25320352d1e239: 2023-02-15 20:01:25,384 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,m\xED\xED,1676491281022.97b529ba0e37421e99fb43de9d23d817.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 20:01:25,384 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 35f8711edfdb4222926a2aec3e6ab181 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-15 20:01:25,384 INFO [RestoreSnapshot-pool-4] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 1eedc5ffee284d0aa5210a5ab40bb91c from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-15 20:01:25,384 INFO [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 31b2ff03534b4586a751a4d981d67074 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-15 20:01:25,384 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1603): Closing 296941d2565b5d20cfd81aec8ac11565, disabling compactions & flushes 2023-02-15 20:01:25,384 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(1625): Closing region testWithMapReduce,q\x11\x10,1676491281022.296941d2565b5d20cfd81aec8ac11565. 2023-02-15 20:01:25,384 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,q\x11\x10,1676491281022.296941d2565b5d20cfd81aec8ac11565. 2023-02-15 20:01:25,384 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,q\x11\x10,1676491281022.296941d2565b5d20cfd81aec8ac11565. after waiting 0 ms 2023-02-15 20:01:25,384 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,q\x11\x10,1676491281022.296941d2565b5d20cfd81aec8ac11565. 2023-02-15 20:01:25,384 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(1837): Closed testWithMapReduce,q\x11\x10,1676491281022.296941d2565b5d20cfd81aec8ac11565. 2023-02-15 20:01:25,385 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1557): Region close journal for 296941d2565b5d20cfd81aec8ac11565: 2023-02-15 20:01:25,386 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1603): Closing dae437d89db301633beda20a6a7029ef, disabling compactions & flushes 2023-02-15 20:01:25,386 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(1625): Closing region testWithMapReduce,aaa,1676491281022.dae437d89db301633beda20a6a7029ef. 2023-02-15 20:01:25,386 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,aaa,1676491281022.dae437d89db301633beda20a6a7029ef. 2023-02-15 20:01:25,386 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,aaa,1676491281022.dae437d89db301633beda20a6a7029ef. after waiting 0 ms 2023-02-15 20:01:25,386 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,aaa,1676491281022.dae437d89db301633beda20a6a7029ef. 2023-02-15 20:01:25,386 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(1837): Closed testWithMapReduce,aaa,1676491281022.dae437d89db301633beda20a6a7029ef. 2023-02-15 20:01:25,386 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1557): Region close journal for dae437d89db301633beda20a6a7029ef: 2023-02-15 20:01:25,387 INFO [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(628): Adding HFileLink b71d28cc99fb44eba8165e9e0657a35f from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-15 20:01:25,387 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1603): Closing 1486d61d8d2fe0efe2a608c7110b6c7d, disabling compactions & flushes 2023-02-15 20:01:25,387 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,j\xCA\xCA,1676491281022.1486d61d8d2fe0efe2a608c7110b6c7d. 2023-02-15 20:01:25,387 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1603): Closing 69ce6540f755e21eae3d289ad231610b, disabling compactions & flushes 2023-02-15 20:01:25,387 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,j\xCA\xCA,1676491281022.1486d61d8d2fe0efe2a608c7110b6c7d. 2023-02-15 20:01:25,387 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(1625): Closing region testWithMapReduce,wWV,1676491281022.69ce6540f755e21eae3d289ad231610b. 2023-02-15 20:01:25,387 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,j\xCA\xCA,1676491281022.1486d61d8d2fe0efe2a608c7110b6c7d. after waiting 0 ms 2023-02-15 20:01:25,387 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,wWV,1676491281022.69ce6540f755e21eae3d289ad231610b. 2023-02-15 20:01:25,387 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,j\xCA\xCA,1676491281022.1486d61d8d2fe0efe2a608c7110b6c7d. 2023-02-15 20:01:25,387 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,wWV,1676491281022.69ce6540f755e21eae3d289ad231610b. after waiting 0 ms 2023-02-15 20:01:25,387 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,j\xCA\xCA,1676491281022.1486d61d8d2fe0efe2a608c7110b6c7d. 2023-02-15 20:01:25,387 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,wWV,1676491281022.69ce6540f755e21eae3d289ad231610b. 2023-02-15 20:01:25,387 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1557): Region close journal for 1486d61d8d2fe0efe2a608c7110b6c7d: 2023-02-15 20:01:25,387 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(1837): Closed testWithMapReduce,wWV,1676491281022.69ce6540f755e21eae3d289ad231610b. 2023-02-15 20:01:25,387 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1557): Region close journal for 69ce6540f755e21eae3d289ad231610b: 2023-02-15 20:01:25,389 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1603): Closing 97b529ba0e37421e99fb43de9d23d817, disabling compactions & flushes 2023-02-15 20:01:25,389 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,m\xED\xED,1676491281022.97b529ba0e37421e99fb43de9d23d817. 2023-02-15 20:01:25,389 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,m\xED\xED,1676491281022.97b529ba0e37421e99fb43de9d23d817. 2023-02-15 20:01:25,389 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,m\xED\xED,1676491281022.97b529ba0e37421e99fb43de9d23d817. after waiting 0 ms 2023-02-15 20:01:25,389 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,m\xED\xED,1676491281022.97b529ba0e37421e99fb43de9d23d817. 2023-02-15 20:01:25,389 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,m\xED\xED,1676491281022.97b529ba0e37421e99fb43de9d23d817. 2023-02-15 20:01:25,389 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1557): Region close journal for 97b529ba0e37421e99fb43de9d23d817: 2023-02-15 20:01:25,389 INFO [Listener at localhost/43949] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "testWithMapReduceAndOfflineHBaseMultiRegion" table: "testWithMapReduce" creation_time: 1676491281841 type: FLUSH version: 2 ttl: 0 2023-02-15 20:01:25,389 DEBUG [Listener at localhost/43949] snapshot.RestoreSnapshotHelper(832): Restored table dir:hdfs://localhost:40371/user/jenkins/test-data/743659ce-8263-b073-8e60-8033ef08dd2c/testWithMapReduceAndOfflineHBaseMultiRegion/296c0b3e-d6da-4cf1-bdc4-c441f21ef899 2023-02-15 20:01:25,390 DEBUG [Listener at localhost/43949] util.CommonFSUtils(682): File system contents for path hdfs://localhost:40371/user/jenkins/test-data/743659ce-8263-b073-8e60-8033ef08dd2c/testWithMapReduceAndOfflineHBaseMultiRegion/296c0b3e-d6da-4cf1-bdc4-c441f21ef899 2023-02-15 20:01:25,390 DEBUG [Listener at localhost/43949] util.CommonFSUtils(699): |-data/ 2023-02-15 20:01:25,391 DEBUG [Listener at localhost/43949] util.CommonFSUtils(699): |----default/ 2023-02-15 20:01:25,391 DEBUG [Listener at localhost/43949] util.CommonFSUtils(699): |-------testWithMapReduce/ 2023-02-15 20:01:25,392 DEBUG [Listener at localhost/43949] util.CommonFSUtils(699): |----------1486d61d8d2fe0efe2a608c7110b6c7d/ 2023-02-15 20:01:25,393 DEBUG [Listener at localhost/43949] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-15 20:01:25,393 DEBUG [Listener at localhost/43949] util.CommonFSUtils(699): |-------------f1/ 2023-02-15 20:01:25,393 DEBUG [Listener at localhost/43949] util.CommonFSUtils(702): |----------------testWithMapReduce=1486d61d8d2fe0efe2a608c7110b6c7d-de28b0ab497640e590f6f466e3019c49 2023-02-15 20:01:25,393 DEBUG [Listener at localhost/43949] util.CommonFSUtils(699): |-------------f2/ 2023-02-15 20:01:25,394 DEBUG [Listener at localhost/43949] util.CommonFSUtils(702): |----------------testWithMapReduce=1486d61d8d2fe0efe2a608c7110b6c7d-35f8711edfdb4222926a2aec3e6ab181 2023-02-15 20:01:25,394 DEBUG [Listener at localhost/43949] util.CommonFSUtils(699): |----------2241125b7d23be16c4949dc36e627f50/ 2023-02-15 20:01:25,394 DEBUG [Listener at localhost/43949] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-15 20:01:25,394 DEBUG [Listener at localhost/43949] util.CommonFSUtils(699): |----------296941d2565b5d20cfd81aec8ac11565/ 2023-02-15 20:01:25,395 DEBUG [Listener at localhost/43949] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-15 20:01:25,395 DEBUG [Listener at localhost/43949] util.CommonFSUtils(699): |-------------f1/ 2023-02-15 20:01:25,395 DEBUG [Listener at localhost/43949] util.CommonFSUtils(702): |----------------testWithMapReduce=296941d2565b5d20cfd81aec8ac11565-57f05d0842a74ba98a471fe3065929c4 2023-02-15 20:01:25,395 DEBUG [Listener at localhost/43949] util.CommonFSUtils(699): |-------------f2/ 2023-02-15 20:01:25,396 DEBUG [Listener at localhost/43949] util.CommonFSUtils(702): |----------------testWithMapReduce=296941d2565b5d20cfd81aec8ac11565-4e45595a7c04411e96f207fccb0aade2 2023-02-15 20:01:25,396 DEBUG [Listener at localhost/43949] util.CommonFSUtils(699): |----------2a1c7014d8c6c818f8ea2f67ef6b2118/ 2023-02-15 20:01:25,396 DEBUG [Listener at localhost/43949] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-15 20:01:25,396 DEBUG [Listener at localhost/43949] util.CommonFSUtils(699): |-------------f1/ 2023-02-15 20:01:25,397 DEBUG [Listener at localhost/43949] util.CommonFSUtils(702): |----------------testWithMapReduce=2a1c7014d8c6c818f8ea2f67ef6b2118-23d33b83df074886bcad94456fae89f1 2023-02-15 20:01:25,397 DEBUG [Listener at localhost/43949] util.CommonFSUtils(699): |-------------f2/ 2023-02-15 20:01:25,397 DEBUG [Listener at localhost/43949] util.CommonFSUtils(702): |----------------testWithMapReduce=2a1c7014d8c6c818f8ea2f67ef6b2118-52f1540918dd49b6b7dc0f3174528264 2023-02-15 20:01:25,397 DEBUG [Listener at localhost/43949] util.CommonFSUtils(699): |----------2f6827bb8b2d8e3d5d25320352d1e239/ 2023-02-15 20:01:25,398 DEBUG [Listener at localhost/43949] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-15 20:01:25,398 DEBUG [Listener at localhost/43949] util.CommonFSUtils(699): |-------------f1/ 2023-02-15 20:01:25,398 DEBUG [Listener at localhost/43949] util.CommonFSUtils(702): |----------------testWithMapReduce=2f6827bb8b2d8e3d5d25320352d1e239-92d7cc4cd31942629f77cf21178cc2d6 2023-02-15 20:01:25,398 DEBUG [Listener at localhost/43949] util.CommonFSUtils(699): |-------------f2/ 2023-02-15 20:01:25,399 DEBUG [Listener at localhost/43949] util.CommonFSUtils(702): |----------------testWithMapReduce=2f6827bb8b2d8e3d5d25320352d1e239-5b1da113e4194abcba98b6f99fc34cb8 2023-02-15 20:01:25,399 DEBUG [Listener at localhost/43949] util.CommonFSUtils(699): |----------69ce6540f755e21eae3d289ad231610b/ 2023-02-15 20:01:25,399 DEBUG [Listener at localhost/43949] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-15 20:01:25,399 DEBUG [Listener at localhost/43949] util.CommonFSUtils(699): |-------------f1/ 2023-02-15 20:01:25,400 DEBUG [Listener at localhost/43949] util.CommonFSUtils(702): |----------------testWithMapReduce=69ce6540f755e21eae3d289ad231610b-e5f6c27caca2460f87a952d21f5687bc 2023-02-15 20:01:25,400 DEBUG [Listener at localhost/43949] util.CommonFSUtils(699): |-------------f2/ 2023-02-15 20:01:25,400 DEBUG [Listener at localhost/43949] util.CommonFSUtils(702): |----------------testWithMapReduce=69ce6540f755e21eae3d289ad231610b-1eedc5ffee284d0aa5210a5ab40bb91c 2023-02-15 20:01:25,400 DEBUG [Listener at localhost/43949] util.CommonFSUtils(699): |----------97b529ba0e37421e99fb43de9d23d817/ 2023-02-15 20:01:25,401 DEBUG [Listener at localhost/43949] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-15 20:01:25,401 DEBUG [Listener at localhost/43949] util.CommonFSUtils(699): |-------------f1/ 2023-02-15 20:01:25,401 DEBUG [Listener at localhost/43949] util.CommonFSUtils(702): |----------------testWithMapReduce=97b529ba0e37421e99fb43de9d23d817-31b2ff03534b4586a751a4d981d67074 2023-02-15 20:01:25,401 DEBUG [Listener at localhost/43949] util.CommonFSUtils(699): |-------------f2/ 2023-02-15 20:01:25,402 DEBUG [Listener at localhost/43949] util.CommonFSUtils(702): |----------------testWithMapReduce=97b529ba0e37421e99fb43de9d23d817-b71d28cc99fb44eba8165e9e0657a35f 2023-02-15 20:01:25,402 DEBUG [Listener at localhost/43949] util.CommonFSUtils(699): |----------9fdf60e81d6a22352a6acb2fcb8c9f3e/ 2023-02-15 20:01:25,402 DEBUG [Listener at localhost/43949] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-15 20:01:25,402 DEBUG [Listener at localhost/43949] util.CommonFSUtils(699): |----------bd3ac405f939af16962e576b69a6c71b/ 2023-02-15 20:01:25,402 DEBUG [Listener at localhost/43949] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-15 20:01:25,403 DEBUG [Listener at localhost/43949] util.CommonFSUtils(699): |-------------f1/ 2023-02-15 20:01:25,403 DEBUG [Listener at localhost/43949] util.CommonFSUtils(702): |----------------testWithMapReduce=bd3ac405f939af16962e576b69a6c71b-e061b466566641ce84e5637aff6e87d4 2023-02-15 20:01:25,403 DEBUG [Listener at localhost/43949] util.CommonFSUtils(699): |-------------f2/ 2023-02-15 20:01:25,403 DEBUG [Listener at localhost/43949] util.CommonFSUtils(702): |----------------testWithMapReduce=bd3ac405f939af16962e576b69a6c71b-4df29d784f394edcafca4e683f7852fa 2023-02-15 20:01:25,403 DEBUG [Listener at localhost/43949] util.CommonFSUtils(699): |----------dae437d89db301633beda20a6a7029ef/ 2023-02-15 20:01:25,404 DEBUG [Listener at localhost/43949] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-15 20:01:25,404 DEBUG [Listener at localhost/43949] util.CommonFSUtils(699): |-------------f1/ 2023-02-15 20:01:25,404 DEBUG [Listener at localhost/43949] util.CommonFSUtils(702): |----------------testWithMapReduce=dae437d89db301633beda20a6a7029ef-594cc29e1efe4b82a77293865b824b63 2023-02-15 20:01:25,404 DEBUG [Listener at localhost/43949] util.CommonFSUtils(699): |-------------f2/ 2023-02-15 20:01:25,405 DEBUG [Listener at localhost/43949] util.CommonFSUtils(702): |----------------testWithMapReduce=dae437d89db301633beda20a6a7029ef-b2caa048c0fc4ce4816c15496b0e136b 2023-02-15 20:01:25,405 DEBUG [Listener at localhost/43949] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.17-SNAPSHOT.jar 2023-02-15 20:01:25,406 DEBUG [Listener at localhost/43949] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.17-SNAPSHOT.jar 2023-02-15 20:01:25,406 DEBUG [Listener at localhost/43949] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.17-SNAPSHOT.jar 2023-02-15 20:01:25,406 DEBUG [Listener at localhost/43949] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.17-SNAPSHOT.jar 2023-02-15 20:01:26,270 DEBUG [Listener at localhost/43949] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c11e5f15-9142-b55b-08be-b6cf0858e875/hadoop-8157918834154626409.jar 2023-02-15 20:01:26,270 DEBUG [Listener at localhost/43949] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.17-SNAPSHOT.jar 2023-02-15 20:01:26,271 DEBUG [Listener at localhost/43949] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.17-SNAPSHOT.jar 2023-02-15 20:01:26,336 DEBUG [Listener at localhost/43949] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c11e5f15-9142-b55b-08be-b6cf0858e875/hadoop-242406125773573431.jar 2023-02-15 20:01:26,337 DEBUG [Listener at localhost/43949] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.17-SNAPSHOT.jar 2023-02-15 20:01:26,337 DEBUG [Listener at localhost/43949] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.17-SNAPSHOT.jar 2023-02-15 20:01:26,338 DEBUG [Listener at localhost/43949] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.17-SNAPSHOT.jar 2023-02-15 20:01:26,338 DEBUG [Listener at localhost/43949] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.17-SNAPSHOT.jar 2023-02-15 20:01:26,339 DEBUG [Listener at localhost/43949] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.17-SNAPSHOT.jar 2023-02-15 20:01:26,339 DEBUG [Listener at localhost/43949] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.17-SNAPSHOT.jar 2023-02-15 20:01:26,339 DEBUG [Listener at localhost/43949] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-02-15 20:01:26,340 DEBUG [Listener at localhost/43949] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-02-15 20:01:26,340 DEBUG [Listener at localhost/43949] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-02-15 20:01:26,340 DEBUG [Listener at localhost/43949] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-02-15 20:01:26,341 DEBUG [Listener at localhost/43949] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-02-15 20:01:26,341 DEBUG [Listener at localhost/43949] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-02-15 20:01:26,342 DEBUG [Listener at localhost/43949] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-02-15 20:01:26,342 DEBUG [Listener at localhost/43949] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-02-15 20:01:26,342 DEBUG [Listener at localhost/43949] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-02-15 20:01:26,343 DEBUG [Listener at localhost/43949] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-02-15 20:01:26,343 DEBUG [Listener at localhost/43949] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.io.ImmutableBytesWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.17-SNAPSHOT.jar 2023-02-15 20:01:26,344 DEBUG [Listener at localhost/43949] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.NullWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-15 20:01:26,344 DEBUG [Listener at localhost/43949] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-15 20:01:26,344 DEBUG [Listener at localhost/43949] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-15 20:01:26,345 DEBUG [Listener at localhost/43949] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapred.lib.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-02-15 20:01:26,410 DEBUG [Listener at localhost/43949] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapred.TableSnapshotInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c11e5f15-9142-b55b-08be-b6cf0858e875/hadoop-842843253375501645.jar 2023-02-15 20:01:26,411 DEBUG [Listener at localhost/43949] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapred.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-02-15 20:01:26,416 WARN [Listener at localhost/43949] mapreduce.JobResourceUploader(142): Hadoop command-line option parsing not performed. Implement the Tool interface and execute your application with ToolRunner to remedy this. 2023-02-15 20:01:26,422 WARN [Listener at localhost/43949] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-02-15 20:01:26,429 INFO [Listener at localhost/43949] mapreduce.TableSnapshotInputFormatImpl(392): Provided Scan has DEFAULT ReadType, updating STREAM for Snapshot-based InputFormat 2023-02-15 20:01:26,527 WARN [Listener at localhost/43949] fs.FileUtil(850): Command 'ln -s /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c11e5f15-9142-b55b-08be-b6cf0858e875/mapreduce.cluster.local.dir/1676491286495/libjars /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/*' failed 1 with: ln: failed to create symbolic link '/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/*': No such file or directory 2023-02-15 20:01:26,527 WARN [Listener at localhost/43949] mapred.LocalDistributedCacheManager(202): Failed to create symlink: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c11e5f15-9142-b55b-08be-b6cf0858e875/mapreduce.cluster.local.dir/1676491286495/libjars <- /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/* 2023-02-15 20:01:26,561 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,j\xCA\xCA,1676491281022.1486d61d8d2fe0efe2a608c7110b6c7d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 20:01:26,561 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-15 20:01:26,562 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-15 20:01:26,564 INFO [StoreOpener-1486d61d8d2fe0efe2a608c7110b6c7d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 1486d61d8d2fe0efe2a608c7110b6c7d 2023-02-15 20:01:26,564 DEBUG [StoreOpener-1486d61d8d2fe0efe2a608c7110b6c7d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40371/user/jenkins/test-data/743659ce-8263-b073-8e60-8033ef08dd2c/testWithMapReduceAndOfflineHBaseMultiRegion/296c0b3e-d6da-4cf1-bdc4-c441f21ef899/data/default/testWithMapReduce/1486d61d8d2fe0efe2a608c7110b6c7d/f1 2023-02-15 20:01:26,565 INFO [StoreOpener-1486d61d8d2fe0efe2a608c7110b6c7d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1486d61d8d2fe0efe2a608c7110b6c7d columnFamilyName f1 2023-02-15 20:01:26,572 DEBUG [StoreOpener-1486d61d8d2fe0efe2a608c7110b6c7d-1] regionserver.HStore(539): loaded hdfs://localhost:40371/user/jenkins/test-data/743659ce-8263-b073-8e60-8033ef08dd2c/testWithMapReduceAndOfflineHBaseMultiRegion/296c0b3e-d6da-4cf1-bdc4-c441f21ef899/data/default/testWithMapReduce/1486d61d8d2fe0efe2a608c7110b6c7d/f1/testWithMapReduce=1486d61d8d2fe0efe2a608c7110b6c7d-de28b0ab497640e590f6f466e3019c49 2023-02-15 20:01:26,572 INFO [StoreOpener-1486d61d8d2fe0efe2a608c7110b6c7d-1] regionserver.HStore(310): Store=1486d61d8d2fe0efe2a608c7110b6c7d/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 20:01:26,572 INFO [StoreOpener-1486d61d8d2fe0efe2a608c7110b6c7d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 1486d61d8d2fe0efe2a608c7110b6c7d 2023-02-15 20:01:26,573 DEBUG [StoreOpener-1486d61d8d2fe0efe2a608c7110b6c7d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40371/user/jenkins/test-data/743659ce-8263-b073-8e60-8033ef08dd2c/testWithMapReduceAndOfflineHBaseMultiRegion/296c0b3e-d6da-4cf1-bdc4-c441f21ef899/data/default/testWithMapReduce/1486d61d8d2fe0efe2a608c7110b6c7d/f2 2023-02-15 20:01:26,574 INFO [StoreOpener-1486d61d8d2fe0efe2a608c7110b6c7d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1486d61d8d2fe0efe2a608c7110b6c7d columnFamilyName f2 2023-02-15 20:01:26,578 DEBUG [StoreOpener-1486d61d8d2fe0efe2a608c7110b6c7d-1] regionserver.HStore(539): loaded hdfs://localhost:40371/user/jenkins/test-data/743659ce-8263-b073-8e60-8033ef08dd2c/testWithMapReduceAndOfflineHBaseMultiRegion/296c0b3e-d6da-4cf1-bdc4-c441f21ef899/data/default/testWithMapReduce/1486d61d8d2fe0efe2a608c7110b6c7d/f2/testWithMapReduce=1486d61d8d2fe0efe2a608c7110b6c7d-35f8711edfdb4222926a2aec3e6ab181 2023-02-15 20:01:26,578 INFO [StoreOpener-1486d61d8d2fe0efe2a608c7110b6c7d-1] regionserver.HStore(310): Store=1486d61d8d2fe0efe2a608c7110b6c7d/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 20:01:26,579 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-15 20:01:26,579 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 1486d61d8d2fe0efe2a608c7110b6c7d; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59311449, jitterRate=-0.11619053781032562}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-15 20:01:26,579 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 1486d61d8d2fe0efe2a608c7110b6c7d: 2023-02-15 20:01:26,613 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 1486d61d8d2fe0efe2a608c7110b6c7d, disabling compactions & flushes 2023-02-15 20:01:26,613 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,j\xCA\xCA,1676491281022.1486d61d8d2fe0efe2a608c7110b6c7d. 2023-02-15 20:01:26,613 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,j\xCA\xCA,1676491281022.1486d61d8d2fe0efe2a608c7110b6c7d. 2023-02-15 20:01:26,614 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,j\xCA\xCA,1676491281022.1486d61d8d2fe0efe2a608c7110b6c7d. after waiting 0 ms 2023-02-15 20:01:26,614 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,j\xCA\xCA,1676491281022.1486d61d8d2fe0efe2a608c7110b6c7d. 2023-02-15 20:01:26,614 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,j\xCA\xCA,1676491281022.1486d61d8d2fe0efe2a608c7110b6c7d. 2023-02-15 20:01:26,615 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 1486d61d8d2fe0efe2a608c7110b6c7d: 2023-02-15 20:01:26,617 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,zz{,1676491281022.2241125b7d23be16c4949dc36e627f50.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 20:01:26,618 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-15 20:01:26,620 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-15 20:01:26,624 INFO [StoreOpener-2241125b7d23be16c4949dc36e627f50-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 2241125b7d23be16c4949dc36e627f50 2023-02-15 20:01:26,626 DEBUG [StoreOpener-2241125b7d23be16c4949dc36e627f50-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40371/user/jenkins/test-data/743659ce-8263-b073-8e60-8033ef08dd2c/testWithMapReduceAndOfflineHBaseMultiRegion/296c0b3e-d6da-4cf1-bdc4-c441f21ef899/data/default/testWithMapReduce/2241125b7d23be16c4949dc36e627f50/f1 2023-02-15 20:01:26,626 INFO [StoreOpener-2241125b7d23be16c4949dc36e627f50-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2241125b7d23be16c4949dc36e627f50 columnFamilyName f1 2023-02-15 20:01:26,627 INFO [StoreOpener-2241125b7d23be16c4949dc36e627f50-1] regionserver.HStore(310): Store=2241125b7d23be16c4949dc36e627f50/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 20:01:26,627 INFO [StoreOpener-2241125b7d23be16c4949dc36e627f50-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 2241125b7d23be16c4949dc36e627f50 2023-02-15 20:01:26,628 DEBUG [StoreOpener-2241125b7d23be16c4949dc36e627f50-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40371/user/jenkins/test-data/743659ce-8263-b073-8e60-8033ef08dd2c/testWithMapReduceAndOfflineHBaseMultiRegion/296c0b3e-d6da-4cf1-bdc4-c441f21ef899/data/default/testWithMapReduce/2241125b7d23be16c4949dc36e627f50/f2 2023-02-15 20:01:26,629 INFO [StoreOpener-2241125b7d23be16c4949dc36e627f50-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2241125b7d23be16c4949dc36e627f50 columnFamilyName f2 2023-02-15 20:01:26,629 INFO [StoreOpener-2241125b7d23be16c4949dc36e627f50-1] regionserver.HStore(310): Store=2241125b7d23be16c4949dc36e627f50/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 20:01:26,629 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-15 20:01:26,629 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 2241125b7d23be16c4949dc36e627f50; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62519306, jitterRate=-0.06838974356651306}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-15 20:01:26,630 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 2241125b7d23be16c4949dc36e627f50: 2023-02-15 20:01:26,648 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 2241125b7d23be16c4949dc36e627f50, disabling compactions & flushes 2023-02-15 20:01:26,648 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,zz{,1676491281022.2241125b7d23be16c4949dc36e627f50. 2023-02-15 20:01:26,649 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,zz{,1676491281022.2241125b7d23be16c4949dc36e627f50. 2023-02-15 20:01:26,649 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,zz{,1676491281022.2241125b7d23be16c4949dc36e627f50. after waiting 0 ms 2023-02-15 20:01:26,649 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,zz{,1676491281022.2241125b7d23be16c4949dc36e627f50. 2023-02-15 20:01:26,649 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,zz{,1676491281022.2241125b7d23be16c4949dc36e627f50. 2023-02-15 20:01:26,649 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 2241125b7d23be16c4949dc36e627f50: 2023-02-15 20:01:26,653 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676491281022.9fdf60e81d6a22352a6acb2fcb8c9f3e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 20:01:26,653 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-15 20:01:26,654 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-15 20:01:26,657 INFO [StoreOpener-9fdf60e81d6a22352a6acb2fcb8c9f3e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 9fdf60e81d6a22352a6acb2fcb8c9f3e 2023-02-15 20:01:26,658 DEBUG [StoreOpener-9fdf60e81d6a22352a6acb2fcb8c9f3e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40371/user/jenkins/test-data/743659ce-8263-b073-8e60-8033ef08dd2c/testWithMapReduceAndOfflineHBaseMultiRegion/296c0b3e-d6da-4cf1-bdc4-c441f21ef899/data/default/testWithMapReduce/9fdf60e81d6a22352a6acb2fcb8c9f3e/f1 2023-02-15 20:01:26,659 INFO [StoreOpener-9fdf60e81d6a22352a6acb2fcb8c9f3e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9fdf60e81d6a22352a6acb2fcb8c9f3e columnFamilyName f1 2023-02-15 20:01:26,660 INFO [StoreOpener-9fdf60e81d6a22352a6acb2fcb8c9f3e-1] regionserver.HStore(310): Store=9fdf60e81d6a22352a6acb2fcb8c9f3e/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 20:01:26,660 INFO [StoreOpener-9fdf60e81d6a22352a6acb2fcb8c9f3e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 9fdf60e81d6a22352a6acb2fcb8c9f3e 2023-02-15 20:01:26,661 DEBUG [StoreOpener-9fdf60e81d6a22352a6acb2fcb8c9f3e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40371/user/jenkins/test-data/743659ce-8263-b073-8e60-8033ef08dd2c/testWithMapReduceAndOfflineHBaseMultiRegion/296c0b3e-d6da-4cf1-bdc4-c441f21ef899/data/default/testWithMapReduce/9fdf60e81d6a22352a6acb2fcb8c9f3e/f2 2023-02-15 20:01:26,662 INFO [StoreOpener-9fdf60e81d6a22352a6acb2fcb8c9f3e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9fdf60e81d6a22352a6acb2fcb8c9f3e columnFamilyName f2 2023-02-15 20:01:26,662 INFO [StoreOpener-9fdf60e81d6a22352a6acb2fcb8c9f3e-1] regionserver.HStore(310): Store=9fdf60e81d6a22352a6acb2fcb8c9f3e/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 20:01:26,663 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-15 20:01:26,663 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 9fdf60e81d6a22352a6acb2fcb8c9f3e; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72934804, jitterRate=0.08681327104568481}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-15 20:01:26,663 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 9fdf60e81d6a22352a6acb2fcb8c9f3e: 2023-02-15 20:01:26,692 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 9fdf60e81d6a22352a6acb2fcb8c9f3e, disabling compactions & flushes 2023-02-15 20:01:26,692 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676491281022.9fdf60e81d6a22352a6acb2fcb8c9f3e. 2023-02-15 20:01:26,692 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676491281022.9fdf60e81d6a22352a6acb2fcb8c9f3e. 2023-02-15 20:01:26,693 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676491281022.9fdf60e81d6a22352a6acb2fcb8c9f3e. after waiting 0 ms 2023-02-15 20:01:26,693 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676491281022.9fdf60e81d6a22352a6acb2fcb8c9f3e. 2023-02-15 20:01:26,693 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,,1676491281022.9fdf60e81d6a22352a6acb2fcb8c9f3e. 2023-02-15 20:01:26,693 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 9fdf60e81d6a22352a6acb2fcb8c9f3e: 2023-02-15 20:01:26,696 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,q\x11\x10,1676491281022.296941d2565b5d20cfd81aec8ac11565.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 20:01:26,696 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-15 20:01:26,697 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-15 20:01:26,700 INFO [StoreOpener-296941d2565b5d20cfd81aec8ac11565-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 296941d2565b5d20cfd81aec8ac11565 2023-02-15 20:01:26,701 DEBUG [StoreOpener-296941d2565b5d20cfd81aec8ac11565-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40371/user/jenkins/test-data/743659ce-8263-b073-8e60-8033ef08dd2c/testWithMapReduceAndOfflineHBaseMultiRegion/296c0b3e-d6da-4cf1-bdc4-c441f21ef899/data/default/testWithMapReduce/296941d2565b5d20cfd81aec8ac11565/f1 2023-02-15 20:01:26,702 INFO [StoreOpener-296941d2565b5d20cfd81aec8ac11565-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 296941d2565b5d20cfd81aec8ac11565 columnFamilyName f1 2023-02-15 20:01:26,707 DEBUG [StoreOpener-296941d2565b5d20cfd81aec8ac11565-1] regionserver.HStore(539): loaded hdfs://localhost:40371/user/jenkins/test-data/743659ce-8263-b073-8e60-8033ef08dd2c/testWithMapReduceAndOfflineHBaseMultiRegion/296c0b3e-d6da-4cf1-bdc4-c441f21ef899/data/default/testWithMapReduce/296941d2565b5d20cfd81aec8ac11565/f1/testWithMapReduce=296941d2565b5d20cfd81aec8ac11565-57f05d0842a74ba98a471fe3065929c4 2023-02-15 20:01:26,708 INFO [StoreOpener-296941d2565b5d20cfd81aec8ac11565-1] regionserver.HStore(310): Store=296941d2565b5d20cfd81aec8ac11565/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 20:01:26,708 INFO [StoreOpener-296941d2565b5d20cfd81aec8ac11565-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 296941d2565b5d20cfd81aec8ac11565 2023-02-15 20:01:26,709 DEBUG [StoreOpener-296941d2565b5d20cfd81aec8ac11565-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40371/user/jenkins/test-data/743659ce-8263-b073-8e60-8033ef08dd2c/testWithMapReduceAndOfflineHBaseMultiRegion/296c0b3e-d6da-4cf1-bdc4-c441f21ef899/data/default/testWithMapReduce/296941d2565b5d20cfd81aec8ac11565/f2 2023-02-15 20:01:26,709 INFO [StoreOpener-296941d2565b5d20cfd81aec8ac11565-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 296941d2565b5d20cfd81aec8ac11565 columnFamilyName f2 2023-02-15 20:01:26,713 DEBUG [StoreOpener-296941d2565b5d20cfd81aec8ac11565-1] regionserver.HStore(539): loaded hdfs://localhost:40371/user/jenkins/test-data/743659ce-8263-b073-8e60-8033ef08dd2c/testWithMapReduceAndOfflineHBaseMultiRegion/296c0b3e-d6da-4cf1-bdc4-c441f21ef899/data/default/testWithMapReduce/296941d2565b5d20cfd81aec8ac11565/f2/testWithMapReduce=296941d2565b5d20cfd81aec8ac11565-4e45595a7c04411e96f207fccb0aade2 2023-02-15 20:01:26,714 INFO [StoreOpener-296941d2565b5d20cfd81aec8ac11565-1] regionserver.HStore(310): Store=296941d2565b5d20cfd81aec8ac11565/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 20:01:26,714 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-15 20:01:26,714 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 296941d2565b5d20cfd81aec8ac11565; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68790269, jitterRate=0.02505488693714142}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-15 20:01:26,714 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 296941d2565b5d20cfd81aec8ac11565: 2023-02-15 20:01:26,741 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 296941d2565b5d20cfd81aec8ac11565, disabling compactions & flushes 2023-02-15 20:01:26,742 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,q\x11\x10,1676491281022.296941d2565b5d20cfd81aec8ac11565. 2023-02-15 20:01:26,742 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,q\x11\x10,1676491281022.296941d2565b5d20cfd81aec8ac11565. 2023-02-15 20:01:26,742 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,q\x11\x10,1676491281022.296941d2565b5d20cfd81aec8ac11565. after waiting 0 ms 2023-02-15 20:01:26,742 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,q\x11\x10,1676491281022.296941d2565b5d20cfd81aec8ac11565. 2023-02-15 20:01:26,743 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,q\x11\x10,1676491281022.296941d2565b5d20cfd81aec8ac11565. 2023-02-15 20:01:26,743 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 296941d2565b5d20cfd81aec8ac11565: 2023-02-15 20:01:26,746 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,t43,1676491281022.bd3ac405f939af16962e576b69a6c71b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 20:01:26,746 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-15 20:01:26,747 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-15 20:01:26,751 INFO [StoreOpener-bd3ac405f939af16962e576b69a6c71b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region bd3ac405f939af16962e576b69a6c71b 2023-02-15 20:01:26,751 DEBUG [StoreOpener-bd3ac405f939af16962e576b69a6c71b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40371/user/jenkins/test-data/743659ce-8263-b073-8e60-8033ef08dd2c/testWithMapReduceAndOfflineHBaseMultiRegion/296c0b3e-d6da-4cf1-bdc4-c441f21ef899/data/default/testWithMapReduce/bd3ac405f939af16962e576b69a6c71b/f1 2023-02-15 20:01:26,752 INFO [StoreOpener-bd3ac405f939af16962e576b69a6c71b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region bd3ac405f939af16962e576b69a6c71b columnFamilyName f1 2023-02-15 20:01:26,756 DEBUG [StoreOpener-bd3ac405f939af16962e576b69a6c71b-1] regionserver.HStore(539): loaded hdfs://localhost:40371/user/jenkins/test-data/743659ce-8263-b073-8e60-8033ef08dd2c/testWithMapReduceAndOfflineHBaseMultiRegion/296c0b3e-d6da-4cf1-bdc4-c441f21ef899/data/default/testWithMapReduce/bd3ac405f939af16962e576b69a6c71b/f1/testWithMapReduce=bd3ac405f939af16962e576b69a6c71b-e061b466566641ce84e5637aff6e87d4 2023-02-15 20:01:26,757 INFO [StoreOpener-bd3ac405f939af16962e576b69a6c71b-1] regionserver.HStore(310): Store=bd3ac405f939af16962e576b69a6c71b/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 20:01:26,757 INFO [StoreOpener-bd3ac405f939af16962e576b69a6c71b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region bd3ac405f939af16962e576b69a6c71b 2023-02-15 20:01:26,757 DEBUG [StoreOpener-bd3ac405f939af16962e576b69a6c71b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40371/user/jenkins/test-data/743659ce-8263-b073-8e60-8033ef08dd2c/testWithMapReduceAndOfflineHBaseMultiRegion/296c0b3e-d6da-4cf1-bdc4-c441f21ef899/data/default/testWithMapReduce/bd3ac405f939af16962e576b69a6c71b/f2 2023-02-15 20:01:26,758 INFO [StoreOpener-bd3ac405f939af16962e576b69a6c71b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region bd3ac405f939af16962e576b69a6c71b columnFamilyName f2 2023-02-15 20:01:26,762 DEBUG [StoreOpener-bd3ac405f939af16962e576b69a6c71b-1] regionserver.HStore(539): loaded hdfs://localhost:40371/user/jenkins/test-data/743659ce-8263-b073-8e60-8033ef08dd2c/testWithMapReduceAndOfflineHBaseMultiRegion/296c0b3e-d6da-4cf1-bdc4-c441f21ef899/data/default/testWithMapReduce/bd3ac405f939af16962e576b69a6c71b/f2/testWithMapReduce=bd3ac405f939af16962e576b69a6c71b-4df29d784f394edcafca4e683f7852fa 2023-02-15 20:01:26,763 INFO [StoreOpener-bd3ac405f939af16962e576b69a6c71b-1] regionserver.HStore(310): Store=bd3ac405f939af16962e576b69a6c71b/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 20:01:26,763 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-15 20:01:26,763 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened bd3ac405f939af16962e576b69a6c71b; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73934121, jitterRate=0.10170425474643707}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-15 20:01:26,763 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for bd3ac405f939af16962e576b69a6c71b: 2023-02-15 20:01:26,790 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing bd3ac405f939af16962e576b69a6c71b, disabling compactions & flushes 2023-02-15 20:01:26,791 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,t43,1676491281022.bd3ac405f939af16962e576b69a6c71b. 2023-02-15 20:01:26,791 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,t43,1676491281022.bd3ac405f939af16962e576b69a6c71b. 2023-02-15 20:01:26,791 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,t43,1676491281022.bd3ac405f939af16962e576b69a6c71b. after waiting 0 ms 2023-02-15 20:01:26,791 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,t43,1676491281022.bd3ac405f939af16962e576b69a6c71b. 2023-02-15 20:01:26,792 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,t43,1676491281022.bd3ac405f939af16962e576b69a6c71b. 2023-02-15 20:01:26,792 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for bd3ac405f939af16962e576b69a6c71b: 2023-02-15 20:01:26,795 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,m\xED\xED,1676491281022.97b529ba0e37421e99fb43de9d23d817.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 20:01:26,795 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-15 20:01:26,797 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-15 20:01:26,799 INFO [StoreOpener-97b529ba0e37421e99fb43de9d23d817-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 97b529ba0e37421e99fb43de9d23d817 2023-02-15 20:01:26,799 DEBUG [StoreOpener-97b529ba0e37421e99fb43de9d23d817-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40371/user/jenkins/test-data/743659ce-8263-b073-8e60-8033ef08dd2c/testWithMapReduceAndOfflineHBaseMultiRegion/296c0b3e-d6da-4cf1-bdc4-c441f21ef899/data/default/testWithMapReduce/97b529ba0e37421e99fb43de9d23d817/f1 2023-02-15 20:01:26,800 INFO [StoreOpener-97b529ba0e37421e99fb43de9d23d817-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 97b529ba0e37421e99fb43de9d23d817 columnFamilyName f1 2023-02-15 20:01:26,805 DEBUG [StoreOpener-97b529ba0e37421e99fb43de9d23d817-1] regionserver.HStore(539): loaded hdfs://localhost:40371/user/jenkins/test-data/743659ce-8263-b073-8e60-8033ef08dd2c/testWithMapReduceAndOfflineHBaseMultiRegion/296c0b3e-d6da-4cf1-bdc4-c441f21ef899/data/default/testWithMapReduce/97b529ba0e37421e99fb43de9d23d817/f1/testWithMapReduce=97b529ba0e37421e99fb43de9d23d817-31b2ff03534b4586a751a4d981d67074 2023-02-15 20:01:26,805 INFO [StoreOpener-97b529ba0e37421e99fb43de9d23d817-1] regionserver.HStore(310): Store=97b529ba0e37421e99fb43de9d23d817/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 20:01:26,805 INFO [StoreOpener-97b529ba0e37421e99fb43de9d23d817-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 97b529ba0e37421e99fb43de9d23d817 2023-02-15 20:01:26,806 DEBUG [StoreOpener-97b529ba0e37421e99fb43de9d23d817-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40371/user/jenkins/test-data/743659ce-8263-b073-8e60-8033ef08dd2c/testWithMapReduceAndOfflineHBaseMultiRegion/296c0b3e-d6da-4cf1-bdc4-c441f21ef899/data/default/testWithMapReduce/97b529ba0e37421e99fb43de9d23d817/f2 2023-02-15 20:01:26,806 INFO [StoreOpener-97b529ba0e37421e99fb43de9d23d817-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 97b529ba0e37421e99fb43de9d23d817 columnFamilyName f2 2023-02-15 20:01:26,810 DEBUG [StoreOpener-97b529ba0e37421e99fb43de9d23d817-1] regionserver.HStore(539): loaded hdfs://localhost:40371/user/jenkins/test-data/743659ce-8263-b073-8e60-8033ef08dd2c/testWithMapReduceAndOfflineHBaseMultiRegion/296c0b3e-d6da-4cf1-bdc4-c441f21ef899/data/default/testWithMapReduce/97b529ba0e37421e99fb43de9d23d817/f2/testWithMapReduce=97b529ba0e37421e99fb43de9d23d817-b71d28cc99fb44eba8165e9e0657a35f 2023-02-15 20:01:26,810 INFO [StoreOpener-97b529ba0e37421e99fb43de9d23d817-1] regionserver.HStore(310): Store=97b529ba0e37421e99fb43de9d23d817/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 20:01:26,810 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-15 20:01:26,811 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 97b529ba0e37421e99fb43de9d23d817; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73080147, jitterRate=0.08897905051708221}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-15 20:01:26,811 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 97b529ba0e37421e99fb43de9d23d817: 2023-02-15 20:01:26,838 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 97b529ba0e37421e99fb43de9d23d817, disabling compactions & flushes 2023-02-15 20:01:26,838 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,m\xED\xED,1676491281022.97b529ba0e37421e99fb43de9d23d817. 2023-02-15 20:01:26,838 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,m\xED\xED,1676491281022.97b529ba0e37421e99fb43de9d23d817. 2023-02-15 20:01:26,838 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,m\xED\xED,1676491281022.97b529ba0e37421e99fb43de9d23d817. after waiting 0 ms 2023-02-15 20:01:26,838 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,m\xED\xED,1676491281022.97b529ba0e37421e99fb43de9d23d817. 2023-02-15 20:01:26,839 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,m\xED\xED,1676491281022.97b529ba0e37421e99fb43de9d23d817. 2023-02-15 20:01:26,839 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 97b529ba0e37421e99fb43de9d23d817: 2023-02-15 20:01:26,842 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,d\x84\x84,1676491281022.2a1c7014d8c6c818f8ea2f67ef6b2118.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 20:01:26,842 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-15 20:01:26,843 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-15 20:01:26,844 INFO [StoreOpener-2a1c7014d8c6c818f8ea2f67ef6b2118-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 2a1c7014d8c6c818f8ea2f67ef6b2118 2023-02-15 20:01:26,845 DEBUG [StoreOpener-2a1c7014d8c6c818f8ea2f67ef6b2118-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40371/user/jenkins/test-data/743659ce-8263-b073-8e60-8033ef08dd2c/testWithMapReduceAndOfflineHBaseMultiRegion/296c0b3e-d6da-4cf1-bdc4-c441f21ef899/data/default/testWithMapReduce/2a1c7014d8c6c818f8ea2f67ef6b2118/f1 2023-02-15 20:01:26,846 INFO [StoreOpener-2a1c7014d8c6c818f8ea2f67ef6b2118-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2a1c7014d8c6c818f8ea2f67ef6b2118 columnFamilyName f1 2023-02-15 20:01:26,850 DEBUG [StoreOpener-2a1c7014d8c6c818f8ea2f67ef6b2118-1] regionserver.HStore(539): loaded hdfs://localhost:40371/user/jenkins/test-data/743659ce-8263-b073-8e60-8033ef08dd2c/testWithMapReduceAndOfflineHBaseMultiRegion/296c0b3e-d6da-4cf1-bdc4-c441f21ef899/data/default/testWithMapReduce/2a1c7014d8c6c818f8ea2f67ef6b2118/f1/testWithMapReduce=2a1c7014d8c6c818f8ea2f67ef6b2118-23d33b83df074886bcad94456fae89f1 2023-02-15 20:01:26,850 INFO [StoreOpener-2a1c7014d8c6c818f8ea2f67ef6b2118-1] regionserver.HStore(310): Store=2a1c7014d8c6c818f8ea2f67ef6b2118/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 20:01:26,850 INFO [StoreOpener-2a1c7014d8c6c818f8ea2f67ef6b2118-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 2a1c7014d8c6c818f8ea2f67ef6b2118 2023-02-15 20:01:26,851 DEBUG [StoreOpener-2a1c7014d8c6c818f8ea2f67ef6b2118-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40371/user/jenkins/test-data/743659ce-8263-b073-8e60-8033ef08dd2c/testWithMapReduceAndOfflineHBaseMultiRegion/296c0b3e-d6da-4cf1-bdc4-c441f21ef899/data/default/testWithMapReduce/2a1c7014d8c6c818f8ea2f67ef6b2118/f2 2023-02-15 20:01:26,851 INFO [StoreOpener-2a1c7014d8c6c818f8ea2f67ef6b2118-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2a1c7014d8c6c818f8ea2f67ef6b2118 columnFamilyName f2 2023-02-15 20:01:26,856 DEBUG [StoreOpener-2a1c7014d8c6c818f8ea2f67ef6b2118-1] regionserver.HStore(539): loaded hdfs://localhost:40371/user/jenkins/test-data/743659ce-8263-b073-8e60-8033ef08dd2c/testWithMapReduceAndOfflineHBaseMultiRegion/296c0b3e-d6da-4cf1-bdc4-c441f21ef899/data/default/testWithMapReduce/2a1c7014d8c6c818f8ea2f67ef6b2118/f2/testWithMapReduce=2a1c7014d8c6c818f8ea2f67ef6b2118-52f1540918dd49b6b7dc0f3174528264 2023-02-15 20:01:26,856 INFO [StoreOpener-2a1c7014d8c6c818f8ea2f67ef6b2118-1] regionserver.HStore(310): Store=2a1c7014d8c6c818f8ea2f67ef6b2118/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 20:01:26,856 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-15 20:01:26,856 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 2a1c7014d8c6c818f8ea2f67ef6b2118; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72233505, jitterRate=0.07636310160160065}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-15 20:01:26,856 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 2a1c7014d8c6c818f8ea2f67ef6b2118: 2023-02-15 20:01:26,894 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 2a1c7014d8c6c818f8ea2f67ef6b2118, disabling compactions & flushes 2023-02-15 20:01:26,894 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,d\x84\x84,1676491281022.2a1c7014d8c6c818f8ea2f67ef6b2118. 2023-02-15 20:01:26,894 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,d\x84\x84,1676491281022.2a1c7014d8c6c818f8ea2f67ef6b2118. 2023-02-15 20:01:26,894 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,d\x84\x84,1676491281022.2a1c7014d8c6c818f8ea2f67ef6b2118. after waiting 0 ms 2023-02-15 20:01:26,894 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,d\x84\x84,1676491281022.2a1c7014d8c6c818f8ea2f67ef6b2118. 2023-02-15 20:01:26,895 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,d\x84\x84,1676491281022.2a1c7014d8c6c818f8ea2f67ef6b2118. 2023-02-15 20:01:26,895 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 2a1c7014d8c6c818f8ea2f67ef6b2118: 2023-02-15 20:01:26,897 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,wWV,1676491281022.69ce6540f755e21eae3d289ad231610b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 20:01:26,897 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-15 20:01:26,898 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-15 20:01:26,900 INFO [StoreOpener-69ce6540f755e21eae3d289ad231610b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 69ce6540f755e21eae3d289ad231610b 2023-02-15 20:01:26,901 DEBUG [StoreOpener-69ce6540f755e21eae3d289ad231610b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40371/user/jenkins/test-data/743659ce-8263-b073-8e60-8033ef08dd2c/testWithMapReduceAndOfflineHBaseMultiRegion/296c0b3e-d6da-4cf1-bdc4-c441f21ef899/data/default/testWithMapReduce/69ce6540f755e21eae3d289ad231610b/f1 2023-02-15 20:01:26,901 INFO [StoreOpener-69ce6540f755e21eae3d289ad231610b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 69ce6540f755e21eae3d289ad231610b columnFamilyName f1 2023-02-15 20:01:26,906 DEBUG [StoreOpener-69ce6540f755e21eae3d289ad231610b-1] regionserver.HStore(539): loaded hdfs://localhost:40371/user/jenkins/test-data/743659ce-8263-b073-8e60-8033ef08dd2c/testWithMapReduceAndOfflineHBaseMultiRegion/296c0b3e-d6da-4cf1-bdc4-c441f21ef899/data/default/testWithMapReduce/69ce6540f755e21eae3d289ad231610b/f1/testWithMapReduce=69ce6540f755e21eae3d289ad231610b-e5f6c27caca2460f87a952d21f5687bc 2023-02-15 20:01:26,907 INFO [StoreOpener-69ce6540f755e21eae3d289ad231610b-1] regionserver.HStore(310): Store=69ce6540f755e21eae3d289ad231610b/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 20:01:26,907 INFO [StoreOpener-69ce6540f755e21eae3d289ad231610b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 69ce6540f755e21eae3d289ad231610b 2023-02-15 20:01:26,907 DEBUG [StoreOpener-69ce6540f755e21eae3d289ad231610b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40371/user/jenkins/test-data/743659ce-8263-b073-8e60-8033ef08dd2c/testWithMapReduceAndOfflineHBaseMultiRegion/296c0b3e-d6da-4cf1-bdc4-c441f21ef899/data/default/testWithMapReduce/69ce6540f755e21eae3d289ad231610b/f2 2023-02-15 20:01:26,908 INFO [StoreOpener-69ce6540f755e21eae3d289ad231610b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 69ce6540f755e21eae3d289ad231610b columnFamilyName f2 2023-02-15 20:01:26,912 DEBUG [StoreOpener-69ce6540f755e21eae3d289ad231610b-1] regionserver.HStore(539): loaded hdfs://localhost:40371/user/jenkins/test-data/743659ce-8263-b073-8e60-8033ef08dd2c/testWithMapReduceAndOfflineHBaseMultiRegion/296c0b3e-d6da-4cf1-bdc4-c441f21ef899/data/default/testWithMapReduce/69ce6540f755e21eae3d289ad231610b/f2/testWithMapReduce=69ce6540f755e21eae3d289ad231610b-1eedc5ffee284d0aa5210a5ab40bb91c 2023-02-15 20:01:26,912 INFO [StoreOpener-69ce6540f755e21eae3d289ad231610b-1] regionserver.HStore(310): Store=69ce6540f755e21eae3d289ad231610b/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 20:01:26,913 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-15 20:01:26,913 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 69ce6540f755e21eae3d289ad231610b; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65463499, jitterRate=-0.02451784908771515}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-15 20:01:26,913 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 69ce6540f755e21eae3d289ad231610b: 2023-02-15 20:01:26,941 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 69ce6540f755e21eae3d289ad231610b, disabling compactions & flushes 2023-02-15 20:01:26,941 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,wWV,1676491281022.69ce6540f755e21eae3d289ad231610b. 2023-02-15 20:01:26,941 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,wWV,1676491281022.69ce6540f755e21eae3d289ad231610b. 2023-02-15 20:01:26,941 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,wWV,1676491281022.69ce6540f755e21eae3d289ad231610b. after waiting 0 ms 2023-02-15 20:01:26,941 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,wWV,1676491281022.69ce6540f755e21eae3d289ad231610b. 2023-02-15 20:01:26,942 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,wWV,1676491281022.69ce6540f755e21eae3d289ad231610b. 2023-02-15 20:01:26,942 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 69ce6540f755e21eae3d289ad231610b: 2023-02-15 20:01:26,945 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,g\xA7\xA7,1676491281022.2f6827bb8b2d8e3d5d25320352d1e239.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 20:01:26,945 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-15 20:01:26,946 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-15 20:01:26,948 INFO [StoreOpener-2f6827bb8b2d8e3d5d25320352d1e239-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 2f6827bb8b2d8e3d5d25320352d1e239 2023-02-15 20:01:26,949 DEBUG [StoreOpener-2f6827bb8b2d8e3d5d25320352d1e239-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40371/user/jenkins/test-data/743659ce-8263-b073-8e60-8033ef08dd2c/testWithMapReduceAndOfflineHBaseMultiRegion/296c0b3e-d6da-4cf1-bdc4-c441f21ef899/data/default/testWithMapReduce/2f6827bb8b2d8e3d5d25320352d1e239/f1 2023-02-15 20:01:26,949 INFO [StoreOpener-2f6827bb8b2d8e3d5d25320352d1e239-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2f6827bb8b2d8e3d5d25320352d1e239 columnFamilyName f1 2023-02-15 20:01:26,953 DEBUG [StoreOpener-2f6827bb8b2d8e3d5d25320352d1e239-1] regionserver.HStore(539): loaded hdfs://localhost:40371/user/jenkins/test-data/743659ce-8263-b073-8e60-8033ef08dd2c/testWithMapReduceAndOfflineHBaseMultiRegion/296c0b3e-d6da-4cf1-bdc4-c441f21ef899/data/default/testWithMapReduce/2f6827bb8b2d8e3d5d25320352d1e239/f1/testWithMapReduce=2f6827bb8b2d8e3d5d25320352d1e239-92d7cc4cd31942629f77cf21178cc2d6 2023-02-15 20:01:26,953 INFO [StoreOpener-2f6827bb8b2d8e3d5d25320352d1e239-1] regionserver.HStore(310): Store=2f6827bb8b2d8e3d5d25320352d1e239/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 20:01:26,954 INFO [StoreOpener-2f6827bb8b2d8e3d5d25320352d1e239-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 2f6827bb8b2d8e3d5d25320352d1e239 2023-02-15 20:01:26,955 DEBUG [StoreOpener-2f6827bb8b2d8e3d5d25320352d1e239-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40371/user/jenkins/test-data/743659ce-8263-b073-8e60-8033ef08dd2c/testWithMapReduceAndOfflineHBaseMultiRegion/296c0b3e-d6da-4cf1-bdc4-c441f21ef899/data/default/testWithMapReduce/2f6827bb8b2d8e3d5d25320352d1e239/f2 2023-02-15 20:01:26,955 INFO [StoreOpener-2f6827bb8b2d8e3d5d25320352d1e239-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2f6827bb8b2d8e3d5d25320352d1e239 columnFamilyName f2 2023-02-15 20:01:26,960 DEBUG [StoreOpener-2f6827bb8b2d8e3d5d25320352d1e239-1] regionserver.HStore(539): loaded hdfs://localhost:40371/user/jenkins/test-data/743659ce-8263-b073-8e60-8033ef08dd2c/testWithMapReduceAndOfflineHBaseMultiRegion/296c0b3e-d6da-4cf1-bdc4-c441f21ef899/data/default/testWithMapReduce/2f6827bb8b2d8e3d5d25320352d1e239/f2/testWithMapReduce=2f6827bb8b2d8e3d5d25320352d1e239-5b1da113e4194abcba98b6f99fc34cb8 2023-02-15 20:01:26,960 INFO [StoreOpener-2f6827bb8b2d8e3d5d25320352d1e239-1] regionserver.HStore(310): Store=2f6827bb8b2d8e3d5d25320352d1e239/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 20:01:26,960 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-15 20:01:26,960 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 2f6827bb8b2d8e3d5d25320352d1e239; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66670064, jitterRate=-0.0065386295318603516}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-15 20:01:26,960 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 2f6827bb8b2d8e3d5d25320352d1e239: 2023-02-15 20:01:26,988 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 2f6827bb8b2d8e3d5d25320352d1e239, disabling compactions & flushes 2023-02-15 20:01:26,988 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,g\xA7\xA7,1676491281022.2f6827bb8b2d8e3d5d25320352d1e239. 2023-02-15 20:01:26,988 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,g\xA7\xA7,1676491281022.2f6827bb8b2d8e3d5d25320352d1e239. 2023-02-15 20:01:26,988 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,g\xA7\xA7,1676491281022.2f6827bb8b2d8e3d5d25320352d1e239. after waiting 0 ms 2023-02-15 20:01:26,988 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,g\xA7\xA7,1676491281022.2f6827bb8b2d8e3d5d25320352d1e239. 2023-02-15 20:01:26,989 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,g\xA7\xA7,1676491281022.2f6827bb8b2d8e3d5d25320352d1e239. 2023-02-15 20:01:26,989 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 2f6827bb8b2d8e3d5d25320352d1e239: 2023-02-15 20:01:26,992 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,aaa,1676491281022.dae437d89db301633beda20a6a7029ef.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 20:01:26,992 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-15 20:01:26,994 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-15 20:01:26,996 INFO [StoreOpener-dae437d89db301633beda20a6a7029ef-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region dae437d89db301633beda20a6a7029ef 2023-02-15 20:01:26,996 DEBUG [StoreOpener-dae437d89db301633beda20a6a7029ef-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40371/user/jenkins/test-data/743659ce-8263-b073-8e60-8033ef08dd2c/testWithMapReduceAndOfflineHBaseMultiRegion/296c0b3e-d6da-4cf1-bdc4-c441f21ef899/data/default/testWithMapReduce/dae437d89db301633beda20a6a7029ef/f1 2023-02-15 20:01:26,997 INFO [StoreOpener-dae437d89db301633beda20a6a7029ef-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region dae437d89db301633beda20a6a7029ef columnFamilyName f1 2023-02-15 20:01:27,001 DEBUG [StoreOpener-dae437d89db301633beda20a6a7029ef-1] regionserver.HStore(539): loaded hdfs://localhost:40371/user/jenkins/test-data/743659ce-8263-b073-8e60-8033ef08dd2c/testWithMapReduceAndOfflineHBaseMultiRegion/296c0b3e-d6da-4cf1-bdc4-c441f21ef899/data/default/testWithMapReduce/dae437d89db301633beda20a6a7029ef/f1/testWithMapReduce=dae437d89db301633beda20a6a7029ef-594cc29e1efe4b82a77293865b824b63 2023-02-15 20:01:27,002 INFO [StoreOpener-dae437d89db301633beda20a6a7029ef-1] regionserver.HStore(310): Store=dae437d89db301633beda20a6a7029ef/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 20:01:27,002 INFO [StoreOpener-dae437d89db301633beda20a6a7029ef-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region dae437d89db301633beda20a6a7029ef 2023-02-15 20:01:27,003 DEBUG [StoreOpener-dae437d89db301633beda20a6a7029ef-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40371/user/jenkins/test-data/743659ce-8263-b073-8e60-8033ef08dd2c/testWithMapReduceAndOfflineHBaseMultiRegion/296c0b3e-d6da-4cf1-bdc4-c441f21ef899/data/default/testWithMapReduce/dae437d89db301633beda20a6a7029ef/f2 2023-02-15 20:01:27,003 INFO [StoreOpener-dae437d89db301633beda20a6a7029ef-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region dae437d89db301633beda20a6a7029ef columnFamilyName f2 2023-02-15 20:01:27,008 DEBUG [StoreOpener-dae437d89db301633beda20a6a7029ef-1] regionserver.HStore(539): loaded hdfs://localhost:40371/user/jenkins/test-data/743659ce-8263-b073-8e60-8033ef08dd2c/testWithMapReduceAndOfflineHBaseMultiRegion/296c0b3e-d6da-4cf1-bdc4-c441f21ef899/data/default/testWithMapReduce/dae437d89db301633beda20a6a7029ef/f2/testWithMapReduce=dae437d89db301633beda20a6a7029ef-b2caa048c0fc4ce4816c15496b0e136b 2023-02-15 20:01:27,008 INFO [StoreOpener-dae437d89db301633beda20a6a7029ef-1] regionserver.HStore(310): Store=dae437d89db301633beda20a6a7029ef/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 20:01:27,008 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-15 20:01:27,009 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened dae437d89db301633beda20a6a7029ef; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71587975, jitterRate=0.06674395501613617}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-15 20:01:27,009 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for dae437d89db301633beda20a6a7029ef: 2023-02-15 20:01:27,049 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing dae437d89db301633beda20a6a7029ef, disabling compactions & flushes 2023-02-15 20:01:27,049 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,aaa,1676491281022.dae437d89db301633beda20a6a7029ef. 2023-02-15 20:01:27,049 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,aaa,1676491281022.dae437d89db301633beda20a6a7029ef. 2023-02-15 20:01:27,049 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,aaa,1676491281022.dae437d89db301633beda20a6a7029ef. after waiting 0 ms 2023-02-15 20:01:27,049 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,aaa,1676491281022.dae437d89db301633beda20a6a7029ef. 2023-02-15 20:01:27,050 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,aaa,1676491281022.dae437d89db301633beda20a6a7029ef. 2023-02-15 20:01:27,050 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for dae437d89db301633beda20a6a7029ef: 2023-02-15 20:01:27,562 INFO [Listener at localhost/43949] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-02-15 20:01:27,562 WARN [Listener at localhost/43949] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-15 20:01:27,567 INFO [Listener at localhost/43949] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-15 20:01:27,670 WARN [BP-1107624321-172.31.14.131-1676491278794 heartbeating to localhost/127.0.0.1:40371] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-15 20:01:27,670 WARN [BP-1107624321-172.31.14.131-1676491278794 heartbeating to localhost/127.0.0.1:40371] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1107624321-172.31.14.131-1676491278794 (Datanode Uuid b71f6f7e-297c-4cd3-a987-a7ffa677dd37) service to localhost/127.0.0.1:40371 2023-02-15 20:01:27,671 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c11e5f15-9142-b55b-08be-b6cf0858e875/cluster_af7ba18b-1f1a-67fc-11a2-24e3883bc033/dfs/data/data3/current/BP-1107624321-172.31.14.131-1676491278794] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-15 20:01:27,671 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c11e5f15-9142-b55b-08be-b6cf0858e875/cluster_af7ba18b-1f1a-67fc-11a2-24e3883bc033/dfs/data/data4/current/BP-1107624321-172.31.14.131-1676491278794] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-15 20:01:27,672 WARN [Listener at localhost/43949] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-15 20:01:27,675 INFO [Listener at localhost/43949] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-15 20:01:27,779 WARN [BP-1107624321-172.31.14.131-1676491278794 heartbeating to localhost/127.0.0.1:40371] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-15 20:01:27,779 WARN [BP-1107624321-172.31.14.131-1676491278794 heartbeating to localhost/127.0.0.1:40371] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1107624321-172.31.14.131-1676491278794 (Datanode Uuid e159f7e7-7822-49e7-9fe5-5ca02092df2f) service to localhost/127.0.0.1:40371 2023-02-15 20:01:27,780 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c11e5f15-9142-b55b-08be-b6cf0858e875/cluster_af7ba18b-1f1a-67fc-11a2-24e3883bc033/dfs/data/data1/current/BP-1107624321-172.31.14.131-1676491278794] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-15 20:01:27,780 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c11e5f15-9142-b55b-08be-b6cf0858e875/cluster_af7ba18b-1f1a-67fc-11a2-24e3883bc033/dfs/data/data2/current/BP-1107624321-172.31.14.131-1676491278794] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-15 20:01:27,789 INFO [Listener at localhost/43949] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-15 20:01:27,909 INFO [Listener at localhost/43949] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-02-15 20:01:27,953 INFO [Listener at localhost/43949] hbase.HBaseTestingUtility(1293): Minicluster is down 2023-02-15 20:01:27,967 INFO [Listener at localhost/43949] hbase.ResourceChecker(175): after: mapred.TestTableSnapshotInputFormat#testWithMapReduceAndOfflineHBaseMultiRegion Thread=157 (was 103) Potentially hanging thread: LeaseRenewer:jenkins@localhost:40371 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Timer for 'DataNode' metrics system java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: nioEventLoopGroup-7-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-6-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1185813668) connection to localhost/127.0.0.1:40371 from jenkins.hfs.3 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS-EventLoopGroup-8-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/43949 java.lang.Thread.dumpThreads(Native Method) java.lang.Thread.getAllStackTraces(Thread.java:1615) org.apache.hadoop.hbase.ResourceCheckerJUnitListener$ThreadResourceAnalyzer.getVal(ResourceCheckerJUnitListener.java:49) org.apache.hadoop.hbase.ResourceChecker.fill(ResourceChecker.java:110) org.apache.hadoop.hbase.ResourceChecker.fillEndings(ResourceChecker.java:104) org.apache.hadoop.hbase.ResourceChecker.end(ResourceChecker.java:206) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.end(ResourceCheckerJUnitListener.java:165) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.testFinished(ResourceCheckerJUnitListener.java:185) org.junit.runner.notification.SynchronizedRunListener.testFinished(SynchronizedRunListener.java:87) org.junit.runner.notification.RunNotifier$9.notifyListener(RunNotifier.java:225) org.junit.runner.notification.RunNotifier$SafeNotifier.run(RunNotifier.java:72) org.junit.runner.notification.RunNotifier.fireTestFinished(RunNotifier.java:222) org.junit.internal.runners.model.EachTestNotifier.fireTestFinished(EachTestNotifier.java:38) org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:372) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) org.apache.hadoop.hbase.SystemExitRule$1.evaluate(SystemExitRule.java:39) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-9-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-9-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-6-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-8-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-8-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1185813668) connection to localhost/127.0.0.1:40371 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-6 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-9-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1185813668) connection to localhost/127.0.0.1:40371 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: IPC Client (1185813668) connection to localhost/127.0.0.1:40371 from jenkins.hfs.2 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-5 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-8-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ForkJoinPool-2-worker-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.ForkJoinPool.awaitWork(ForkJoinPool.java:1824) java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1693) java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175) Potentially hanging thread: nioEventLoopGroup-7-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.2@localhost:40371 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-7-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-6-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-6-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-4 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase4.apache.org,36865,1676491279587)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-8-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-6-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-7-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-6-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-7-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-7-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-8-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.3@localhost:40371 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=536 (was 521) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=313 (was 282) - SystemLoadAverage LEAK? -, ProcessCount=165 (was 165), AvailableMemoryMB=2873 (was 3103) 2023-02-15 20:01:27,977 INFO [Listener at localhost/43949] hbase.ResourceChecker(147): before: mapred.TestTableSnapshotInputFormat#testInitTableSnapshotMapperJobConfig Thread=157, OpenFileDescriptor=536, MaxFileDescriptor=60000, SystemLoadAverage=313, ProcessCount=165, AvailableMemoryMB=2873 2023-02-15 20:01:27,988 INFO [Listener at localhost/43949] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.log.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c11e5f15-9142-b55b-08be-b6cf0858e875/hadoop.log.dir so I do NOT create it in target/test-data/e81f56f0-58ac-a0f7-02b6-ac3e14664c2f 2023-02-15 20:01:27,988 WARN [Listener at localhost/43949] hbase.HBaseTestingUtility(449): hadoop.log.dir property value differs in configuration and system: Configuration=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/../logs while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c11e5f15-9142-b55b-08be-b6cf0858e875/hadoop.log.dir Erasing configuration value by system value. 2023-02-15 20:01:27,988 INFO [Listener at localhost/43949] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.tmp.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c11e5f15-9142-b55b-08be-b6cf0858e875/hadoop.tmp.dir so I do NOT create it in target/test-data/e81f56f0-58ac-a0f7-02b6-ac3e14664c2f 2023-02-15 20:01:27,989 WARN [Listener at localhost/43949] hbase.HBaseTestingUtility(449): hadoop.tmp.dir property value differs in configuration and system: Configuration=/tmp/hadoop-jenkins while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c11e5f15-9142-b55b-08be-b6cf0858e875/hadoop.tmp.dir Erasing configuration value by system value. 2023-02-15 20:01:27,989 DEBUG [Listener at localhost/43949] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e81f56f0-58ac-a0f7-02b6-ac3e14664c2f 2023-02-15 20:01:27,989 INFO [Listener at localhost/43949] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=2, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=true, createWALDir=false} 2023-02-15 20:01:27,989 INFO [Listener at localhost/43949] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e81f56f0-58ac-a0f7-02b6-ac3e14664c2f/cluster_bb40ddce-9197-56bd-754a-84264c99ad04, deleteOnExit=true 2023-02-15 20:01:27,989 INFO [Listener at localhost/43949] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-02-15 20:01:27,989 INFO [Listener at localhost/43949] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e81f56f0-58ac-a0f7-02b6-ac3e14664c2f/test.cache.data in system properties and HBase conf 2023-02-15 20:01:27,989 INFO [Listener at localhost/43949] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e81f56f0-58ac-a0f7-02b6-ac3e14664c2f/hadoop.tmp.dir in system properties and HBase conf 2023-02-15 20:01:27,989 INFO [Listener at localhost/43949] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e81f56f0-58ac-a0f7-02b6-ac3e14664c2f/hadoop.log.dir in system properties and HBase conf 2023-02-15 20:01:27,989 INFO [Listener at localhost/43949] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e81f56f0-58ac-a0f7-02b6-ac3e14664c2f/mapreduce.cluster.local.dir in system properties and HBase conf 2023-02-15 20:01:27,989 INFO [Listener at localhost/43949] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e81f56f0-58ac-a0f7-02b6-ac3e14664c2f/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-02-15 20:01:27,989 INFO [Listener at localhost/43949] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-02-15 20:01:27,990 DEBUG [Listener at localhost/43949] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-02-15 20:01:27,990 INFO [Listener at localhost/43949] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e81f56f0-58ac-a0f7-02b6-ac3e14664c2f/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-02-15 20:01:27,990 INFO [Listener at localhost/43949] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e81f56f0-58ac-a0f7-02b6-ac3e14664c2f/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-02-15 20:01:27,990 INFO [Listener at localhost/43949] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e81f56f0-58ac-a0f7-02b6-ac3e14664c2f/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-02-15 20:01:27,990 INFO [Listener at localhost/43949] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e81f56f0-58ac-a0f7-02b6-ac3e14664c2f/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-15 20:01:27,990 INFO [Listener at localhost/43949] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e81f56f0-58ac-a0f7-02b6-ac3e14664c2f/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-02-15 20:01:27,990 INFO [Listener at localhost/43949] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e81f56f0-58ac-a0f7-02b6-ac3e14664c2f/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-02-15 20:01:27,990 INFO [Listener at localhost/43949] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e81f56f0-58ac-a0f7-02b6-ac3e14664c2f/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-15 20:01:27,990 INFO [Listener at localhost/43949] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e81f56f0-58ac-a0f7-02b6-ac3e14664c2f/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-15 20:01:27,991 INFO [Listener at localhost/43949] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e81f56f0-58ac-a0f7-02b6-ac3e14664c2f/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-02-15 20:01:27,991 INFO [Listener at localhost/43949] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e81f56f0-58ac-a0f7-02b6-ac3e14664c2f/nfs.dump.dir in system properties and HBase conf 2023-02-15 20:01:27,991 INFO [Listener at localhost/43949] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e81f56f0-58ac-a0f7-02b6-ac3e14664c2f/java.io.tmpdir in system properties and HBase conf 2023-02-15 20:01:27,991 INFO [Listener at localhost/43949] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e81f56f0-58ac-a0f7-02b6-ac3e14664c2f/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-15 20:01:27,991 INFO [Listener at localhost/43949] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e81f56f0-58ac-a0f7-02b6-ac3e14664c2f/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-02-15 20:01:27,991 INFO [Listener at localhost/43949] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e81f56f0-58ac-a0f7-02b6-ac3e14664c2f/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-02-15 20:01:28,000 WARN [Listener at localhost/43949] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-15 20:01:28,000 WARN [Listener at localhost/43949] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-15 20:01:28,044 WARN [Listener at localhost/43949] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-15 20:01:28,047 INFO [Listener at localhost/43949] log.Slf4jLog(67): jetty-6.1.26 2023-02-15 20:01:28,053 INFO [Listener at localhost/43949] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e81f56f0-58ac-a0f7-02b6-ac3e14664c2f/java.io.tmpdir/Jetty_localhost_37895_hdfs____31r5lm/webapp 2023-02-15 20:01:28,146 INFO [Listener at localhost/43949] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:37895 2023-02-15 20:01:28,150 WARN [Listener at localhost/43949] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-15 20:01:28,150 WARN [Listener at localhost/43949] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-15 20:01:28,217 WARN [Listener at localhost/45455] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-15 20:01:28,234 WARN [Listener at localhost/45455] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-15 20:01:28,237 WARN [Listener at localhost/45455] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-15 20:01:28,238 INFO [Listener at localhost/45455] log.Slf4jLog(67): jetty-6.1.26 2023-02-15 20:01:28,244 INFO [Listener at localhost/45455] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e81f56f0-58ac-a0f7-02b6-ac3e14664c2f/java.io.tmpdir/Jetty_localhost_36275_datanode____.lsmg5o/webapp 2023-02-15 20:01:28,337 INFO [Listener at localhost/45455] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:36275 2023-02-15 20:01:28,347 WARN [Listener at localhost/41679] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-15 20:01:28,360 WARN [Listener at localhost/41679] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-15 20:01:28,362 WARN [Listener at localhost/41679] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-15 20:01:28,363 INFO [Listener at localhost/41679] log.Slf4jLog(67): jetty-6.1.26 2023-02-15 20:01:28,367 INFO [Listener at localhost/41679] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e81f56f0-58ac-a0f7-02b6-ac3e14664c2f/java.io.tmpdir/Jetty_localhost_40081_datanode____cfhcwk/webapp 2023-02-15 20:01:28,461 INFO [Listener at localhost/41679] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:40081 2023-02-15 20:01:28,474 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xf6e4621e5652802c: Processing first storage report for DS-b4d68521-58c4-4a0e-888f-ee78e4cf114b from datanode ed127da6-c05a-4854-be1c-9d5ff5bdbec6 2023-02-15 20:01:28,474 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xf6e4621e5652802c: from storage DS-b4d68521-58c4-4a0e-888f-ee78e4cf114b node DatanodeRegistration(127.0.0.1:33605, datanodeUuid=ed127da6-c05a-4854-be1c-9d5ff5bdbec6, infoPort=38465, infoSecurePort=0, ipcPort=41679, storageInfo=lv=-57;cid=testClusterID;nsid=603628295;c=1676491288003), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-15 20:01:28,474 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xf6e4621e5652802c: Processing first storage report for DS-886210ef-0895-4997-980a-5502e5596846 from datanode ed127da6-c05a-4854-be1c-9d5ff5bdbec6 2023-02-15 20:01:28,474 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xf6e4621e5652802c: from storage DS-886210ef-0895-4997-980a-5502e5596846 node DatanodeRegistration(127.0.0.1:33605, datanodeUuid=ed127da6-c05a-4854-be1c-9d5ff5bdbec6, infoPort=38465, infoSecurePort=0, ipcPort=41679, storageInfo=lv=-57;cid=testClusterID;nsid=603628295;c=1676491288003), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-15 20:01:28,478 WARN [Listener at localhost/46363] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-15 20:01:28,572 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x30b79188a7d086a6: Processing first storage report for DS-6fbedd74-acdc-44ea-ab5d-1ac04d536d17 from datanode bb850b3d-f26f-40e4-b8dc-a1cc646a1d93 2023-02-15 20:01:28,572 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x30b79188a7d086a6: from storage DS-6fbedd74-acdc-44ea-ab5d-1ac04d536d17 node DatanodeRegistration(127.0.0.1:34369, datanodeUuid=bb850b3d-f26f-40e4-b8dc-a1cc646a1d93, infoPort=38441, infoSecurePort=0, ipcPort=46363, storageInfo=lv=-57;cid=testClusterID;nsid=603628295;c=1676491288003), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-15 20:01:28,572 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x30b79188a7d086a6: Processing first storage report for DS-6a4e49aa-b96e-4103-80d2-316d580cd3e8 from datanode bb850b3d-f26f-40e4-b8dc-a1cc646a1d93 2023-02-15 20:01:28,572 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x30b79188a7d086a6: from storage DS-6a4e49aa-b96e-4103-80d2-316d580cd3e8 node DatanodeRegistration(127.0.0.1:34369, datanodeUuid=bb850b3d-f26f-40e4-b8dc-a1cc646a1d93, infoPort=38441, infoSecurePort=0, ipcPort=46363, storageInfo=lv=-57;cid=testClusterID;nsid=603628295;c=1676491288003), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-15 20:01:28,588 DEBUG [Listener at localhost/46363] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e81f56f0-58ac-a0f7-02b6-ac3e14664c2f 2023-02-15 20:01:28,590 INFO [Listener at localhost/46363] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e81f56f0-58ac-a0f7-02b6-ac3e14664c2f/cluster_bb40ddce-9197-56bd-754a-84264c99ad04/zookeeper_0, clientPort=62883, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e81f56f0-58ac-a0f7-02b6-ac3e14664c2f/cluster_bb40ddce-9197-56bd-754a-84264c99ad04/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e81f56f0-58ac-a0f7-02b6-ac3e14664c2f/cluster_bb40ddce-9197-56bd-754a-84264c99ad04/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-02-15 20:01:28,591 INFO [Listener at localhost/46363] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=62883 2023-02-15 20:01:28,592 INFO [Listener at localhost/46363] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-15 20:01:28,593 INFO [Listener at localhost/46363] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-15 20:01:28,608 INFO [Listener at localhost/46363] util.FSUtils(479): Created version file at hdfs://localhost:45455/user/jenkins/test-data/5744aa66-a2e1-6b80-327a-b86fd996b793 with version=8 2023-02-15 20:01:28,608 INFO [Listener at localhost/46363] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-15 20:01:28,609 INFO [Listener at localhost/46363] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-15 20:01:28,610 INFO [Listener at localhost/46363] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:45455/user/jenkins/test-data/805b9efe-75a8-d613-28aa-b8ecd93bec51/hbase-staging 2023-02-15 20:01:28,612 INFO [Listener at localhost/46363] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-02-15 20:01:28,612 INFO [Listener at localhost/46363] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-15 20:01:28,612 INFO [Listener at localhost/46363] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-15 20:01:28,612 INFO [Listener at localhost/46363] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-15 20:01:28,612 INFO [Listener at localhost/46363] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-15 20:01:28,612 INFO [Listener at localhost/46363] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-15 20:01:28,612 INFO [Listener at localhost/46363] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-02-15 20:01:28,614 INFO [Listener at localhost/46363] ipc.NettyRpcServer(120): Bind to /172.31.14.131:42195 2023-02-15 20:01:28,614 INFO [Listener at localhost/46363] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-15 20:01:28,615 INFO [Listener at localhost/46363] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-15 20:01:28,615 INFO [Listener at localhost/46363] zookeeper.RecoverableZooKeeper(93): Process identifier=master:42195 connecting to ZooKeeper ensemble=127.0.0.1:62883 2023-02-15 20:01:28,622 DEBUG [Listener at localhost/46363-EventThread] zookeeper.ZKWatcher(600): master:421950x0, quorum=127.0.0.1:62883, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-15 20:01:28,623 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): master:42195-0x1005992d9d30000 connected 2023-02-15 20:01:28,643 DEBUG [Listener at localhost/46363] zookeeper.ZKUtil(164): master:42195-0x1005992d9d30000, quorum=127.0.0.1:62883, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-15 20:01:28,643 DEBUG [Listener at localhost/46363] zookeeper.ZKUtil(164): master:42195-0x1005992d9d30000, quorum=127.0.0.1:62883, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-15 20:01:28,643 DEBUG [Listener at localhost/46363] zookeeper.ZKUtil(164): master:42195-0x1005992d9d30000, quorum=127.0.0.1:62883, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-15 20:01:28,644 DEBUG [Listener at localhost/46363] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=42195 2023-02-15 20:01:28,647 DEBUG [Listener at localhost/46363] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=42195 2023-02-15 20:01:28,647 DEBUG [Listener at localhost/46363] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=42195 2023-02-15 20:01:28,648 DEBUG [Listener at localhost/46363] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=42195 2023-02-15 20:01:28,648 DEBUG [Listener at localhost/46363] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=42195 2023-02-15 20:01:28,648 INFO [Listener at localhost/46363] master.HMaster(444): hbase.rootdir=hdfs://localhost:45455/user/jenkins/test-data/5744aa66-a2e1-6b80-327a-b86fd996b793, hbase.cluster.distributed=false 2023-02-15 20:01:28,661 INFO [Listener at localhost/46363] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-15 20:01:28,661 INFO [Listener at localhost/46363] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-15 20:01:28,662 INFO [Listener at localhost/46363] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-15 20:01:28,662 INFO [Listener at localhost/46363] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-15 20:01:28,662 INFO [Listener at localhost/46363] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-15 20:01:28,662 INFO [Listener at localhost/46363] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-15 20:01:28,662 INFO [Listener at localhost/46363] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-15 20:01:28,664 INFO [Listener at localhost/46363] ipc.NettyRpcServer(120): Bind to /172.31.14.131:33923 2023-02-15 20:01:28,664 INFO [Listener at localhost/46363] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-15 20:01:28,668 DEBUG [Listener at localhost/46363] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-15 20:01:28,669 INFO [Listener at localhost/46363] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-15 20:01:28,670 INFO [Listener at localhost/46363] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-15 20:01:28,671 INFO [Listener at localhost/46363] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:33923 connecting to ZooKeeper ensemble=127.0.0.1:62883 2023-02-15 20:01:28,674 DEBUG [Listener at localhost/46363-EventThread] zookeeper.ZKWatcher(600): regionserver:339230x0, quorum=127.0.0.1:62883, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-15 20:01:28,675 DEBUG [Listener at localhost/46363] zookeeper.ZKUtil(164): regionserver:339230x0, quorum=127.0.0.1:62883, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-15 20:01:28,675 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:33923-0x1005992d9d30001 connected 2023-02-15 20:01:28,676 DEBUG [Listener at localhost/46363] zookeeper.ZKUtil(164): regionserver:33923-0x1005992d9d30001, quorum=127.0.0.1:62883, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-15 20:01:28,677 DEBUG [Listener at localhost/46363] zookeeper.ZKUtil(164): regionserver:33923-0x1005992d9d30001, quorum=127.0.0.1:62883, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-15 20:01:28,677 DEBUG [Listener at localhost/46363] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=33923 2023-02-15 20:01:28,679 DEBUG [Listener at localhost/46363] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=33923 2023-02-15 20:01:28,680 DEBUG [Listener at localhost/46363] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=33923 2023-02-15 20:01:28,684 DEBUG [Listener at localhost/46363] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=33923 2023-02-15 20:01:28,684 DEBUG [Listener at localhost/46363] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=33923 2023-02-15 20:01:28,695 INFO [Listener at localhost/46363] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-15 20:01:28,696 INFO [Listener at localhost/46363] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-15 20:01:28,696 INFO [Listener at localhost/46363] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-15 20:01:28,696 INFO [Listener at localhost/46363] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-15 20:01:28,696 INFO [Listener at localhost/46363] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-15 20:01:28,696 INFO [Listener at localhost/46363] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-15 20:01:28,696 INFO [Listener at localhost/46363] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-15 20:01:28,698 INFO [Listener at localhost/46363] ipc.NettyRpcServer(120): Bind to /172.31.14.131:38559 2023-02-15 20:01:28,698 INFO [Listener at localhost/46363] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-15 20:01:28,700 DEBUG [Listener at localhost/46363] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-15 20:01:28,700 INFO [Listener at localhost/46363] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-15 20:01:28,701 INFO [Listener at localhost/46363] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-15 20:01:28,702 INFO [Listener at localhost/46363] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:38559 connecting to ZooKeeper ensemble=127.0.0.1:62883 2023-02-15 20:01:28,705 DEBUG [Listener at localhost/46363-EventThread] zookeeper.ZKWatcher(600): regionserver:385590x0, quorum=127.0.0.1:62883, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-15 20:01:28,707 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:38559-0x1005992d9d30002 connected 2023-02-15 20:01:28,707 DEBUG [Listener at localhost/46363] zookeeper.ZKUtil(164): regionserver:38559-0x1005992d9d30002, quorum=127.0.0.1:62883, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-15 20:01:28,708 DEBUG [Listener at localhost/46363] zookeeper.ZKUtil(164): regionserver:38559-0x1005992d9d30002, quorum=127.0.0.1:62883, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-15 20:01:28,708 DEBUG [Listener at localhost/46363] zookeeper.ZKUtil(164): regionserver:38559-0x1005992d9d30002, quorum=127.0.0.1:62883, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-15 20:01:28,710 DEBUG [Listener at localhost/46363] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=38559 2023-02-15 20:01:28,710 DEBUG [Listener at localhost/46363] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=38559 2023-02-15 20:01:28,711 DEBUG [Listener at localhost/46363] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=38559 2023-02-15 20:01:28,713 DEBUG [Listener at localhost/46363] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=38559 2023-02-15 20:01:28,714 DEBUG [Listener at localhost/46363] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=38559 2023-02-15 20:01:28,717 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,42195,1676491288611 2023-02-15 20:01:28,718 DEBUG [Listener at localhost/46363-EventThread] zookeeper.ZKWatcher(600): master:42195-0x1005992d9d30000, quorum=127.0.0.1:62883, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-15 20:01:28,718 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:42195-0x1005992d9d30000, quorum=127.0.0.1:62883, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,42195,1676491288611 2023-02-15 20:01:28,720 DEBUG [Listener at localhost/46363-EventThread] zookeeper.ZKWatcher(600): master:42195-0x1005992d9d30000, quorum=127.0.0.1:62883, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-15 20:01:28,720 DEBUG [Listener at localhost/46363-EventThread] zookeeper.ZKWatcher(600): regionserver:33923-0x1005992d9d30001, quorum=127.0.0.1:62883, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-15 20:01:28,721 DEBUG [Listener at localhost/46363-EventThread] zookeeper.ZKWatcher(600): master:42195-0x1005992d9d30000, quorum=127.0.0.1:62883, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-15 20:01:28,720 DEBUG [Listener at localhost/46363-EventThread] zookeeper.ZKWatcher(600): regionserver:38559-0x1005992d9d30002, quorum=127.0.0.1:62883, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-15 20:01:28,722 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:42195-0x1005992d9d30000, quorum=127.0.0.1:62883, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-15 20:01:28,723 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,42195,1676491288611 from backup master directory 2023-02-15 20:01:28,723 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:42195-0x1005992d9d30000, quorum=127.0.0.1:62883, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-15 20:01:28,724 DEBUG [Listener at localhost/46363-EventThread] zookeeper.ZKWatcher(600): master:42195-0x1005992d9d30000, quorum=127.0.0.1:62883, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,42195,1676491288611 2023-02-15 20:01:28,724 DEBUG [Listener at localhost/46363-EventThread] zookeeper.ZKWatcher(600): master:42195-0x1005992d9d30000, quorum=127.0.0.1:62883, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-15 20:01:28,724 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-15 20:01:28,724 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase4.apache.org,42195,1676491288611 2023-02-15 20:01:28,741 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(628): Created cluster ID file at hdfs://localhost:45455/user/jenkins/test-data/5744aa66-a2e1-6b80-327a-b86fd996b793/hbase.id with ID: 9b51df87-ba0c-43e7-9452-c677ae296fc8 2023-02-15 20:01:28,751 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-15 20:01:28,753 DEBUG [Listener at localhost/46363-EventThread] zookeeper.ZKWatcher(600): master:42195-0x1005992d9d30000, quorum=127.0.0.1:62883, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-15 20:01:28,763 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x0fce61e8 to 127.0.0.1:62883 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-15 20:01:28,769 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@792906b8, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-15 20:01:28,769 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-15 20:01:28,769 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-02-15 20:01:28,771 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-15 20:01:28,772 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7689): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:45455/user/jenkins/test-data/5744aa66-a2e1-6b80-327a-b86fd996b793/MasterData/data/master/store-tmp 2023-02-15 20:01:28,783 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 20:01:28,784 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-15 20:01:28,784 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-15 20:01:28,784 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-15 20:01:28,784 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-15 20:01:28,784 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-15 20:01:28,784 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-15 20:01:28,784 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-15 20:01:28,784 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:45455/user/jenkins/test-data/5744aa66-a2e1-6b80-327a-b86fd996b793/MasterData/WALs/jenkins-hbase4.apache.org,42195,1676491288611 2023-02-15 20:01:28,786 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C42195%2C1676491288611, suffix=, logDir=hdfs://localhost:45455/user/jenkins/test-data/5744aa66-a2e1-6b80-327a-b86fd996b793/MasterData/WALs/jenkins-hbase4.apache.org,42195,1676491288611, archiveDir=hdfs://localhost:45455/user/jenkins/test-data/5744aa66-a2e1-6b80-327a-b86fd996b793/MasterData/oldWALs, maxLogs=10 2023-02-15 20:01:28,803 DEBUG [RS-EventLoopGroup-11-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33605,DS-b4d68521-58c4-4a0e-888f-ee78e4cf114b,DISK] 2023-02-15 20:01:28,804 DEBUG [RS-EventLoopGroup-11-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34369,DS-6fbedd74-acdc-44ea-ab5d-1ac04d536d17,DISK] 2023-02-15 20:01:28,806 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/5744aa66-a2e1-6b80-327a-b86fd996b793/MasterData/WALs/jenkins-hbase4.apache.org,42195,1676491288611/jenkins-hbase4.apache.org%2C42195%2C1676491288611.1676491288787 2023-02-15 20:01:28,806 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:33605,DS-b4d68521-58c4-4a0e-888f-ee78e4cf114b,DISK], DatanodeInfoWithStorage[127.0.0.1:34369,DS-6fbedd74-acdc-44ea-ab5d-1ac04d536d17,DISK]] 2023-02-15 20:01:28,806 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7850): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-02-15 20:01:28,806 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 20:01:28,806 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7890): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-02-15 20:01:28,806 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7893): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-02-15 20:01:28,807 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-02-15 20:01:28,808 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45455/user/jenkins/test-data/5744aa66-a2e1-6b80-327a-b86fd996b793/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-02-15 20:01:28,809 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-02-15 20:01:28,809 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 20:01:28,810 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:45455/user/jenkins/test-data/5744aa66-a2e1-6b80-327a-b86fd996b793/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-15 20:01:28,810 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:45455/user/jenkins/test-data/5744aa66-a2e1-6b80-327a-b86fd996b793/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-15 20:01:28,812 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1054): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-02-15 20:01:28,814 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45455/user/jenkins/test-data/5744aa66-a2e1-6b80-327a-b86fd996b793/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-15 20:01:28,815 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1071): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64464096, jitterRate=-0.03941011428833008}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-15 20:01:28,815 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(964): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-15 20:01:28,815 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-02-15 20:01:28,816 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-02-15 20:01:28,816 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-02-15 20:01:28,816 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-02-15 20:01:28,816 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 0 msec 2023-02-15 20:01:28,817 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 0 msec 2023-02-15 20:01:28,817 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(95): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-02-15 20:01:28,817 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-02-15 20:01:28,818 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-02-15 20:01:28,828 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-02-15 20:01:28,828 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-02-15 20:01:28,829 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:42195-0x1005992d9d30000, quorum=127.0.0.1:62883, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-02-15 20:01:28,829 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-02-15 20:01:28,829 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:42195-0x1005992d9d30000, quorum=127.0.0.1:62883, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-02-15 20:01:28,832 DEBUG [Listener at localhost/46363-EventThread] zookeeper.ZKWatcher(600): master:42195-0x1005992d9d30000, quorum=127.0.0.1:62883, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-15 20:01:28,832 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:42195-0x1005992d9d30000, quorum=127.0.0.1:62883, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-02-15 20:01:28,832 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:42195-0x1005992d9d30000, quorum=127.0.0.1:62883, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-02-15 20:01:28,833 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:42195-0x1005992d9d30000, quorum=127.0.0.1:62883, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-02-15 20:01:28,834 DEBUG [Listener at localhost/46363-EventThread] zookeeper.ZKWatcher(600): master:42195-0x1005992d9d30000, quorum=127.0.0.1:62883, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-15 20:01:28,834 DEBUG [Listener at localhost/46363-EventThread] zookeeper.ZKWatcher(600): regionserver:38559-0x1005992d9d30002, quorum=127.0.0.1:62883, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-15 20:01:28,834 DEBUG [Listener at localhost/46363-EventThread] zookeeper.ZKWatcher(600): master:42195-0x1005992d9d30000, quorum=127.0.0.1:62883, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-15 20:01:28,834 DEBUG [Listener at localhost/46363-EventThread] zookeeper.ZKWatcher(600): regionserver:33923-0x1005992d9d30001, quorum=127.0.0.1:62883, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-15 20:01:28,835 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase4.apache.org,42195,1676491288611, sessionid=0x1005992d9d30000, setting cluster-up flag (Was=false) 2023-02-15 20:01:28,839 DEBUG [Listener at localhost/46363-EventThread] zookeeper.ZKWatcher(600): master:42195-0x1005992d9d30000, quorum=127.0.0.1:62883, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-15 20:01:28,844 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-02-15 20:01:28,844 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,42195,1676491288611 2023-02-15 20:01:28,849 DEBUG [Listener at localhost/46363-EventThread] zookeeper.ZKWatcher(600): master:42195-0x1005992d9d30000, quorum=127.0.0.1:62883, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-15 20:01:28,852 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-02-15 20:01:28,853 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,42195,1676491288611 2023-02-15 20:01:28,854 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:45455/user/jenkins/test-data/5744aa66-a2e1-6b80-327a-b86fd996b793/.hbase-snapshot/.tmp 2023-02-15 20:01:28,856 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-02-15 20:01:28,856 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-15 20:01:28,856 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-15 20:01:28,856 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-15 20:01:28,856 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-15 20:01:28,856 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-02-15 20:01:28,856 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 20:01:28,856 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-15 20:01:28,856 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 20:01:28,858 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1676491318858 2023-02-15 20:01:28,858 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-02-15 20:01:28,858 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-02-15 20:01:28,858 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-02-15 20:01:28,858 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-02-15 20:01:28,858 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-02-15 20:01:28,858 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-02-15 20:01:28,859 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-15 20:01:28,859 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-02-15 20:01:28,859 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-02-15 20:01:28,859 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-02-15 20:01:28,859 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-02-15 20:01:28,860 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-02-15 20:01:28,860 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-02-15 20:01:28,860 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-02-15 20:01:28,860 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676491288860,5,FailOnTimeoutGroup] 2023-02-15 20:01:28,860 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676491288860,5,FailOnTimeoutGroup] 2023-02-15 20:01:28,860 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-15 20:01:28,860 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-02-15 20:01:28,860 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-02-15 20:01:28,860 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-02-15 20:01:28,860 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-15 20:01:28,874 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:45455/user/jenkins/test-data/5744aa66-a2e1-6b80-327a-b86fd996b793/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-15 20:01:28,874 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:45455/user/jenkins/test-data/5744aa66-a2e1-6b80-327a-b86fd996b793/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-15 20:01:28,875 INFO [PEWorker-1] regionserver.HRegion(7671): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:45455/user/jenkins/test-data/5744aa66-a2e1-6b80-327a-b86fd996b793 2023-02-15 20:01:28,884 DEBUG [PEWorker-1] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 20:01:28,888 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-15 20:01:28,889 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45455/user/jenkins/test-data/5744aa66-a2e1-6b80-327a-b86fd996b793/data/hbase/meta/1588230740/info 2023-02-15 20:01:28,889 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-15 20:01:28,890 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 20:01:28,890 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-15 20:01:28,891 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45455/user/jenkins/test-data/5744aa66-a2e1-6b80-327a-b86fd996b793/data/hbase/meta/1588230740/rep_barrier 2023-02-15 20:01:28,891 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-15 20:01:28,892 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 20:01:28,892 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-15 20:01:28,893 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45455/user/jenkins/test-data/5744aa66-a2e1-6b80-327a-b86fd996b793/data/hbase/meta/1588230740/table 2023-02-15 20:01:28,893 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-15 20:01:28,893 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 20:01:28,894 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:45455/user/jenkins/test-data/5744aa66-a2e1-6b80-327a-b86fd996b793/data/hbase/meta/1588230740 2023-02-15 20:01:28,894 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:45455/user/jenkins/test-data/5744aa66-a2e1-6b80-327a-b86fd996b793/data/hbase/meta/1588230740 2023-02-15 20:01:28,896 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-15 20:01:28,897 DEBUG [PEWorker-1] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-15 20:01:28,898 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45455/user/jenkins/test-data/5744aa66-a2e1-6b80-327a-b86fd996b793/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-15 20:01:28,898 INFO [PEWorker-1] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62938072, jitterRate=-0.062149643898010254}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-15 20:01:28,898 DEBUG [PEWorker-1] regionserver.HRegion(964): Region open journal for 1588230740: 2023-02-15 20:01:28,899 DEBUG [PEWorker-1] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-15 20:01:28,899 INFO [PEWorker-1] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-15 20:01:28,899 DEBUG [PEWorker-1] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-15 20:01:28,899 DEBUG [PEWorker-1] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-15 20:01:28,899 DEBUG [PEWorker-1] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-15 20:01:28,899 INFO [PEWorker-1] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-15 20:01:28,899 DEBUG [PEWorker-1] regionserver.HRegion(1557): Region close journal for 1588230740: 2023-02-15 20:01:28,900 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-02-15 20:01:28,900 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-02-15 20:01:28,900 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-02-15 20:01:28,901 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-02-15 20:01:28,903 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-02-15 20:01:28,918 INFO [RS:1;jenkins-hbase4:38559] regionserver.HRegionServer(952): ClusterId : 9b51df87-ba0c-43e7-9452-c677ae296fc8 2023-02-15 20:01:28,918 INFO [RS:0;jenkins-hbase4:33923] regionserver.HRegionServer(952): ClusterId : 9b51df87-ba0c-43e7-9452-c677ae296fc8 2023-02-15 20:01:28,918 DEBUG [RS:1;jenkins-hbase4:38559] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-15 20:01:28,918 DEBUG [RS:0;jenkins-hbase4:33923] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-15 20:01:28,921 DEBUG [RS:1;jenkins-hbase4:38559] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-15 20:01:28,921 DEBUG [RS:1;jenkins-hbase4:38559] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-15 20:01:28,921 DEBUG [RS:0;jenkins-hbase4:33923] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-15 20:01:28,921 DEBUG [RS:0;jenkins-hbase4:33923] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-15 20:01:28,923 DEBUG [RS:1;jenkins-hbase4:38559] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-15 20:01:28,924 DEBUG [RS:1;jenkins-hbase4:38559] zookeeper.ReadOnlyZKClient(139): Connect 0x67d4494c to 127.0.0.1:62883 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-15 20:01:28,924 DEBUG [RS:0;jenkins-hbase4:33923] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-15 20:01:28,925 DEBUG [RS:0;jenkins-hbase4:33923] zookeeper.ReadOnlyZKClient(139): Connect 0x49fa2428 to 127.0.0.1:62883 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-15 20:01:28,932 DEBUG [RS:1;jenkins-hbase4:38559] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6913abc6, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-15 20:01:28,932 DEBUG [RS:0;jenkins-hbase4:33923] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@473dc367, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-15 20:01:28,932 DEBUG [RS:1;jenkins-hbase4:38559] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6d2c223c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-15 20:01:28,932 DEBUG [RS:0;jenkins-hbase4:33923] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@43024f58, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-15 20:01:28,942 DEBUG [RS:1;jenkins-hbase4:38559] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:38559 2023-02-15 20:01:28,942 INFO [RS:1;jenkins-hbase4:38559] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-15 20:01:28,942 INFO [RS:1;jenkins-hbase4:38559] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-15 20:01:28,942 DEBUG [RS:1;jenkins-hbase4:38559] regionserver.HRegionServer(1023): About to register with Master. 2023-02-15 20:01:28,942 DEBUG [RS:0;jenkins-hbase4:33923] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:33923 2023-02-15 20:01:28,942 INFO [RS:0;jenkins-hbase4:33923] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-15 20:01:28,942 INFO [RS:0;jenkins-hbase4:33923] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-15 20:01:28,942 DEBUG [RS:0;jenkins-hbase4:33923] regionserver.HRegionServer(1023): About to register with Master. 2023-02-15 20:01:28,942 INFO [RS:1;jenkins-hbase4:38559] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,42195,1676491288611 with isa=jenkins-hbase4.apache.org/172.31.14.131:38559, startcode=1676491288695 2023-02-15 20:01:28,943 DEBUG [RS:1;jenkins-hbase4:38559] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-15 20:01:28,943 INFO [RS:0;jenkins-hbase4:33923] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,42195,1676491288611 with isa=jenkins-hbase4.apache.org/172.31.14.131:33923, startcode=1676491288661 2023-02-15 20:01:28,943 DEBUG [RS:0;jenkins-hbase4:33923] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-15 20:01:28,945 INFO [RS-EventLoopGroup-9-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55881, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.5 (auth:SIMPLE), service=RegionServerStatusService 2023-02-15 20:01:28,947 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42195] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,38559,1676491288695 2023-02-15 20:01:28,947 INFO [RS-EventLoopGroup-9-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38765, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.4 (auth:SIMPLE), service=RegionServerStatusService 2023-02-15 20:01:28,947 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42195] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,33923,1676491288661 2023-02-15 20:01:28,947 DEBUG [RS:1;jenkins-hbase4:38559] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:45455/user/jenkins/test-data/5744aa66-a2e1-6b80-327a-b86fd996b793 2023-02-15 20:01:28,947 DEBUG [RS:1;jenkins-hbase4:38559] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:45455 2023-02-15 20:01:28,947 DEBUG [RS:1;jenkins-hbase4:38559] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-15 20:01:28,947 DEBUG [RS:0;jenkins-hbase4:33923] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:45455/user/jenkins/test-data/5744aa66-a2e1-6b80-327a-b86fd996b793 2023-02-15 20:01:28,947 DEBUG [RS:0;jenkins-hbase4:33923] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:45455 2023-02-15 20:01:28,947 DEBUG [RS:0;jenkins-hbase4:33923] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-15 20:01:28,948 DEBUG [Listener at localhost/46363-EventThread] zookeeper.ZKWatcher(600): master:42195-0x1005992d9d30000, quorum=127.0.0.1:62883, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-15 20:01:28,954 DEBUG [RS:1;jenkins-hbase4:38559] zookeeper.ZKUtil(162): regionserver:38559-0x1005992d9d30002, quorum=127.0.0.1:62883, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,38559,1676491288695 2023-02-15 20:01:28,954 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,38559,1676491288695] 2023-02-15 20:01:28,954 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,33923,1676491288661] 2023-02-15 20:01:28,954 WARN [RS:1;jenkins-hbase4:38559] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-15 20:01:28,954 DEBUG [RS:0;jenkins-hbase4:33923] zookeeper.ZKUtil(162): regionserver:33923-0x1005992d9d30001, quorum=127.0.0.1:62883, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,33923,1676491288661 2023-02-15 20:01:28,954 INFO [RS:1;jenkins-hbase4:38559] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-15 20:01:28,954 WARN [RS:0;jenkins-hbase4:33923] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-15 20:01:28,954 DEBUG [RS:1;jenkins-hbase4:38559] regionserver.HRegionServer(1947): logDir=hdfs://localhost:45455/user/jenkins/test-data/5744aa66-a2e1-6b80-327a-b86fd996b793/WALs/jenkins-hbase4.apache.org,38559,1676491288695 2023-02-15 20:01:28,954 INFO [RS:0;jenkins-hbase4:33923] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-15 20:01:28,954 DEBUG [RS:0;jenkins-hbase4:33923] regionserver.HRegionServer(1947): logDir=hdfs://localhost:45455/user/jenkins/test-data/5744aa66-a2e1-6b80-327a-b86fd996b793/WALs/jenkins-hbase4.apache.org,33923,1676491288661 2023-02-15 20:01:28,960 DEBUG [RS:0;jenkins-hbase4:33923] zookeeper.ZKUtil(162): regionserver:33923-0x1005992d9d30001, quorum=127.0.0.1:62883, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,38559,1676491288695 2023-02-15 20:01:28,960 DEBUG [RS:1;jenkins-hbase4:38559] zookeeper.ZKUtil(162): regionserver:38559-0x1005992d9d30002, quorum=127.0.0.1:62883, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,38559,1676491288695 2023-02-15 20:01:28,960 DEBUG [RS:0;jenkins-hbase4:33923] zookeeper.ZKUtil(162): regionserver:33923-0x1005992d9d30001, quorum=127.0.0.1:62883, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,33923,1676491288661 2023-02-15 20:01:28,960 DEBUG [RS:1;jenkins-hbase4:38559] zookeeper.ZKUtil(162): regionserver:38559-0x1005992d9d30002, quorum=127.0.0.1:62883, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,33923,1676491288661 2023-02-15 20:01:28,961 DEBUG [RS:1;jenkins-hbase4:38559] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-15 20:01:28,961 DEBUG [RS:0;jenkins-hbase4:33923] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-15 20:01:28,961 INFO [RS:1;jenkins-hbase4:38559] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-15 20:01:28,961 INFO [RS:0;jenkins-hbase4:33923] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-15 20:01:28,963 INFO [RS:1;jenkins-hbase4:38559] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-15 20:01:28,964 INFO [RS:1;jenkins-hbase4:38559] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-15 20:01:28,964 INFO [RS:1;jenkins-hbase4:38559] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-15 20:01:28,964 INFO [RS:0;jenkins-hbase4:33923] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-15 20:01:28,965 INFO [RS:1;jenkins-hbase4:38559] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-15 20:01:28,968 INFO [RS:0;jenkins-hbase4:33923] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-15 20:01:28,969 INFO [RS:0;jenkins-hbase4:33923] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-15 20:01:28,969 INFO [RS:0;jenkins-hbase4:33923] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-15 20:01:28,969 INFO [RS:1;jenkins-hbase4:38559] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-15 20:01:28,970 DEBUG [RS:1;jenkins-hbase4:38559] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 20:01:28,970 DEBUG [RS:1;jenkins-hbase4:38559] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 20:01:28,971 DEBUG [RS:1;jenkins-hbase4:38559] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 20:01:28,971 DEBUG [RS:1;jenkins-hbase4:38559] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 20:01:28,971 DEBUG [RS:1;jenkins-hbase4:38559] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 20:01:28,971 DEBUG [RS:1;jenkins-hbase4:38559] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-15 20:01:28,971 DEBUG [RS:1;jenkins-hbase4:38559] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 20:01:28,971 DEBUG [RS:1;jenkins-hbase4:38559] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 20:01:28,971 INFO [RS:0;jenkins-hbase4:33923] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-15 20:01:28,971 DEBUG [RS:1;jenkins-hbase4:38559] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 20:01:28,971 DEBUG [RS:0;jenkins-hbase4:33923] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 20:01:28,971 DEBUG [RS:1;jenkins-hbase4:38559] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 20:01:28,971 DEBUG [RS:0;jenkins-hbase4:33923] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 20:01:28,971 DEBUG [RS:0;jenkins-hbase4:33923] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 20:01:28,971 DEBUG [RS:0;jenkins-hbase4:33923] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 20:01:28,971 DEBUG [RS:0;jenkins-hbase4:33923] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 20:01:28,971 DEBUG [RS:0;jenkins-hbase4:33923] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-15 20:01:28,972 DEBUG [RS:0;jenkins-hbase4:33923] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 20:01:28,972 DEBUG [RS:0;jenkins-hbase4:33923] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 20:01:28,972 DEBUG [RS:0;jenkins-hbase4:33923] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 20:01:28,972 DEBUG [RS:0;jenkins-hbase4:33923] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 20:01:28,981 INFO [RS:1;jenkins-hbase4:38559] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-15 20:01:28,981 INFO [RS:1;jenkins-hbase4:38559] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-15 20:01:28,981 INFO [RS:1;jenkins-hbase4:38559] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-15 20:01:28,984 INFO [RS:0;jenkins-hbase4:33923] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-15 20:01:28,984 INFO [RS:0;jenkins-hbase4:33923] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-15 20:01:28,984 INFO [RS:0;jenkins-hbase4:33923] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-15 20:01:28,995 INFO [RS:0;jenkins-hbase4:33923] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-15 20:01:28,995 INFO [RS:1;jenkins-hbase4:38559] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-15 20:01:28,995 INFO [RS:0;jenkins-hbase4:33923] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,33923,1676491288661-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-15 20:01:28,995 INFO [RS:1;jenkins-hbase4:38559] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,38559,1676491288695-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-15 20:01:29,006 INFO [RS:1;jenkins-hbase4:38559] regionserver.Replication(203): jenkins-hbase4.apache.org,38559,1676491288695 started 2023-02-15 20:01:29,006 INFO [RS:1;jenkins-hbase4:38559] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,38559,1676491288695, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:38559, sessionid=0x1005992d9d30002 2023-02-15 20:01:29,007 INFO [RS:0;jenkins-hbase4:33923] regionserver.Replication(203): jenkins-hbase4.apache.org,33923,1676491288661 started 2023-02-15 20:01:29,007 DEBUG [RS:1;jenkins-hbase4:38559] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-15 20:01:29,007 DEBUG [RS:1;jenkins-hbase4:38559] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,38559,1676491288695 2023-02-15 20:01:29,007 INFO [RS:0;jenkins-hbase4:33923] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,33923,1676491288661, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:33923, sessionid=0x1005992d9d30001 2023-02-15 20:01:29,007 DEBUG [RS:1;jenkins-hbase4:38559] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,38559,1676491288695' 2023-02-15 20:01:29,007 DEBUG [RS:0;jenkins-hbase4:33923] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-15 20:01:29,007 DEBUG [RS:0;jenkins-hbase4:33923] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,33923,1676491288661 2023-02-15 20:01:29,007 DEBUG [RS:0;jenkins-hbase4:33923] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,33923,1676491288661' 2023-02-15 20:01:29,007 DEBUG [RS:0;jenkins-hbase4:33923] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-15 20:01:29,007 DEBUG [RS:1;jenkins-hbase4:38559] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-15 20:01:29,007 DEBUG [RS:0;jenkins-hbase4:33923] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-15 20:01:29,007 DEBUG [RS:1;jenkins-hbase4:38559] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-15 20:01:29,008 DEBUG [RS:0;jenkins-hbase4:33923] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-15 20:01:29,008 DEBUG [RS:1;jenkins-hbase4:38559] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-15 20:01:29,008 DEBUG [RS:1;jenkins-hbase4:38559] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-15 20:01:29,008 DEBUG [RS:1;jenkins-hbase4:38559] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,38559,1676491288695 2023-02-15 20:01:29,008 DEBUG [RS:1;jenkins-hbase4:38559] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,38559,1676491288695' 2023-02-15 20:01:29,008 DEBUG [RS:1;jenkins-hbase4:38559] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-15 20:01:29,008 DEBUG [RS:0;jenkins-hbase4:33923] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-15 20:01:29,008 DEBUG [RS:0;jenkins-hbase4:33923] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,33923,1676491288661 2023-02-15 20:01:29,008 DEBUG [RS:0;jenkins-hbase4:33923] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,33923,1676491288661' 2023-02-15 20:01:29,008 DEBUG [RS:0;jenkins-hbase4:33923] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-15 20:01:29,008 DEBUG [RS:1;jenkins-hbase4:38559] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-15 20:01:29,008 DEBUG [RS:0;jenkins-hbase4:33923] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-15 20:01:29,008 DEBUG [RS:1;jenkins-hbase4:38559] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-15 20:01:29,008 INFO [RS:1;jenkins-hbase4:38559] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-15 20:01:29,008 INFO [RS:1;jenkins-hbase4:38559] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-15 20:01:29,009 DEBUG [RS:0;jenkins-hbase4:33923] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-15 20:01:29,009 INFO [RS:0;jenkins-hbase4:33923] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-15 20:01:29,009 INFO [RS:0;jenkins-hbase4:33923] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-15 20:01:29,053 DEBUG [jenkins-hbase4:42195] assignment.AssignmentManager(2178): Processing assignQueue; systemServersCount=2, allServersCount=2 2023-02-15 20:01:29,053 DEBUG [jenkins-hbase4:42195] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-15 20:01:29,055 DEBUG [jenkins-hbase4:42195] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-15 20:01:29,055 DEBUG [jenkins-hbase4:42195] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-15 20:01:29,055 DEBUG [jenkins-hbase4:42195] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-15 20:01:29,056 INFO [PEWorker-4] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,38559,1676491288695, state=OPENING 2023-02-15 20:01:29,057 DEBUG [PEWorker-4] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-02-15 20:01:29,058 DEBUG [Listener at localhost/46363-EventThread] zookeeper.ZKWatcher(600): master:42195-0x1005992d9d30000, quorum=127.0.0.1:62883, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-15 20:01:29,058 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-15 20:01:29,058 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,38559,1676491288695}] 2023-02-15 20:01:29,213 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,38559,1676491288695 2023-02-15 20:01:29,213 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-15 20:01:29,214 INFO [RS-EventLoopGroup-11-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38970, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-15 20:01:29,219 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:meta,,1.1588230740 2023-02-15 20:01:29,219 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-15 20:01:29,220 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C38559%2C1676491288695.meta, suffix=.meta, logDir=hdfs://localhost:45455/user/jenkins/test-data/5744aa66-a2e1-6b80-327a-b86fd996b793/WALs/jenkins-hbase4.apache.org,38559,1676491288695, archiveDir=hdfs://localhost:45455/user/jenkins/test-data/5744aa66-a2e1-6b80-327a-b86fd996b793/oldWALs, maxLogs=32 2023-02-15 20:01:29,235 DEBUG [RS-EventLoopGroup-11-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34369,DS-6fbedd74-acdc-44ea-ab5d-1ac04d536d17,DISK] 2023-02-15 20:01:29,235 DEBUG [RS-EventLoopGroup-11-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33605,DS-b4d68521-58c4-4a0e-888f-ee78e4cf114b,DISK] 2023-02-15 20:01:29,236 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/5744aa66-a2e1-6b80-327a-b86fd996b793/WALs/jenkins-hbase4.apache.org,38559,1676491288695/jenkins-hbase4.apache.org%2C38559%2C1676491288695.meta.1676491289221.meta 2023-02-15 20:01:29,237 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:33605,DS-b4d68521-58c4-4a0e-888f-ee78e4cf114b,DISK], DatanodeInfoWithStorage[127.0.0.1:34369,DS-6fbedd74-acdc-44ea-ab5d-1ac04d536d17,DISK]] 2023-02-15 20:01:29,237 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-02-15 20:01:29,237 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-02-15 20:01:29,237 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8546): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-02-15 20:01:29,237 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-02-15 20:01:29,237 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-02-15 20:01:29,237 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 20:01:29,237 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 1588230740 2023-02-15 20:01:29,237 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 1588230740 2023-02-15 20:01:29,238 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-15 20:01:29,239 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45455/user/jenkins/test-data/5744aa66-a2e1-6b80-327a-b86fd996b793/data/hbase/meta/1588230740/info 2023-02-15 20:01:29,239 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45455/user/jenkins/test-data/5744aa66-a2e1-6b80-327a-b86fd996b793/data/hbase/meta/1588230740/info 2023-02-15 20:01:29,240 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-15 20:01:29,240 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 20:01:29,240 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-15 20:01:29,241 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45455/user/jenkins/test-data/5744aa66-a2e1-6b80-327a-b86fd996b793/data/hbase/meta/1588230740/rep_barrier 2023-02-15 20:01:29,241 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45455/user/jenkins/test-data/5744aa66-a2e1-6b80-327a-b86fd996b793/data/hbase/meta/1588230740/rep_barrier 2023-02-15 20:01:29,241 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-15 20:01:29,242 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 20:01:29,242 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-15 20:01:29,243 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45455/user/jenkins/test-data/5744aa66-a2e1-6b80-327a-b86fd996b793/data/hbase/meta/1588230740/table 2023-02-15 20:01:29,243 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45455/user/jenkins/test-data/5744aa66-a2e1-6b80-327a-b86fd996b793/data/hbase/meta/1588230740/table 2023-02-15 20:01:29,243 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-15 20:01:29,243 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 20:01:29,244 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:45455/user/jenkins/test-data/5744aa66-a2e1-6b80-327a-b86fd996b793/data/hbase/meta/1588230740 2023-02-15 20:01:29,245 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:45455/user/jenkins/test-data/5744aa66-a2e1-6b80-327a-b86fd996b793/data/hbase/meta/1588230740 2023-02-15 20:01:29,246 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-15 20:01:29,247 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-15 20:01:29,248 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61945335, jitterRate=-0.076942577958107}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-15 20:01:29,248 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 1588230740: 2023-02-15 20:01:29,249 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1676491289212 2023-02-15 20:01:29,253 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:meta,,1.1588230740 2023-02-15 20:01:29,253 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:meta,,1.1588230740 2023-02-15 20:01:29,254 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,38559,1676491288695, state=OPEN 2023-02-15 20:01:29,255 DEBUG [Listener at localhost/46363-EventThread] zookeeper.ZKWatcher(600): master:42195-0x1005992d9d30000, quorum=127.0.0.1:62883, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-02-15 20:01:29,255 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-15 20:01:29,256 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-02-15 20:01:29,256 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,38559,1676491288695 in 197 msec 2023-02-15 20:01:29,258 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-02-15 20:01:29,258 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 356 msec 2023-02-15 20:01:29,259 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 404 msec 2023-02-15 20:01:29,259 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1676491289259, completionTime=-1 2023-02-15 20:01:29,259 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=2; waited=0ms, expected min=2 server(s), max=2 server(s), master is running 2023-02-15 20:01:29,259 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1519): Joining cluster... 2023-02-15 20:01:29,263 DEBUG [hconnection-0x9c0e0b2-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-15 20:01:29,264 INFO [RS-EventLoopGroup-11-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38980, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-15 20:01:29,266 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1531): Number of RegionServers=2 2023-02-15 20:01:29,266 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1676491349266 2023-02-15 20:01:29,266 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1676491409266 2023-02-15 20:01:29,266 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1538): Joined the cluster in 6 msec 2023-02-15 20:01:29,274 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,42195,1676491288611-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-15 20:01:29,274 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,42195,1676491288611-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-15 20:01:29,274 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,42195,1676491288611-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-15 20:01:29,274 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:42195, period=300000, unit=MILLISECONDS is enabled. 2023-02-15 20:01:29,274 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-02-15 20:01:29,275 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-02-15 20:01:29,275 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-15 20:01:29,276 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-02-15 20:01:29,277 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-02-15 20:01:29,277 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-02-15 20:01:29,277 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-15 20:01:29,279 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45455/user/jenkins/test-data/5744aa66-a2e1-6b80-327a-b86fd996b793/.tmp/data/hbase/namespace/14d1dca7ea8b2ab6fcb300bde0aa3457 2023-02-15 20:01:29,279 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:45455/user/jenkins/test-data/5744aa66-a2e1-6b80-327a-b86fd996b793/.tmp/data/hbase/namespace/14d1dca7ea8b2ab6fcb300bde0aa3457 empty. 2023-02-15 20:01:29,280 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:45455/user/jenkins/test-data/5744aa66-a2e1-6b80-327a-b86fd996b793/.tmp/data/hbase/namespace/14d1dca7ea8b2ab6fcb300bde0aa3457 2023-02-15 20:01:29,280 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-02-15 20:01:29,289 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:45455/user/jenkins/test-data/5744aa66-a2e1-6b80-327a-b86fd996b793/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-02-15 20:01:29,290 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7671): creating {ENCODED => 14d1dca7ea8b2ab6fcb300bde0aa3457, NAME => 'hbase:namespace,,1676491289275.14d1dca7ea8b2ab6fcb300bde0aa3457.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:45455/user/jenkins/test-data/5744aa66-a2e1-6b80-327a-b86fd996b793/.tmp 2023-02-15 20:01:29,296 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676491289275.14d1dca7ea8b2ab6fcb300bde0aa3457.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 20:01:29,296 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1603): Closing 14d1dca7ea8b2ab6fcb300bde0aa3457, disabling compactions & flushes 2023-02-15 20:01:29,296 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676491289275.14d1dca7ea8b2ab6fcb300bde0aa3457. 2023-02-15 20:01:29,296 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676491289275.14d1dca7ea8b2ab6fcb300bde0aa3457. 2023-02-15 20:01:29,296 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676491289275.14d1dca7ea8b2ab6fcb300bde0aa3457. after waiting 0 ms 2023-02-15 20:01:29,296 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676491289275.14d1dca7ea8b2ab6fcb300bde0aa3457. 2023-02-15 20:01:29,296 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676491289275.14d1dca7ea8b2ab6fcb300bde0aa3457. 2023-02-15 20:01:29,296 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1557): Region close journal for 14d1dca7ea8b2ab6fcb300bde0aa3457: 2023-02-15 20:01:29,298 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-02-15 20:01:29,299 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1676491289275.14d1dca7ea8b2ab6fcb300bde0aa3457.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676491289299"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676491289299"}]},"ts":"1676491289299"} 2023-02-15 20:01:29,300 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-15 20:01:29,301 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-15 20:01:29,301 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676491289301"}]},"ts":"1676491289301"} 2023-02-15 20:01:29,302 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-02-15 20:01:29,305 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-15 20:01:29,305 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-15 20:01:29,305 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-15 20:01:29,305 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-15 20:01:29,306 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=14d1dca7ea8b2ab6fcb300bde0aa3457, ASSIGN}] 2023-02-15 20:01:29,308 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=14d1dca7ea8b2ab6fcb300bde0aa3457, ASSIGN 2023-02-15 20:01:29,309 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=14d1dca7ea8b2ab6fcb300bde0aa3457, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,38559,1676491288695; forceNewPlan=false, retain=false 2023-02-15 20:01:29,459 INFO [jenkins-hbase4:42195] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-15 20:01:29,460 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=14d1dca7ea8b2ab6fcb300bde0aa3457, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,38559,1676491288695 2023-02-15 20:01:29,461 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1676491289275.14d1dca7ea8b2ab6fcb300bde0aa3457.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676491289460"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676491289460"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676491289460"}]},"ts":"1676491289460"} 2023-02-15 20:01:29,462 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 14d1dca7ea8b2ab6fcb300bde0aa3457, server=jenkins-hbase4.apache.org,38559,1676491288695}] 2023-02-15 20:01:29,618 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:namespace,,1676491289275.14d1dca7ea8b2ab6fcb300bde0aa3457. 2023-02-15 20:01:29,619 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C38559%2C1676491288695, suffix=, logDir=hdfs://localhost:45455/user/jenkins/test-data/5744aa66-a2e1-6b80-327a-b86fd996b793/WALs/jenkins-hbase4.apache.org,38559,1676491288695, archiveDir=hdfs://localhost:45455/user/jenkins/test-data/5744aa66-a2e1-6b80-327a-b86fd996b793/oldWALs, maxLogs=32 2023-02-15 20:01:29,639 DEBUG [RS-EventLoopGroup-11-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33605,DS-b4d68521-58c4-4a0e-888f-ee78e4cf114b,DISK] 2023-02-15 20:01:29,640 DEBUG [RS-EventLoopGroup-11-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34369,DS-6fbedd74-acdc-44ea-ab5d-1ac04d536d17,DISK] 2023-02-15 20:01:29,642 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/5744aa66-a2e1-6b80-327a-b86fd996b793/WALs/jenkins-hbase4.apache.org,38559,1676491288695/jenkins-hbase4.apache.org%2C38559%2C1676491288695.1676491289620 2023-02-15 20:01:29,648 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:33605,DS-b4d68521-58c4-4a0e-888f-ee78e4cf114b,DISK], DatanodeInfoWithStorage[127.0.0.1:34369,DS-6fbedd74-acdc-44ea-ab5d-1ac04d536d17,DISK]] 2023-02-15 20:01:29,648 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 14d1dca7ea8b2ab6fcb300bde0aa3457, NAME => 'hbase:namespace,,1676491289275.14d1dca7ea8b2ab6fcb300bde0aa3457.', STARTKEY => '', ENDKEY => ''} 2023-02-15 20:01:29,648 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 14d1dca7ea8b2ab6fcb300bde0aa3457 2023-02-15 20:01:29,648 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676491289275.14d1dca7ea8b2ab6fcb300bde0aa3457.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 20:01:29,649 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 14d1dca7ea8b2ab6fcb300bde0aa3457 2023-02-15 20:01:29,649 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 14d1dca7ea8b2ab6fcb300bde0aa3457 2023-02-15 20:01:29,650 INFO [StoreOpener-14d1dca7ea8b2ab6fcb300bde0aa3457-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 14d1dca7ea8b2ab6fcb300bde0aa3457 2023-02-15 20:01:29,651 DEBUG [StoreOpener-14d1dca7ea8b2ab6fcb300bde0aa3457-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45455/user/jenkins/test-data/5744aa66-a2e1-6b80-327a-b86fd996b793/data/hbase/namespace/14d1dca7ea8b2ab6fcb300bde0aa3457/info 2023-02-15 20:01:29,651 DEBUG [StoreOpener-14d1dca7ea8b2ab6fcb300bde0aa3457-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45455/user/jenkins/test-data/5744aa66-a2e1-6b80-327a-b86fd996b793/data/hbase/namespace/14d1dca7ea8b2ab6fcb300bde0aa3457/info 2023-02-15 20:01:29,652 INFO [StoreOpener-14d1dca7ea8b2ab6fcb300bde0aa3457-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 14d1dca7ea8b2ab6fcb300bde0aa3457 columnFamilyName info 2023-02-15 20:01:29,652 INFO [StoreOpener-14d1dca7ea8b2ab6fcb300bde0aa3457-1] regionserver.HStore(310): Store=14d1dca7ea8b2ab6fcb300bde0aa3457/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 20:01:29,653 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:45455/user/jenkins/test-data/5744aa66-a2e1-6b80-327a-b86fd996b793/data/hbase/namespace/14d1dca7ea8b2ab6fcb300bde0aa3457 2023-02-15 20:01:29,653 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:45455/user/jenkins/test-data/5744aa66-a2e1-6b80-327a-b86fd996b793/data/hbase/namespace/14d1dca7ea8b2ab6fcb300bde0aa3457 2023-02-15 20:01:29,656 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 14d1dca7ea8b2ab6fcb300bde0aa3457 2023-02-15 20:01:29,657 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45455/user/jenkins/test-data/5744aa66-a2e1-6b80-327a-b86fd996b793/data/hbase/namespace/14d1dca7ea8b2ab6fcb300bde0aa3457/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-15 20:01:29,658 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 14d1dca7ea8b2ab6fcb300bde0aa3457; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71528570, jitterRate=0.06585875153541565}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-15 20:01:29,658 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 14d1dca7ea8b2ab6fcb300bde0aa3457: 2023-02-15 20:01:29,659 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:namespace,,1676491289275.14d1dca7ea8b2ab6fcb300bde0aa3457., pid=6, masterSystemTime=1676491289614 2023-02-15 20:01:29,661 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:namespace,,1676491289275.14d1dca7ea8b2ab6fcb300bde0aa3457. 2023-02-15 20:01:29,661 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:namespace,,1676491289275.14d1dca7ea8b2ab6fcb300bde0aa3457. 2023-02-15 20:01:29,661 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=14d1dca7ea8b2ab6fcb300bde0aa3457, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,38559,1676491288695 2023-02-15 20:01:29,661 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1676491289275.14d1dca7ea8b2ab6fcb300bde0aa3457.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676491289661"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676491289661"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676491289661"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676491289661"}]},"ts":"1676491289661"} 2023-02-15 20:01:29,664 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-02-15 20:01:29,665 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 14d1dca7ea8b2ab6fcb300bde0aa3457, server=jenkins-hbase4.apache.org,38559,1676491288695 in 201 msec 2023-02-15 20:01:29,666 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-02-15 20:01:29,666 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=14d1dca7ea8b2ab6fcb300bde0aa3457, ASSIGN in 359 msec 2023-02-15 20:01:29,667 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-15 20:01:29,667 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676491289667"}]},"ts":"1676491289667"} 2023-02-15 20:01:29,668 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-02-15 20:01:29,672 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-02-15 20:01:29,673 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 397 msec 2023-02-15 20:01:29,677 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:42195-0x1005992d9d30000, quorum=127.0.0.1:62883, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-02-15 20:01:29,679 DEBUG [Listener at localhost/46363-EventThread] zookeeper.ZKWatcher(600): master:42195-0x1005992d9d30000, quorum=127.0.0.1:62883, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-02-15 20:01:29,679 DEBUG [Listener at localhost/46363-EventThread] zookeeper.ZKWatcher(600): master:42195-0x1005992d9d30000, quorum=127.0.0.1:62883, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-15 20:01:29,685 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-02-15 20:01:29,693 DEBUG [Listener at localhost/46363-EventThread] zookeeper.ZKWatcher(600): master:42195-0x1005992d9d30000, quorum=127.0.0.1:62883, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-15 20:01:29,695 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 10 msec 2023-02-15 20:01:29,707 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-02-15 20:01:29,715 DEBUG [Listener at localhost/46363-EventThread] zookeeper.ZKWatcher(600): master:42195-0x1005992d9d30000, quorum=127.0.0.1:62883, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-15 20:01:29,718 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 10 msec 2023-02-15 20:01:29,732 DEBUG [Listener at localhost/46363-EventThread] zookeeper.ZKWatcher(600): master:42195-0x1005992d9d30000, quorum=127.0.0.1:62883, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-02-15 20:01:29,735 DEBUG [Listener at localhost/46363-EventThread] zookeeper.ZKWatcher(600): master:42195-0x1005992d9d30000, quorum=127.0.0.1:62883, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-02-15 20:01:29,736 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 1.011sec 2023-02-15 20:01:29,736 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-02-15 20:01:29,736 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-02-15 20:01:29,736 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-02-15 20:01:29,736 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,42195,1676491288611-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-02-15 20:01:29,736 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,42195,1676491288611-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-02-15 20:01:29,738 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-02-15 20:01:29,818 DEBUG [Listener at localhost/46363] zookeeper.ReadOnlyZKClient(139): Connect 0x785535ff to 127.0.0.1:62883 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-15 20:01:29,823 DEBUG [Listener at localhost/46363] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@71e7c016, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-15 20:01:29,825 DEBUG [hconnection-0x2d9cf438-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-15 20:01:29,827 INFO [RS-EventLoopGroup-11-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38986, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-15 20:01:29,829 INFO [Listener at localhost/46363] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,42195,1676491288611 2023-02-15 20:01:29,829 DEBUG [Listener at localhost/46363] mapreduce.TableSnapshotInputFormatTestBase(193): Ensuring table doesn't exist. 2023-02-15 20:01:29,831 DEBUG [Listener at localhost/46363] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-15 20:01:29,833 INFO [RS-EventLoopGroup-9-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44364, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-15 20:01:29,834 INFO [Listener at localhost/46363] client.HBaseAdmin$15(890): Started disable of testInitTableSnapshotMapperJobConfig 2023-02-15 20:01:29,834 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42195] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testInitTableSnapshotMapperJobConfig 2023-02-15 20:01:29,834 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42195] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.TableNotFoundException: testInitTableSnapshotMapperJobConfig at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.checkTableModifiable(AbstractStateMachineTableProcedure.java:125) at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.preflightChecks(AbstractStateMachineTableProcedure.java:157) at org.apache.hadoop.hbase.master.procedure.DisableTableProcedure.(DisableTableProcedure.java:78) at org.apache.hadoop.hbase.master.HMaster$11.run(HMaster.java:2429) at org.apache.hadoop.hbase.master.procedure.MasterProcedureUtil.submitProcedure(MasterProcedureUtil.java:132) at org.apache.hadoop.hbase.master.HMaster.disableTable(HMaster.java:2413) at org.apache.hadoop.hbase.master.MasterRpcServices.disableTable(MasterRpcServices.java:784) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-02-15 20:01:29,834 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42195] ipc.CallRunner(144): callId: 2 service: MasterService methodName: DisableTable size: 96 connection: 172.31.14.131:44364 deadline: 1676491349834, exception=org.apache.hadoop.hbase.TableNotFoundException: testInitTableSnapshotMapperJobConfig 2023-02-15 20:01:29,835 INFO [Listener at localhost/46363] mapreduce.TableSnapshotInputFormatTestBase(199): creating table 'testInitTableSnapshotMapperJobConfig' 2023-02-15 20:01:29,837 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42195] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testInitTableSnapshotMapperJobConfig', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-15 20:01:29,838 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42195] procedure2.ProcedureExecutor(1029): Stored pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testInitTableSnapshotMapperJobConfig 2023-02-15 20:01:29,840 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testInitTableSnapshotMapperJobConfig execute state=CREATE_TABLE_PRE_OPERATION 2023-02-15 20:01:29,840 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42195] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testInitTableSnapshotMapperJobConfig" procId is: 10 2023-02-15 20:01:29,840 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testInitTableSnapshotMapperJobConfig execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-15 20:01:29,841 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42195] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-15 20:01:29,842 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45455/user/jenkins/test-data/5744aa66-a2e1-6b80-327a-b86fd996b793/.tmp/data/default/testInitTableSnapshotMapperJobConfig/99181b6cd95ad247bd311d18199bc950 2023-02-15 20:01:29,843 DEBUG [HFileArchiver-5] backup.HFileArchiver(153): Directory hdfs://localhost:45455/user/jenkins/test-data/5744aa66-a2e1-6b80-327a-b86fd996b793/.tmp/data/default/testInitTableSnapshotMapperJobConfig/99181b6cd95ad247bd311d18199bc950 empty. 2023-02-15 20:01:29,843 DEBUG [HFileArchiver-5] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:45455/user/jenkins/test-data/5744aa66-a2e1-6b80-327a-b86fd996b793/.tmp/data/default/testInitTableSnapshotMapperJobConfig/99181b6cd95ad247bd311d18199bc950 2023-02-15 20:01:29,843 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testInitTableSnapshotMapperJobConfig regions 2023-02-15 20:01:29,852 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:45455/user/jenkins/test-data/5744aa66-a2e1-6b80-327a-b86fd996b793/.tmp/data/default/testInitTableSnapshotMapperJobConfig/.tabledesc/.tableinfo.0000000001 2023-02-15 20:01:29,853 INFO [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(7671): creating {ENCODED => 99181b6cd95ad247bd311d18199bc950, NAME => 'testInitTableSnapshotMapperJobConfig,,1676491289837.99181b6cd95ad247bd311d18199bc950.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testInitTableSnapshotMapperJobConfig', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:45455/user/jenkins/test-data/5744aa66-a2e1-6b80-327a-b86fd996b793/.tmp 2023-02-15 20:01:29,859 DEBUG [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(865): Instantiated testInitTableSnapshotMapperJobConfig,,1676491289837.99181b6cd95ad247bd311d18199bc950.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 20:01:29,859 DEBUG [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(1603): Closing 99181b6cd95ad247bd311d18199bc950, disabling compactions & flushes 2023-02-15 20:01:29,859 INFO [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(1625): Closing region testInitTableSnapshotMapperJobConfig,,1676491289837.99181b6cd95ad247bd311d18199bc950. 2023-02-15 20:01:29,859 DEBUG [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testInitTableSnapshotMapperJobConfig,,1676491289837.99181b6cd95ad247bd311d18199bc950. 2023-02-15 20:01:29,859 DEBUG [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(1713): Acquired close lock on testInitTableSnapshotMapperJobConfig,,1676491289837.99181b6cd95ad247bd311d18199bc950. after waiting 0 ms 2023-02-15 20:01:29,859 DEBUG [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(1723): Updates disabled for region testInitTableSnapshotMapperJobConfig,,1676491289837.99181b6cd95ad247bd311d18199bc950. 2023-02-15 20:01:29,859 INFO [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(1837): Closed testInitTableSnapshotMapperJobConfig,,1676491289837.99181b6cd95ad247bd311d18199bc950. 2023-02-15 20:01:29,859 DEBUG [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(1557): Region close journal for 99181b6cd95ad247bd311d18199bc950: 2023-02-15 20:01:29,862 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testInitTableSnapshotMapperJobConfig execute state=CREATE_TABLE_ADD_TO_META 2023-02-15 20:01:29,863 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testInitTableSnapshotMapperJobConfig,,1676491289837.99181b6cd95ad247bd311d18199bc950.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1676491289862"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676491289862"}]},"ts":"1676491289862"} 2023-02-15 20:01:29,864 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-15 20:01:29,865 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testInitTableSnapshotMapperJobConfig execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-15 20:01:29,865 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testInitTableSnapshotMapperJobConfig","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676491289865"}]},"ts":"1676491289865"} 2023-02-15 20:01:29,866 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testInitTableSnapshotMapperJobConfig, state=ENABLING in hbase:meta 2023-02-15 20:01:29,870 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-15 20:01:29,871 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-15 20:01:29,871 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-15 20:01:29,871 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-15 20:01:29,871 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testInitTableSnapshotMapperJobConfig, region=99181b6cd95ad247bd311d18199bc950, ASSIGN}] 2023-02-15 20:01:29,873 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testInitTableSnapshotMapperJobConfig, region=99181b6cd95ad247bd311d18199bc950, ASSIGN 2023-02-15 20:01:29,874 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testInitTableSnapshotMapperJobConfig, region=99181b6cd95ad247bd311d18199bc950, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,33923,1676491288661; forceNewPlan=false, retain=false 2023-02-15 20:01:29,943 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42195] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-15 20:01:30,011 INFO [RS:0;jenkins-hbase4:33923] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C33923%2C1676491288661, suffix=, logDir=hdfs://localhost:45455/user/jenkins/test-data/5744aa66-a2e1-6b80-327a-b86fd996b793/WALs/jenkins-hbase4.apache.org,33923,1676491288661, archiveDir=hdfs://localhost:45455/user/jenkins/test-data/5744aa66-a2e1-6b80-327a-b86fd996b793/oldWALs, maxLogs=32 2023-02-15 20:01:30,024 INFO [jenkins-hbase4:42195] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-15 20:01:30,025 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=99181b6cd95ad247bd311d18199bc950, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,33923,1676491288661 2023-02-15 20:01:30,025 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testInitTableSnapshotMapperJobConfig,,1676491289837.99181b6cd95ad247bd311d18199bc950.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1676491290025"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676491290025"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676491290025"}]},"ts":"1676491290025"} 2023-02-15 20:01:30,028 DEBUG [RS-EventLoopGroup-11-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33605,DS-b4d68521-58c4-4a0e-888f-ee78e4cf114b,DISK] 2023-02-15 20:01:30,028 DEBUG [RS-EventLoopGroup-11-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34369,DS-6fbedd74-acdc-44ea-ab5d-1ac04d536d17,DISK] 2023-02-15 20:01:30,029 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=12, ppid=11, state=RUNNABLE; OpenRegionProcedure 99181b6cd95ad247bd311d18199bc950, server=jenkins-hbase4.apache.org,33923,1676491288661}] 2023-02-15 20:01:30,030 INFO [RS:0;jenkins-hbase4:33923] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/5744aa66-a2e1-6b80-327a-b86fd996b793/WALs/jenkins-hbase4.apache.org,33923,1676491288661/jenkins-hbase4.apache.org%2C33923%2C1676491288661.1676491290011 2023-02-15 20:01:30,032 DEBUG [RS:0;jenkins-hbase4:33923] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:34369,DS-6fbedd74-acdc-44ea-ab5d-1ac04d536d17,DISK], DatanodeInfoWithStorage[127.0.0.1:33605,DS-b4d68521-58c4-4a0e-888f-ee78e4cf114b,DISK]] 2023-02-15 20:01:30,039 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-datanode.properties,hadoop-metrics2.properties 2023-02-15 20:01:30,144 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42195] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-15 20:01:30,182 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,33923,1676491288661 2023-02-15 20:01:30,182 DEBUG [RSProcedureDispatcher-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-15 20:01:30,184 INFO [RS-EventLoopGroup-10-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38608, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-15 20:01:30,188 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testInitTableSnapshotMapperJobConfig,,1676491289837.99181b6cd95ad247bd311d18199bc950. 2023-02-15 20:01:30,188 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 99181b6cd95ad247bd311d18199bc950, NAME => 'testInitTableSnapshotMapperJobConfig,,1676491289837.99181b6cd95ad247bd311d18199bc950.', STARTKEY => '', ENDKEY => ''} 2023-02-15 20:01:30,188 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testInitTableSnapshotMapperJobConfig 99181b6cd95ad247bd311d18199bc950 2023-02-15 20:01:30,188 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testInitTableSnapshotMapperJobConfig,,1676491289837.99181b6cd95ad247bd311d18199bc950.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 20:01:30,188 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 99181b6cd95ad247bd311d18199bc950 2023-02-15 20:01:30,188 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 99181b6cd95ad247bd311d18199bc950 2023-02-15 20:01:30,189 INFO [StoreOpener-99181b6cd95ad247bd311d18199bc950-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 99181b6cd95ad247bd311d18199bc950 2023-02-15 20:01:30,191 DEBUG [StoreOpener-99181b6cd95ad247bd311d18199bc950-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45455/user/jenkins/test-data/5744aa66-a2e1-6b80-327a-b86fd996b793/data/default/testInitTableSnapshotMapperJobConfig/99181b6cd95ad247bd311d18199bc950/f1 2023-02-15 20:01:30,191 DEBUG [StoreOpener-99181b6cd95ad247bd311d18199bc950-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45455/user/jenkins/test-data/5744aa66-a2e1-6b80-327a-b86fd996b793/data/default/testInitTableSnapshotMapperJobConfig/99181b6cd95ad247bd311d18199bc950/f1 2023-02-15 20:01:30,191 INFO [StoreOpener-99181b6cd95ad247bd311d18199bc950-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 99181b6cd95ad247bd311d18199bc950 columnFamilyName f1 2023-02-15 20:01:30,192 INFO [StoreOpener-99181b6cd95ad247bd311d18199bc950-1] regionserver.HStore(310): Store=99181b6cd95ad247bd311d18199bc950/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 20:01:30,192 INFO [StoreOpener-99181b6cd95ad247bd311d18199bc950-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 99181b6cd95ad247bd311d18199bc950 2023-02-15 20:01:30,193 DEBUG [StoreOpener-99181b6cd95ad247bd311d18199bc950-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45455/user/jenkins/test-data/5744aa66-a2e1-6b80-327a-b86fd996b793/data/default/testInitTableSnapshotMapperJobConfig/99181b6cd95ad247bd311d18199bc950/f2 2023-02-15 20:01:30,193 DEBUG [StoreOpener-99181b6cd95ad247bd311d18199bc950-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45455/user/jenkins/test-data/5744aa66-a2e1-6b80-327a-b86fd996b793/data/default/testInitTableSnapshotMapperJobConfig/99181b6cd95ad247bd311d18199bc950/f2 2023-02-15 20:01:30,193 INFO [StoreOpener-99181b6cd95ad247bd311d18199bc950-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 99181b6cd95ad247bd311d18199bc950 columnFamilyName f2 2023-02-15 20:01:30,193 INFO [StoreOpener-99181b6cd95ad247bd311d18199bc950-1] regionserver.HStore(310): Store=99181b6cd95ad247bd311d18199bc950/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 20:01:30,194 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:45455/user/jenkins/test-data/5744aa66-a2e1-6b80-327a-b86fd996b793/data/default/testInitTableSnapshotMapperJobConfig/99181b6cd95ad247bd311d18199bc950 2023-02-15 20:01:30,194 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:45455/user/jenkins/test-data/5744aa66-a2e1-6b80-327a-b86fd996b793/data/default/testInitTableSnapshotMapperJobConfig/99181b6cd95ad247bd311d18199bc950 2023-02-15 20:01:30,196 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testInitTableSnapshotMapperJobConfig descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-15 20:01:30,197 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 99181b6cd95ad247bd311d18199bc950 2023-02-15 20:01:30,200 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45455/user/jenkins/test-data/5744aa66-a2e1-6b80-327a-b86fd996b793/data/default/testInitTableSnapshotMapperJobConfig/99181b6cd95ad247bd311d18199bc950/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-15 20:01:30,200 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 99181b6cd95ad247bd311d18199bc950; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70634867, jitterRate=0.05254153907299042}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-15 20:01:30,200 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 99181b6cd95ad247bd311d18199bc950: 2023-02-15 20:01:30,201 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testInitTableSnapshotMapperJobConfig,,1676491289837.99181b6cd95ad247bd311d18199bc950., pid=12, masterSystemTime=1676491290182 2023-02-15 20:01:30,204 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testInitTableSnapshotMapperJobConfig,,1676491289837.99181b6cd95ad247bd311d18199bc950. 2023-02-15 20:01:30,205 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testInitTableSnapshotMapperJobConfig,,1676491289837.99181b6cd95ad247bd311d18199bc950. 2023-02-15 20:01:30,205 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=99181b6cd95ad247bd311d18199bc950, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,33923,1676491288661 2023-02-15 20:01:30,205 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testInitTableSnapshotMapperJobConfig,,1676491289837.99181b6cd95ad247bd311d18199bc950.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1676491290205"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676491290205"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676491290205"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676491290205"}]},"ts":"1676491290205"} 2023-02-15 20:01:30,208 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=12, resume processing ppid=11 2023-02-15 20:01:30,208 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=12, ppid=11, state=SUCCESS; OpenRegionProcedure 99181b6cd95ad247bd311d18199bc950, server=jenkins-hbase4.apache.org,33923,1676491288661 in 178 msec 2023-02-15 20:01:30,210 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-02-15 20:01:30,210 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testInitTableSnapshotMapperJobConfig, region=99181b6cd95ad247bd311d18199bc950, ASSIGN in 337 msec 2023-02-15 20:01:30,210 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testInitTableSnapshotMapperJobConfig execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-15 20:01:30,210 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testInitTableSnapshotMapperJobConfig","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676491290210"}]},"ts":"1676491290210"} 2023-02-15 20:01:30,212 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testInitTableSnapshotMapperJobConfig, state=ENABLED in hbase:meta 2023-02-15 20:01:30,214 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testInitTableSnapshotMapperJobConfig execute state=CREATE_TABLE_POST_OPERATION 2023-02-15 20:01:30,215 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=10, state=SUCCESS; CreateTableProcedure table=testInitTableSnapshotMapperJobConfig in 377 msec 2023-02-15 20:01:30,446 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42195] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-15 20:01:30,446 INFO [Listener at localhost/46363] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testInitTableSnapshotMapperJobConfig, procId: 10 completed 2023-02-15 20:01:30,447 DEBUG [Listener at localhost/46363] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testInitTableSnapshotMapperJobConfig get assigned. Timeout = 60000ms 2023-02-15 20:01:30,447 INFO [Listener at localhost/46363] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-15 20:01:30,449 INFO [Listener at localhost/46363] hbase.HBaseTestingUtility(3484): All regions for table testInitTableSnapshotMapperJobConfig assigned to meta. Checking AM states. 2023-02-15 20:01:30,449 INFO [Listener at localhost/46363] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-15 20:01:30,449 INFO [Listener at localhost/46363] hbase.HBaseTestingUtility(3504): All regions for table testInitTableSnapshotMapperJobConfig assigned. 2023-02-15 20:01:30,449 INFO [Listener at localhost/46363] mapreduce.TableSnapshotInputFormatTestBase(207): put some stuff in the table 2023-02-15 20:01:30,471 DEBUG [hconnection-0x2d9cf438-shared-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-15 20:01:30,493 INFO [RS-EventLoopGroup-10-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38616, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-15 20:01:30,500 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33923] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 17576 Client: jenkins//172.31.14.131 first region in multi=testInitTableSnapshotMapperJobConfig,,1676491289837.99181b6cd95ad247bd311d18199bc950. 2023-02-15 20:01:30,605 INFO [Listener at localhost/46363] mapreduce.TableSnapshotInputFormatTestBase(214): snapshot 2023-02-15 20:01:30,605 INFO [Listener at localhost/46363] snapshot.SnapshotTestingUtils(396): taking snapshot. 2023-02-15 20:01:30,606 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42195] master.MasterRpcServices(1580): Client=jenkins//172.31.14.131 snapshot request for:{ ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 } 2023-02-15 20:01:30,606 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42195] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1676491290606 (current time:1676491290606). 2023-02-15 20:01:30,606 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42195] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-02-15 20:01:30,607 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42195] zookeeper.ReadOnlyZKClient(139): Connect 0x1c4da9ad to 127.0.0.1:62883 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-15 20:01:30,612 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42195] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@365e9915, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-15 20:01:30,614 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42195] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-15 20:01:30,615 INFO [RS-EventLoopGroup-11-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38998, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-15 20:01:30,616 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42195] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1c4da9ad to 127.0.0.1:62883 2023-02-15 20:01:30,616 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42195] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-15 20:01:30,617 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42195] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-02-15 20:01:30,617 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42195] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 } 2023-02-15 20:01:30,619 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42195] procedure2.ProcedureExecutor(1029): Stored pid=13, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=EXCLUSIVE 2023-02-15 20:01:30,620 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=13, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=EXCLUSIVE 2023-02-15 20:01:30,621 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=13, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=EXCLUSIVE; timeout=600000, timestamp=1676491890620 2023-02-15 20:01:30,621 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42195] snapshot.SnapshotManager(653): Started snapshot: { ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 } 2023-02-15 20:01:30,621 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot foo C_M_SNAPSHOT_TABLE on table testInitTableSnapshotMapperJobConfig 2023-02-15 20:01:30,622 DEBUG [Listener at localhost/46363] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-02-15 20:01:30,623 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=13, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=EXCLUSIVE 2023-02-15 20:01:30,623 DEBUG [Listener at localhost/46363] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-02-15 20:01:30,623 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=14, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=SHARED 2023-02-15 20:01:30,624 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=13, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=EXCLUSIVE in 5 msec 2023-02-15 20:01:30,624 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=14, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=SHARED 2023-02-15 20:01:30,625 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=14, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=SHARED; timeout=600000, timestamp=1676491890625 2023-02-15 20:01:30,633 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure foo 2023-02-15 20:01:30,633 INFO [(jenkins-hbase4.apache.org,42195,1676491288611)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'foo' 2023-02-15 20:01:30,633 DEBUG [(jenkins-hbase4.apache.org,42195,1676491288611)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-15 20:01:30,634 DEBUG [(jenkins-hbase4.apache.org,42195,1676491288611)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'foo' starting 'acquire' 2023-02-15 20:01:30,634 DEBUG [(jenkins-hbase4.apache.org,42195,1676491288611)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'foo', kicking off acquire phase on members. 2023-02-15 20:01:30,635 DEBUG [(jenkins-hbase4.apache.org,42195,1676491288611)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42195-0x1005992d9d30000, quorum=127.0.0.1:62883, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/foo 2023-02-15 20:01:30,635 DEBUG [(jenkins-hbase4.apache.org,42195,1676491288611)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/foo 2023-02-15 20:01:30,636 DEBUG [Listener at localhost/46363-EventThread] zookeeper.ZKWatcher(600): regionserver:38559-0x1005992d9d30002, quorum=127.0.0.1:62883, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-15 20:01:30,636 DEBUG [(jenkins-hbase4.apache.org,42195,1676491288611)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,33923,1676491288661 2023-02-15 20:01:30,636 DEBUG [Listener at localhost/46363-EventThread] zookeeper.ZKWatcher(600): regionserver:33923-0x1005992d9d30001, quorum=127.0.0.1:62883, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-15 20:01:30,637 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-15 20:01:30,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-15 20:01:30,637 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-15 20:01:30,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-15 20:01:30,637 DEBUG [(jenkins-hbase4.apache.org,42195,1676491288611)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42195-0x1005992d9d30000, quorum=127.0.0.1:62883, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,33923,1676491288661 2023-02-15 20:01:30,637 DEBUG [(jenkins-hbase4.apache.org,42195,1676491288611)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-15 20:01:30,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/foo 2023-02-15 20:01:30,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/foo 2023-02-15 20:01:30,637 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38559-0x1005992d9d30002, quorum=127.0.0.1:62883, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/foo 2023-02-15 20:01:30,637 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33923-0x1005992d9d30001, quorum=127.0.0.1:62883, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/foo 2023-02-15 20:01:30,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 60 2023-02-15 20:01:30,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/foo 2023-02-15 20:01:30,638 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot foo from table testInitTableSnapshotMapperJobConfig type FLUSH 2023-02-15 20:01:30,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 60 2023-02-15 20:01:30,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/foo 2023-02-15 20:01:30,638 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot foo from table testInitTableSnapshotMapperJobConfig type FLUSH 2023-02-15 20:01:30,638 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:foo 2023-02-15 20:01:30,638 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:foo 2023-02-15 20:01:30,638 DEBUG [member: 'jenkins-hbase4.apache.org,38559,1676491288695' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'foo' with timeout 300000ms 2023-02-15 20:01:30,638 DEBUG [member: 'jenkins-hbase4.apache.org,38559,1676491288695' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-15 20:01:30,638 DEBUG [member: 'jenkins-hbase4.apache.org,33923,1676491288661' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'foo' with timeout 300000ms 2023-02-15 20:01:30,638 DEBUG [member: 'jenkins-hbase4.apache.org,33923,1676491288661' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-15 20:01:30,639 DEBUG [member: 'jenkins-hbase4.apache.org,38559,1676491288695' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'foo' starting 'acquire' stage 2023-02-15 20:01:30,639 DEBUG [member: 'jenkins-hbase4.apache.org,33923,1676491288661' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'foo' starting 'acquire' stage 2023-02-15 20:01:30,640 DEBUG [member: 'jenkins-hbase4.apache.org,33923,1676491288661' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'foo' locally acquired 2023-02-15 20:01:30,640 DEBUG [member: 'jenkins-hbase4.apache.org,33923,1676491288661' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33923,1676491288661' joining acquired barrier for procedure (foo) in zk 2023-02-15 20:01:30,640 DEBUG [member: 'jenkins-hbase4.apache.org,38559,1676491288695' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'foo' locally acquired 2023-02-15 20:01:30,640 DEBUG [member: 'jenkins-hbase4.apache.org,38559,1676491288695' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38559,1676491288695' joining acquired barrier for procedure (foo) in zk 2023-02-15 20:01:30,641 DEBUG [member: 'jenkins-hbase4.apache.org,33923,1676491288661' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/foo 2023-02-15 20:01:30,641 DEBUG [Listener at localhost/46363-EventThread] zookeeper.ZKWatcher(600): master:42195-0x1005992d9d30000, quorum=127.0.0.1:62883, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,33923,1676491288661 2023-02-15 20:01:30,641 DEBUG [member: 'jenkins-hbase4.apache.org,38559,1676491288695' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/foo 2023-02-15 20:01:30,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,33923,1676491288661 2023-02-15 20:01:30,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-15 20:01:30,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-15 20:01:30,641 DEBUG [member: 'jenkins-hbase4.apache.org,33923,1676491288661' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33923-0x1005992d9d30001, quorum=127.0.0.1:62883, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/foo 2023-02-15 20:01:30,641 DEBUG [member: 'jenkins-hbase4.apache.org,33923,1676491288661' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'foo' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-15 20:01:30,641 DEBUG [member: 'jenkins-hbase4.apache.org,38559,1676491288695' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38559-0x1005992d9d30002, quorum=127.0.0.1:62883, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/foo 2023-02-15 20:01:30,641 DEBUG [member: 'jenkins-hbase4.apache.org,38559,1676491288695' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'foo' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-15 20:01:30,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-15 20:01:30,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-15 20:01:30,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-15 20:01:30,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38559,1676491288695 2023-02-15 20:01:30,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33923,1676491288661 2023-02-15 20:01:30,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-15 20:01:30,643 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,33923,1676491288661' joining acquired barrier for procedure 'foo' on coordinator 2023-02-15 20:01:30,643 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@67ceca4e[Count = 0] remaining members to acquire global barrier 2023-02-15 20:01:30,643 DEBUG [(jenkins-hbase4.apache.org,42195,1676491288611)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'foo' starting 'in-barrier' execution. 2023-02-15 20:01:30,643 DEBUG [(jenkins-hbase4.apache.org,42195,1676491288611)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/foo 2023-02-15 20:01:30,644 DEBUG [Listener at localhost/46363-EventThread] zookeeper.ZKWatcher(600): regionserver:38559-0x1005992d9d30002, quorum=127.0.0.1:62883, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/foo 2023-02-15 20:01:30,644 DEBUG [Listener at localhost/46363-EventThread] zookeeper.ZKWatcher(600): regionserver:33923-0x1005992d9d30001, quorum=127.0.0.1:62883, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/foo 2023-02-15 20:01:30,644 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/foo 2023-02-15 20:01:30,644 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/foo 2023-02-15 20:01:30,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/foo 2023-02-15 20:01:30,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/foo 2023-02-15 20:01:30,645 DEBUG [(jenkins-hbase4.apache.org,42195,1676491288611)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42195-0x1005992d9d30000, quorum=127.0.0.1:62883, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,33923,1676491288661 2023-02-15 20:01:30,645 DEBUG [(jenkins-hbase4.apache.org,42195,1676491288611)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-15 20:01:30,645 DEBUG [member: 'jenkins-hbase4.apache.org,33923,1676491288661' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'foo' received 'reached' from coordinator. 2023-02-15 20:01:30,645 DEBUG [member: 'jenkins-hbase4.apache.org,33923,1676491288661' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-02-15 20:01:30,645 DEBUG [member: 'jenkins-hbase4.apache.org,33923,1676491288661' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-15 20:01:30,645 DEBUG [rs(jenkins-hbase4.apache.org,33923,1676491288661)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testInitTableSnapshotMapperJobConfig,,1676491289837.99181b6cd95ad247bd311d18199bc950. 2023-02-15 20:01:30,645 DEBUG [rs(jenkins-hbase4.apache.org,33923,1676491288661)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testInitTableSnapshotMapperJobConfig,,1676491289837.99181b6cd95ad247bd311d18199bc950. started... 2023-02-15 20:01:30,645 DEBUG [member: 'jenkins-hbase4.apache.org,38559,1676491288695' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'foo' received 'reached' from coordinator. 2023-02-15 20:01:30,646 INFO [rs(jenkins-hbase4.apache.org,33923,1676491288661)-snapshot-pool-0] regionserver.HRegion(2744): Flushing 99181b6cd95ad247bd311d18199bc950 2/2 column families, dataSize=1.01 MB heapSize=3.49 MB 2023-02-15 20:01:30,646 DEBUG [member: 'jenkins-hbase4.apache.org,38559,1676491288695' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'foo' locally completed 2023-02-15 20:01:30,646 DEBUG [member: 'jenkins-hbase4.apache.org,38559,1676491288695' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'foo' completed for member 'jenkins-hbase4.apache.org,38559,1676491288695' in zk 2023-02-15 20:01:30,647 DEBUG [member: 'jenkins-hbase4.apache.org,38559,1676491288695' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'foo' has notified controller of completion 2023-02-15 20:01:30,647 DEBUG [member: 'jenkins-hbase4.apache.org,38559,1676491288695' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-15 20:01:30,647 DEBUG [member: 'jenkins-hbase4.apache.org,38559,1676491288695' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'foo' completed. 2023-02-15 20:01:30,661 INFO [rs(jenkins-hbase4.apache.org,33923,1676491288661)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=514.92 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:45455/user/jenkins/test-data/5744aa66-a2e1-6b80-327a-b86fd996b793/data/default/testInitTableSnapshotMapperJobConfig/99181b6cd95ad247bd311d18199bc950/.tmp/f1/447b0d2603b64c1897600c37a2439183 2023-02-15 20:01:30,679 INFO [rs(jenkins-hbase4.apache.org,33923,1676491288661)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=514.92 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:45455/user/jenkins/test-data/5744aa66-a2e1-6b80-327a-b86fd996b793/data/default/testInitTableSnapshotMapperJobConfig/99181b6cd95ad247bd311d18199bc950/.tmp/f2/88dcc96416d2454d848c6e522bba6e7e 2023-02-15 20:01:30,684 DEBUG [rs(jenkins-hbase4.apache.org,33923,1676491288661)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45455/user/jenkins/test-data/5744aa66-a2e1-6b80-327a-b86fd996b793/data/default/testInitTableSnapshotMapperJobConfig/99181b6cd95ad247bd311d18199bc950/.tmp/f1/447b0d2603b64c1897600c37a2439183 as hdfs://localhost:45455/user/jenkins/test-data/5744aa66-a2e1-6b80-327a-b86fd996b793/data/default/testInitTableSnapshotMapperJobConfig/99181b6cd95ad247bd311d18199bc950/f1/447b0d2603b64c1897600c37a2439183 2023-02-15 20:01:30,688 INFO [rs(jenkins-hbase4.apache.org,33923,1676491288661)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45455/user/jenkins/test-data/5744aa66-a2e1-6b80-327a-b86fd996b793/data/default/testInitTableSnapshotMapperJobConfig/99181b6cd95ad247bd311d18199bc950/f1/447b0d2603b64c1897600c37a2439183, entries=17576, sequenceid=5, filesize=537.3 K 2023-02-15 20:01:30,689 DEBUG [rs(jenkins-hbase4.apache.org,33923,1676491288661)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45455/user/jenkins/test-data/5744aa66-a2e1-6b80-327a-b86fd996b793/data/default/testInitTableSnapshotMapperJobConfig/99181b6cd95ad247bd311d18199bc950/.tmp/f2/88dcc96416d2454d848c6e522bba6e7e as hdfs://localhost:45455/user/jenkins/test-data/5744aa66-a2e1-6b80-327a-b86fd996b793/data/default/testInitTableSnapshotMapperJobConfig/99181b6cd95ad247bd311d18199bc950/f2/88dcc96416d2454d848c6e522bba6e7e 2023-02-15 20:01:30,694 INFO [rs(jenkins-hbase4.apache.org,33923,1676491288661)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45455/user/jenkins/test-data/5744aa66-a2e1-6b80-327a-b86fd996b793/data/default/testInitTableSnapshotMapperJobConfig/99181b6cd95ad247bd311d18199bc950/f2/88dcc96416d2454d848c6e522bba6e7e, entries=17576, sequenceid=5, filesize=537.3 K 2023-02-15 20:01:30,695 INFO [rs(jenkins-hbase4.apache.org,33923,1676491288661)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~1.01 MB/1054560, heapSize ~3.49 MB/3656288, currentSize=0 B/0 for 99181b6cd95ad247bd311d18199bc950 in 50ms, sequenceid=5, compaction requested=false 2023-02-15 20:01:30,695 DEBUG [rs(jenkins-hbase4.apache.org,33923,1676491288661)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testInitTableSnapshotMapperJobConfig' 2023-02-15 20:01:30,695 DEBUG [rs(jenkins-hbase4.apache.org,33923,1676491288661)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 99181b6cd95ad247bd311d18199bc950: 2023-02-15 20:01:30,695 DEBUG [rs(jenkins-hbase4.apache.org,33923,1676491288661)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testInitTableSnapshotMapperJobConfig,,1676491289837.99181b6cd95ad247bd311d18199bc950.' region-info for snapshot=foo 2023-02-15 20:01:30,695 DEBUG [rs(jenkins-hbase4.apache.org,33923,1676491288661)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-15 20:01:30,696 DEBUG [rs(jenkins-hbase4.apache.org,33923,1676491288661)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:45455/user/jenkins/test-data/5744aa66-a2e1-6b80-327a-b86fd996b793/data/default/testInitTableSnapshotMapperJobConfig/99181b6cd95ad247bd311d18199bc950/f1/447b0d2603b64c1897600c37a2439183] hfiles 2023-02-15 20:01:30,696 DEBUG [rs(jenkins-hbase4.apache.org,33923,1676491288661)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:45455/user/jenkins/test-data/5744aa66-a2e1-6b80-327a-b86fd996b793/data/default/testInitTableSnapshotMapperJobConfig/99181b6cd95ad247bd311d18199bc950/f1/447b0d2603b64c1897600c37a2439183 for snapshot=foo 2023-02-15 20:01:30,696 DEBUG [rs(jenkins-hbase4.apache.org,33923,1676491288661)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:45455/user/jenkins/test-data/5744aa66-a2e1-6b80-327a-b86fd996b793/data/default/testInitTableSnapshotMapperJobConfig/99181b6cd95ad247bd311d18199bc950/f2/88dcc96416d2454d848c6e522bba6e7e] hfiles 2023-02-15 20:01:30,696 DEBUG [rs(jenkins-hbase4.apache.org,33923,1676491288661)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:45455/user/jenkins/test-data/5744aa66-a2e1-6b80-327a-b86fd996b793/data/default/testInitTableSnapshotMapperJobConfig/99181b6cd95ad247bd311d18199bc950/f2/88dcc96416d2454d848c6e522bba6e7e for snapshot=foo 2023-02-15 20:01:30,706 DEBUG [rs(jenkins-hbase4.apache.org,33923,1676491288661)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testInitTableSnapshotMapperJobConfig,,1676491289837.99181b6cd95ad247bd311d18199bc950. completed. 2023-02-15 20:01:30,706 DEBUG [rs(jenkins-hbase4.apache.org,33923,1676491288661)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testInitTableSnapshotMapperJobConfig,,1676491289837.99181b6cd95ad247bd311d18199bc950. 2023-02-15 20:01:30,706 DEBUG [member: 'jenkins-hbase4.apache.org,33923,1676491288661' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-02-15 20:01:30,706 DEBUG [member: 'jenkins-hbase4.apache.org,33923,1676491288661' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-02-15 20:01:30,706 DEBUG [member: 'jenkins-hbase4.apache.org,33923,1676491288661' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,33923,1676491288661 2023-02-15 20:01:30,706 DEBUG [member: 'jenkins-hbase4.apache.org,33923,1676491288661' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'foo' locally completed 2023-02-15 20:01:30,707 DEBUG [member: 'jenkins-hbase4.apache.org,33923,1676491288661' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'foo' completed for member 'jenkins-hbase4.apache.org,33923,1676491288661' in zk 2023-02-15 20:01:30,710 DEBUG [Listener at localhost/46363-EventThread] zookeeper.ZKWatcher(600): master:42195-0x1005992d9d30000, quorum=127.0.0.1:62883, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,33923,1676491288661 2023-02-15 20:01:30,710 DEBUG [member: 'jenkins-hbase4.apache.org,33923,1676491288661' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'foo' has notified controller of completion 2023-02-15 20:01:30,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,33923,1676491288661 2023-02-15 20:01:30,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-15 20:01:30,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-15 20:01:30,710 DEBUG [member: 'jenkins-hbase4.apache.org,33923,1676491288661' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-15 20:01:30,710 DEBUG [member: 'jenkins-hbase4.apache.org,33923,1676491288661' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'foo' completed. 2023-02-15 20:01:30,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-15 20:01:30,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-15 20:01:30,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-15 20:01:30,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38559,1676491288695 2023-02-15 20:01:30,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33923,1676491288661 2023-02-15 20:01:30,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-15 20:01:30,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-15 20:01:30,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38559,1676491288695 2023-02-15 20:01:30,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33923,1676491288661 2023-02-15 20:01:30,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'foo' member 'jenkins-hbase4.apache.org,33923,1676491288661': 2023-02-15 20:01:30,714 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,33923,1676491288661' released barrier for procedure'foo', counting down latch. Waiting for 0 more 2023-02-15 20:01:30,714 INFO [(jenkins-hbase4.apache.org,42195,1676491288611)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'foo' execution completed 2023-02-15 20:01:30,714 DEBUG [(jenkins-hbase4.apache.org,42195,1676491288611)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-15 20:01:30,714 DEBUG [(jenkins-hbase4.apache.org,42195,1676491288611)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-15 20:01:30,714 DEBUG [(jenkins-hbase4.apache.org,42195,1676491288611)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:foo 2023-02-15 20:01:30,715 INFO [(jenkins-hbase4.apache.org,42195,1676491288611)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure fooincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-02-15 20:01:30,717 DEBUG [Listener at localhost/46363-EventThread] zookeeper.ZKWatcher(600): regionserver:38559-0x1005992d9d30002, quorum=127.0.0.1:62883, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/foo 2023-02-15 20:01:30,717 DEBUG [Listener at localhost/46363-EventThread] zookeeper.ZKWatcher(600): master:42195-0x1005992d9d30000, quorum=127.0.0.1:62883, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/foo 2023-02-15 20:01:30,717 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/foo 2023-02-15 20:01:30,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/foo 2023-02-15 20:01:30,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-15 20:01:30,717 DEBUG [Listener at localhost/46363-EventThread] zookeeper.ZKWatcher(600): regionserver:33923-0x1005992d9d30001, quorum=127.0.0.1:62883, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/foo 2023-02-15 20:01:30,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-15 20:01:30,717 DEBUG [Listener at localhost/46363-EventThread] zookeeper.ZKWatcher(600): regionserver:38559-0x1005992d9d30002, quorum=127.0.0.1:62883, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-15 20:01:30,717 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/foo 2023-02-15 20:01:30,717 DEBUG [Listener at localhost/46363-EventThread] zookeeper.ZKWatcher(600): regionserver:33923-0x1005992d9d30001, quorum=127.0.0.1:62883, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-15 20:01:30,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/foo 2023-02-15 20:01:30,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/foo 2023-02-15 20:01:30,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-15 20:01:30,717 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-15 20:01:30,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-15 20:01:30,717 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-15 20:01:30,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-15 20:01:30,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/foo 2023-02-15 20:01:30,718 DEBUG [(jenkins-hbase4.apache.org,42195,1676491288611)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42195-0x1005992d9d30000, quorum=127.0.0.1:62883, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,38559,1676491288695 2023-02-15 20:01:30,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-15 20:01:30,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/foo 2023-02-15 20:01:30,718 DEBUG [(jenkins-hbase4.apache.org,42195,1676491288611)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42195-0x1005992d9d30000, quorum=127.0.0.1:62883, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,33923,1676491288661 2023-02-15 20:01:30,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-15 20:01:30,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-15 20:01:30,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38559,1676491288695 2023-02-15 20:01:30,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33923,1676491288661 2023-02-15 20:01:30,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-15 20:01:30,721 DEBUG [(jenkins-hbase4.apache.org,42195,1676491288611)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42195-0x1005992d9d30000, quorum=127.0.0.1:62883, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,38559,1676491288695 2023-02-15 20:01:30,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-15 20:01:30,722 DEBUG [(jenkins-hbase4.apache.org,42195,1676491288611)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42195-0x1005992d9d30000, quorum=127.0.0.1:62883, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,33923,1676491288661 2023-02-15 20:01:30,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38559,1676491288695 2023-02-15 20:01:30,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33923,1676491288661 2023-02-15 20:01:30,723 DEBUG [Listener at localhost/46363] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-15 20:01:30,724 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42195] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 } is done 2023-02-15 20:01:30,724 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42195] snapshot.SnapshotManager(404): Snapshoting '{ ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 }' is still in progress! 2023-02-15 20:01:30,725 DEBUG [Listener at localhost/46363] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-02-15 20:01:30,727 DEBUG [Listener at localhost/46363-EventThread] zookeeper.ZKWatcher(600): master:42195-0x1005992d9d30000, quorum=127.0.0.1:62883, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,33923,1676491288661 2023-02-15 20:01:30,727 DEBUG [Listener at localhost/46363-EventThread] zookeeper.ZKWatcher(600): regionserver:38559-0x1005992d9d30002, quorum=127.0.0.1:62883, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-15 20:01:30,727 DEBUG [Listener at localhost/46363-EventThread] zookeeper.ZKWatcher(600): regionserver:33923-0x1005992d9d30001, quorum=127.0.0.1:62883, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-15 20:01:30,727 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-15 20:01:30,727 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-15 20:01:30,727 DEBUG [Listener at localhost/46363-EventThread] zookeeper.ZKWatcher(600): master:42195-0x1005992d9d30000, quorum=127.0.0.1:62883, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo 2023-02-15 20:01:30,727 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for foo 2023-02-15 20:01:30,727 DEBUG [Listener at localhost/46363-EventThread] zookeeper.ZKWatcher(600): master:42195-0x1005992d9d30000, quorum=127.0.0.1:62883, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,38559,1676491288695 2023-02-15 20:01:30,727 DEBUG [(jenkins-hbase4.apache.org,42195,1676491288611)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-15 20:01:30,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-15 20:01:30,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-15 20:01:30,727 DEBUG [Listener at localhost/46363-EventThread] zookeeper.ZKWatcher(600): regionserver:33923-0x1005992d9d30001, quorum=127.0.0.1:62883, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-15 20:01:30,727 DEBUG [Listener at localhost/46363-EventThread] zookeeper.ZKWatcher(600): regionserver:38559-0x1005992d9d30002, quorum=127.0.0.1:62883, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-15 20:01:30,727 DEBUG [Listener at localhost/46363-EventThread] zookeeper.ZKWatcher(600): master:42195-0x1005992d9d30000, quorum=127.0.0.1:62883, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo 2023-02-15 20:01:30,727 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for foo 2023-02-15 20:01:30,729 DEBUG [Listener at localhost/46363-EventThread] zookeeper.ZKWatcher(600): master:42195-0x1005992d9d30000, quorum=127.0.0.1:62883, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,33923,1676491288661 2023-02-15 20:01:30,729 DEBUG [Listener at localhost/46363-EventThread] zookeeper.ZKWatcher(600): master:42195-0x1005992d9d30000, quorum=127.0.0.1:62883, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/foo 2023-02-15 20:01:30,729 DEBUG [Listener at localhost/46363-EventThread] zookeeper.ZKWatcher(600): master:42195-0x1005992d9d30000, quorum=127.0.0.1:62883, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,38559,1676491288695 2023-02-15 20:01:30,729 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-15 20:01:30,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-15 20:01:30,729 DEBUG [Listener at localhost/46363-EventThread] zookeeper.ZKWatcher(600): master:42195-0x1005992d9d30000, quorum=127.0.0.1:62883, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/foo 2023-02-15 20:01:30,729 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-15 20:01:30,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-15 20:01:30,729 DEBUG [Listener at localhost/46363-EventThread] zookeeper.ZKWatcher(600): master:42195-0x1005992d9d30000, quorum=127.0.0.1:62883, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/foo 2023-02-15 20:01:30,729 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:45455/user/jenkins/test-data/5744aa66-a2e1-6b80-327a-b86fd996b793/.hbase-snapshot/.tmp/foo 2023-02-15 20:01:30,746 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:45455/user/jenkins/test-data/5744aa66-a2e1-6b80-327a-b86fd996b793/.hbase-snapshot/.tmp/foo to hdfs://localhost:45455/user/jenkins/test-data/5744aa66-a2e1-6b80-327a-b86fd996b793/.hbase-snapshot/foo 2023-02-15 20:01:30,764 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot foo of table testInitTableSnapshotMapperJobConfig completed 2023-02-15 20:01:30,764 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:45455/user/jenkins/test-data/5744aa66-a2e1-6b80-327a-b86fd996b793/.hbase-snapshot/.tmp/foo 2023-02-15 20:01:30,764 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:45455/user/jenkins/test-data/5744aa66-a2e1-6b80-327a-b86fd996b793/.hbase-snapshot/.tmp/foo 2023-02-15 20:01:30,764 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot foo C_M_SNAPSHOT_TABLE on table testInitTableSnapshotMapperJobConfig at 1676491290621Consolidate snapshot: foo at 1676491290727 (+106 ms)Loading Region manifests for foo at 1676491290729 (+2 ms)Writing data manifest for foo at 1676491290732 (+3 ms)Verifying snapshot: foo at 1676491290739 (+7 ms)Snapshot foo of table testInitTableSnapshotMapperJobConfig completed at 1676491290764 (+25 ms) 2023-02-15 20:01:30,766 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=14, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=SHARED 2023-02-15 20:01:30,767 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=14, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=SHARED in 144 msec 2023-02-15 20:01:30,925 DEBUG [Listener at localhost/46363] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-15 20:01:30,926 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42195] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 } is done 2023-02-15 20:01:30,926 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42195] snapshot.SnapshotManager(401): Snapshot '{ ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 }' has completed, notifying client. 2023-02-15 20:01:30,927 INFO [Listener at localhost/46363] snapshot.SnapshotTestingUtils(399): Confirming snapshot exists. 2023-02-15 20:01:30,931 INFO [Listener at localhost/46363] snapshot.SnapshotTestingUtils(406): validating snapshot. 2023-02-15 20:01:30,937 INFO [Listener at localhost/46363] mapreduce.TableSnapshotInputFormatTestBase(218): load different values 2023-02-15 20:01:30,981 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33923] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 17576 Client: jenkins//172.31.14.131 first region in multi=testInitTableSnapshotMapperJobConfig,,1676491289837.99181b6cd95ad247bd311d18199bc950. 2023-02-15 20:01:31,086 INFO [Listener at localhost/46363] mapreduce.TableSnapshotInputFormatTestBase(222): cause flush to create new files in the region 2023-02-15 20:01:31,092 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42195] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-15 20:01:31,094 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42195] procedure.ProcedureCoordinator(165): Submitting procedure testInitTableSnapshotMapperJobConfig 2023-02-15 20:01:31,094 INFO [(jenkins-hbase4.apache.org,42195,1676491288611)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testInitTableSnapshotMapperJobConfig' 2023-02-15 20:01:31,094 DEBUG [(jenkins-hbase4.apache.org,42195,1676491288611)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-15 20:01:31,095 DEBUG [(jenkins-hbase4.apache.org,42195,1676491288611)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testInitTableSnapshotMapperJobConfig' starting 'acquire' 2023-02-15 20:01:31,095 DEBUG [(jenkins-hbase4.apache.org,42195,1676491288611)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testInitTableSnapshotMapperJobConfig', kicking off acquire phase on members. 2023-02-15 20:01:31,096 DEBUG [(jenkins-hbase4.apache.org,42195,1676491288611)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42195-0x1005992d9d30000, quorum=127.0.0.1:62883, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-15 20:01:31,096 DEBUG [(jenkins-hbase4.apache.org,42195,1676491288611)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig 2023-02-15 20:01:31,098 DEBUG [Listener at localhost/46363-EventThread] zookeeper.ZKWatcher(600): regionserver:38559-0x1005992d9d30002, quorum=127.0.0.1:62883, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-15 20:01:31,098 DEBUG [Listener at localhost/46363-EventThread] zookeeper.ZKWatcher(600): regionserver:33923-0x1005992d9d30001, quorum=127.0.0.1:62883, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-15 20:01:31,098 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-15 20:01:31,098 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-15 20:01:31,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-15 20:01:31,098 DEBUG [(jenkins-hbase4.apache.org,42195,1676491288611)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,33923,1676491288661 2023-02-15 20:01:31,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-15 20:01:31,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig 2023-02-15 20:01:31,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig 2023-02-15 20:01:31,098 DEBUG [(jenkins-hbase4.apache.org,42195,1676491288611)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42195-0x1005992d9d30000, quorum=127.0.0.1:62883, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,33923,1676491288661 2023-02-15 20:01:31,099 DEBUG [(jenkins-hbase4.apache.org,42195,1676491288611)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-15 20:01:31,099 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38559-0x1005992d9d30002, quorum=127.0.0.1:62883, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-15 20:01:31,099 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33923-0x1005992d9d30001, quorum=127.0.0.1:62883, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-15 20:01:31,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-15 20:01:31,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-15 20:01:31,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig 2023-02-15 20:01:31,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig 2023-02-15 20:01:31,099 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testInitTableSnapshotMapperJobConfig 2023-02-15 20:01:31,099 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testInitTableSnapshotMapperJobConfig 2023-02-15 20:01:31,104 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testInitTableSnapshotMapperJobConfig 2023-02-15 20:01:31,104 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testInitTableSnapshotMapperJobConfig 2023-02-15 20:01:31,108 DEBUG [member: 'jenkins-hbase4.apache.org,38559,1676491288695' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testInitTableSnapshotMapperJobConfig' with timeout 60000ms 2023-02-15 20:01:31,108 DEBUG [member: 'jenkins-hbase4.apache.org,38559,1676491288695' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-15 20:01:31,109 DEBUG [member: 'jenkins-hbase4.apache.org,38559,1676491288695' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testInitTableSnapshotMapperJobConfig' starting 'acquire' stage 2023-02-15 20:01:31,109 DEBUG [member: 'jenkins-hbase4.apache.org,33923,1676491288661' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testInitTableSnapshotMapperJobConfig' with timeout 60000ms 2023-02-15 20:01:31,109 DEBUG [member: 'jenkins-hbase4.apache.org,33923,1676491288661' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-15 20:01:31,109 DEBUG [member: 'jenkins-hbase4.apache.org,38559,1676491288695' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testInitTableSnapshotMapperJobConfig' locally acquired 2023-02-15 20:01:31,109 DEBUG [member: 'jenkins-hbase4.apache.org,38559,1676491288695' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38559,1676491288695' joining acquired barrier for procedure (testInitTableSnapshotMapperJobConfig) in zk 2023-02-15 20:01:31,110 DEBUG [member: 'jenkins-hbase4.apache.org,33923,1676491288661' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testInitTableSnapshotMapperJobConfig' starting 'acquire' stage 2023-02-15 20:01:31,111 DEBUG [member: 'jenkins-hbase4.apache.org,38559,1676491288695' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-15 20:01:31,111 DEBUG [member: 'jenkins-hbase4.apache.org,33923,1676491288661' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-15 20:01:31,111 DEBUG [member: 'jenkins-hbase4.apache.org,33923,1676491288661' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-15 20:01:31,111 DEBUG [rs(jenkins-hbase4.apache.org,33923,1676491288661)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testInitTableSnapshotMapperJobConfig,,1676491289837.99181b6cd95ad247bd311d18199bc950. 2023-02-15 20:01:31,112 DEBUG [rs(jenkins-hbase4.apache.org,33923,1676491288661)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testInitTableSnapshotMapperJobConfig,,1676491289837.99181b6cd95ad247bd311d18199bc950. started... 2023-02-15 20:01:31,112 INFO [rs(jenkins-hbase4.apache.org,33923,1676491288661)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 99181b6cd95ad247bd311d18199bc950 2/2 column families, dataSize=1.58 MB heapSize=4.02 MB 2023-02-15 20:01:31,112 DEBUG [member: 'jenkins-hbase4.apache.org,38559,1676491288695' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38559-0x1005992d9d30002, quorum=127.0.0.1:62883, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-15 20:01:31,112 DEBUG [member: 'jenkins-hbase4.apache.org,38559,1676491288695' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testInitTableSnapshotMapperJobConfig' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-15 20:01:31,135 INFO [rs(jenkins-hbase4.apache.org,33923,1676491288661)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=806.71 KB at sequenceid=9 (bloomFilter=false), to=hdfs://localhost:45455/user/jenkins/test-data/5744aa66-a2e1-6b80-327a-b86fd996b793/data/default/testInitTableSnapshotMapperJobConfig/99181b6cd95ad247bd311d18199bc950/.tmp/f1/17394b5a3cf2405ba1dbcb9b5d5a5487 2023-02-15 20:01:31,155 INFO [rs(jenkins-hbase4.apache.org,33923,1676491288661)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=806.71 KB at sequenceid=9 (bloomFilter=false), to=hdfs://localhost:45455/user/jenkins/test-data/5744aa66-a2e1-6b80-327a-b86fd996b793/data/default/testInitTableSnapshotMapperJobConfig/99181b6cd95ad247bd311d18199bc950/.tmp/f2/f1f5e7c6b6614769b3f03994fbadb922 2023-02-15 20:01:31,160 DEBUG [rs(jenkins-hbase4.apache.org,33923,1676491288661)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45455/user/jenkins/test-data/5744aa66-a2e1-6b80-327a-b86fd996b793/data/default/testInitTableSnapshotMapperJobConfig/99181b6cd95ad247bd311d18199bc950/.tmp/f1/17394b5a3cf2405ba1dbcb9b5d5a5487 as hdfs://localhost:45455/user/jenkins/test-data/5744aa66-a2e1-6b80-327a-b86fd996b793/data/default/testInitTableSnapshotMapperJobConfig/99181b6cd95ad247bd311d18199bc950/f1/17394b5a3cf2405ba1dbcb9b5d5a5487 2023-02-15 20:01:31,164 INFO [rs(jenkins-hbase4.apache.org,33923,1676491288661)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45455/user/jenkins/test-data/5744aa66-a2e1-6b80-327a-b86fd996b793/data/default/testInitTableSnapshotMapperJobConfig/99181b6cd95ad247bd311d18199bc950/f1/17394b5a3cf2405ba1dbcb9b5d5a5487, entries=17576, sequenceid=9, filesize=829.4 K 2023-02-15 20:01:31,165 DEBUG [rs(jenkins-hbase4.apache.org,33923,1676491288661)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45455/user/jenkins/test-data/5744aa66-a2e1-6b80-327a-b86fd996b793/data/default/testInitTableSnapshotMapperJobConfig/99181b6cd95ad247bd311d18199bc950/.tmp/f2/f1f5e7c6b6614769b3f03994fbadb922 as hdfs://localhost:45455/user/jenkins/test-data/5744aa66-a2e1-6b80-327a-b86fd996b793/data/default/testInitTableSnapshotMapperJobConfig/99181b6cd95ad247bd311d18199bc950/f2/f1f5e7c6b6614769b3f03994fbadb922 2023-02-15 20:01:31,169 INFO [rs(jenkins-hbase4.apache.org,33923,1676491288661)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45455/user/jenkins/test-data/5744aa66-a2e1-6b80-327a-b86fd996b793/data/default/testInitTableSnapshotMapperJobConfig/99181b6cd95ad247bd311d18199bc950/f2/f1f5e7c6b6614769b3f03994fbadb922, entries=17576, sequenceid=9, filesize=829.4 K 2023-02-15 20:01:31,170 INFO [rs(jenkins-hbase4.apache.org,33923,1676491288661)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~1.58 MB/1652144, heapSize ~4.02 MB/4218720, currentSize=0 B/0 for 99181b6cd95ad247bd311d18199bc950 in 58ms, sequenceid=9, compaction requested=false 2023-02-15 20:01:31,171 DEBUG [rs(jenkins-hbase4.apache.org,33923,1676491288661)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 99181b6cd95ad247bd311d18199bc950: 2023-02-15 20:01:31,171 DEBUG [rs(jenkins-hbase4.apache.org,33923,1676491288661)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testInitTableSnapshotMapperJobConfig,,1676491289837.99181b6cd95ad247bd311d18199bc950. 2023-02-15 20:01:31,171 DEBUG [member: 'jenkins-hbase4.apache.org,33923,1676491288661' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-15 20:01:31,171 DEBUG [member: 'jenkins-hbase4.apache.org,33923,1676491288661' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-15 20:01:31,171 DEBUG [member: 'jenkins-hbase4.apache.org,33923,1676491288661' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,33923,1676491288661 2023-02-15 20:01:31,171 DEBUG [member: 'jenkins-hbase4.apache.org,33923,1676491288661' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testInitTableSnapshotMapperJobConfig' locally acquired 2023-02-15 20:01:31,171 DEBUG [member: 'jenkins-hbase4.apache.org,33923,1676491288661' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33923,1676491288661' joining acquired barrier for procedure (testInitTableSnapshotMapperJobConfig) in zk 2023-02-15 20:01:31,173 DEBUG [member: 'jenkins-hbase4.apache.org,33923,1676491288661' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-15 20:01:31,173 DEBUG [Listener at localhost/46363-EventThread] zookeeper.ZKWatcher(600): master:42195-0x1005992d9d30000, quorum=127.0.0.1:62883, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,33923,1676491288661 2023-02-15 20:01:31,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,33923,1676491288661 2023-02-15 20:01:31,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-15 20:01:31,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-15 20:01:31,173 DEBUG [member: 'jenkins-hbase4.apache.org,33923,1676491288661' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33923-0x1005992d9d30001, quorum=127.0.0.1:62883, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-15 20:01:31,173 DEBUG [member: 'jenkins-hbase4.apache.org,33923,1676491288661' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testInitTableSnapshotMapperJobConfig' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-15 20:01:31,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-15 20:01:31,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-15 20:01:31,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testInitTableSnapshotMapperJobConfig 2023-02-15 20:01:31,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38559,1676491288695 2023-02-15 20:01:31,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33923,1676491288661 2023-02-15 20:01:31,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-15 20:01:31,175 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,33923,1676491288661' joining acquired barrier for procedure 'testInitTableSnapshotMapperJobConfig' on coordinator 2023-02-15 20:01:31,175 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@63f1426f[Count = 0] remaining members to acquire global barrier 2023-02-15 20:01:31,175 DEBUG [(jenkins-hbase4.apache.org,42195,1676491288611)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testInitTableSnapshotMapperJobConfig' starting 'in-barrier' execution. 2023-02-15 20:01:31,175 DEBUG [(jenkins-hbase4.apache.org,42195,1676491288611)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-15 20:01:31,176 DEBUG [Listener at localhost/46363-EventThread] zookeeper.ZKWatcher(600): regionserver:33923-0x1005992d9d30001, quorum=127.0.0.1:62883, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-15 20:01:31,176 DEBUG [Listener at localhost/46363-EventThread] zookeeper.ZKWatcher(600): regionserver:38559-0x1005992d9d30002, quorum=127.0.0.1:62883, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-15 20:01:31,176 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-15 20:01:31,176 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-15 20:01:31,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-15 20:01:31,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-15 20:01:31,176 DEBUG [member: 'jenkins-hbase4.apache.org,33923,1676491288661' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testInitTableSnapshotMapperJobConfig' received 'reached' from coordinator. 2023-02-15 20:01:31,176 DEBUG [member: 'jenkins-hbase4.apache.org,38559,1676491288695' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testInitTableSnapshotMapperJobConfig' received 'reached' from coordinator. 2023-02-15 20:01:31,176 DEBUG [(jenkins-hbase4.apache.org,42195,1676491288611)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42195-0x1005992d9d30000, quorum=127.0.0.1:62883, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,33923,1676491288661 2023-02-15 20:01:31,176 DEBUG [(jenkins-hbase4.apache.org,42195,1676491288611)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-15 20:01:31,176 DEBUG [member: 'jenkins-hbase4.apache.org,38559,1676491288695' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testInitTableSnapshotMapperJobConfig' locally completed 2023-02-15 20:01:31,177 DEBUG [member: 'jenkins-hbase4.apache.org,38559,1676491288695' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testInitTableSnapshotMapperJobConfig' completed for member 'jenkins-hbase4.apache.org,38559,1676491288695' in zk 2023-02-15 20:01:31,176 DEBUG [member: 'jenkins-hbase4.apache.org,33923,1676491288661' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testInitTableSnapshotMapperJobConfig' locally completed 2023-02-15 20:01:31,177 DEBUG [member: 'jenkins-hbase4.apache.org,33923,1676491288661' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testInitTableSnapshotMapperJobConfig' completed for member 'jenkins-hbase4.apache.org,33923,1676491288661' in zk 2023-02-15 20:01:31,179 DEBUG [member: 'jenkins-hbase4.apache.org,38559,1676491288695' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testInitTableSnapshotMapperJobConfig' has notified controller of completion 2023-02-15 20:01:31,179 DEBUG [member: 'jenkins-hbase4.apache.org,38559,1676491288695' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-15 20:01:31,179 DEBUG [member: 'jenkins-hbase4.apache.org,38559,1676491288695' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testInitTableSnapshotMapperJobConfig' completed. 2023-02-15 20:01:31,180 DEBUG [Listener at localhost/46363-EventThread] zookeeper.ZKWatcher(600): master:42195-0x1005992d9d30000, quorum=127.0.0.1:62883, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,33923,1676491288661 2023-02-15 20:01:31,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,33923,1676491288661 2023-02-15 20:01:31,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-15 20:01:31,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-15 20:01:31,181 DEBUG [member: 'jenkins-hbase4.apache.org,33923,1676491288661' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testInitTableSnapshotMapperJobConfig' has notified controller of completion 2023-02-15 20:01:31,181 DEBUG [member: 'jenkins-hbase4.apache.org,33923,1676491288661' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-15 20:01:31,181 DEBUG [member: 'jenkins-hbase4.apache.org,33923,1676491288661' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testInitTableSnapshotMapperJobConfig' completed. 2023-02-15 20:01:31,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-15 20:01:31,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-15 20:01:31,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testInitTableSnapshotMapperJobConfig 2023-02-15 20:01:31,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38559,1676491288695 2023-02-15 20:01:31,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33923,1676491288661 2023-02-15 20:01:31,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-15 20:01:31,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testInitTableSnapshotMapperJobConfig 2023-02-15 20:01:31,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38559,1676491288695 2023-02-15 20:01:31,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33923,1676491288661 2023-02-15 20:01:31,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testInitTableSnapshotMapperJobConfig' member 'jenkins-hbase4.apache.org,33923,1676491288661': 2023-02-15 20:01:31,184 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,33923,1676491288661' released barrier for procedure'testInitTableSnapshotMapperJobConfig', counting down latch. Waiting for 0 more 2023-02-15 20:01:31,184 INFO [(jenkins-hbase4.apache.org,42195,1676491288611)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testInitTableSnapshotMapperJobConfig' execution completed 2023-02-15 20:01:31,184 DEBUG [(jenkins-hbase4.apache.org,42195,1676491288611)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-15 20:01:31,184 DEBUG [(jenkins-hbase4.apache.org,42195,1676491288611)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-15 20:01:31,184 DEBUG [(jenkins-hbase4.apache.org,42195,1676491288611)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testInitTableSnapshotMapperJobConfig 2023-02-15 20:01:31,184 INFO [(jenkins-hbase4.apache.org,42195,1676491288611)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testInitTableSnapshotMapperJobConfigincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-15 20:01:31,186 DEBUG [Listener at localhost/46363-EventThread] zookeeper.ZKWatcher(600): master:42195-0x1005992d9d30000, quorum=127.0.0.1:62883, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-15 20:01:31,186 DEBUG [Listener at localhost/46363-EventThread] zookeeper.ZKWatcher(600): regionserver:33923-0x1005992d9d30001, quorum=127.0.0.1:62883, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-15 20:01:31,186 DEBUG [Listener at localhost/46363-EventThread] zookeeper.ZKWatcher(600): regionserver:38559-0x1005992d9d30002, quorum=127.0.0.1:62883, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-15 20:01:31,186 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-15 20:01:31,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-15 20:01:31,186 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-15 20:01:31,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-15 20:01:31,186 DEBUG [Listener at localhost/46363-EventThread] zookeeper.ZKWatcher(600): regionserver:38559-0x1005992d9d30002, quorum=127.0.0.1:62883, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-15 20:01:31,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-15 20:01:31,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-15 20:01:31,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-15 20:01:31,186 DEBUG [Listener at localhost/46363-EventThread] zookeeper.ZKWatcher(600): regionserver:33923-0x1005992d9d30001, quorum=127.0.0.1:62883, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-15 20:01:31,186 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-15 20:01:31,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-15 20:01:31,186 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-15 20:01:31,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-15 20:01:31,186 DEBUG [(jenkins-hbase4.apache.org,42195,1676491288611)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42195-0x1005992d9d30000, quorum=127.0.0.1:62883, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,38559,1676491288695 2023-02-15 20:01:31,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-15 20:01:31,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-15 20:01:31,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-15 20:01:31,187 DEBUG [(jenkins-hbase4.apache.org,42195,1676491288611)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42195-0x1005992d9d30000, quorum=127.0.0.1:62883, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,33923,1676491288661 2023-02-15 20:01:31,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testInitTableSnapshotMapperJobConfig 2023-02-15 20:01:31,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-15 20:01:31,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testInitTableSnapshotMapperJobConfig 2023-02-15 20:01:31,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38559,1676491288695 2023-02-15 20:01:31,188 DEBUG [(jenkins-hbase4.apache.org,42195,1676491288611)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42195-0x1005992d9d30000, quorum=127.0.0.1:62883, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,38559,1676491288695 2023-02-15 20:01:31,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33923,1676491288661 2023-02-15 20:01:31,189 DEBUG [(jenkins-hbase4.apache.org,42195,1676491288611)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42195-0x1005992d9d30000, quorum=127.0.0.1:62883, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,33923,1676491288661 2023-02-15 20:01:31,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-15 20:01:31,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testInitTableSnapshotMapperJobConfig 2023-02-15 20:01:31,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38559,1676491288695 2023-02-15 20:01:31,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33923,1676491288661 2023-02-15 20:01:31,191 DEBUG [Listener at localhost/46363-EventThread] zookeeper.ZKWatcher(600): regionserver:33923-0x1005992d9d30001, quorum=127.0.0.1:62883, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-15 20:01:31,191 DEBUG [Listener at localhost/46363-EventThread] zookeeper.ZKWatcher(600): regionserver:33923-0x1005992d9d30001, quorum=127.0.0.1:62883, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-15 20:01:31,191 DEBUG [Listener at localhost/46363-EventThread] zookeeper.ZKWatcher(600): regionserver:38559-0x1005992d9d30002, quorum=127.0.0.1:62883, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-15 20:01:31,191 DEBUG [Listener at localhost/46363-EventThread] zookeeper.ZKWatcher(600): master:42195-0x1005992d9d30000, quorum=127.0.0.1:62883, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,33923,1676491288661 2023-02-15 20:01:31,191 DEBUG [(jenkins-hbase4.apache.org,42195,1676491288611)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-15 20:01:31,191 DEBUG [Listener at localhost/46363-EventThread] zookeeper.ZKWatcher(600): master:42195-0x1005992d9d30000, quorum=127.0.0.1:62883, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig 2023-02-15 20:01:31,191 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-15 20:01:31,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-15 20:01:31,191 DEBUG [Listener at localhost/46363-EventThread] zookeeper.ZKWatcher(600): regionserver:38559-0x1005992d9d30002, quorum=127.0.0.1:62883, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-15 20:01:31,191 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-15 20:01:31,191 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42195] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testInitTableSnapshotMapperJobConfig' 2023-02-15 20:01:31,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-15 20:01:31,191 DEBUG [Listener at localhost/46363-EventThread] zookeeper.ZKWatcher(600): master:42195-0x1005992d9d30000, quorum=127.0.0.1:62883, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,38559,1676491288695 2023-02-15 20:01:31,192 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-15 20:01:31,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-15 20:01:31,192 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42195] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-15 20:01:31,192 DEBUG [Listener at localhost/46363-EventThread] zookeeper.ZKWatcher(600): master:42195-0x1005992d9d30000, quorum=127.0.0.1:62883, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig 2023-02-15 20:01:31,193 DEBUG [Listener at localhost/46363-EventThread] zookeeper.ZKWatcher(600): master:42195-0x1005992d9d30000, quorum=127.0.0.1:62883, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,33923,1676491288661 2023-02-15 20:01:31,193 DEBUG [Listener at localhost/46363-EventThread] zookeeper.ZKWatcher(600): master:42195-0x1005992d9d30000, quorum=127.0.0.1:62883, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-15 20:01:31,193 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-15 20:01:31,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-15 20:01:31,193 DEBUG [Listener at localhost/46363-EventThread] zookeeper.ZKWatcher(600): master:42195-0x1005992d9d30000, quorum=127.0.0.1:62883, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,38559,1676491288695 2023-02-15 20:01:31,193 DEBUG [Listener at localhost/46363-EventThread] zookeeper.ZKWatcher(600): master:42195-0x1005992d9d30000, quorum=127.0.0.1:62883, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-15 20:01:31,193 DEBUG [Listener at localhost/46363-EventThread] zookeeper.ZKWatcher(600): master:42195-0x1005992d9d30000, quorum=127.0.0.1:62883, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-15 20:01:31,193 DEBUG [Listener at localhost/46363] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testInitTableSnapshotMapperJobConfig'' to complete. (max 20000 ms per retry) 2023-02-15 20:01:31,193 DEBUG [Listener at localhost/46363] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-15 20:01:31,293 DEBUG [Listener at localhost/46363] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-15 20:01:31,295 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42195] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-15 20:01:31,299 INFO [Listener at localhost/46363] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "foo" table: "testInitTableSnapshotMapperJobConfig" creation_time: 1676491290606 type: FLUSH version: 2 ttl: 0 2023-02-15 20:01:31,299 DEBUG [Listener at localhost/46363] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost:45455/user/jenkins/test-data/805b9efe-75a8-d613-28aa-b8ecd93bec51/foo/d897a8f6-e2df-4213-b3bc-e671a03deab3/data/default/testInitTableSnapshotMapperJobConfig 2023-02-15 20:01:31,300 INFO [Listener at localhost/46363] snapshot.RestoreSnapshotHelper(239): region to add: 99181b6cd95ad247bd311d18199bc950 2023-02-15 20:01:31,300 INFO [Listener at localhost/46363] snapshot.RestoreSnapshotHelper(585): clone region=99181b6cd95ad247bd311d18199bc950 as 99181b6cd95ad247bd311d18199bc950 in snapshot foo 2023-02-15 20:01:31,301 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(7671): creating {ENCODED => 99181b6cd95ad247bd311d18199bc950, NAME => 'testInitTableSnapshotMapperJobConfig,,1676491289837.99181b6cd95ad247bd311d18199bc950.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testInitTableSnapshotMapperJobConfig', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:45455/user/jenkins/test-data/805b9efe-75a8-d613-28aa-b8ecd93bec51/foo/d897a8f6-e2df-4213-b3bc-e671a03deab3 2023-02-15 20:01:31,310 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(865): Instantiated testInitTableSnapshotMapperJobConfig,,1676491289837.99181b6cd95ad247bd311d18199bc950.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 20:01:31,310 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 447b0d2603b64c1897600c37a2439183 from cloned region in snapshot foo to table=testInitTableSnapshotMapperJobConfig 2023-02-15 20:01:31,312 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 88dcc96416d2454d848c6e522bba6e7e from cloned region in snapshot foo to table=testInitTableSnapshotMapperJobConfig 2023-02-15 20:01:31,314 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1603): Closing 99181b6cd95ad247bd311d18199bc950, disabling compactions & flushes 2023-02-15 20:01:31,314 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1625): Closing region testInitTableSnapshotMapperJobConfig,,1676491289837.99181b6cd95ad247bd311d18199bc950. 2023-02-15 20:01:31,314 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testInitTableSnapshotMapperJobConfig,,1676491289837.99181b6cd95ad247bd311d18199bc950. 2023-02-15 20:01:31,314 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1713): Acquired close lock on testInitTableSnapshotMapperJobConfig,,1676491289837.99181b6cd95ad247bd311d18199bc950. after waiting 0 ms 2023-02-15 20:01:31,314 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1723): Updates disabled for region testInitTableSnapshotMapperJobConfig,,1676491289837.99181b6cd95ad247bd311d18199bc950. 2023-02-15 20:01:31,314 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1837): Closed testInitTableSnapshotMapperJobConfig,,1676491289837.99181b6cd95ad247bd311d18199bc950. 2023-02-15 20:01:31,314 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1557): Region close journal for 99181b6cd95ad247bd311d18199bc950: 2023-02-15 20:01:31,314 INFO [Listener at localhost/46363] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "foo" table: "testInitTableSnapshotMapperJobConfig" creation_time: 1676491290606 type: FLUSH version: 2 ttl: 0 2023-02-15 20:01:31,314 DEBUG [Listener at localhost/46363] snapshot.RestoreSnapshotHelper(832): Restored table dir:hdfs://localhost:45455/user/jenkins/test-data/805b9efe-75a8-d613-28aa-b8ecd93bec51/foo/d897a8f6-e2df-4213-b3bc-e671a03deab3 2023-02-15 20:01:31,314 DEBUG [Listener at localhost/46363] util.CommonFSUtils(682): File system contents for path hdfs://localhost:45455/user/jenkins/test-data/805b9efe-75a8-d613-28aa-b8ecd93bec51/foo/d897a8f6-e2df-4213-b3bc-e671a03deab3 2023-02-15 20:01:31,315 DEBUG [Listener at localhost/46363] util.CommonFSUtils(699): |-data/ 2023-02-15 20:01:31,315 DEBUG [Listener at localhost/46363] util.CommonFSUtils(699): |----default/ 2023-02-15 20:01:31,316 DEBUG [Listener at localhost/46363] util.CommonFSUtils(699): |-------testInitTableSnapshotMapperJobConfig/ 2023-02-15 20:01:31,316 DEBUG [Listener at localhost/46363] util.CommonFSUtils(699): |----------99181b6cd95ad247bd311d18199bc950/ 2023-02-15 20:01:31,316 DEBUG [Listener at localhost/46363] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-15 20:01:31,316 DEBUG [Listener at localhost/46363] util.CommonFSUtils(699): |-------------f1/ 2023-02-15 20:01:31,317 DEBUG [Listener at localhost/46363] util.CommonFSUtils(702): |----------------testInitTableSnapshotMapperJobConfig=99181b6cd95ad247bd311d18199bc950-447b0d2603b64c1897600c37a2439183 2023-02-15 20:01:31,317 DEBUG [Listener at localhost/46363] util.CommonFSUtils(699): |-------------f2/ 2023-02-15 20:01:31,317 DEBUG [Listener at localhost/46363] util.CommonFSUtils(702): |----------------testInitTableSnapshotMapperJobConfig=99181b6cd95ad247bd311d18199bc950-88dcc96416d2454d848c6e522bba6e7e 2023-02-15 20:01:31,318 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42195] master.MasterRpcServices(748): Client=jenkins//172.31.14.131 delete name: "foo" 2023-02-15 20:01:31,320 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42195] snapshot.SnapshotManager(333): Deleting snapshot: foo 2023-02-15 20:01:31,321 INFO [Listener at localhost/46363] client.HBaseAdmin$15(890): Started disable of testInitTableSnapshotMapperJobConfig 2023-02-15 20:01:31,321 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42195] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testInitTableSnapshotMapperJobConfig 2023-02-15 20:01:31,322 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42195] procedure2.ProcedureExecutor(1029): Stored pid=15, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testInitTableSnapshotMapperJobConfig 2023-02-15 20:01:31,325 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testInitTableSnapshotMapperJobConfig","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676491291325"}]},"ts":"1676491291325"} 2023-02-15 20:01:31,325 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42195] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-15 20:01:31,326 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testInitTableSnapshotMapperJobConfig, state=DISABLING in hbase:meta 2023-02-15 20:01:31,329 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testInitTableSnapshotMapperJobConfig to state=DISABLING 2023-02-15 20:01:31,329 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testInitTableSnapshotMapperJobConfig, region=99181b6cd95ad247bd311d18199bc950, UNASSIGN}] 2023-02-15 20:01:31,332 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testInitTableSnapshotMapperJobConfig, region=99181b6cd95ad247bd311d18199bc950, UNASSIGN 2023-02-15 20:01:31,333 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=99181b6cd95ad247bd311d18199bc950, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,33923,1676491288661 2023-02-15 20:01:31,333 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testInitTableSnapshotMapperJobConfig,,1676491289837.99181b6cd95ad247bd311d18199bc950.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1676491291332"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676491291332"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676491291332"}]},"ts":"1676491291332"} 2023-02-15 20:01:31,334 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=17, ppid=16, state=RUNNABLE; CloseRegionProcedure 99181b6cd95ad247bd311d18199bc950, server=jenkins-hbase4.apache.org,33923,1676491288661}] 2023-02-15 20:01:31,426 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42195] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-15 20:01:31,487 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 99181b6cd95ad247bd311d18199bc950 2023-02-15 20:01:31,487 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 99181b6cd95ad247bd311d18199bc950, disabling compactions & flushes 2023-02-15 20:01:31,487 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testInitTableSnapshotMapperJobConfig,,1676491289837.99181b6cd95ad247bd311d18199bc950. 2023-02-15 20:01:31,487 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testInitTableSnapshotMapperJobConfig,,1676491289837.99181b6cd95ad247bd311d18199bc950. 2023-02-15 20:01:31,487 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testInitTableSnapshotMapperJobConfig,,1676491289837.99181b6cd95ad247bd311d18199bc950. after waiting 0 ms 2023-02-15 20:01:31,487 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testInitTableSnapshotMapperJobConfig,,1676491289837.99181b6cd95ad247bd311d18199bc950. 2023-02-15 20:01:31,491 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45455/user/jenkins/test-data/5744aa66-a2e1-6b80-327a-b86fd996b793/data/default/testInitTableSnapshotMapperJobConfig/99181b6cd95ad247bd311d18199bc950/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-15 20:01:31,492 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testInitTableSnapshotMapperJobConfig,,1676491289837.99181b6cd95ad247bd311d18199bc950. 2023-02-15 20:01:31,492 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 99181b6cd95ad247bd311d18199bc950: 2023-02-15 20:01:31,493 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 99181b6cd95ad247bd311d18199bc950 2023-02-15 20:01:31,493 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=99181b6cd95ad247bd311d18199bc950, regionState=CLOSED 2023-02-15 20:01:31,494 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testInitTableSnapshotMapperJobConfig,,1676491289837.99181b6cd95ad247bd311d18199bc950.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1676491291493"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676491291493"}]},"ts":"1676491291493"} 2023-02-15 20:01:31,496 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=17, resume processing ppid=16 2023-02-15 20:01:31,496 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=16, state=SUCCESS; CloseRegionProcedure 99181b6cd95ad247bd311d18199bc950, server=jenkins-hbase4.apache.org,33923,1676491288661 in 161 msec 2023-02-15 20:01:31,498 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=16, resume processing ppid=15 2023-02-15 20:01:31,498 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=15, state=SUCCESS; TransitRegionStateProcedure table=testInitTableSnapshotMapperJobConfig, region=99181b6cd95ad247bd311d18199bc950, UNASSIGN in 167 msec 2023-02-15 20:01:31,498 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testInitTableSnapshotMapperJobConfig","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676491291498"}]},"ts":"1676491291498"} 2023-02-15 20:01:31,500 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testInitTableSnapshotMapperJobConfig, state=DISABLED in hbase:meta 2023-02-15 20:01:31,501 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testInitTableSnapshotMapperJobConfig to state=DISABLED 2023-02-15 20:01:31,503 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=15, state=SUCCESS; DisableTableProcedure table=testInitTableSnapshotMapperJobConfig in 180 msec 2023-02-15 20:01:31,628 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42195] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-15 20:01:31,628 INFO [Listener at localhost/46363] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testInitTableSnapshotMapperJobConfig, procId: 15 completed 2023-02-15 20:01:31,629 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42195] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testInitTableSnapshotMapperJobConfig 2023-02-15 20:01:31,630 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42195] procedure2.ProcedureExecutor(1029): Stored pid=18, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testInitTableSnapshotMapperJobConfig 2023-02-15 20:01:31,632 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=18, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testInitTableSnapshotMapperJobConfig 2023-02-15 20:01:31,633 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=18, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testInitTableSnapshotMapperJobConfig 2023-02-15 20:01:31,633 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42195] master.MasterRpcServices(1227): Checking to see if procedure is done pid=18 2023-02-15 20:01:31,636 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45455/user/jenkins/test-data/5744aa66-a2e1-6b80-327a-b86fd996b793/.tmp/data/default/testInitTableSnapshotMapperJobConfig/99181b6cd95ad247bd311d18199bc950 2023-02-15 20:01:31,639 DEBUG [HFileArchiver-6] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:45455/user/jenkins/test-data/5744aa66-a2e1-6b80-327a-b86fd996b793/.tmp/data/default/testInitTableSnapshotMapperJobConfig/99181b6cd95ad247bd311d18199bc950/f1, FileablePath, hdfs://localhost:45455/user/jenkins/test-data/5744aa66-a2e1-6b80-327a-b86fd996b793/.tmp/data/default/testInitTableSnapshotMapperJobConfig/99181b6cd95ad247bd311d18199bc950/f2, FileablePath, hdfs://localhost:45455/user/jenkins/test-data/5744aa66-a2e1-6b80-327a-b86fd996b793/.tmp/data/default/testInitTableSnapshotMapperJobConfig/99181b6cd95ad247bd311d18199bc950/recovered.edits] 2023-02-15 20:01:31,642 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45455/user/jenkins/test-data/5744aa66-a2e1-6b80-327a-b86fd996b793/.tmp/data/default/testInitTableSnapshotMapperJobConfig/99181b6cd95ad247bd311d18199bc950/f1/17394b5a3cf2405ba1dbcb9b5d5a5487 to hdfs://localhost:45455/user/jenkins/test-data/5744aa66-a2e1-6b80-327a-b86fd996b793/archive/data/default/testInitTableSnapshotMapperJobConfig/99181b6cd95ad247bd311d18199bc950/f1/17394b5a3cf2405ba1dbcb9b5d5a5487 2023-02-15 20:01:31,644 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45455/user/jenkins/test-data/5744aa66-a2e1-6b80-327a-b86fd996b793/.tmp/data/default/testInitTableSnapshotMapperJobConfig/99181b6cd95ad247bd311d18199bc950/f1/447b0d2603b64c1897600c37a2439183 to hdfs://localhost:45455/user/jenkins/test-data/5744aa66-a2e1-6b80-327a-b86fd996b793/archive/data/default/testInitTableSnapshotMapperJobConfig/99181b6cd95ad247bd311d18199bc950/f1/447b0d2603b64c1897600c37a2439183 2023-02-15 20:01:31,646 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45455/user/jenkins/test-data/5744aa66-a2e1-6b80-327a-b86fd996b793/.tmp/data/default/testInitTableSnapshotMapperJobConfig/99181b6cd95ad247bd311d18199bc950/f2/88dcc96416d2454d848c6e522bba6e7e to hdfs://localhost:45455/user/jenkins/test-data/5744aa66-a2e1-6b80-327a-b86fd996b793/archive/data/default/testInitTableSnapshotMapperJobConfig/99181b6cd95ad247bd311d18199bc950/f2/88dcc96416d2454d848c6e522bba6e7e 2023-02-15 20:01:31,648 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45455/user/jenkins/test-data/5744aa66-a2e1-6b80-327a-b86fd996b793/.tmp/data/default/testInitTableSnapshotMapperJobConfig/99181b6cd95ad247bd311d18199bc950/f2/f1f5e7c6b6614769b3f03994fbadb922 to hdfs://localhost:45455/user/jenkins/test-data/5744aa66-a2e1-6b80-327a-b86fd996b793/archive/data/default/testInitTableSnapshotMapperJobConfig/99181b6cd95ad247bd311d18199bc950/f2/f1f5e7c6b6614769b3f03994fbadb922 2023-02-15 20:01:31,650 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45455/user/jenkins/test-data/5744aa66-a2e1-6b80-327a-b86fd996b793/.tmp/data/default/testInitTableSnapshotMapperJobConfig/99181b6cd95ad247bd311d18199bc950/recovered.edits/12.seqid to hdfs://localhost:45455/user/jenkins/test-data/5744aa66-a2e1-6b80-327a-b86fd996b793/archive/data/default/testInitTableSnapshotMapperJobConfig/99181b6cd95ad247bd311d18199bc950/recovered.edits/12.seqid 2023-02-15 20:01:31,651 DEBUG [HFileArchiver-6] backup.HFileArchiver(596): Deleted hdfs://localhost:45455/user/jenkins/test-data/5744aa66-a2e1-6b80-327a-b86fd996b793/.tmp/data/default/testInitTableSnapshotMapperJobConfig/99181b6cd95ad247bd311d18199bc950 2023-02-15 20:01:31,651 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testInitTableSnapshotMapperJobConfig regions 2023-02-15 20:01:31,653 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=18, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testInitTableSnapshotMapperJobConfig 2023-02-15 20:01:31,655 WARN [PEWorker-5] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testInitTableSnapshotMapperJobConfig from hbase:meta 2023-02-15 20:01:31,657 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(421): Removing 'testInitTableSnapshotMapperJobConfig' descriptor. 2023-02-15 20:01:31,658 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=18, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testInitTableSnapshotMapperJobConfig 2023-02-15 20:01:31,658 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(411): Removing 'testInitTableSnapshotMapperJobConfig' from region states. 2023-02-15 20:01:31,659 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testInitTableSnapshotMapperJobConfig,,1676491289837.99181b6cd95ad247bd311d18199bc950.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676491291658"}]},"ts":"9223372036854775807"} 2023-02-15 20:01:31,660 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-02-15 20:01:31,660 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 99181b6cd95ad247bd311d18199bc950, NAME => 'testInitTableSnapshotMapperJobConfig,,1676491289837.99181b6cd95ad247bd311d18199bc950.', STARTKEY => '', ENDKEY => ''}] 2023-02-15 20:01:31,660 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(415): Marking 'testInitTableSnapshotMapperJobConfig' as deleted. 2023-02-15 20:01:31,660 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testInitTableSnapshotMapperJobConfig","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1676491291660"}]},"ts":"9223372036854775807"} 2023-02-15 20:01:31,665 INFO [PEWorker-5] hbase.MetaTableAccessor(1658): Deleted table testInitTableSnapshotMapperJobConfig state from META 2023-02-15 20:01:31,667 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(130): Finished pid=18, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testInitTableSnapshotMapperJobConfig 2023-02-15 20:01:31,668 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=18, state=SUCCESS; DeleteTableProcedure table=testInitTableSnapshotMapperJobConfig in 38 msec 2023-02-15 20:01:31,735 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42195] master.MasterRpcServices(1227): Checking to see if procedure is done pid=18 2023-02-15 20:01:31,735 INFO [Listener at localhost/46363] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testInitTableSnapshotMapperJobConfig, procId: 18 completed 2023-02-15 20:01:31,735 INFO [Listener at localhost/46363] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-02-15 20:01:31,735 INFO [Listener at localhost/46363] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-15 20:01:31,736 DEBUG [Listener at localhost/46363] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x785535ff to 127.0.0.1:62883 2023-02-15 20:01:31,736 DEBUG [Listener at localhost/46363] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-15 20:01:31,736 DEBUG [Listener at localhost/46363] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-02-15 20:01:31,736 DEBUG [Listener at localhost/46363] util.JVMClusterUtil(257): Found active master hash=1233939068, stopped=false 2023-02-15 20:01:31,736 INFO [Listener at localhost/46363] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,42195,1676491288611 2023-02-15 20:01:31,739 DEBUG [Listener at localhost/46363-EventThread] zookeeper.ZKWatcher(600): regionserver:33923-0x1005992d9d30001, quorum=127.0.0.1:62883, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-15 20:01:31,739 DEBUG [Listener at localhost/46363-EventThread] zookeeper.ZKWatcher(600): regionserver:38559-0x1005992d9d30002, quorum=127.0.0.1:62883, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-15 20:01:31,739 DEBUG [Listener at localhost/46363-EventThread] zookeeper.ZKWatcher(600): master:42195-0x1005992d9d30000, quorum=127.0.0.1:62883, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-15 20:01:31,739 INFO [Listener at localhost/46363] procedure2.ProcedureExecutor(629): Stopping 2023-02-15 20:01:31,740 DEBUG [Listener at localhost/46363-EventThread] zookeeper.ZKWatcher(600): master:42195-0x1005992d9d30000, quorum=127.0.0.1:62883, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-15 20:01:31,740 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:42195-0x1005992d9d30000, quorum=127.0.0.1:62883, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-15 20:01:31,740 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33923-0x1005992d9d30001, quorum=127.0.0.1:62883, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-15 20:01:31,740 DEBUG [Listener at localhost/46363] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0fce61e8 to 127.0.0.1:62883 2023-02-15 20:01:31,740 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38559-0x1005992d9d30002, quorum=127.0.0.1:62883, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-15 20:01:31,740 DEBUG [Listener at localhost/46363] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-15 20:01:31,742 INFO [Listener at localhost/46363] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,33923,1676491288661' ***** 2023-02-15 20:01:31,742 INFO [Listener at localhost/46363] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-15 20:01:31,742 INFO [Listener at localhost/46363] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,38559,1676491288695' ***** 2023-02-15 20:01:31,742 INFO [Listener at localhost/46363] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-15 20:01:31,742 INFO [RS:0;jenkins-hbase4:33923] regionserver.HeapMemoryManager(220): Stopping 2023-02-15 20:01:31,742 INFO [RS:0;jenkins-hbase4:33923] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-15 20:01:31,742 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-15 20:01:31,742 INFO [RS:1;jenkins-hbase4:38559] regionserver.HeapMemoryManager(220): Stopping 2023-02-15 20:01:31,742 INFO [RS:0;jenkins-hbase4:33923] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-15 20:01:31,744 INFO [RS:0;jenkins-hbase4:33923] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,33923,1676491288661 2023-02-15 20:01:31,744 DEBUG [RS:0;jenkins-hbase4:33923] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x49fa2428 to 127.0.0.1:62883 2023-02-15 20:01:31,744 INFO [RS:1;jenkins-hbase4:38559] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-15 20:01:31,744 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-15 20:01:31,744 INFO [RS:1;jenkins-hbase4:38559] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-15 20:01:31,745 INFO [RS:1;jenkins-hbase4:38559] regionserver.HRegionServer(3304): Received CLOSE for 14d1dca7ea8b2ab6fcb300bde0aa3457 2023-02-15 20:01:31,744 DEBUG [RS:0;jenkins-hbase4:33923] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-15 20:01:31,745 INFO [RS:1;jenkins-hbase4:38559] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,38559,1676491288695 2023-02-15 20:01:31,745 INFO [RS:0;jenkins-hbase4:33923] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,33923,1676491288661; all regions closed. 2023-02-15 20:01:31,745 DEBUG [RS:1;jenkins-hbase4:38559] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x67d4494c to 127.0.0.1:62883 2023-02-15 20:01:31,746 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 14d1dca7ea8b2ab6fcb300bde0aa3457, disabling compactions & flushes 2023-02-15 20:01:31,746 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676491289275.14d1dca7ea8b2ab6fcb300bde0aa3457. 2023-02-15 20:01:31,746 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676491289275.14d1dca7ea8b2ab6fcb300bde0aa3457. 2023-02-15 20:01:31,746 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676491289275.14d1dca7ea8b2ab6fcb300bde0aa3457. after waiting 0 ms 2023-02-15 20:01:31,746 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676491289275.14d1dca7ea8b2ab6fcb300bde0aa3457. 2023-02-15 20:01:31,746 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 14d1dca7ea8b2ab6fcb300bde0aa3457 1/1 column families, dataSize=78 B heapSize=488 B 2023-02-15 20:01:31,746 DEBUG [RS:1;jenkins-hbase4:38559] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-15 20:01:31,746 INFO [RS:1;jenkins-hbase4:38559] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-15 20:01:31,746 INFO [RS:1;jenkins-hbase4:38559] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-15 20:01:31,746 INFO [RS:1;jenkins-hbase4:38559] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-15 20:01:31,746 INFO [RS:1;jenkins-hbase4:38559] regionserver.HRegionServer(3304): Received CLOSE for 1588230740 2023-02-15 20:01:31,747 INFO [RS:1;jenkins-hbase4:38559] regionserver.HRegionServer(1475): Waiting on 2 regions to close 2023-02-15 20:01:31,747 DEBUG [RS:1;jenkins-hbase4:38559] regionserver.HRegionServer(1479): Online Regions={1588230740=hbase:meta,,1.1588230740, 14d1dca7ea8b2ab6fcb300bde0aa3457=hbase:namespace,,1676491289275.14d1dca7ea8b2ab6fcb300bde0aa3457.} 2023-02-15 20:01:31,747 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-15 20:01:31,747 DEBUG [RS:1;jenkins-hbase4:38559] regionserver.HRegionServer(1505): Waiting on 14d1dca7ea8b2ab6fcb300bde0aa3457, 1588230740 2023-02-15 20:01:31,747 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-15 20:01:31,747 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-15 20:01:31,747 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-15 20:01:31,747 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-15 20:01:31,747 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 1588230740 3/3 column families, dataSize=4.24 KB heapSize=7.64 KB 2023-02-15 20:01:31,752 DEBUG [RS:0;jenkins-hbase4:33923] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/5744aa66-a2e1-6b80-327a-b86fd996b793/oldWALs 2023-02-15 20:01:31,752 INFO [RS:0;jenkins-hbase4:33923] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C33923%2C1676491288661:(num 1676491290011) 2023-02-15 20:01:31,753 DEBUG [RS:0;jenkins-hbase4:33923] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-15 20:01:31,753 INFO [RS:0;jenkins-hbase4:33923] regionserver.LeaseManager(133): Closed leases 2023-02-15 20:01:31,753 INFO [RS:0;jenkins-hbase4:33923] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-02-15 20:01:31,753 INFO [RS:0;jenkins-hbase4:33923] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-15 20:01:31,753 INFO [RS:0;jenkins-hbase4:33923] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-15 20:01:31,753 INFO [RS:0;jenkins-hbase4:33923] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-15 20:01:31,753 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-15 20:01:31,760 INFO [RS:0;jenkins-hbase4:33923] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:33923 2023-02-15 20:01:31,763 DEBUG [Listener at localhost/46363-EventThread] zookeeper.ZKWatcher(600): master:42195-0x1005992d9d30000, quorum=127.0.0.1:62883, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-15 20:01:31,763 DEBUG [Listener at localhost/46363-EventThread] zookeeper.ZKWatcher(600): regionserver:33923-0x1005992d9d30001, quorum=127.0.0.1:62883, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,33923,1676491288661 2023-02-15 20:01:31,763 ERROR [Listener at localhost/46363-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@590d7087 rejected from java.util.concurrent.ThreadPoolExecutor@5d32ef7e[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-15 20:01:31,763 DEBUG [Listener at localhost/46363-EventThread] zookeeper.ZKWatcher(600): regionserver:33923-0x1005992d9d30001, quorum=127.0.0.1:62883, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-15 20:01:31,763 ERROR [Listener at localhost/46363-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@1bd97740 rejected from java.util.concurrent.ThreadPoolExecutor@5d32ef7e[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-15 20:01:31,763 DEBUG [Listener at localhost/46363-EventThread] zookeeper.ZKWatcher(600): regionserver:38559-0x1005992d9d30002, quorum=127.0.0.1:62883, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,33923,1676491288661 2023-02-15 20:01:31,764 DEBUG [Listener at localhost/46363-EventThread] zookeeper.ZKWatcher(600): regionserver:38559-0x1005992d9d30002, quorum=127.0.0.1:62883, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-15 20:01:31,764 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,33923,1676491288661] 2023-02-15 20:01:31,764 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,33923,1676491288661; numProcessing=1 2023-02-15 20:01:31,766 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,33923,1676491288661 already deleted, retry=false 2023-02-15 20:01:31,766 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,33923,1676491288661 expired; onlineServers=1 2023-02-15 20:01:31,774 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:45455/user/jenkins/test-data/5744aa66-a2e1-6b80-327a-b86fd996b793/data/hbase/namespace/14d1dca7ea8b2ab6fcb300bde0aa3457/.tmp/info/7ede13494161430db767063a30c00698 2023-02-15 20:01:31,779 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45455/user/jenkins/test-data/5744aa66-a2e1-6b80-327a-b86fd996b793/data/hbase/namespace/14d1dca7ea8b2ab6fcb300bde0aa3457/.tmp/info/7ede13494161430db767063a30c00698 as hdfs://localhost:45455/user/jenkins/test-data/5744aa66-a2e1-6b80-327a-b86fd996b793/data/hbase/namespace/14d1dca7ea8b2ab6fcb300bde0aa3457/info/7ede13494161430db767063a30c00698 2023-02-15 20:01:31,783 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:45455/user/jenkins/test-data/5744aa66-a2e1-6b80-327a-b86fd996b793/data/hbase/namespace/14d1dca7ea8b2ab6fcb300bde0aa3457/info/7ede13494161430db767063a30c00698, entries=2, sequenceid=6, filesize=4.8 K 2023-02-15 20:01:31,784 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 14d1dca7ea8b2ab6fcb300bde0aa3457 in 38ms, sequenceid=6, compaction requested=false 2023-02-15 20:01:31,786 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-15 20:01:31,786 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-15 20:01:31,789 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45455/user/jenkins/test-data/5744aa66-a2e1-6b80-327a-b86fd996b793/data/hbase/namespace/14d1dca7ea8b2ab6fcb300bde0aa3457/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-02-15 20:01:31,790 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676491289275.14d1dca7ea8b2ab6fcb300bde0aa3457. 2023-02-15 20:01:31,790 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 14d1dca7ea8b2ab6fcb300bde0aa3457: 2023-02-15 20:01:31,790 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1676491289275.14d1dca7ea8b2ab6fcb300bde0aa3457. 2023-02-15 20:01:31,938 DEBUG [Listener at localhost/46363-EventThread] zookeeper.ZKWatcher(600): regionserver:33923-0x1005992d9d30001, quorum=127.0.0.1:62883, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-15 20:01:31,938 INFO [RS:0;jenkins-hbase4:33923] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,33923,1676491288661; zookeeper connection closed. 2023-02-15 20:01:31,938 ERROR [Listener at localhost/46363-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@63e1f6a9 rejected from java.util.concurrent.ThreadPoolExecutor@5d32ef7e[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-15 20:01:31,938 DEBUG [Listener at localhost/46363-EventThread] zookeeper.ZKWatcher(600): regionserver:33923-0x1005992d9d30001, quorum=127.0.0.1:62883, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-15 20:01:31,938 ERROR [Listener at localhost/46363-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@282c9ec7 rejected from java.util.concurrent.ThreadPoolExecutor@5d32ef7e[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-15 20:01:31,938 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@6aa13ee5] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@6aa13ee5 2023-02-15 20:01:31,947 DEBUG [RS:1;jenkins-hbase4:38559] regionserver.HRegionServer(1505): Waiting on 1588230740 2023-02-15 20:01:32,043 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-02-15 20:01:32,043 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-02-15 20:01:32,148 DEBUG [RS:1;jenkins-hbase4:38559] regionserver.HRegionServer(1505): Waiting on 1588230740 2023-02-15 20:01:32,175 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.60 KB at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:45455/user/jenkins/test-data/5744aa66-a2e1-6b80-327a-b86fd996b793/data/hbase/meta/1588230740/.tmp/info/8cd9991ce74b46cfad15e1fa6e4f2406 2023-02-15 20:01:32,181 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 8cd9991ce74b46cfad15e1fa6e4f2406 2023-02-15 20:01:32,191 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=116 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:45455/user/jenkins/test-data/5744aa66-a2e1-6b80-327a-b86fd996b793/data/hbase/meta/1588230740/.tmp/rep_barrier/03c6907d58df4176b505c585ebe65389 2023-02-15 20:01:32,195 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 03c6907d58df4176b505c585ebe65389 2023-02-15 20:01:32,202 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=542 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:45455/user/jenkins/test-data/5744aa66-a2e1-6b80-327a-b86fd996b793/data/hbase/meta/1588230740/.tmp/table/a734977a577345d9af9acf01bf4e78cc 2023-02-15 20:01:32,206 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for a734977a577345d9af9acf01bf4e78cc 2023-02-15 20:01:32,206 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45455/user/jenkins/test-data/5744aa66-a2e1-6b80-327a-b86fd996b793/data/hbase/meta/1588230740/.tmp/info/8cd9991ce74b46cfad15e1fa6e4f2406 as hdfs://localhost:45455/user/jenkins/test-data/5744aa66-a2e1-6b80-327a-b86fd996b793/data/hbase/meta/1588230740/info/8cd9991ce74b46cfad15e1fa6e4f2406 2023-02-15 20:01:32,211 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 8cd9991ce74b46cfad15e1fa6e4f2406 2023-02-15 20:01:32,211 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:45455/user/jenkins/test-data/5744aa66-a2e1-6b80-327a-b86fd996b793/data/hbase/meta/1588230740/info/8cd9991ce74b46cfad15e1fa6e4f2406, entries=12, sequenceid=21, filesize=6.3 K 2023-02-15 20:01:32,212 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45455/user/jenkins/test-data/5744aa66-a2e1-6b80-327a-b86fd996b793/data/hbase/meta/1588230740/.tmp/rep_barrier/03c6907d58df4176b505c585ebe65389 as hdfs://localhost:45455/user/jenkins/test-data/5744aa66-a2e1-6b80-327a-b86fd996b793/data/hbase/meta/1588230740/rep_barrier/03c6907d58df4176b505c585ebe65389 2023-02-15 20:01:32,216 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 03c6907d58df4176b505c585ebe65389 2023-02-15 20:01:32,217 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:45455/user/jenkins/test-data/5744aa66-a2e1-6b80-327a-b86fd996b793/data/hbase/meta/1588230740/rep_barrier/03c6907d58df4176b505c585ebe65389, entries=1, sequenceid=21, filesize=5.0 K 2023-02-15 20:01:32,217 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45455/user/jenkins/test-data/5744aa66-a2e1-6b80-327a-b86fd996b793/data/hbase/meta/1588230740/.tmp/table/a734977a577345d9af9acf01bf4e78cc as hdfs://localhost:45455/user/jenkins/test-data/5744aa66-a2e1-6b80-327a-b86fd996b793/data/hbase/meta/1588230740/table/a734977a577345d9af9acf01bf4e78cc 2023-02-15 20:01:32,221 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for a734977a577345d9af9acf01bf4e78cc 2023-02-15 20:01:32,221 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:45455/user/jenkins/test-data/5744aa66-a2e1-6b80-327a-b86fd996b793/data/hbase/meta/1588230740/table/a734977a577345d9af9acf01bf4e78cc, entries=4, sequenceid=21, filesize=5.1 K 2023-02-15 20:01:32,222 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~4.24 KB/4340, heapSize ~7.59 KB/7776, currentSize=0 B/0 for 1588230740 in 475ms, sequenceid=21, compaction requested=false 2023-02-15 20:01:32,226 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45455/user/jenkins/test-data/5744aa66-a2e1-6b80-327a-b86fd996b793/data/hbase/meta/1588230740/recovered.edits/24.seqid, newMaxSeqId=24, maxSeqId=1 2023-02-15 20:01:32,227 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-15 20:01:32,227 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-15 20:01:32,228 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 1588230740: 2023-02-15 20:01:32,228 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-02-15 20:01:32,348 INFO [RS:1;jenkins-hbase4:38559] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,38559,1676491288695; all regions closed. 2023-02-15 20:01:32,353 DEBUG [RS:1;jenkins-hbase4:38559] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/5744aa66-a2e1-6b80-327a-b86fd996b793/oldWALs 2023-02-15 20:01:32,353 INFO [RS:1;jenkins-hbase4:38559] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C38559%2C1676491288695.meta:.meta(num 1676491289221) 2023-02-15 20:01:32,358 DEBUG [RS:1;jenkins-hbase4:38559] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/5744aa66-a2e1-6b80-327a-b86fd996b793/oldWALs 2023-02-15 20:01:32,358 INFO [RS:1;jenkins-hbase4:38559] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C38559%2C1676491288695:(num 1676491289620) 2023-02-15 20:01:32,358 DEBUG [RS:1;jenkins-hbase4:38559] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-15 20:01:32,358 INFO [RS:1;jenkins-hbase4:38559] regionserver.LeaseManager(133): Closed leases 2023-02-15 20:01:32,358 INFO [RS:1;jenkins-hbase4:38559] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-02-15 20:01:32,358 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-15 20:01:32,359 INFO [RS:1;jenkins-hbase4:38559] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:38559 2023-02-15 20:01:32,360 DEBUG [Listener at localhost/46363-EventThread] zookeeper.ZKWatcher(600): regionserver:38559-0x1005992d9d30002, quorum=127.0.0.1:62883, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,38559,1676491288695 2023-02-15 20:01:32,361 DEBUG [Listener at localhost/46363-EventThread] zookeeper.ZKWatcher(600): master:42195-0x1005992d9d30000, quorum=127.0.0.1:62883, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-15 20:01:32,361 ERROR [Listener at localhost/46363-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@2f4ec171 rejected from java.util.concurrent.ThreadPoolExecutor@2b715040[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-15 20:01:32,362 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,38559,1676491288695] 2023-02-15 20:01:32,362 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,38559,1676491288695; numProcessing=2 2023-02-15 20:01:32,364 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,38559,1676491288695 already deleted, retry=false 2023-02-15 20:01:32,364 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,38559,1676491288695 expired; onlineServers=0 2023-02-15 20:01:32,364 INFO [RegionServerTracker-0] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,42195,1676491288611' ***** 2023-02-15 20:01:32,364 INFO [RegionServerTracker-0] regionserver.HRegionServer(2310): STOPPED: Cluster shutdown set; onlineServer=0 2023-02-15 20:01:32,364 DEBUG [M:0;jenkins-hbase4:42195] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4db3e795, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-15 20:01:32,364 INFO [M:0;jenkins-hbase4:42195] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,42195,1676491288611 2023-02-15 20:01:32,364 INFO [M:0;jenkins-hbase4:42195] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,42195,1676491288611; all regions closed. 2023-02-15 20:01:32,364 DEBUG [M:0;jenkins-hbase4:42195] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-15 20:01:32,365 DEBUG [M:0;jenkins-hbase4:42195] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-02-15 20:01:32,365 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-02-15 20:01:32,365 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676491288860] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676491288860,5,FailOnTimeoutGroup] 2023-02-15 20:01:32,365 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676491288860] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676491288860,5,FailOnTimeoutGroup] 2023-02-15 20:01:32,365 DEBUG [M:0;jenkins-hbase4:42195] cleaner.HFileCleaner(317): Stopping file delete threads 2023-02-15 20:01:32,366 INFO [M:0;jenkins-hbase4:42195] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-02-15 20:01:32,366 INFO [M:0;jenkins-hbase4:42195] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-02-15 20:01:32,366 INFO [M:0;jenkins-hbase4:42195] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-02-15 20:01:32,366 DEBUG [M:0;jenkins-hbase4:42195] master.HMaster(1512): Stopping service threads 2023-02-15 20:01:32,366 INFO [M:0;jenkins-hbase4:42195] procedure2.RemoteProcedureDispatcher(118): Stopping procedure remote dispatcher 2023-02-15 20:01:32,367 ERROR [M:0;jenkins-hbase4:42195] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-02-15 20:01:32,367 DEBUG [Listener at localhost/46363-EventThread] zookeeper.ZKWatcher(600): master:42195-0x1005992d9d30000, quorum=127.0.0.1:62883, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-02-15 20:01:32,367 INFO [M:0;jenkins-hbase4:42195] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-02-15 20:01:32,367 DEBUG [Listener at localhost/46363-EventThread] zookeeper.ZKWatcher(600): master:42195-0x1005992d9d30000, quorum=127.0.0.1:62883, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-15 20:01:32,367 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-02-15 20:01:32,367 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:42195-0x1005992d9d30000, quorum=127.0.0.1:62883, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-15 20:01:32,367 DEBUG [M:0;jenkins-hbase4:42195] zookeeper.ZKUtil(398): master:42195-0x1005992d9d30000, quorum=127.0.0.1:62883, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-02-15 20:01:32,367 WARN [M:0;jenkins-hbase4:42195] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-02-15 20:01:32,368 INFO [M:0;jenkins-hbase4:42195] assignment.AssignmentManager(315): Stopping assignment manager 2023-02-15 20:01:32,368 INFO [M:0;jenkins-hbase4:42195] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-02-15 20:01:32,368 DEBUG [M:0;jenkins-hbase4:42195] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-15 20:01:32,369 INFO [M:0;jenkins-hbase4:42195] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-15 20:01:32,369 DEBUG [M:0;jenkins-hbase4:42195] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-15 20:01:32,369 DEBUG [M:0;jenkins-hbase4:42195] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-15 20:01:32,369 DEBUG [M:0;jenkins-hbase4:42195] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-15 20:01:32,369 INFO [M:0;jenkins-hbase4:42195] regionserver.HRegion(2744): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=55.88 KB heapSize=66.82 KB 2023-02-15 20:01:32,377 INFO [M:0;jenkins-hbase4:42195] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=55.88 KB at sequenceid=132 (bloomFilter=true), to=hdfs://localhost:45455/user/jenkins/test-data/5744aa66-a2e1-6b80-327a-b86fd996b793/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/a71d5b0244db494bbd9b162007338e7d 2023-02-15 20:01:32,381 DEBUG [M:0;jenkins-hbase4:42195] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45455/user/jenkins/test-data/5744aa66-a2e1-6b80-327a-b86fd996b793/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/a71d5b0244db494bbd9b162007338e7d as hdfs://localhost:45455/user/jenkins/test-data/5744aa66-a2e1-6b80-327a-b86fd996b793/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/a71d5b0244db494bbd9b162007338e7d 2023-02-15 20:01:32,386 INFO [M:0;jenkins-hbase4:42195] regionserver.HStore(1080): Added hdfs://localhost:45455/user/jenkins/test-data/5744aa66-a2e1-6b80-327a-b86fd996b793/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/a71d5b0244db494bbd9b162007338e7d, entries=17, sequenceid=132, filesize=8.7 K 2023-02-15 20:01:32,386 INFO [M:0;jenkins-hbase4:42195] regionserver.HRegion(2947): Finished flush of dataSize ~55.88 KB/57221, heapSize ~66.80 KB/68408, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 17ms, sequenceid=132, compaction requested=false 2023-02-15 20:01:32,387 INFO [M:0;jenkins-hbase4:42195] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-15 20:01:32,387 DEBUG [M:0;jenkins-hbase4:42195] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-15 20:01:32,391 INFO [M:0;jenkins-hbase4:42195] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-02-15 20:01:32,391 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-15 20:01:32,391 INFO [M:0;jenkins-hbase4:42195] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:42195 2023-02-15 20:01:32,393 DEBUG [M:0;jenkins-hbase4:42195] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,42195,1676491288611 already deleted, retry=false 2023-02-15 20:01:32,463 DEBUG [Listener at localhost/46363-EventThread] zookeeper.ZKWatcher(600): regionserver:38559-0x1005992d9d30002, quorum=127.0.0.1:62883, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-15 20:01:32,463 INFO [RS:1;jenkins-hbase4:38559] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,38559,1676491288695; zookeeper connection closed. 2023-02-15 20:01:32,463 ERROR [Listener at localhost/46363-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@64b3d0f rejected from java.util.concurrent.ThreadPoolExecutor@2b715040[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-15 20:01:32,463 DEBUG [Listener at localhost/46363-EventThread] zookeeper.ZKWatcher(600): regionserver:38559-0x1005992d9d30002, quorum=127.0.0.1:62883, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-15 20:01:32,463 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@2fce74ac] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@2fce74ac 2023-02-15 20:01:32,463 ERROR [Listener at localhost/46363-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@7e058914 rejected from java.util.concurrent.ThreadPoolExecutor@2b715040[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-15 20:01:32,463 INFO [Listener at localhost/46363] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 2 regionserver(s) complete 2023-02-15 20:01:32,563 DEBUG [Listener at localhost/46363-EventThread] zookeeper.ZKWatcher(600): master:42195-0x1005992d9d30000, quorum=127.0.0.1:62883, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-15 20:01:32,563 INFO [M:0;jenkins-hbase4:42195] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,42195,1676491288611; zookeeper connection closed. 2023-02-15 20:01:32,563 ERROR [Listener at localhost/46363-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@74a05cd0 rejected from java.util.concurrent.ThreadPoolExecutor@709fc69c[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 51] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-15 20:01:32,564 DEBUG [Listener at localhost/46363-EventThread] zookeeper.ZKWatcher(600): master:42195-0x1005992d9d30000, quorum=127.0.0.1:62883, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-15 20:01:32,564 ERROR [Listener at localhost/46363-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@72d28579 rejected from java.util.concurrent.ThreadPoolExecutor@709fc69c[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 51] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-15 20:01:32,564 WARN [Listener at localhost/46363] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-15 20:01:32,568 INFO [Listener at localhost/46363] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-15 20:01:32,673 WARN [BP-1390927150-172.31.14.131-1676491288003 heartbeating to localhost/127.0.0.1:45455] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-15 20:01:32,673 WARN [BP-1390927150-172.31.14.131-1676491288003 heartbeating to localhost/127.0.0.1:45455] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1390927150-172.31.14.131-1676491288003 (Datanode Uuid bb850b3d-f26f-40e4-b8dc-a1cc646a1d93) service to localhost/127.0.0.1:45455 2023-02-15 20:01:32,673 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e81f56f0-58ac-a0f7-02b6-ac3e14664c2f/cluster_bb40ddce-9197-56bd-754a-84264c99ad04/dfs/data/data3/current/BP-1390927150-172.31.14.131-1676491288003] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-15 20:01:32,674 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e81f56f0-58ac-a0f7-02b6-ac3e14664c2f/cluster_bb40ddce-9197-56bd-754a-84264c99ad04/dfs/data/data4/current/BP-1390927150-172.31.14.131-1676491288003] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-15 20:01:32,675 WARN [Listener at localhost/46363] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-15 20:01:32,679 INFO [Listener at localhost/46363] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-15 20:01:32,783 WARN [BP-1390927150-172.31.14.131-1676491288003 heartbeating to localhost/127.0.0.1:45455] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-15 20:01:32,783 WARN [BP-1390927150-172.31.14.131-1676491288003 heartbeating to localhost/127.0.0.1:45455] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1390927150-172.31.14.131-1676491288003 (Datanode Uuid ed127da6-c05a-4854-be1c-9d5ff5bdbec6) service to localhost/127.0.0.1:45455 2023-02-15 20:01:32,783 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e81f56f0-58ac-a0f7-02b6-ac3e14664c2f/cluster_bb40ddce-9197-56bd-754a-84264c99ad04/dfs/data/data1/current/BP-1390927150-172.31.14.131-1676491288003] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-15 20:01:32,784 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e81f56f0-58ac-a0f7-02b6-ac3e14664c2f/cluster_bb40ddce-9197-56bd-754a-84264c99ad04/dfs/data/data2/current/BP-1390927150-172.31.14.131-1676491288003] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-15 20:01:32,795 INFO [Listener at localhost/46363] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-15 20:01:32,929 INFO [Listener at localhost/46363] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-02-15 20:01:32,964 INFO [Listener at localhost/46363] hbase.HBaseTestingUtility(1293): Minicluster is down 2023-02-15 20:01:32,992 INFO [Listener at localhost/46363] hbase.ResourceChecker(175): after: mapred.TestTableSnapshotInputFormat#testInitTableSnapshotMapperJobConfig Thread=180 (was 157) Potentially hanging thread: LeaseRenewer:jenkins.hfs.4@localhost:45455 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-13-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1185813668) connection to localhost/127.0.0.1:45455 from jenkins.hfs.5 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS-EventLoopGroup-10-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-10-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-11-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-9-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/46363 java.lang.Thread.dumpThreads(Native Method) java.lang.Thread.getAllStackTraces(Thread.java:1615) org.apache.hadoop.hbase.ResourceCheckerJUnitListener$ThreadResourceAnalyzer.getVal(ResourceCheckerJUnitListener.java:49) org.apache.hadoop.hbase.ResourceChecker.fill(ResourceChecker.java:110) org.apache.hadoop.hbase.ResourceChecker.fillEndings(ResourceChecker.java:104) org.apache.hadoop.hbase.ResourceChecker.end(ResourceChecker.java:206) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.end(ResourceCheckerJUnitListener.java:165) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.testFinished(ResourceCheckerJUnitListener.java:185) org.junit.runner.notification.SynchronizedRunListener.testFinished(SynchronizedRunListener.java:87) org.junit.runner.notification.RunNotifier$9.notifyListener(RunNotifier.java:225) org.junit.runner.notification.RunNotifier$SafeNotifier.run(RunNotifier.java:72) org.junit.runner.notification.RunNotifier.fireTestFinished(RunNotifier.java:222) org.junit.internal.runners.model.EachTestNotifier.fireTestFinished(EachTestNotifier.java:38) org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:372) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) org.apache.hadoop.hbase.SystemExitRule$1.evaluate(SystemExitRule.java:39) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-11-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-8 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase4.apache.org,42195,1676491288611)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-11-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-11-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-12-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-9-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-10-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1185813668) connection to localhost/127.0.0.1:45455 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-13-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-9 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-9-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins@localhost:45455 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-7 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-10-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1185813668) connection to localhost/127.0.0.1:45455 from jenkins.hfs.4 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: IPC Client (1185813668) connection to localhost/127.0.0.1:45455 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS-EventLoopGroup-11-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.5@localhost:45455 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-10-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-11-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-13-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-12-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-12-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-10-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=567 (was 536) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=304 (was 313), ProcessCount=165 (was 165), AvailableMemoryMB=2738 (was 2873) 2023-02-15 20:01:33,003 INFO [Listener at localhost/46363] hbase.ResourceChecker(147): before: mapred.TestTableSnapshotInputFormat#testWithMockedMapReduceMultiRegion Thread=180, OpenFileDescriptor=567, MaxFileDescriptor=60000, SystemLoadAverage=304, ProcessCount=165, AvailableMemoryMB=2737 2023-02-15 20:01:33,013 INFO [Listener at localhost/46363] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.log.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e81f56f0-58ac-a0f7-02b6-ac3e14664c2f/hadoop.log.dir so I do NOT create it in target/test-data/63389d22-ebad-6aa5-b3ed-1f47f6072df6 2023-02-15 20:01:33,013 WARN [Listener at localhost/46363] hbase.HBaseTestingUtility(449): hadoop.log.dir property value differs in configuration and system: Configuration=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/../logs while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e81f56f0-58ac-a0f7-02b6-ac3e14664c2f/hadoop.log.dir Erasing configuration value by system value. 2023-02-15 20:01:33,014 INFO [Listener at localhost/46363] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.tmp.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e81f56f0-58ac-a0f7-02b6-ac3e14664c2f/hadoop.tmp.dir so I do NOT create it in target/test-data/63389d22-ebad-6aa5-b3ed-1f47f6072df6 2023-02-15 20:01:33,014 WARN [Listener at localhost/46363] hbase.HBaseTestingUtility(449): hadoop.tmp.dir property value differs in configuration and system: Configuration=/tmp/hadoop-jenkins while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e81f56f0-58ac-a0f7-02b6-ac3e14664c2f/hadoop.tmp.dir Erasing configuration value by system value. 2023-02-15 20:01:33,014 DEBUG [Listener at localhost/46363] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/63389d22-ebad-6aa5-b3ed-1f47f6072df6 2023-02-15 20:01:33,014 INFO [Listener at localhost/46363] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=2, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=true, createWALDir=false} 2023-02-15 20:01:33,014 INFO [Listener at localhost/46363] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/63389d22-ebad-6aa5-b3ed-1f47f6072df6/cluster_75e2f904-c355-d1cf-5c64-97d220c683ad, deleteOnExit=true 2023-02-15 20:01:33,014 INFO [Listener at localhost/46363] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-02-15 20:01:33,014 INFO [Listener at localhost/46363] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/63389d22-ebad-6aa5-b3ed-1f47f6072df6/test.cache.data in system properties and HBase conf 2023-02-15 20:01:33,014 INFO [Listener at localhost/46363] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/63389d22-ebad-6aa5-b3ed-1f47f6072df6/hadoop.tmp.dir in system properties and HBase conf 2023-02-15 20:01:33,014 INFO [Listener at localhost/46363] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/63389d22-ebad-6aa5-b3ed-1f47f6072df6/hadoop.log.dir in system properties and HBase conf 2023-02-15 20:01:33,014 INFO [Listener at localhost/46363] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/63389d22-ebad-6aa5-b3ed-1f47f6072df6/mapreduce.cluster.local.dir in system properties and HBase conf 2023-02-15 20:01:33,014 INFO [Listener at localhost/46363] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/63389d22-ebad-6aa5-b3ed-1f47f6072df6/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-02-15 20:01:33,015 INFO [Listener at localhost/46363] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-02-15 20:01:33,015 DEBUG [Listener at localhost/46363] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-02-15 20:01:33,015 INFO [Listener at localhost/46363] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/63389d22-ebad-6aa5-b3ed-1f47f6072df6/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-02-15 20:01:33,015 INFO [Listener at localhost/46363] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/63389d22-ebad-6aa5-b3ed-1f47f6072df6/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-02-15 20:01:33,015 INFO [Listener at localhost/46363] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/63389d22-ebad-6aa5-b3ed-1f47f6072df6/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-02-15 20:01:33,015 INFO [Listener at localhost/46363] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/63389d22-ebad-6aa5-b3ed-1f47f6072df6/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-15 20:01:33,015 INFO [Listener at localhost/46363] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/63389d22-ebad-6aa5-b3ed-1f47f6072df6/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-02-15 20:01:33,015 INFO [Listener at localhost/46363] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/63389d22-ebad-6aa5-b3ed-1f47f6072df6/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-02-15 20:01:33,015 INFO [Listener at localhost/46363] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/63389d22-ebad-6aa5-b3ed-1f47f6072df6/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-15 20:01:33,015 INFO [Listener at localhost/46363] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/63389d22-ebad-6aa5-b3ed-1f47f6072df6/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-15 20:01:33,016 INFO [Listener at localhost/46363] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/63389d22-ebad-6aa5-b3ed-1f47f6072df6/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-02-15 20:01:33,016 INFO [Listener at localhost/46363] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/63389d22-ebad-6aa5-b3ed-1f47f6072df6/nfs.dump.dir in system properties and HBase conf 2023-02-15 20:01:33,016 INFO [Listener at localhost/46363] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/63389d22-ebad-6aa5-b3ed-1f47f6072df6/java.io.tmpdir in system properties and HBase conf 2023-02-15 20:01:33,016 INFO [Listener at localhost/46363] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/63389d22-ebad-6aa5-b3ed-1f47f6072df6/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-15 20:01:33,016 INFO [Listener at localhost/46363] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/63389d22-ebad-6aa5-b3ed-1f47f6072df6/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-02-15 20:01:33,016 INFO [Listener at localhost/46363] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/63389d22-ebad-6aa5-b3ed-1f47f6072df6/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-02-15 20:01:33,020 WARN [Listener at localhost/46363] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-15 20:01:33,020 WARN [Listener at localhost/46363] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-15 20:01:33,055 WARN [Listener at localhost/46363] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-15 20:01:33,057 INFO [Listener at localhost/46363] log.Slf4jLog(67): jetty-6.1.26 2023-02-15 20:01:33,063 INFO [Listener at localhost/46363] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/63389d22-ebad-6aa5-b3ed-1f47f6072df6/java.io.tmpdir/Jetty_localhost_35185_hdfs____.31a3gq/webapp 2023-02-15 20:01:33,156 INFO [Listener at localhost/46363] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:35185 2023-02-15 20:01:33,160 WARN [Listener at localhost/46363] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-15 20:01:33,160 WARN [Listener at localhost/46363] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-15 20:01:33,200 WARN [Listener at localhost/43597] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-15 20:01:33,214 WARN [Listener at localhost/43597] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-15 20:01:33,217 WARN [Listener at localhost/43597] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-15 20:01:33,218 INFO [Listener at localhost/43597] log.Slf4jLog(67): jetty-6.1.26 2023-02-15 20:01:33,225 INFO [Listener at localhost/43597] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/63389d22-ebad-6aa5-b3ed-1f47f6072df6/java.io.tmpdir/Jetty_localhost_38825_datanode____ank6ot/webapp 2023-02-15 20:01:33,318 INFO [Listener at localhost/43597] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:38825 2023-02-15 20:01:33,325 WARN [Listener at localhost/34339] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-15 20:01:33,341 WARN [Listener at localhost/34339] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-15 20:01:33,344 WARN [Listener at localhost/34339] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-15 20:01:33,345 INFO [Listener at localhost/34339] log.Slf4jLog(67): jetty-6.1.26 2023-02-15 20:01:33,350 INFO [Listener at localhost/34339] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/63389d22-ebad-6aa5-b3ed-1f47f6072df6/java.io.tmpdir/Jetty_localhost_43177_datanode____.8py4h3/webapp 2023-02-15 20:01:33,429 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x2dc0676c368a2232: Processing first storage report for DS-e837e9c6-0708-472d-9353-1e894a7734aa from datanode 4389ca41-3fee-42de-bc59-7ff211de1455 2023-02-15 20:01:33,429 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x2dc0676c368a2232: from storage DS-e837e9c6-0708-472d-9353-1e894a7734aa node DatanodeRegistration(127.0.0.1:41685, datanodeUuid=4389ca41-3fee-42de-bc59-7ff211de1455, infoPort=43209, infoSecurePort=0, ipcPort=34339, storageInfo=lv=-57;cid=testClusterID;nsid=455919083;c=1676491293022), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-15 20:01:33,429 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x2dc0676c368a2232: Processing first storage report for DS-fb02ea55-e8c6-44c9-a2df-03136fb871d1 from datanode 4389ca41-3fee-42de-bc59-7ff211de1455 2023-02-15 20:01:33,429 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x2dc0676c368a2232: from storage DS-fb02ea55-e8c6-44c9-a2df-03136fb871d1 node DatanodeRegistration(127.0.0.1:41685, datanodeUuid=4389ca41-3fee-42de-bc59-7ff211de1455, infoPort=43209, infoSecurePort=0, ipcPort=34339, storageInfo=lv=-57;cid=testClusterID;nsid=455919083;c=1676491293022), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-15 20:01:33,460 INFO [Listener at localhost/34339] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:43177 2023-02-15 20:01:33,467 WARN [Listener at localhost/43553] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-15 20:01:33,575 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x98d733c4ac88b388: Processing first storage report for DS-36199039-2a25-4302-8846-2abe0a20a212 from datanode c8f119a7-b671-44fd-b45a-8761b32a7a92 2023-02-15 20:01:33,575 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x98d733c4ac88b388: from storage DS-36199039-2a25-4302-8846-2abe0a20a212 node DatanodeRegistration(127.0.0.1:36975, datanodeUuid=c8f119a7-b671-44fd-b45a-8761b32a7a92, infoPort=41765, infoSecurePort=0, ipcPort=43553, storageInfo=lv=-57;cid=testClusterID;nsid=455919083;c=1676491293022), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-15 20:01:33,575 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x98d733c4ac88b388: Processing first storage report for DS-8eb0f105-ef50-4c2c-a286-01757460524a from datanode c8f119a7-b671-44fd-b45a-8761b32a7a92 2023-02-15 20:01:33,575 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x98d733c4ac88b388: from storage DS-8eb0f105-ef50-4c2c-a286-01757460524a node DatanodeRegistration(127.0.0.1:36975, datanodeUuid=c8f119a7-b671-44fd-b45a-8761b32a7a92, infoPort=41765, infoSecurePort=0, ipcPort=43553, storageInfo=lv=-57;cid=testClusterID;nsid=455919083;c=1676491293022), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-15 20:01:33,581 DEBUG [Listener at localhost/43553] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/63389d22-ebad-6aa5-b3ed-1f47f6072df6 2023-02-15 20:01:33,583 INFO [Listener at localhost/43553] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/63389d22-ebad-6aa5-b3ed-1f47f6072df6/cluster_75e2f904-c355-d1cf-5c64-97d220c683ad/zookeeper_0, clientPort=49184, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/63389d22-ebad-6aa5-b3ed-1f47f6072df6/cluster_75e2f904-c355-d1cf-5c64-97d220c683ad/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/63389d22-ebad-6aa5-b3ed-1f47f6072df6/cluster_75e2f904-c355-d1cf-5c64-97d220c683ad/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-02-15 20:01:33,584 INFO [Listener at localhost/43553] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=49184 2023-02-15 20:01:33,584 INFO [Listener at localhost/43553] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-15 20:01:33,585 INFO [Listener at localhost/43553] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-15 20:01:33,601 INFO [Listener at localhost/43553] util.FSUtils(479): Created version file at hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789 with version=8 2023-02-15 20:01:33,601 INFO [Listener at localhost/43553] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-15 20:01:33,602 INFO [Listener at localhost/43553] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-15 20:01:33,603 INFO [Listener at localhost/43553] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:43597/user/jenkins/test-data/af11d76e-1f10-9ba9-86e0-eb3a3c9ec018/hbase-staging 2023-02-15 20:01:33,605 INFO [Listener at localhost/43553] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-02-15 20:01:33,605 INFO [Listener at localhost/43553] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-15 20:01:33,605 INFO [Listener at localhost/43553] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-15 20:01:33,605 INFO [Listener at localhost/43553] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-15 20:01:33,606 INFO [Listener at localhost/43553] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-15 20:01:33,606 INFO [Listener at localhost/43553] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-15 20:01:33,606 INFO [Listener at localhost/43553] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-02-15 20:01:33,607 INFO [Listener at localhost/43553] ipc.NettyRpcServer(120): Bind to /172.31.14.131:35467 2023-02-15 20:01:33,608 INFO [Listener at localhost/43553] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-15 20:01:33,609 INFO [Listener at localhost/43553] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-15 20:01:33,609 INFO [Listener at localhost/43553] zookeeper.RecoverableZooKeeper(93): Process identifier=master:35467 connecting to ZooKeeper ensemble=127.0.0.1:49184 2023-02-15 20:01:33,617 DEBUG [Listener at localhost/43553-EventThread] zookeeper.ZKWatcher(600): master:354670x0, quorum=127.0.0.1:49184, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-15 20:01:33,618 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): master:35467-0x1005992ed530000 connected 2023-02-15 20:01:33,637 DEBUG [Listener at localhost/43553] zookeeper.ZKUtil(164): master:35467-0x1005992ed530000, quorum=127.0.0.1:49184, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-15 20:01:33,638 DEBUG [Listener at localhost/43553] zookeeper.ZKUtil(164): master:35467-0x1005992ed530000, quorum=127.0.0.1:49184, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-15 20:01:33,638 DEBUG [Listener at localhost/43553] zookeeper.ZKUtil(164): master:35467-0x1005992ed530000, quorum=127.0.0.1:49184, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-15 20:01:33,643 DEBUG [Listener at localhost/43553] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=35467 2023-02-15 20:01:33,648 DEBUG [Listener at localhost/43553] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=35467 2023-02-15 20:01:33,648 DEBUG [Listener at localhost/43553] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=35467 2023-02-15 20:01:33,650 DEBUG [Listener at localhost/43553] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=35467 2023-02-15 20:01:33,652 DEBUG [Listener at localhost/43553] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=35467 2023-02-15 20:01:33,652 INFO [Listener at localhost/43553] master.HMaster(444): hbase.rootdir=hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789, hbase.cluster.distributed=false 2023-02-15 20:01:33,665 INFO [Listener at localhost/43553] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-15 20:01:33,665 INFO [Listener at localhost/43553] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-15 20:01:33,665 INFO [Listener at localhost/43553] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-15 20:01:33,665 INFO [Listener at localhost/43553] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-15 20:01:33,665 INFO [Listener at localhost/43553] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-15 20:01:33,665 INFO [Listener at localhost/43553] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-15 20:01:33,665 INFO [Listener at localhost/43553] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-15 20:01:33,666 INFO [Listener at localhost/43553] ipc.NettyRpcServer(120): Bind to /172.31.14.131:40517 2023-02-15 20:01:33,666 INFO [Listener at localhost/43553] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-15 20:01:33,668 DEBUG [Listener at localhost/43553] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-15 20:01:33,668 INFO [Listener at localhost/43553] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-15 20:01:33,669 INFO [Listener at localhost/43553] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-15 20:01:33,670 INFO [Listener at localhost/43553] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:40517 connecting to ZooKeeper ensemble=127.0.0.1:49184 2023-02-15 20:01:33,673 DEBUG [Listener at localhost/43553-EventThread] zookeeper.ZKWatcher(600): regionserver:405170x0, quorum=127.0.0.1:49184, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-15 20:01:33,678 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:40517-0x1005992ed530001 connected 2023-02-15 20:01:33,678 DEBUG [Listener at localhost/43553] zookeeper.ZKUtil(164): regionserver:40517-0x1005992ed530001, quorum=127.0.0.1:49184, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-15 20:01:33,679 DEBUG [Listener at localhost/43553] zookeeper.ZKUtil(164): regionserver:40517-0x1005992ed530001, quorum=127.0.0.1:49184, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-15 20:01:33,679 DEBUG [Listener at localhost/43553] zookeeper.ZKUtil(164): regionserver:40517-0x1005992ed530001, quorum=127.0.0.1:49184, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-15 20:01:33,681 DEBUG [Listener at localhost/43553] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=40517 2023-02-15 20:01:33,681 DEBUG [Listener at localhost/43553] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=40517 2023-02-15 20:01:33,684 DEBUG [Listener at localhost/43553] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=40517 2023-02-15 20:01:33,684 DEBUG [Listener at localhost/43553] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=40517 2023-02-15 20:01:33,684 DEBUG [Listener at localhost/43553] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=40517 2023-02-15 20:01:33,696 INFO [Listener at localhost/43553] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-15 20:01:33,696 INFO [Listener at localhost/43553] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-15 20:01:33,696 INFO [Listener at localhost/43553] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-15 20:01:33,696 INFO [Listener at localhost/43553] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-15 20:01:33,697 INFO [Listener at localhost/43553] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-15 20:01:33,697 INFO [Listener at localhost/43553] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-15 20:01:33,697 INFO [Listener at localhost/43553] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-15 20:01:33,697 INFO [Listener at localhost/43553] ipc.NettyRpcServer(120): Bind to /172.31.14.131:36625 2023-02-15 20:01:33,698 INFO [Listener at localhost/43553] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-15 20:01:33,699 DEBUG [Listener at localhost/43553] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-15 20:01:33,700 INFO [Listener at localhost/43553] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-15 20:01:33,701 INFO [Listener at localhost/43553] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-15 20:01:33,701 INFO [Listener at localhost/43553] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:36625 connecting to ZooKeeper ensemble=127.0.0.1:49184 2023-02-15 20:01:33,763 DEBUG [Listener at localhost/43553-EventThread] zookeeper.ZKWatcher(600): regionserver:366250x0, quorum=127.0.0.1:49184, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-15 20:01:33,765 DEBUG [Listener at localhost/43553] zookeeper.ZKUtil(164): regionserver:366250x0, quorum=127.0.0.1:49184, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-15 20:01:33,765 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:36625-0x1005992ed530002 connected 2023-02-15 20:01:33,766 DEBUG [Listener at localhost/43553] zookeeper.ZKUtil(164): regionserver:36625-0x1005992ed530002, quorum=127.0.0.1:49184, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-15 20:01:33,766 DEBUG [Listener at localhost/43553] zookeeper.ZKUtil(164): regionserver:36625-0x1005992ed530002, quorum=127.0.0.1:49184, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-15 20:01:33,767 DEBUG [Listener at localhost/43553] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=36625 2023-02-15 20:01:33,767 DEBUG [Listener at localhost/43553] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=36625 2023-02-15 20:01:33,767 DEBUG [Listener at localhost/43553] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=36625 2023-02-15 20:01:33,767 DEBUG [Listener at localhost/43553] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=36625 2023-02-15 20:01:33,767 DEBUG [Listener at localhost/43553] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=36625 2023-02-15 20:01:33,769 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,35467,1676491293605 2023-02-15 20:01:33,786 DEBUG [Listener at localhost/43553-EventThread] zookeeper.ZKWatcher(600): master:35467-0x1005992ed530000, quorum=127.0.0.1:49184, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-15 20:01:33,787 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:35467-0x1005992ed530000, quorum=127.0.0.1:49184, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,35467,1676491293605 2023-02-15 20:01:33,840 DEBUG [Listener at localhost/43553-EventThread] zookeeper.ZKWatcher(600): master:35467-0x1005992ed530000, quorum=127.0.0.1:49184, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-15 20:01:33,840 DEBUG [Listener at localhost/43553-EventThread] zookeeper.ZKWatcher(600): regionserver:36625-0x1005992ed530002, quorum=127.0.0.1:49184, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-15 20:01:33,840 DEBUG [Listener at localhost/43553-EventThread] zookeeper.ZKWatcher(600): regionserver:40517-0x1005992ed530001, quorum=127.0.0.1:49184, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-15 20:01:33,840 DEBUG [Listener at localhost/43553-EventThread] zookeeper.ZKWatcher(600): master:35467-0x1005992ed530000, quorum=127.0.0.1:49184, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-15 20:01:33,842 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:35467-0x1005992ed530000, quorum=127.0.0.1:49184, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-15 20:01:33,843 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,35467,1676491293605 from backup master directory 2023-02-15 20:01:33,843 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:35467-0x1005992ed530000, quorum=127.0.0.1:49184, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-15 20:01:33,878 DEBUG [Listener at localhost/43553-EventThread] zookeeper.ZKWatcher(600): master:35467-0x1005992ed530000, quorum=127.0.0.1:49184, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,35467,1676491293605 2023-02-15 20:01:33,879 DEBUG [Listener at localhost/43553-EventThread] zookeeper.ZKWatcher(600): master:35467-0x1005992ed530000, quorum=127.0.0.1:49184, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-15 20:01:33,879 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-15 20:01:33,879 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase4.apache.org,35467,1676491293605 2023-02-15 20:01:33,892 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(628): Created cluster ID file at hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/hbase.id with ID: bae67c45-830b-4150-8024-320870864103 2023-02-15 20:01:33,901 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-15 20:01:33,955 DEBUG [Listener at localhost/43553-EventThread] zookeeper.ZKWatcher(600): master:35467-0x1005992ed530000, quorum=127.0.0.1:49184, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-15 20:01:33,964 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x35955abd to 127.0.0.1:49184 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-15 20:01:33,995 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@797b2c6b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-15 20:01:33,995 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-15 20:01:33,995 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-02-15 20:01:33,996 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-15 20:01:33,997 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7689): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/MasterData/data/master/store-tmp 2023-02-15 20:01:34,004 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 20:01:34,004 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-15 20:01:34,005 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-15 20:01:34,005 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-15 20:01:34,005 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-15 20:01:34,005 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-15 20:01:34,005 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-15 20:01:34,005 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-15 20:01:34,005 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/MasterData/WALs/jenkins-hbase4.apache.org,35467,1676491293605 2023-02-15 20:01:34,008 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C35467%2C1676491293605, suffix=, logDir=hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/MasterData/WALs/jenkins-hbase4.apache.org,35467,1676491293605, archiveDir=hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/MasterData/oldWALs, maxLogs=10 2023-02-15 20:01:34,023 DEBUG [RS-EventLoopGroup-14-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41685,DS-e837e9c6-0708-472d-9353-1e894a7734aa,DISK] 2023-02-15 20:01:34,023 DEBUG [RS-EventLoopGroup-14-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36975,DS-36199039-2a25-4302-8846-2abe0a20a212,DISK] 2023-02-15 20:01:34,028 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/MasterData/WALs/jenkins-hbase4.apache.org,35467,1676491293605/jenkins-hbase4.apache.org%2C35467%2C1676491293605.1676491294008 2023-02-15 20:01:34,028 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:41685,DS-e837e9c6-0708-472d-9353-1e894a7734aa,DISK], DatanodeInfoWithStorage[127.0.0.1:36975,DS-36199039-2a25-4302-8846-2abe0a20a212,DISK]] 2023-02-15 20:01:34,028 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7850): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-02-15 20:01:34,029 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 20:01:34,029 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7890): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-02-15 20:01:34,029 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7893): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-02-15 20:01:34,030 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-02-15 20:01:34,032 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-02-15 20:01:34,032 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-02-15 20:01:34,033 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 20:01:34,034 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-15 20:01:34,034 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-15 20:01:34,037 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1054): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-02-15 20:01:34,040 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-15 20:01:34,043 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1071): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67068952, jitterRate=-5.947351455688477E-4}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-15 20:01:34,043 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(964): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-15 20:01:34,044 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-02-15 20:01:34,045 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-02-15 20:01:34,045 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-02-15 20:01:34,045 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-02-15 20:01:34,046 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 0 msec 2023-02-15 20:01:34,046 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 0 msec 2023-02-15 20:01:34,046 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(95): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-02-15 20:01:34,048 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-02-15 20:01:34,049 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-02-15 20:01:34,059 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-02-15 20:01:34,060 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-02-15 20:01:34,060 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:35467-0x1005992ed530000, quorum=127.0.0.1:49184, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-02-15 20:01:34,060 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-02-15 20:01:34,061 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:35467-0x1005992ed530000, quorum=127.0.0.1:49184, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-02-15 20:01:34,086 DEBUG [Listener at localhost/43553-EventThread] zookeeper.ZKWatcher(600): master:35467-0x1005992ed530000, quorum=127.0.0.1:49184, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-15 20:01:34,087 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:35467-0x1005992ed530000, quorum=127.0.0.1:49184, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-02-15 20:01:34,087 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:35467-0x1005992ed530000, quorum=127.0.0.1:49184, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-02-15 20:01:34,088 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:35467-0x1005992ed530000, quorum=127.0.0.1:49184, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-02-15 20:01:34,125 DEBUG [Listener at localhost/43553-EventThread] zookeeper.ZKWatcher(600): regionserver:36625-0x1005992ed530002, quorum=127.0.0.1:49184, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-15 20:01:34,125 DEBUG [Listener at localhost/43553-EventThread] zookeeper.ZKWatcher(600): master:35467-0x1005992ed530000, quorum=127.0.0.1:49184, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-15 20:01:34,125 DEBUG [Listener at localhost/43553-EventThread] zookeeper.ZKWatcher(600): regionserver:40517-0x1005992ed530001, quorum=127.0.0.1:49184, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-15 20:01:34,126 DEBUG [Listener at localhost/43553-EventThread] zookeeper.ZKWatcher(600): master:35467-0x1005992ed530000, quorum=127.0.0.1:49184, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-15 20:01:34,126 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase4.apache.org,35467,1676491293605, sessionid=0x1005992ed530000, setting cluster-up flag (Was=false) 2023-02-15 20:01:34,225 DEBUG [Listener at localhost/43553-EventThread] zookeeper.ZKWatcher(600): master:35467-0x1005992ed530000, quorum=127.0.0.1:49184, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-15 20:01:34,418 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-02-15 20:01:34,419 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,35467,1676491293605 2023-02-15 20:01:34,548 DEBUG [Listener at localhost/43553-EventThread] zookeeper.ZKWatcher(600): master:35467-0x1005992ed530000, quorum=127.0.0.1:49184, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-15 20:01:34,686 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-02-15 20:01:34,687 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,35467,1676491293605 2023-02-15 20:01:34,688 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/.hbase-snapshot/.tmp 2023-02-15 20:01:34,689 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-02-15 20:01:34,691 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-15 20:01:34,692 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-15 20:01:34,692 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-15 20:01:34,692 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-15 20:01:34,692 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-02-15 20:01:34,692 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 20:01:34,692 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-15 20:01:34,692 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 20:01:34,697 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1676491324697 2023-02-15 20:01:34,698 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-02-15 20:01:34,698 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-02-15 20:01:34,698 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-02-15 20:01:34,698 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-02-15 20:01:34,698 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-02-15 20:01:34,698 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-02-15 20:01:34,698 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-02-15 20:01:34,698 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-02-15 20:01:34,699 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-15 20:01:34,699 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-15 20:01:34,699 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-02-15 20:01:34,700 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-02-15 20:01:34,701 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-02-15 20:01:34,701 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-02-15 20:01:34,701 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-02-15 20:01:34,701 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676491294701,5,FailOnTimeoutGroup] 2023-02-15 20:01:34,701 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676491294701,5,FailOnTimeoutGroup] 2023-02-15 20:01:34,701 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-15 20:01:34,701 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-02-15 20:01:34,701 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-02-15 20:01:34,701 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-02-15 20:01:34,711 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-15 20:01:34,711 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-15 20:01:34,711 INFO [PEWorker-1] regionserver.HRegion(7671): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789 2023-02-15 20:01:34,720 DEBUG [PEWorker-1] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 20:01:34,722 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-15 20:01:34,723 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/data/hbase/meta/1588230740/info 2023-02-15 20:01:34,724 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-15 20:01:34,724 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 20:01:34,724 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-15 20:01:34,726 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/data/hbase/meta/1588230740/rep_barrier 2023-02-15 20:01:34,726 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-15 20:01:34,727 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 20:01:34,727 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-15 20:01:34,728 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/data/hbase/meta/1588230740/table 2023-02-15 20:01:34,728 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-15 20:01:34,729 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 20:01:34,730 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/data/hbase/meta/1588230740 2023-02-15 20:01:34,730 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/data/hbase/meta/1588230740 2023-02-15 20:01:34,732 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-15 20:01:34,733 DEBUG [PEWorker-1] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-15 20:01:34,735 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-15 20:01:34,735 INFO [PEWorker-1] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67999766, jitterRate=0.013275474309921265}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-15 20:01:34,735 DEBUG [PEWorker-1] regionserver.HRegion(964): Region open journal for 1588230740: 2023-02-15 20:01:34,735 DEBUG [PEWorker-1] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-15 20:01:34,735 INFO [PEWorker-1] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-15 20:01:34,735 DEBUG [PEWorker-1] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-15 20:01:34,735 DEBUG [PEWorker-1] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-15 20:01:34,735 DEBUG [PEWorker-1] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-15 20:01:34,735 INFO [PEWorker-1] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-15 20:01:34,736 DEBUG [PEWorker-1] regionserver.HRegion(1557): Region close journal for 1588230740: 2023-02-15 20:01:34,736 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-02-15 20:01:34,736 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-02-15 20:01:34,736 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-02-15 20:01:34,738 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-02-15 20:01:34,739 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-02-15 20:01:34,770 INFO [RS:0;jenkins-hbase4:40517] regionserver.HRegionServer(952): ClusterId : bae67c45-830b-4150-8024-320870864103 2023-02-15 20:01:34,770 INFO [RS:1;jenkins-hbase4:36625] regionserver.HRegionServer(952): ClusterId : bae67c45-830b-4150-8024-320870864103 2023-02-15 20:01:34,770 DEBUG [RS:0;jenkins-hbase4:40517] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-15 20:01:34,770 DEBUG [RS:1;jenkins-hbase4:36625] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-15 20:01:34,872 DEBUG [RS:0;jenkins-hbase4:40517] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-15 20:01:34,872 DEBUG [RS:0;jenkins-hbase4:40517] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-15 20:01:34,872 DEBUG [RS:1;jenkins-hbase4:36625] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-15 20:01:34,872 DEBUG [RS:1;jenkins-hbase4:36625] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-15 20:01:34,889 WARN [jenkins-hbase4:35467] assignment.AssignmentManager(2157): No servers available; cannot place 1 unassigned regions. 2023-02-15 20:01:35,056 DEBUG [RS:0;jenkins-hbase4:40517] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-15 20:01:35,057 DEBUG [RS:1;jenkins-hbase4:36625] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-15 20:01:35,059 DEBUG [RS:1;jenkins-hbase4:36625] zookeeper.ReadOnlyZKClient(139): Connect 0x68cc14e7 to 127.0.0.1:49184 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-15 20:01:35,059 DEBUG [RS:0;jenkins-hbase4:40517] zookeeper.ReadOnlyZKClient(139): Connect 0x3ceb3b0c to 127.0.0.1:49184 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-15 20:01:35,111 DEBUG [RS:0;jenkins-hbase4:40517] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@322cc2e1, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-15 20:01:35,111 DEBUG [RS:1;jenkins-hbase4:36625] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@660bf78e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-15 20:01:35,111 DEBUG [RS:0;jenkins-hbase4:40517] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3613507c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-15 20:01:35,111 DEBUG [RS:1;jenkins-hbase4:36625] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@62347f97, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-15 20:01:35,120 DEBUG [RS:1;jenkins-hbase4:36625] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:36625 2023-02-15 20:01:35,120 DEBUG [RS:0;jenkins-hbase4:40517] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:40517 2023-02-15 20:01:35,120 INFO [RS:1;jenkins-hbase4:36625] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-15 20:01:35,120 INFO [RS:0;jenkins-hbase4:40517] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-15 20:01:35,120 INFO [RS:0;jenkins-hbase4:40517] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-15 20:01:35,120 INFO [RS:1;jenkins-hbase4:36625] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-15 20:01:35,120 DEBUG [RS:0;jenkins-hbase4:40517] regionserver.HRegionServer(1023): About to register with Master. 2023-02-15 20:01:35,120 DEBUG [RS:1;jenkins-hbase4:36625] regionserver.HRegionServer(1023): About to register with Master. 2023-02-15 20:01:35,121 INFO [RS:1;jenkins-hbase4:36625] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,35467,1676491293605 with isa=jenkins-hbase4.apache.org/172.31.14.131:36625, startcode=1676491293696 2023-02-15 20:01:35,121 INFO [RS:0;jenkins-hbase4:40517] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,35467,1676491293605 with isa=jenkins-hbase4.apache.org/172.31.14.131:40517, startcode=1676491293664 2023-02-15 20:01:35,121 DEBUG [RS:1;jenkins-hbase4:36625] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-15 20:01:35,121 DEBUG [RS:0;jenkins-hbase4:40517] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-15 20:01:35,123 INFO [RS-EventLoopGroup-12-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47037, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.7 (auth:SIMPLE), service=RegionServerStatusService 2023-02-15 20:01:35,124 INFO [RS-EventLoopGroup-12-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:57333, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.6 (auth:SIMPLE), service=RegionServerStatusService 2023-02-15 20:01:35,125 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35467] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,36625,1676491293696 2023-02-15 20:01:35,125 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35467] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,40517,1676491293664 2023-02-15 20:01:35,126 DEBUG [RS:1;jenkins-hbase4:36625] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789 2023-02-15 20:01:35,126 DEBUG [RS:1;jenkins-hbase4:36625] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:43597 2023-02-15 20:01:35,126 DEBUG [RS:1;jenkins-hbase4:36625] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-15 20:01:35,126 DEBUG [RS:0;jenkins-hbase4:40517] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789 2023-02-15 20:01:35,126 DEBUG [RS:0;jenkins-hbase4:40517] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:43597 2023-02-15 20:01:35,126 DEBUG [RS:0;jenkins-hbase4:40517] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-15 20:01:35,139 DEBUG [jenkins-hbase4:35467] assignment.AssignmentManager(2178): Processing assignQueue; systemServersCount=2, allServersCount=2 2023-02-15 20:01:35,139 DEBUG [jenkins-hbase4:35467] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-15 20:01:35,141 DEBUG [jenkins-hbase4:35467] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-15 20:01:35,141 DEBUG [jenkins-hbase4:35467] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-15 20:01:35,141 DEBUG [jenkins-hbase4:35467] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-15 20:01:35,141 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,40517,1676491293664, state=OPENING 2023-02-15 20:01:35,151 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-datanode.properties,hadoop-metrics2.properties 2023-02-15 20:01:35,206 DEBUG [Listener at localhost/43553-EventThread] zookeeper.ZKWatcher(600): master:35467-0x1005992ed530000, quorum=127.0.0.1:49184, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-15 20:01:35,494 DEBUG [RS:1;jenkins-hbase4:36625] zookeeper.ZKUtil(162): regionserver:36625-0x1005992ed530002, quorum=127.0.0.1:49184, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,36625,1676491293696 2023-02-15 20:01:35,494 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,36625,1676491293696] 2023-02-15 20:01:35,494 WARN [RS:1;jenkins-hbase4:36625] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-15 20:01:35,494 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-02-15 20:01:35,494 DEBUG [RS:0;jenkins-hbase4:40517] zookeeper.ZKUtil(162): regionserver:40517-0x1005992ed530001, quorum=127.0.0.1:49184, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,40517,1676491293664 2023-02-15 20:01:35,494 INFO [RS:1;jenkins-hbase4:36625] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-15 20:01:35,494 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,40517,1676491293664] 2023-02-15 20:01:35,494 WARN [RS:0;jenkins-hbase4:40517] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-15 20:01:35,495 DEBUG [RS:1;jenkins-hbase4:36625] regionserver.HRegionServer(1947): logDir=hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/WALs/jenkins-hbase4.apache.org,36625,1676491293696 2023-02-15 20:01:35,495 INFO [RS:0;jenkins-hbase4:40517] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-15 20:01:35,495 DEBUG [RS:0;jenkins-hbase4:40517] regionserver.HRegionServer(1947): logDir=hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/WALs/jenkins-hbase4.apache.org,40517,1676491293664 2023-02-15 20:01:35,532 DEBUG [Listener at localhost/43553-EventThread] zookeeper.ZKWatcher(600): master:35467-0x1005992ed530000, quorum=127.0.0.1:49184, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-15 20:01:35,533 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,40517,1676491293664}] 2023-02-15 20:01:35,534 DEBUG [RS:1;jenkins-hbase4:36625] zookeeper.ZKUtil(162): regionserver:36625-0x1005992ed530002, quorum=127.0.0.1:49184, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,36625,1676491293696 2023-02-15 20:01:35,534 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-15 20:01:35,534 DEBUG [RS:0;jenkins-hbase4:40517] zookeeper.ZKUtil(162): regionserver:40517-0x1005992ed530001, quorum=127.0.0.1:49184, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,36625,1676491293696 2023-02-15 20:01:35,534 DEBUG [RS:1;jenkins-hbase4:36625] zookeeper.ZKUtil(162): regionserver:36625-0x1005992ed530002, quorum=127.0.0.1:49184, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,40517,1676491293664 2023-02-15 20:01:35,534 DEBUG [RS:0;jenkins-hbase4:40517] zookeeper.ZKUtil(162): regionserver:40517-0x1005992ed530001, quorum=127.0.0.1:49184, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,40517,1676491293664 2023-02-15 20:01:35,536 DEBUG [RS:1;jenkins-hbase4:36625] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-15 20:01:35,536 DEBUG [RS:0;jenkins-hbase4:40517] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-15 20:01:35,536 INFO [RS:1;jenkins-hbase4:36625] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-15 20:01:35,536 INFO [RS:0;jenkins-hbase4:40517] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-15 20:01:35,540 INFO [RS:1;jenkins-hbase4:36625] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-15 20:01:35,541 INFO [RS:1;jenkins-hbase4:36625] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-15 20:01:35,541 INFO [RS:1;jenkins-hbase4:36625] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-15 20:01:35,541 INFO [RS:0;jenkins-hbase4:40517] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-15 20:01:35,544 INFO [RS:1;jenkins-hbase4:36625] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-15 20:01:35,545 INFO [RS:0;jenkins-hbase4:40517] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-15 20:01:35,545 INFO [RS:0;jenkins-hbase4:40517] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-15 20:01:35,548 INFO [RS:0;jenkins-hbase4:40517] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-15 20:01:35,548 INFO [RS:1;jenkins-hbase4:36625] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-15 20:01:35,549 DEBUG [RS:1;jenkins-hbase4:36625] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 20:01:35,549 DEBUG [RS:1;jenkins-hbase4:36625] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 20:01:35,550 DEBUG [RS:1;jenkins-hbase4:36625] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 20:01:35,550 DEBUG [RS:1;jenkins-hbase4:36625] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 20:01:35,550 DEBUG [RS:1;jenkins-hbase4:36625] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 20:01:35,550 DEBUG [RS:1;jenkins-hbase4:36625] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-15 20:01:35,550 DEBUG [RS:1;jenkins-hbase4:36625] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 20:01:35,550 DEBUG [RS:1;jenkins-hbase4:36625] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 20:01:35,550 DEBUG [RS:1;jenkins-hbase4:36625] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 20:01:35,550 DEBUG [RS:1;jenkins-hbase4:36625] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 20:01:35,550 INFO [RS:0;jenkins-hbase4:40517] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-15 20:01:35,552 DEBUG [RS:0;jenkins-hbase4:40517] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 20:01:35,552 DEBUG [RS:0;jenkins-hbase4:40517] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 20:01:35,553 INFO [RS:1;jenkins-hbase4:36625] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-15 20:01:35,553 DEBUG [RS:0;jenkins-hbase4:40517] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 20:01:35,553 INFO [RS:1;jenkins-hbase4:36625] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-15 20:01:35,553 DEBUG [RS:0;jenkins-hbase4:40517] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 20:01:35,553 INFO [RS:1;jenkins-hbase4:36625] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-15 20:01:35,553 DEBUG [RS:0;jenkins-hbase4:40517] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 20:01:35,553 DEBUG [RS:0;jenkins-hbase4:40517] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-15 20:01:35,553 DEBUG [RS:0;jenkins-hbase4:40517] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 20:01:35,553 DEBUG [RS:0;jenkins-hbase4:40517] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 20:01:35,553 DEBUG [RS:0;jenkins-hbase4:40517] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 20:01:35,553 DEBUG [RS:0;jenkins-hbase4:40517] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 20:01:35,554 INFO [RS:0;jenkins-hbase4:40517] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-15 20:01:35,554 INFO [RS:0;jenkins-hbase4:40517] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-15 20:01:35,554 INFO [RS:0;jenkins-hbase4:40517] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-15 20:01:35,565 INFO [RS:1;jenkins-hbase4:36625] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-15 20:01:35,565 INFO [RS:1;jenkins-hbase4:36625] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,36625,1676491293696-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-15 20:01:35,571 INFO [RS:0;jenkins-hbase4:40517] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-15 20:01:35,571 INFO [RS:0;jenkins-hbase4:40517] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,40517,1676491293664-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-15 20:01:35,576 INFO [RS:1;jenkins-hbase4:36625] regionserver.Replication(203): jenkins-hbase4.apache.org,36625,1676491293696 started 2023-02-15 20:01:35,576 INFO [RS:1;jenkins-hbase4:36625] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,36625,1676491293696, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:36625, sessionid=0x1005992ed530002 2023-02-15 20:01:35,576 DEBUG [RS:1;jenkins-hbase4:36625] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-15 20:01:35,576 DEBUG [RS:1;jenkins-hbase4:36625] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,36625,1676491293696 2023-02-15 20:01:35,576 DEBUG [RS:1;jenkins-hbase4:36625] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,36625,1676491293696' 2023-02-15 20:01:35,576 DEBUG [RS:1;jenkins-hbase4:36625] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-15 20:01:35,576 DEBUG [RS:1;jenkins-hbase4:36625] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-15 20:01:35,576 DEBUG [RS:1;jenkins-hbase4:36625] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-15 20:01:35,576 DEBUG [RS:1;jenkins-hbase4:36625] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-15 20:01:35,576 DEBUG [RS:1;jenkins-hbase4:36625] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,36625,1676491293696 2023-02-15 20:01:35,576 DEBUG [RS:1;jenkins-hbase4:36625] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,36625,1676491293696' 2023-02-15 20:01:35,577 DEBUG [RS:1;jenkins-hbase4:36625] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-15 20:01:35,577 DEBUG [RS:1;jenkins-hbase4:36625] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-15 20:01:35,577 DEBUG [RS:1;jenkins-hbase4:36625] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-15 20:01:35,577 INFO [RS:1;jenkins-hbase4:36625] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-15 20:01:35,577 INFO [RS:1;jenkins-hbase4:36625] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-15 20:01:35,582 INFO [RS:0;jenkins-hbase4:40517] regionserver.Replication(203): jenkins-hbase4.apache.org,40517,1676491293664 started 2023-02-15 20:01:35,582 INFO [RS:0;jenkins-hbase4:40517] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,40517,1676491293664, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:40517, sessionid=0x1005992ed530001 2023-02-15 20:01:35,582 DEBUG [RS:0;jenkins-hbase4:40517] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-15 20:01:35,582 DEBUG [RS:0;jenkins-hbase4:40517] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,40517,1676491293664 2023-02-15 20:01:35,582 DEBUG [RS:0;jenkins-hbase4:40517] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,40517,1676491293664' 2023-02-15 20:01:35,582 DEBUG [RS:0;jenkins-hbase4:40517] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-15 20:01:35,582 DEBUG [RS:0;jenkins-hbase4:40517] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-15 20:01:35,583 DEBUG [RS:0;jenkins-hbase4:40517] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-15 20:01:35,583 DEBUG [RS:0;jenkins-hbase4:40517] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-15 20:01:35,583 DEBUG [RS:0;jenkins-hbase4:40517] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,40517,1676491293664 2023-02-15 20:01:35,583 DEBUG [RS:0;jenkins-hbase4:40517] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,40517,1676491293664' 2023-02-15 20:01:35,583 DEBUG [RS:0;jenkins-hbase4:40517] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-15 20:01:35,583 DEBUG [RS:0;jenkins-hbase4:40517] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-15 20:01:35,583 DEBUG [RS:0;jenkins-hbase4:40517] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-15 20:01:35,583 INFO [RS:0;jenkins-hbase4:40517] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-15 20:01:35,583 INFO [RS:0;jenkins-hbase4:40517] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-15 20:01:35,687 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,40517,1676491293664 2023-02-15 20:01:35,687 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-15 20:01:35,689 INFO [RS-EventLoopGroup-13-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56740, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-15 20:01:35,695 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:meta,,1.1588230740 2023-02-15 20:01:35,695 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-15 20:01:35,697 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C40517%2C1676491293664.meta, suffix=.meta, logDir=hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/WALs/jenkins-hbase4.apache.org,40517,1676491293664, archiveDir=hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/oldWALs, maxLogs=32 2023-02-15 20:01:35,712 DEBUG [RS-EventLoopGroup-14-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36975,DS-36199039-2a25-4302-8846-2abe0a20a212,DISK] 2023-02-15 20:01:35,712 DEBUG [RS-EventLoopGroup-14-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41685,DS-e837e9c6-0708-472d-9353-1e894a7734aa,DISK] 2023-02-15 20:01:35,714 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/WALs/jenkins-hbase4.apache.org,40517,1676491293664/jenkins-hbase4.apache.org%2C40517%2C1676491293664.meta.1676491295697.meta 2023-02-15 20:01:35,714 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:41685,DS-e837e9c6-0708-472d-9353-1e894a7734aa,DISK], DatanodeInfoWithStorage[127.0.0.1:36975,DS-36199039-2a25-4302-8846-2abe0a20a212,DISK]] 2023-02-15 20:01:35,714 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-02-15 20:01:35,714 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-02-15 20:01:35,714 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8546): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-02-15 20:01:35,714 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-02-15 20:01:35,714 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-02-15 20:01:35,715 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 20:01:35,715 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 1588230740 2023-02-15 20:01:35,715 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 1588230740 2023-02-15 20:01:35,716 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-15 20:01:35,717 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/data/hbase/meta/1588230740/info 2023-02-15 20:01:35,717 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/data/hbase/meta/1588230740/info 2023-02-15 20:01:35,717 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-15 20:01:35,717 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 20:01:35,717 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-15 20:01:35,718 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/data/hbase/meta/1588230740/rep_barrier 2023-02-15 20:01:35,718 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/data/hbase/meta/1588230740/rep_barrier 2023-02-15 20:01:35,719 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-15 20:01:35,719 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 20:01:35,719 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-15 20:01:35,720 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/data/hbase/meta/1588230740/table 2023-02-15 20:01:35,720 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/data/hbase/meta/1588230740/table 2023-02-15 20:01:35,720 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-15 20:01:35,720 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 20:01:35,721 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/data/hbase/meta/1588230740 2023-02-15 20:01:35,722 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/data/hbase/meta/1588230740 2023-02-15 20:01:35,723 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-15 20:01:35,724 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-15 20:01:35,725 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63502947, jitterRate=-0.05373235046863556}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-15 20:01:35,725 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 1588230740: 2023-02-15 20:01:35,726 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1676491295687 2023-02-15 20:01:35,730 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:meta,,1.1588230740 2023-02-15 20:01:35,730 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:meta,,1.1588230740 2023-02-15 20:01:35,730 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,40517,1676491293664, state=OPEN 2023-02-15 20:01:35,802 DEBUG [Listener at localhost/43553-EventThread] zookeeper.ZKWatcher(600): master:35467-0x1005992ed530000, quorum=127.0.0.1:49184, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-02-15 20:01:35,802 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-15 20:01:35,803 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-02-15 20:01:35,803 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,40517,1676491293664 in 269 msec 2023-02-15 20:01:35,804 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-02-15 20:01:35,804 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 1.0670 sec 2023-02-15 20:01:35,806 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 1.1160 sec 2023-02-15 20:01:35,806 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1676491295806, completionTime=-1 2023-02-15 20:01:35,806 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=2; waited=0ms, expected min=2 server(s), max=2 server(s), master is running 2023-02-15 20:01:35,806 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1519): Joining cluster... 2023-02-15 20:01:35,809 DEBUG [hconnection-0x116d04de-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-15 20:01:35,810 INFO [RS-EventLoopGroup-13-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56754, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-15 20:01:35,812 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1531): Number of RegionServers=2 2023-02-15 20:01:35,812 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1676491355812 2023-02-15 20:01:35,812 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1676491415812 2023-02-15 20:01:35,812 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1538): Joined the cluster in 5 msec 2023-02-15 20:01:35,980 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,35467,1676491293605-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-15 20:01:35,980 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,35467,1676491293605-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-15 20:01:35,980 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,35467,1676491293605-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-15 20:01:35,980 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:35467, period=300000, unit=MILLISECONDS is enabled. 2023-02-15 20:01:35,980 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-02-15 20:01:35,980 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-02-15 20:01:35,980 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-15 20:01:35,981 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-02-15 20:01:35,983 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-02-15 20:01:35,983 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-02-15 20:01:35,984 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-15 20:01:35,985 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/.tmp/data/hbase/namespace/c723e21a7ef92eed0b6fdf5f063344e2 2023-02-15 20:01:35,986 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/.tmp/data/hbase/namespace/c723e21a7ef92eed0b6fdf5f063344e2 empty. 2023-02-15 20:01:35,986 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/.tmp/data/hbase/namespace/c723e21a7ef92eed0b6fdf5f063344e2 2023-02-15 20:01:35,986 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-02-15 20:01:35,997 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-02-15 20:01:35,998 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7671): creating {ENCODED => c723e21a7ef92eed0b6fdf5f063344e2, NAME => 'hbase:namespace,,1676491295980.c723e21a7ef92eed0b6fdf5f063344e2.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/.tmp 2023-02-15 20:01:36,006 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676491295980.c723e21a7ef92eed0b6fdf5f063344e2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 20:01:36,006 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1603): Closing c723e21a7ef92eed0b6fdf5f063344e2, disabling compactions & flushes 2023-02-15 20:01:36,006 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676491295980.c723e21a7ef92eed0b6fdf5f063344e2. 2023-02-15 20:01:36,007 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676491295980.c723e21a7ef92eed0b6fdf5f063344e2. 2023-02-15 20:01:36,007 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676491295980.c723e21a7ef92eed0b6fdf5f063344e2. after waiting 0 ms 2023-02-15 20:01:36,007 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676491295980.c723e21a7ef92eed0b6fdf5f063344e2. 2023-02-15 20:01:36,007 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676491295980.c723e21a7ef92eed0b6fdf5f063344e2. 2023-02-15 20:01:36,007 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1557): Region close journal for c723e21a7ef92eed0b6fdf5f063344e2: 2023-02-15 20:01:36,009 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-02-15 20:01:36,010 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1676491295980.c723e21a7ef92eed0b6fdf5f063344e2.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676491296009"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676491296009"}]},"ts":"1676491296009"} 2023-02-15 20:01:36,012 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-15 20:01:36,013 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-15 20:01:36,013 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676491296013"}]},"ts":"1676491296013"} 2023-02-15 20:01:36,015 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-02-15 20:01:36,125 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-15 20:01:36,126 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-15 20:01:36,126 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-15 20:01:36,126 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-15 20:01:36,128 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=c723e21a7ef92eed0b6fdf5f063344e2, ASSIGN}] 2023-02-15 20:01:36,131 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=c723e21a7ef92eed0b6fdf5f063344e2, ASSIGN 2023-02-15 20:01:36,132 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=c723e21a7ef92eed0b6fdf5f063344e2, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40517,1676491293664; forceNewPlan=false, retain=false 2023-02-15 20:01:36,282 INFO [jenkins-hbase4:35467] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-15 20:01:36,284 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=c723e21a7ef92eed0b6fdf5f063344e2, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40517,1676491293664 2023-02-15 20:01:36,284 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1676491295980.c723e21a7ef92eed0b6fdf5f063344e2.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676491296283"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676491296283"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676491296283"}]},"ts":"1676491296283"} 2023-02-15 20:01:36,286 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure c723e21a7ef92eed0b6fdf5f063344e2, server=jenkins-hbase4.apache.org,40517,1676491293664}] 2023-02-15 20:01:36,441 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:namespace,,1676491295980.c723e21a7ef92eed0b6fdf5f063344e2. 2023-02-15 20:01:36,443 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C40517%2C1676491293664, suffix=, logDir=hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/WALs/jenkins-hbase4.apache.org,40517,1676491293664, archiveDir=hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/oldWALs, maxLogs=32 2023-02-15 20:01:36,456 DEBUG [RS-EventLoopGroup-14-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41685,DS-e837e9c6-0708-472d-9353-1e894a7734aa,DISK] 2023-02-15 20:01:36,456 DEBUG [RS-EventLoopGroup-14-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36975,DS-36199039-2a25-4302-8846-2abe0a20a212,DISK] 2023-02-15 20:01:36,458 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/WALs/jenkins-hbase4.apache.org,40517,1676491293664/jenkins-hbase4.apache.org%2C40517%2C1676491293664.1676491296443 2023-02-15 20:01:36,458 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:41685,DS-e837e9c6-0708-472d-9353-1e894a7734aa,DISK], DatanodeInfoWithStorage[127.0.0.1:36975,DS-36199039-2a25-4302-8846-2abe0a20a212,DISK]] 2023-02-15 20:01:36,458 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => c723e21a7ef92eed0b6fdf5f063344e2, NAME => 'hbase:namespace,,1676491295980.c723e21a7ef92eed0b6fdf5f063344e2.', STARTKEY => '', ENDKEY => ''} 2023-02-15 20:01:36,458 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace c723e21a7ef92eed0b6fdf5f063344e2 2023-02-15 20:01:36,458 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676491295980.c723e21a7ef92eed0b6fdf5f063344e2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 20:01:36,458 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for c723e21a7ef92eed0b6fdf5f063344e2 2023-02-15 20:01:36,458 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for c723e21a7ef92eed0b6fdf5f063344e2 2023-02-15 20:01:36,459 INFO [StoreOpener-c723e21a7ef92eed0b6fdf5f063344e2-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region c723e21a7ef92eed0b6fdf5f063344e2 2023-02-15 20:01:36,460 DEBUG [StoreOpener-c723e21a7ef92eed0b6fdf5f063344e2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/data/hbase/namespace/c723e21a7ef92eed0b6fdf5f063344e2/info 2023-02-15 20:01:36,460 DEBUG [StoreOpener-c723e21a7ef92eed0b6fdf5f063344e2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/data/hbase/namespace/c723e21a7ef92eed0b6fdf5f063344e2/info 2023-02-15 20:01:36,461 INFO [StoreOpener-c723e21a7ef92eed0b6fdf5f063344e2-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c723e21a7ef92eed0b6fdf5f063344e2 columnFamilyName info 2023-02-15 20:01:36,461 INFO [StoreOpener-c723e21a7ef92eed0b6fdf5f063344e2-1] regionserver.HStore(310): Store=c723e21a7ef92eed0b6fdf5f063344e2/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 20:01:36,462 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/data/hbase/namespace/c723e21a7ef92eed0b6fdf5f063344e2 2023-02-15 20:01:36,462 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/data/hbase/namespace/c723e21a7ef92eed0b6fdf5f063344e2 2023-02-15 20:01:36,464 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for c723e21a7ef92eed0b6fdf5f063344e2 2023-02-15 20:01:36,465 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/data/hbase/namespace/c723e21a7ef92eed0b6fdf5f063344e2/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-15 20:01:36,466 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened c723e21a7ef92eed0b6fdf5f063344e2; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64836130, jitterRate=-0.03386637568473816}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-15 20:01:36,466 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for c723e21a7ef92eed0b6fdf5f063344e2: 2023-02-15 20:01:36,466 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:namespace,,1676491295980.c723e21a7ef92eed0b6fdf5f063344e2., pid=6, masterSystemTime=1676491296438 2023-02-15 20:01:36,469 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=c723e21a7ef92eed0b6fdf5f063344e2, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40517,1676491293664 2023-02-15 20:01:36,469 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1676491295980.c723e21a7ef92eed0b6fdf5f063344e2.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676491296469"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676491296469"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676491296469"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676491296469"}]},"ts":"1676491296469"} 2023-02-15 20:01:36,471 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:namespace,,1676491295980.c723e21a7ef92eed0b6fdf5f063344e2. 2023-02-15 20:01:36,471 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:namespace,,1676491295980.c723e21a7ef92eed0b6fdf5f063344e2. 2023-02-15 20:01:36,474 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-02-15 20:01:36,474 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure c723e21a7ef92eed0b6fdf5f063344e2, server=jenkins-hbase4.apache.org,40517,1676491293664 in 186 msec 2023-02-15 20:01:36,475 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-02-15 20:01:36,475 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=c723e21a7ef92eed0b6fdf5f063344e2, ASSIGN in 348 msec 2023-02-15 20:01:36,476 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-15 20:01:36,476 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676491296476"}]},"ts":"1676491296476"} 2023-02-15 20:01:36,477 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-02-15 20:01:36,525 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:35467-0x1005992ed530000, quorum=127.0.0.1:49184, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-02-15 20:01:36,526 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-02-15 20:01:36,527 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 546 msec 2023-02-15 20:01:36,578 DEBUG [Listener at localhost/43553-EventThread] zookeeper.ZKWatcher(600): master:35467-0x1005992ed530000, quorum=127.0.0.1:49184, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-02-15 20:01:36,578 DEBUG [Listener at localhost/43553-EventThread] zookeeper.ZKWatcher(600): master:35467-0x1005992ed530000, quorum=127.0.0.1:49184, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-15 20:01:36,579 INFO [RS:1;jenkins-hbase4:36625] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C36625%2C1676491293696, suffix=, logDir=hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/WALs/jenkins-hbase4.apache.org,36625,1676491293696, archiveDir=hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/oldWALs, maxLogs=32 2023-02-15 20:01:36,582 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-02-15 20:01:36,595 DEBUG [RS-EventLoopGroup-14-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36975,DS-36199039-2a25-4302-8846-2abe0a20a212,DISK] 2023-02-15 20:01:36,595 DEBUG [RS-EventLoopGroup-14-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41685,DS-e837e9c6-0708-472d-9353-1e894a7734aa,DISK] 2023-02-15 20:01:36,598 INFO [RS:1;jenkins-hbase4:36625] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/WALs/jenkins-hbase4.apache.org,36625,1676491293696/jenkins-hbase4.apache.org%2C36625%2C1676491293696.1676491296579 2023-02-15 20:01:36,599 DEBUG [RS:1;jenkins-hbase4:36625] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:36975,DS-36199039-2a25-4302-8846-2abe0a20a212,DISK], DatanodeInfoWithStorage[127.0.0.1:41685,DS-e837e9c6-0708-472d-9353-1e894a7734aa,DISK]] 2023-02-15 20:01:36,601 DEBUG [Listener at localhost/43553-EventThread] zookeeper.ZKWatcher(600): master:35467-0x1005992ed530000, quorum=127.0.0.1:49184, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-15 20:01:36,626 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 43 msec 2023-02-15 20:01:36,635 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-02-15 20:01:36,641 DEBUG [Listener at localhost/43553-EventThread] zookeeper.ZKWatcher(600): master:35467-0x1005992ed530000, quorum=127.0.0.1:49184, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-15 20:01:36,649 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 14 msec 2023-02-15 20:01:36,663 DEBUG [Listener at localhost/43553-EventThread] zookeeper.ZKWatcher(600): master:35467-0x1005992ed530000, quorum=127.0.0.1:49184, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-02-15 20:01:36,678 DEBUG [Listener at localhost/43553-EventThread] zookeeper.ZKWatcher(600): master:35467-0x1005992ed530000, quorum=127.0.0.1:49184, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-02-15 20:01:36,679 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 2.799sec 2023-02-15 20:01:36,679 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-02-15 20:01:36,679 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-02-15 20:01:36,679 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-02-15 20:01:36,679 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,35467,1676491293605-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-02-15 20:01:36,679 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,35467,1676491293605-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-02-15 20:01:36,680 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-02-15 20:01:36,772 DEBUG [Listener at localhost/43553] zookeeper.ReadOnlyZKClient(139): Connect 0x22c6b7ea to 127.0.0.1:49184 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-15 20:01:36,778 DEBUG [Listener at localhost/43553] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@14c314f1, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-15 20:01:36,780 DEBUG [hconnection-0x5980165c-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-15 20:01:36,781 INFO [RS-EventLoopGroup-13-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56770, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-15 20:01:36,783 INFO [Listener at localhost/43553] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,35467,1676491293605 2023-02-15 20:01:36,783 DEBUG [Listener at localhost/43553] mapreduce.TableSnapshotInputFormatTestBase(193): Ensuring table doesn't exist. 2023-02-15 20:01:36,784 DEBUG [Listener at localhost/43553] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-15 20:01:36,786 INFO [RS-EventLoopGroup-12-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46148, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-15 20:01:36,786 INFO [Listener at localhost/43553] client.HBaseAdmin$15(890): Started disable of testWithMockedMapReduceMultiRegion 2023-02-15 20:01:36,787 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35467] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testWithMockedMapReduceMultiRegion 2023-02-15 20:01:36,787 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35467] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.TableNotFoundException: testWithMockedMapReduceMultiRegion at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.checkTableModifiable(AbstractStateMachineTableProcedure.java:125) at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.preflightChecks(AbstractStateMachineTableProcedure.java:157) at org.apache.hadoop.hbase.master.procedure.DisableTableProcedure.(DisableTableProcedure.java:78) at org.apache.hadoop.hbase.master.HMaster$11.run(HMaster.java:2429) at org.apache.hadoop.hbase.master.procedure.MasterProcedureUtil.submitProcedure(MasterProcedureUtil.java:132) at org.apache.hadoop.hbase.master.HMaster.disableTable(HMaster.java:2413) at org.apache.hadoop.hbase.master.MasterRpcServices.disableTable(MasterRpcServices.java:784) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-02-15 20:01:36,787 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35467] ipc.CallRunner(144): callId: 2 service: MasterService methodName: DisableTable size: 93 connection: 172.31.14.131:46148 deadline: 1676491356787, exception=org.apache.hadoop.hbase.TableNotFoundException: testWithMockedMapReduceMultiRegion 2023-02-15 20:01:36,787 INFO [Listener at localhost/43553] mapreduce.TableSnapshotInputFormatTestBase(199): creating table 'testWithMockedMapReduceMultiRegion' 2023-02-15 20:01:36,789 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35467] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-15 20:01:36,791 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35467] procedure2.ProcedureExecutor(1029): Stored pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testWithMockedMapReduceMultiRegion 2023-02-15 20:01:36,792 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testWithMockedMapReduceMultiRegion execute state=CREATE_TABLE_PRE_OPERATION 2023-02-15 20:01:36,792 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35467] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testWithMockedMapReduceMultiRegion" procId is: 10 2023-02-15 20:01:36,793 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testWithMockedMapReduceMultiRegion execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-15 20:01:36,793 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35467] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-15 20:01:36,800 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/.tmp/data/default/testWithMockedMapReduceMultiRegion/5e40ee2d96ae1cbe88d7c194cd72dda2 2023-02-15 20:01:36,800 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/.tmp/data/default/testWithMockedMapReduceMultiRegion/5a8c9c21a9831b445d533dd705940e06 2023-02-15 20:01:36,800 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/.tmp/data/default/testWithMockedMapReduceMultiRegion/c069ee68dab22f36ea73f04b91933c1f 2023-02-15 20:01:36,800 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/.tmp/data/default/testWithMockedMapReduceMultiRegion/fe51e97cb822f497ca56994d85f7310f 2023-02-15 20:01:36,800 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/.tmp/data/default/testWithMockedMapReduceMultiRegion/81644ccf4d63c864b007cbc1043831d7 2023-02-15 20:01:36,800 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/.tmp/data/default/testWithMockedMapReduceMultiRegion/007dd63b20f9d2149ba11df9b0cddc4c 2023-02-15 20:01:36,800 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/.tmp/data/default/testWithMockedMapReduceMultiRegion/85c1d4ec199a8eac4595716bde5173ab 2023-02-15 20:01:36,800 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/.tmp/data/default/testWithMockedMapReduceMultiRegion/6f4ab26e6b0d69c90f3b3b848034eb88 2023-02-15 20:01:36,800 DEBUG [HFileArchiver-5] backup.HFileArchiver(153): Directory hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/.tmp/data/default/testWithMockedMapReduceMultiRegion/c069ee68dab22f36ea73f04b91933c1f empty. 2023-02-15 20:01:36,800 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/.tmp/data/default/testWithMockedMapReduceMultiRegion/5e40ee2d96ae1cbe88d7c194cd72dda2 empty. 2023-02-15 20:01:36,801 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/.tmp/data/default/testWithMockedMapReduceMultiRegion/007dd63b20f9d2149ba11df9b0cddc4c empty. 2023-02-15 20:01:36,801 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/.tmp/data/default/testWithMockedMapReduceMultiRegion/85c1d4ec199a8eac4595716bde5173ab empty. 2023-02-15 20:01:36,801 DEBUG [HFileArchiver-6] backup.HFileArchiver(153): Directory hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/.tmp/data/default/testWithMockedMapReduceMultiRegion/81644ccf4d63c864b007cbc1043831d7 empty. 2023-02-15 20:01:36,801 DEBUG [HFileArchiver-5] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/.tmp/data/default/testWithMockedMapReduceMultiRegion/c069ee68dab22f36ea73f04b91933c1f 2023-02-15 20:01:36,801 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/.tmp/data/default/testWithMockedMapReduceMultiRegion/fe51e97cb822f497ca56994d85f7310f empty. 2023-02-15 20:01:36,801 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/.tmp/data/default/testWithMockedMapReduceMultiRegion/007dd63b20f9d2149ba11df9b0cddc4c 2023-02-15 20:01:36,801 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/.tmp/data/default/testWithMockedMapReduceMultiRegion/4229d692a52fca982c3f6193911c155d 2023-02-15 20:01:36,801 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/.tmp/data/default/testWithMockedMapReduceMultiRegion/85c1d4ec199a8eac4595716bde5173ab 2023-02-15 20:01:36,801 DEBUG [HFileArchiver-6] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/.tmp/data/default/testWithMockedMapReduceMultiRegion/81644ccf4d63c864b007cbc1043831d7 2023-02-15 20:01:36,801 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/.tmp/data/default/testWithMockedMapReduceMultiRegion/8a79eee6aefc962407df2ed05672c891 2023-02-15 20:01:36,802 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/.tmp/data/default/testWithMockedMapReduceMultiRegion/fe51e97cb822f497ca56994d85f7310f 2023-02-15 20:01:36,802 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/.tmp/data/default/testWithMockedMapReduceMultiRegion/4229d692a52fca982c3f6193911c155d empty. 2023-02-15 20:01:36,802 DEBUG [HFileArchiver-5] backup.HFileArchiver(153): Directory hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/.tmp/data/default/testWithMockedMapReduceMultiRegion/8a79eee6aefc962407df2ed05672c891 empty. 2023-02-15 20:01:36,802 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/.tmp/data/default/testWithMockedMapReduceMultiRegion/4229d692a52fca982c3f6193911c155d 2023-02-15 20:01:36,802 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/.tmp/data/default/testWithMockedMapReduceMultiRegion/5a8c9c21a9831b445d533dd705940e06 empty. 2023-02-15 20:01:36,802 DEBUG [HFileArchiver-5] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/.tmp/data/default/testWithMockedMapReduceMultiRegion/8a79eee6aefc962407df2ed05672c891 2023-02-15 20:01:36,802 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/.tmp/data/default/testWithMockedMapReduceMultiRegion/5e40ee2d96ae1cbe88d7c194cd72dda2 2023-02-15 20:01:36,802 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/.tmp/data/default/testWithMockedMapReduceMultiRegion/6f4ab26e6b0d69c90f3b3b848034eb88 empty. 2023-02-15 20:01:36,803 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/.tmp/data/default/testWithMockedMapReduceMultiRegion/5a8c9c21a9831b445d533dd705940e06 2023-02-15 20:01:36,803 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/.tmp/data/default/testWithMockedMapReduceMultiRegion/6f4ab26e6b0d69c90f3b3b848034eb88 2023-02-15 20:01:36,803 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testWithMockedMapReduceMultiRegion regions 2023-02-15 20:01:36,813 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/.tmp/data/default/testWithMockedMapReduceMultiRegion/.tabledesc/.tableinfo.0000000001 2023-02-15 20:01:36,814 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(7671): creating {ENCODED => 5e40ee2d96ae1cbe88d7c194cd72dda2, NAME => 'testWithMockedMapReduceMultiRegion,,1676491296789.5e40ee2d96ae1cbe88d7c194cd72dda2.', STARTKEY => '', ENDKEY => 'aaa'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/.tmp 2023-02-15 20:01:36,820 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(7671): creating {ENCODED => 85c1d4ec199a8eac4595716bde5173ab, NAME => 'testWithMockedMapReduceMultiRegion,d\x84\x84,1676491296789.85c1d4ec199a8eac4595716bde5173ab.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/.tmp 2023-02-15 20:01:36,820 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(7671): creating {ENCODED => 6f4ab26e6b0d69c90f3b3b848034eb88, NAME => 'testWithMockedMapReduceMultiRegion,aaa,1676491296789.6f4ab26e6b0d69c90f3b3b848034eb88.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/.tmp 2023-02-15 20:01:36,830 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,,1676491296789.5e40ee2d96ae1cbe88d7c194cd72dda2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 20:01:36,830 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1603): Closing 5e40ee2d96ae1cbe88d7c194cd72dda2, disabling compactions & flushes 2023-02-15 20:01:36,830 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,,1676491296789.5e40ee2d96ae1cbe88d7c194cd72dda2. 2023-02-15 20:01:36,830 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,,1676491296789.5e40ee2d96ae1cbe88d7c194cd72dda2. 2023-02-15 20:01:36,831 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,,1676491296789.5e40ee2d96ae1cbe88d7c194cd72dda2. after waiting 0 ms 2023-02-15 20:01:36,831 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,,1676491296789.5e40ee2d96ae1cbe88d7c194cd72dda2. 2023-02-15 20:01:36,831 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,,1676491296789.5e40ee2d96ae1cbe88d7c194cd72dda2. 2023-02-15 20:01:36,831 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1557): Region close journal for 5e40ee2d96ae1cbe88d7c194cd72dda2: 2023-02-15 20:01:36,831 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,d\x84\x84,1676491296789.85c1d4ec199a8eac4595716bde5173ab.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 20:01:36,831 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(7671): creating {ENCODED => 5a8c9c21a9831b445d533dd705940e06, NAME => 'testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676491296789.5a8c9c21a9831b445d533dd705940e06.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/.tmp 2023-02-15 20:01:36,831 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1603): Closing 85c1d4ec199a8eac4595716bde5173ab, disabling compactions & flushes 2023-02-15 20:01:36,831 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,d\x84\x84,1676491296789.85c1d4ec199a8eac4595716bde5173ab. 2023-02-15 20:01:36,831 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,d\x84\x84,1676491296789.85c1d4ec199a8eac4595716bde5173ab. 2023-02-15 20:01:36,831 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,d\x84\x84,1676491296789.85c1d4ec199a8eac4595716bde5173ab. after waiting 0 ms 2023-02-15 20:01:36,831 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,d\x84\x84,1676491296789.85c1d4ec199a8eac4595716bde5173ab. 2023-02-15 20:01:36,831 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,d\x84\x84,1676491296789.85c1d4ec199a8eac4595716bde5173ab. 2023-02-15 20:01:36,831 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1557): Region close journal for 85c1d4ec199a8eac4595716bde5173ab: 2023-02-15 20:01:36,832 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(7671): creating {ENCODED => 007dd63b20f9d2149ba11df9b0cddc4c, NAME => 'testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676491296789.007dd63b20f9d2149ba11df9b0cddc4c.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/.tmp 2023-02-15 20:01:36,833 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,aaa,1676491296789.6f4ab26e6b0d69c90f3b3b848034eb88.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 20:01:36,833 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1603): Closing 6f4ab26e6b0d69c90f3b3b848034eb88, disabling compactions & flushes 2023-02-15 20:01:36,833 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,aaa,1676491296789.6f4ab26e6b0d69c90f3b3b848034eb88. 2023-02-15 20:01:36,833 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,aaa,1676491296789.6f4ab26e6b0d69c90f3b3b848034eb88. 2023-02-15 20:01:36,833 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,aaa,1676491296789.6f4ab26e6b0d69c90f3b3b848034eb88. after waiting 0 ms 2023-02-15 20:01:36,833 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,aaa,1676491296789.6f4ab26e6b0d69c90f3b3b848034eb88. 2023-02-15 20:01:36,833 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,aaa,1676491296789.6f4ab26e6b0d69c90f3b3b848034eb88. 2023-02-15 20:01:36,833 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1557): Region close journal for 6f4ab26e6b0d69c90f3b3b848034eb88: 2023-02-15 20:01:36,833 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(7671): creating {ENCODED => c069ee68dab22f36ea73f04b91933c1f, NAME => 'testWithMockedMapReduceMultiRegion,m\xED\xED,1676491296789.c069ee68dab22f36ea73f04b91933c1f.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/.tmp 2023-02-15 20:01:36,842 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676491296789.5a8c9c21a9831b445d533dd705940e06.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 20:01:36,843 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1603): Closing 5a8c9c21a9831b445d533dd705940e06, disabling compactions & flushes 2023-02-15 20:01:36,843 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676491296789.5a8c9c21a9831b445d533dd705940e06. 2023-02-15 20:01:36,843 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676491296789.5a8c9c21a9831b445d533dd705940e06. 2023-02-15 20:01:36,843 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676491296789.5a8c9c21a9831b445d533dd705940e06. after waiting 0 ms 2023-02-15 20:01:36,843 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676491296789.5a8c9c21a9831b445d533dd705940e06. 2023-02-15 20:01:36,843 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676491296789.5a8c9c21a9831b445d533dd705940e06. 2023-02-15 20:01:36,843 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1557): Region close journal for 5a8c9c21a9831b445d533dd705940e06: 2023-02-15 20:01:36,843 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(7671): creating {ENCODED => 81644ccf4d63c864b007cbc1043831d7, NAME => 'testWithMockedMapReduceMultiRegion,q\x11\x10,1676491296789.81644ccf4d63c864b007cbc1043831d7.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/.tmp 2023-02-15 20:01:36,844 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676491296789.007dd63b20f9d2149ba11df9b0cddc4c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 20:01:36,844 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1603): Closing 007dd63b20f9d2149ba11df9b0cddc4c, disabling compactions & flushes 2023-02-15 20:01:36,844 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676491296789.007dd63b20f9d2149ba11df9b0cddc4c. 2023-02-15 20:01:36,844 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676491296789.007dd63b20f9d2149ba11df9b0cddc4c. 2023-02-15 20:01:36,844 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676491296789.007dd63b20f9d2149ba11df9b0cddc4c. after waiting 0 ms 2023-02-15 20:01:36,844 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676491296789.007dd63b20f9d2149ba11df9b0cddc4c. 2023-02-15 20:01:36,845 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676491296789.007dd63b20f9d2149ba11df9b0cddc4c. 2023-02-15 20:01:36,845 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1557): Region close journal for 007dd63b20f9d2149ba11df9b0cddc4c: 2023-02-15 20:01:36,845 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(7671): creating {ENCODED => fe51e97cb822f497ca56994d85f7310f, NAME => 'testWithMockedMapReduceMultiRegion,t43,1676491296789.fe51e97cb822f497ca56994d85f7310f.', STARTKEY => 't43', ENDKEY => 'wWV'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/.tmp 2023-02-15 20:01:36,845 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,m\xED\xED,1676491296789.c069ee68dab22f36ea73f04b91933c1f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 20:01:36,846 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1603): Closing c069ee68dab22f36ea73f04b91933c1f, disabling compactions & flushes 2023-02-15 20:01:36,846 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,m\xED\xED,1676491296789.c069ee68dab22f36ea73f04b91933c1f. 2023-02-15 20:01:36,846 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,m\xED\xED,1676491296789.c069ee68dab22f36ea73f04b91933c1f. 2023-02-15 20:01:36,846 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,m\xED\xED,1676491296789.c069ee68dab22f36ea73f04b91933c1f. after waiting 0 ms 2023-02-15 20:01:36,846 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,m\xED\xED,1676491296789.c069ee68dab22f36ea73f04b91933c1f. 2023-02-15 20:01:36,846 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,m\xED\xED,1676491296789.c069ee68dab22f36ea73f04b91933c1f. 2023-02-15 20:01:36,846 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1557): Region close journal for c069ee68dab22f36ea73f04b91933c1f: 2023-02-15 20:01:36,846 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(7671): creating {ENCODED => 8a79eee6aefc962407df2ed05672c891, NAME => 'testWithMockedMapReduceMultiRegion,wWV,1676491296789.8a79eee6aefc962407df2ed05672c891.', STARTKEY => 'wWV', ENDKEY => 'zz{'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/.tmp 2023-02-15 20:01:36,852 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,q\x11\x10,1676491296789.81644ccf4d63c864b007cbc1043831d7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 20:01:36,852 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1603): Closing 81644ccf4d63c864b007cbc1043831d7, disabling compactions & flushes 2023-02-15 20:01:36,852 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,q\x11\x10,1676491296789.81644ccf4d63c864b007cbc1043831d7. 2023-02-15 20:01:36,852 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,q\x11\x10,1676491296789.81644ccf4d63c864b007cbc1043831d7. 2023-02-15 20:01:36,852 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,q\x11\x10,1676491296789.81644ccf4d63c864b007cbc1043831d7. after waiting 0 ms 2023-02-15 20:01:36,852 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,q\x11\x10,1676491296789.81644ccf4d63c864b007cbc1043831d7. 2023-02-15 20:01:36,852 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,q\x11\x10,1676491296789.81644ccf4d63c864b007cbc1043831d7. 2023-02-15 20:01:36,852 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1557): Region close journal for 81644ccf4d63c864b007cbc1043831d7: 2023-02-15 20:01:36,853 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(7671): creating {ENCODED => 4229d692a52fca982c3f6193911c155d, NAME => 'testWithMockedMapReduceMultiRegion,zz{,1676491296789.4229d692a52fca982c3f6193911c155d.', STARTKEY => 'zz{', ENDKEY => ''}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/.tmp 2023-02-15 20:01:36,855 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,t43,1676491296789.fe51e97cb822f497ca56994d85f7310f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 20:01:36,855 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1603): Closing fe51e97cb822f497ca56994d85f7310f, disabling compactions & flushes 2023-02-15 20:01:36,855 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,t43,1676491296789.fe51e97cb822f497ca56994d85f7310f. 2023-02-15 20:01:36,855 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,t43,1676491296789.fe51e97cb822f497ca56994d85f7310f. 2023-02-15 20:01:36,855 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,t43,1676491296789.fe51e97cb822f497ca56994d85f7310f. after waiting 0 ms 2023-02-15 20:01:36,855 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,t43,1676491296789.fe51e97cb822f497ca56994d85f7310f. 2023-02-15 20:01:36,855 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,t43,1676491296789.fe51e97cb822f497ca56994d85f7310f. 2023-02-15 20:01:36,855 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1557): Region close journal for fe51e97cb822f497ca56994d85f7310f: 2023-02-15 20:01:36,857 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,wWV,1676491296789.8a79eee6aefc962407df2ed05672c891.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 20:01:36,857 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1603): Closing 8a79eee6aefc962407df2ed05672c891, disabling compactions & flushes 2023-02-15 20:01:36,857 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,wWV,1676491296789.8a79eee6aefc962407df2ed05672c891. 2023-02-15 20:01:36,857 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,wWV,1676491296789.8a79eee6aefc962407df2ed05672c891. 2023-02-15 20:01:36,857 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,wWV,1676491296789.8a79eee6aefc962407df2ed05672c891. after waiting 0 ms 2023-02-15 20:01:36,857 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,wWV,1676491296789.8a79eee6aefc962407df2ed05672c891. 2023-02-15 20:01:36,857 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,wWV,1676491296789.8a79eee6aefc962407df2ed05672c891. 2023-02-15 20:01:36,857 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1557): Region close journal for 8a79eee6aefc962407df2ed05672c891: 2023-02-15 20:01:36,859 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,zz{,1676491296789.4229d692a52fca982c3f6193911c155d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 20:01:36,859 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1603): Closing 4229d692a52fca982c3f6193911c155d, disabling compactions & flushes 2023-02-15 20:01:36,859 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,zz{,1676491296789.4229d692a52fca982c3f6193911c155d. 2023-02-15 20:01:36,859 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,zz{,1676491296789.4229d692a52fca982c3f6193911c155d. 2023-02-15 20:01:36,859 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,zz{,1676491296789.4229d692a52fca982c3f6193911c155d. after waiting 0 ms 2023-02-15 20:01:36,859 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,zz{,1676491296789.4229d692a52fca982c3f6193911c155d. 2023-02-15 20:01:36,859 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,zz{,1676491296789.4229d692a52fca982c3f6193911c155d. 2023-02-15 20:01:36,859 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1557): Region close journal for 4229d692a52fca982c3f6193911c155d: 2023-02-15 20:01:36,861 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testWithMockedMapReduceMultiRegion execute state=CREATE_TABLE_ADD_TO_META 2023-02-15 20:01:36,862 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,,1676491296789.5e40ee2d96ae1cbe88d7c194cd72dda2.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1676491296862"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676491296862"}]},"ts":"1676491296862"} 2023-02-15 20:01:36,862 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,d\\x84\\x84,1676491296789.85c1d4ec199a8eac4595716bde5173ab.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676491296862"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676491296862"}]},"ts":"1676491296862"} 2023-02-15 20:01:36,862 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,aaa,1676491296789.6f4ab26e6b0d69c90f3b3b848034eb88.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676491296862"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676491296862"}]},"ts":"1676491296862"} 2023-02-15 20:01:36,863 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,g\\xA7\\xA7,1676491296789.5a8c9c21a9831b445d533dd705940e06.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676491296862"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676491296862"}]},"ts":"1676491296862"} 2023-02-15 20:01:36,863 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,j\\xCA\\xCA,1676491296789.007dd63b20f9d2149ba11df9b0cddc4c.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676491296862"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676491296862"}]},"ts":"1676491296862"} 2023-02-15 20:01:36,863 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,m\\xED\\xED,1676491296789.c069ee68dab22f36ea73f04b91933c1f.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676491296862"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676491296862"}]},"ts":"1676491296862"} 2023-02-15 20:01:36,863 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,q\\x11\\x10,1676491296789.81644ccf4d63c864b007cbc1043831d7.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676491296862"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676491296862"}]},"ts":"1676491296862"} 2023-02-15 20:01:36,863 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,t43,1676491296789.fe51e97cb822f497ca56994d85f7310f.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676491296862"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676491296862"}]},"ts":"1676491296862"} 2023-02-15 20:01:36,863 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,wWV,1676491296789.8a79eee6aefc962407df2ed05672c891.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676491296862"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676491296862"}]},"ts":"1676491296862"} 2023-02-15 20:01:36,863 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,zz{,1676491296789.4229d692a52fca982c3f6193911c155d.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1676491296862"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676491296862"}]},"ts":"1676491296862"} 2023-02-15 20:01:36,865 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 10 regions to meta. 2023-02-15 20:01:36,865 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testWithMockedMapReduceMultiRegion execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-15 20:01:36,866 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676491296866"}]},"ts":"1676491296866"} 2023-02-15 20:01:36,867 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testWithMockedMapReduceMultiRegion, state=ENABLING in hbase:meta 2023-02-15 20:01:36,869 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-15 20:01:36,875 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-15 20:01:36,875 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-15 20:01:36,875 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-15 20:01:36,875 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=5e40ee2d96ae1cbe88d7c194cd72dda2, ASSIGN}, {pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=6f4ab26e6b0d69c90f3b3b848034eb88, ASSIGN}, {pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=85c1d4ec199a8eac4595716bde5173ab, ASSIGN}, {pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=5a8c9c21a9831b445d533dd705940e06, ASSIGN}, {pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=007dd63b20f9d2149ba11df9b0cddc4c, ASSIGN}, {pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=c069ee68dab22f36ea73f04b91933c1f, ASSIGN}, {pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=81644ccf4d63c864b007cbc1043831d7, ASSIGN}, {pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=fe51e97cb822f497ca56994d85f7310f, ASSIGN}, {pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=8a79eee6aefc962407df2ed05672c891, ASSIGN}, {pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=4229d692a52fca982c3f6193911c155d, ASSIGN}] 2023-02-15 20:01:36,877 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=fe51e97cb822f497ca56994d85f7310f, ASSIGN 2023-02-15 20:01:36,877 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=8a79eee6aefc962407df2ed05672c891, ASSIGN 2023-02-15 20:01:36,877 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=4229d692a52fca982c3f6193911c155d, ASSIGN 2023-02-15 20:01:36,877 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=81644ccf4d63c864b007cbc1043831d7, ASSIGN 2023-02-15 20:01:36,878 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=c069ee68dab22f36ea73f04b91933c1f, ASSIGN 2023-02-15 20:01:36,878 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=fe51e97cb822f497ca56994d85f7310f, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40517,1676491293664; forceNewPlan=false, retain=false 2023-02-15 20:01:36,878 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=81644ccf4d63c864b007cbc1043831d7, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,36625,1676491293696; forceNewPlan=false, retain=false 2023-02-15 20:01:36,878 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=4229d692a52fca982c3f6193911c155d, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40517,1676491293664; forceNewPlan=false, retain=false 2023-02-15 20:01:36,878 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=c069ee68dab22f36ea73f04b91933c1f, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40517,1676491293664; forceNewPlan=false, retain=false 2023-02-15 20:01:36,878 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=8a79eee6aefc962407df2ed05672c891, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,36625,1676491293696; forceNewPlan=false, retain=false 2023-02-15 20:01:36,879 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=007dd63b20f9d2149ba11df9b0cddc4c, ASSIGN 2023-02-15 20:01:36,879 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=5a8c9c21a9831b445d533dd705940e06, ASSIGN 2023-02-15 20:01:36,879 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=85c1d4ec199a8eac4595716bde5173ab, ASSIGN 2023-02-15 20:01:36,880 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=6f4ab26e6b0d69c90f3b3b848034eb88, ASSIGN 2023-02-15 20:01:36,880 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=007dd63b20f9d2149ba11df9b0cddc4c, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,36625,1676491293696; forceNewPlan=false, retain=false 2023-02-15 20:01:36,880 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=5e40ee2d96ae1cbe88d7c194cd72dda2, ASSIGN 2023-02-15 20:01:36,880 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=5a8c9c21a9831b445d533dd705940e06, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40517,1676491293664; forceNewPlan=false, retain=false 2023-02-15 20:01:36,880 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=85c1d4ec199a8eac4595716bde5173ab, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40517,1676491293664; forceNewPlan=false, retain=false 2023-02-15 20:01:36,880 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=6f4ab26e6b0d69c90f3b3b848034eb88, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,36625,1676491293696; forceNewPlan=false, retain=false 2023-02-15 20:01:36,880 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=5e40ee2d96ae1cbe88d7c194cd72dda2, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,36625,1676491293696; forceNewPlan=false, retain=false 2023-02-15 20:01:36,894 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35467] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-15 20:01:37,028 INFO [jenkins-hbase4:35467] balancer.BaseLoadBalancer(1545): Reassigned 10 regions. 10 retained the pre-restart assignment. 2023-02-15 20:01:37,034 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=18 updating hbase:meta row=fe51e97cb822f497ca56994d85f7310f, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40517,1676491293664 2023-02-15 20:01:37,034 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=4229d692a52fca982c3f6193911c155d, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40517,1676491293664 2023-02-15 20:01:37,034 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,t43,1676491296789.fe51e97cb822f497ca56994d85f7310f.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676491297034"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676491297034"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676491297034"}]},"ts":"1676491297034"} 2023-02-15 20:01:37,034 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=85c1d4ec199a8eac4595716bde5173ab, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40517,1676491293664 2023-02-15 20:01:37,034 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,zz{,1676491296789.4229d692a52fca982c3f6193911c155d.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1676491297034"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676491297034"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676491297034"}]},"ts":"1676491297034"} 2023-02-15 20:01:37,034 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,d\\x84\\x84,1676491296789.85c1d4ec199a8eac4595716bde5173ab.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676491297034"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676491297034"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676491297034"}]},"ts":"1676491297034"} 2023-02-15 20:01:37,034 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=c069ee68dab22f36ea73f04b91933c1f, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40517,1676491293664 2023-02-15 20:01:37,034 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=5a8c9c21a9831b445d533dd705940e06, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40517,1676491293664 2023-02-15 20:01:37,035 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,m\\xED\\xED,1676491296789.c069ee68dab22f36ea73f04b91933c1f.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676491297034"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676491297034"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676491297034"}]},"ts":"1676491297034"} 2023-02-15 20:01:37,035 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,g\\xA7\\xA7,1676491296789.5a8c9c21a9831b445d533dd705940e06.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676491297034"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676491297034"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676491297034"}]},"ts":"1676491297034"} 2023-02-15 20:01:37,036 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=21, ppid=18, state=RUNNABLE; OpenRegionProcedure fe51e97cb822f497ca56994d85f7310f, server=jenkins-hbase4.apache.org,40517,1676491293664}] 2023-02-15 20:01:37,037 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=22, ppid=20, state=RUNNABLE; OpenRegionProcedure 4229d692a52fca982c3f6193911c155d, server=jenkins-hbase4.apache.org,40517,1676491293664}] 2023-02-15 20:01:37,037 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=23, ppid=13, state=RUNNABLE; OpenRegionProcedure 85c1d4ec199a8eac4595716bde5173ab, server=jenkins-hbase4.apache.org,40517,1676491293664}] 2023-02-15 20:01:37,038 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=24, ppid=16, state=RUNNABLE; OpenRegionProcedure c069ee68dab22f36ea73f04b91933c1f, server=jenkins-hbase4.apache.org,40517,1676491293664}] 2023-02-15 20:01:37,042 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=5e40ee2d96ae1cbe88d7c194cd72dda2, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,36625,1676491293696 2023-02-15 20:01:37,042 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,,1676491296789.5e40ee2d96ae1cbe88d7c194cd72dda2.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1676491297042"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676491297042"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676491297042"}]},"ts":"1676491297042"} 2023-02-15 20:01:37,043 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=25, ppid=14, state=RUNNABLE; OpenRegionProcedure 5a8c9c21a9831b445d533dd705940e06, server=jenkins-hbase4.apache.org,40517,1676491293664}] 2023-02-15 20:01:37,043 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=19 updating hbase:meta row=8a79eee6aefc962407df2ed05672c891, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,36625,1676491293696 2023-02-15 20:01:37,043 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=17 updating hbase:meta row=81644ccf4d63c864b007cbc1043831d7, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,36625,1676491293696 2023-02-15 20:01:37,044 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,wWV,1676491296789.8a79eee6aefc962407df2ed05672c891.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676491297043"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676491297043"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676491297043"}]},"ts":"1676491297043"} 2023-02-15 20:01:37,044 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,q\\x11\\x10,1676491296789.81644ccf4d63c864b007cbc1043831d7.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676491297043"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676491297043"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676491297043"}]},"ts":"1676491297043"} 2023-02-15 20:01:37,044 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=26, ppid=11, state=RUNNABLE; OpenRegionProcedure 5e40ee2d96ae1cbe88d7c194cd72dda2, server=jenkins-hbase4.apache.org,36625,1676491293696}] 2023-02-15 20:01:37,044 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=007dd63b20f9d2149ba11df9b0cddc4c, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,36625,1676491293696 2023-02-15 20:01:37,045 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,j\\xCA\\xCA,1676491296789.007dd63b20f9d2149ba11df9b0cddc4c.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676491297044"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676491297044"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676491297044"}]},"ts":"1676491297044"} 2023-02-15 20:01:37,045 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=27, ppid=17, state=RUNNABLE; OpenRegionProcedure 81644ccf4d63c864b007cbc1043831d7, server=jenkins-hbase4.apache.org,36625,1676491293696}] 2023-02-15 20:01:37,046 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=28, ppid=19, state=RUNNABLE; OpenRegionProcedure 8a79eee6aefc962407df2ed05672c891, server=jenkins-hbase4.apache.org,36625,1676491293696}] 2023-02-15 20:01:37,046 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=12 updating hbase:meta row=6f4ab26e6b0d69c90f3b3b848034eb88, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,36625,1676491293696 2023-02-15 20:01:37,046 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,aaa,1676491296789.6f4ab26e6b0d69c90f3b3b848034eb88.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676491297046"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676491297046"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676491297046"}]},"ts":"1676491297046"} 2023-02-15 20:01:37,047 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=29, ppid=15, state=RUNNABLE; OpenRegionProcedure 007dd63b20f9d2149ba11df9b0cddc4c, server=jenkins-hbase4.apache.org,36625,1676491293696}] 2023-02-15 20:01:37,048 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=30, ppid=12, state=RUNNABLE; OpenRegionProcedure 6f4ab26e6b0d69c90f3b3b848034eb88, server=jenkins-hbase4.apache.org,36625,1676491293696}] 2023-02-15 20:01:37,096 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35467] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-15 20:01:37,191 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,m\xED\xED,1676491296789.c069ee68dab22f36ea73f04b91933c1f. 2023-02-15 20:01:37,191 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => c069ee68dab22f36ea73f04b91933c1f, NAME => 'testWithMockedMapReduceMultiRegion,m\xED\xED,1676491296789.c069ee68dab22f36ea73f04b91933c1f.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'} 2023-02-15 20:01:37,192 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion c069ee68dab22f36ea73f04b91933c1f 2023-02-15 20:01:37,192 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,m\xED\xED,1676491296789.c069ee68dab22f36ea73f04b91933c1f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 20:01:37,192 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for c069ee68dab22f36ea73f04b91933c1f 2023-02-15 20:01:37,192 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for c069ee68dab22f36ea73f04b91933c1f 2023-02-15 20:01:37,193 INFO [StoreOpener-c069ee68dab22f36ea73f04b91933c1f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region c069ee68dab22f36ea73f04b91933c1f 2023-02-15 20:01:37,194 DEBUG [StoreOpener-c069ee68dab22f36ea73f04b91933c1f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/data/default/testWithMockedMapReduceMultiRegion/c069ee68dab22f36ea73f04b91933c1f/f1 2023-02-15 20:01:37,194 DEBUG [StoreOpener-c069ee68dab22f36ea73f04b91933c1f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/data/default/testWithMockedMapReduceMultiRegion/c069ee68dab22f36ea73f04b91933c1f/f1 2023-02-15 20:01:37,194 INFO [StoreOpener-c069ee68dab22f36ea73f04b91933c1f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c069ee68dab22f36ea73f04b91933c1f columnFamilyName f1 2023-02-15 20:01:37,195 INFO [StoreOpener-c069ee68dab22f36ea73f04b91933c1f-1] regionserver.HStore(310): Store=c069ee68dab22f36ea73f04b91933c1f/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 20:01:37,195 INFO [StoreOpener-c069ee68dab22f36ea73f04b91933c1f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region c069ee68dab22f36ea73f04b91933c1f 2023-02-15 20:01:37,195 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,36625,1676491293696 2023-02-15 20:01:37,195 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-15 20:01:37,196 DEBUG [StoreOpener-c069ee68dab22f36ea73f04b91933c1f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/data/default/testWithMockedMapReduceMultiRegion/c069ee68dab22f36ea73f04b91933c1f/f2 2023-02-15 20:01:37,196 DEBUG [StoreOpener-c069ee68dab22f36ea73f04b91933c1f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/data/default/testWithMockedMapReduceMultiRegion/c069ee68dab22f36ea73f04b91933c1f/f2 2023-02-15 20:01:37,196 INFO [StoreOpener-c069ee68dab22f36ea73f04b91933c1f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c069ee68dab22f36ea73f04b91933c1f columnFamilyName f2 2023-02-15 20:01:37,197 INFO [RS-EventLoopGroup-14-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33984, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-15 20:01:37,197 INFO [StoreOpener-c069ee68dab22f36ea73f04b91933c1f-1] regionserver.HStore(310): Store=c069ee68dab22f36ea73f04b91933c1f/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 20:01:37,197 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/data/default/testWithMockedMapReduceMultiRegion/c069ee68dab22f36ea73f04b91933c1f 2023-02-15 20:01:37,198 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/data/default/testWithMockedMapReduceMultiRegion/c069ee68dab22f36ea73f04b91933c1f 2023-02-15 20:01:37,199 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,aaa,1676491296789.6f4ab26e6b0d69c90f3b3b848034eb88. 2023-02-15 20:01:37,199 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 6f4ab26e6b0d69c90f3b3b848034eb88, NAME => 'testWithMockedMapReduceMultiRegion,aaa,1676491296789.6f4ab26e6b0d69c90f3b3b848034eb88.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'} 2023-02-15 20:01:37,199 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-15 20:01:37,200 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion 6f4ab26e6b0d69c90f3b3b848034eb88 2023-02-15 20:01:37,200 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,aaa,1676491296789.6f4ab26e6b0d69c90f3b3b848034eb88.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 20:01:37,200 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 6f4ab26e6b0d69c90f3b3b848034eb88 2023-02-15 20:01:37,200 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 6f4ab26e6b0d69c90f3b3b848034eb88 2023-02-15 20:01:37,201 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for c069ee68dab22f36ea73f04b91933c1f 2023-02-15 20:01:37,204 INFO [StoreOpener-6f4ab26e6b0d69c90f3b3b848034eb88-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 6f4ab26e6b0d69c90f3b3b848034eb88 2023-02-15 20:01:37,204 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/data/default/testWithMockedMapReduceMultiRegion/c069ee68dab22f36ea73f04b91933c1f/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-15 20:01:37,205 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened c069ee68dab22f36ea73f04b91933c1f; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68941105, jitterRate=0.027302518486976624}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-15 20:01:37,205 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for c069ee68dab22f36ea73f04b91933c1f: 2023-02-15 20:01:37,205 DEBUG [StoreOpener-6f4ab26e6b0d69c90f3b3b848034eb88-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/data/default/testWithMockedMapReduceMultiRegion/6f4ab26e6b0d69c90f3b3b848034eb88/f1 2023-02-15 20:01:37,205 DEBUG [StoreOpener-6f4ab26e6b0d69c90f3b3b848034eb88-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/data/default/testWithMockedMapReduceMultiRegion/6f4ab26e6b0d69c90f3b3b848034eb88/f1 2023-02-15 20:01:37,205 INFO [StoreOpener-6f4ab26e6b0d69c90f3b3b848034eb88-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6f4ab26e6b0d69c90f3b3b848034eb88 columnFamilyName f1 2023-02-15 20:01:37,205 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,m\xED\xED,1676491296789.c069ee68dab22f36ea73f04b91933c1f., pid=24, masterSystemTime=1676491297188 2023-02-15 20:01:37,206 INFO [StoreOpener-6f4ab26e6b0d69c90f3b3b848034eb88-1] regionserver.HStore(310): Store=6f4ab26e6b0d69c90f3b3b848034eb88/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 20:01:37,206 INFO [StoreOpener-6f4ab26e6b0d69c90f3b3b848034eb88-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 6f4ab26e6b0d69c90f3b3b848034eb88 2023-02-15 20:01:37,207 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,m\xED\xED,1676491296789.c069ee68dab22f36ea73f04b91933c1f. 2023-02-15 20:01:37,207 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,m\xED\xED,1676491296789.c069ee68dab22f36ea73f04b91933c1f. 2023-02-15 20:01:37,207 DEBUG [StoreOpener-6f4ab26e6b0d69c90f3b3b848034eb88-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/data/default/testWithMockedMapReduceMultiRegion/6f4ab26e6b0d69c90f3b3b848034eb88/f2 2023-02-15 20:01:37,207 DEBUG [StoreOpener-6f4ab26e6b0d69c90f3b3b848034eb88-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/data/default/testWithMockedMapReduceMultiRegion/6f4ab26e6b0d69c90f3b3b848034eb88/f2 2023-02-15 20:01:37,207 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,d\x84\x84,1676491296789.85c1d4ec199a8eac4595716bde5173ab. 2023-02-15 20:01:37,207 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=c069ee68dab22f36ea73f04b91933c1f, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40517,1676491293664 2023-02-15 20:01:37,207 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 85c1d4ec199a8eac4595716bde5173ab, NAME => 'testWithMockedMapReduceMultiRegion,d\x84\x84,1676491296789.85c1d4ec199a8eac4595716bde5173ab.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'} 2023-02-15 20:01:37,207 INFO [StoreOpener-6f4ab26e6b0d69c90f3b3b848034eb88-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6f4ab26e6b0d69c90f3b3b848034eb88 columnFamilyName f2 2023-02-15 20:01:37,207 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,m\\xED\\xED,1676491296789.c069ee68dab22f36ea73f04b91933c1f.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676491297207"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676491297207"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676491297207"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676491297207"}]},"ts":"1676491297207"} 2023-02-15 20:01:37,208 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion 85c1d4ec199a8eac4595716bde5173ab 2023-02-15 20:01:37,208 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,d\x84\x84,1676491296789.85c1d4ec199a8eac4595716bde5173ab.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 20:01:37,208 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 85c1d4ec199a8eac4595716bde5173ab 2023-02-15 20:01:37,208 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 85c1d4ec199a8eac4595716bde5173ab 2023-02-15 20:01:37,208 INFO [StoreOpener-6f4ab26e6b0d69c90f3b3b848034eb88-1] regionserver.HStore(310): Store=6f4ab26e6b0d69c90f3b3b848034eb88/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 20:01:37,209 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/data/default/testWithMockedMapReduceMultiRegion/6f4ab26e6b0d69c90f3b3b848034eb88 2023-02-15 20:01:37,209 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/data/default/testWithMockedMapReduceMultiRegion/6f4ab26e6b0d69c90f3b3b848034eb88 2023-02-15 20:01:37,209 INFO [StoreOpener-85c1d4ec199a8eac4595716bde5173ab-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 85c1d4ec199a8eac4595716bde5173ab 2023-02-15 20:01:37,210 DEBUG [StoreOpener-85c1d4ec199a8eac4595716bde5173ab-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/data/default/testWithMockedMapReduceMultiRegion/85c1d4ec199a8eac4595716bde5173ab/f1 2023-02-15 20:01:37,210 DEBUG [StoreOpener-85c1d4ec199a8eac4595716bde5173ab-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/data/default/testWithMockedMapReduceMultiRegion/85c1d4ec199a8eac4595716bde5173ab/f1 2023-02-15 20:01:37,211 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=24, resume processing ppid=16 2023-02-15 20:01:37,211 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-15 20:01:37,211 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=24, ppid=16, state=SUCCESS; OpenRegionProcedure c069ee68dab22f36ea73f04b91933c1f, server=jenkins-hbase4.apache.org,40517,1676491293664 in 171 msec 2023-02-15 20:01:37,211 INFO [StoreOpener-85c1d4ec199a8eac4595716bde5173ab-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 85c1d4ec199a8eac4595716bde5173ab columnFamilyName f1 2023-02-15 20:01:37,211 INFO [StoreOpener-85c1d4ec199a8eac4595716bde5173ab-1] regionserver.HStore(310): Store=85c1d4ec199a8eac4595716bde5173ab/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 20:01:37,211 INFO [StoreOpener-85c1d4ec199a8eac4595716bde5173ab-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 85c1d4ec199a8eac4595716bde5173ab 2023-02-15 20:01:37,212 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=c069ee68dab22f36ea73f04b91933c1f, ASSIGN in 336 msec 2023-02-15 20:01:37,212 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 6f4ab26e6b0d69c90f3b3b848034eb88 2023-02-15 20:01:37,213 DEBUG [StoreOpener-85c1d4ec199a8eac4595716bde5173ab-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/data/default/testWithMockedMapReduceMultiRegion/85c1d4ec199a8eac4595716bde5173ab/f2 2023-02-15 20:01:37,213 DEBUG [StoreOpener-85c1d4ec199a8eac4595716bde5173ab-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/data/default/testWithMockedMapReduceMultiRegion/85c1d4ec199a8eac4595716bde5173ab/f2 2023-02-15 20:01:37,213 INFO [StoreOpener-85c1d4ec199a8eac4595716bde5173ab-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 85c1d4ec199a8eac4595716bde5173ab columnFamilyName f2 2023-02-15 20:01:37,213 INFO [StoreOpener-85c1d4ec199a8eac4595716bde5173ab-1] regionserver.HStore(310): Store=85c1d4ec199a8eac4595716bde5173ab/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 20:01:37,214 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/data/default/testWithMockedMapReduceMultiRegion/6f4ab26e6b0d69c90f3b3b848034eb88/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-15 20:01:37,214 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/data/default/testWithMockedMapReduceMultiRegion/85c1d4ec199a8eac4595716bde5173ab 2023-02-15 20:01:37,214 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 6f4ab26e6b0d69c90f3b3b848034eb88; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73845238, jitterRate=0.10037979483604431}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-15 20:01:37,214 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 6f4ab26e6b0d69c90f3b3b848034eb88: 2023-02-15 20:01:37,214 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/data/default/testWithMockedMapReduceMultiRegion/85c1d4ec199a8eac4595716bde5173ab 2023-02-15 20:01:37,215 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,aaa,1676491296789.6f4ab26e6b0d69c90f3b3b848034eb88., pid=30, masterSystemTime=1676491297195 2023-02-15 20:01:37,217 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-15 20:01:37,218 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,aaa,1676491296789.6f4ab26e6b0d69c90f3b3b848034eb88. 2023-02-15 20:01:37,218 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,aaa,1676491296789.6f4ab26e6b0d69c90f3b3b848034eb88. 2023-02-15 20:01:37,219 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,q\x11\x10,1676491296789.81644ccf4d63c864b007cbc1043831d7. 2023-02-15 20:01:37,219 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 81644ccf4d63c864b007cbc1043831d7, NAME => 'testWithMockedMapReduceMultiRegion,q\x11\x10,1676491296789.81644ccf4d63c864b007cbc1043831d7.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'} 2023-02-15 20:01:37,219 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=12 updating hbase:meta row=6f4ab26e6b0d69c90f3b3b848034eb88, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,36625,1676491293696 2023-02-15 20:01:37,219 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion 81644ccf4d63c864b007cbc1043831d7 2023-02-15 20:01:37,219 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,q\x11\x10,1676491296789.81644ccf4d63c864b007cbc1043831d7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 20:01:37,219 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,aaa,1676491296789.6f4ab26e6b0d69c90f3b3b848034eb88.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676491297219"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676491297219"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676491297219"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676491297219"}]},"ts":"1676491297219"} 2023-02-15 20:01:37,219 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 81644ccf4d63c864b007cbc1043831d7 2023-02-15 20:01:37,219 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 81644ccf4d63c864b007cbc1043831d7 2023-02-15 20:01:37,219 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 85c1d4ec199a8eac4595716bde5173ab 2023-02-15 20:01:37,220 INFO [StoreOpener-81644ccf4d63c864b007cbc1043831d7-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 81644ccf4d63c864b007cbc1043831d7 2023-02-15 20:01:37,222 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/data/default/testWithMockedMapReduceMultiRegion/85c1d4ec199a8eac4595716bde5173ab/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-15 20:01:37,222 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=30, resume processing ppid=12 2023-02-15 20:01:37,222 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=30, ppid=12, state=SUCCESS; OpenRegionProcedure 6f4ab26e6b0d69c90f3b3b848034eb88, server=jenkins-hbase4.apache.org,36625,1676491293696 in 172 msec 2023-02-15 20:01:37,222 DEBUG [StoreOpener-81644ccf4d63c864b007cbc1043831d7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/data/default/testWithMockedMapReduceMultiRegion/81644ccf4d63c864b007cbc1043831d7/f1 2023-02-15 20:01:37,222 DEBUG [StoreOpener-81644ccf4d63c864b007cbc1043831d7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/data/default/testWithMockedMapReduceMultiRegion/81644ccf4d63c864b007cbc1043831d7/f1 2023-02-15 20:01:37,222 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 85c1d4ec199a8eac4595716bde5173ab; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73354745, jitterRate=0.0930708795785904}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-15 20:01:37,222 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 85c1d4ec199a8eac4595716bde5173ab: 2023-02-15 20:01:37,222 INFO [StoreOpener-81644ccf4d63c864b007cbc1043831d7-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 81644ccf4d63c864b007cbc1043831d7 columnFamilyName f1 2023-02-15 20:01:37,223 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,d\x84\x84,1676491296789.85c1d4ec199a8eac4595716bde5173ab., pid=23, masterSystemTime=1676491297188 2023-02-15 20:01:37,223 INFO [StoreOpener-81644ccf4d63c864b007cbc1043831d7-1] regionserver.HStore(310): Store=81644ccf4d63c864b007cbc1043831d7/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 20:01:37,223 INFO [StoreOpener-81644ccf4d63c864b007cbc1043831d7-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 81644ccf4d63c864b007cbc1043831d7 2023-02-15 20:01:37,223 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=12, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=6f4ab26e6b0d69c90f3b3b848034eb88, ASSIGN in 347 msec 2023-02-15 20:01:37,224 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,d\x84\x84,1676491296789.85c1d4ec199a8eac4595716bde5173ab. 2023-02-15 20:01:37,224 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,d\x84\x84,1676491296789.85c1d4ec199a8eac4595716bde5173ab. 2023-02-15 20:01:37,224 DEBUG [StoreOpener-81644ccf4d63c864b007cbc1043831d7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/data/default/testWithMockedMapReduceMultiRegion/81644ccf4d63c864b007cbc1043831d7/f2 2023-02-15 20:01:37,224 DEBUG [StoreOpener-81644ccf4d63c864b007cbc1043831d7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/data/default/testWithMockedMapReduceMultiRegion/81644ccf4d63c864b007cbc1043831d7/f2 2023-02-15 20:01:37,224 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676491296789.5a8c9c21a9831b445d533dd705940e06. 2023-02-15 20:01:37,224 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=85c1d4ec199a8eac4595716bde5173ab, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40517,1676491293664 2023-02-15 20:01:37,225 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 5a8c9c21a9831b445d533dd705940e06, NAME => 'testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676491296789.5a8c9c21a9831b445d533dd705940e06.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'} 2023-02-15 20:01:37,225 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,d\\x84\\x84,1676491296789.85c1d4ec199a8eac4595716bde5173ab.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676491297224"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676491297224"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676491297224"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676491297224"}]},"ts":"1676491297224"} 2023-02-15 20:01:37,225 INFO [StoreOpener-81644ccf4d63c864b007cbc1043831d7-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 81644ccf4d63c864b007cbc1043831d7 columnFamilyName f2 2023-02-15 20:01:37,225 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion 5a8c9c21a9831b445d533dd705940e06 2023-02-15 20:01:37,225 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676491296789.5a8c9c21a9831b445d533dd705940e06.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 20:01:37,225 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 5a8c9c21a9831b445d533dd705940e06 2023-02-15 20:01:37,225 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 5a8c9c21a9831b445d533dd705940e06 2023-02-15 20:01:37,225 INFO [StoreOpener-81644ccf4d63c864b007cbc1043831d7-1] regionserver.HStore(310): Store=81644ccf4d63c864b007cbc1043831d7/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 20:01:37,226 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/data/default/testWithMockedMapReduceMultiRegion/81644ccf4d63c864b007cbc1043831d7 2023-02-15 20:01:37,226 INFO [StoreOpener-5a8c9c21a9831b445d533dd705940e06-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 5a8c9c21a9831b445d533dd705940e06 2023-02-15 20:01:37,226 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/data/default/testWithMockedMapReduceMultiRegion/81644ccf4d63c864b007cbc1043831d7 2023-02-15 20:01:37,227 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=23, resume processing ppid=13 2023-02-15 20:01:37,227 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=23, ppid=13, state=SUCCESS; OpenRegionProcedure 85c1d4ec199a8eac4595716bde5173ab, server=jenkins-hbase4.apache.org,40517,1676491293664 in 189 msec 2023-02-15 20:01:37,228 DEBUG [StoreOpener-5a8c9c21a9831b445d533dd705940e06-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/data/default/testWithMockedMapReduceMultiRegion/5a8c9c21a9831b445d533dd705940e06/f1 2023-02-15 20:01:37,228 DEBUG [StoreOpener-5a8c9c21a9831b445d533dd705940e06-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/data/default/testWithMockedMapReduceMultiRegion/5a8c9c21a9831b445d533dd705940e06/f1 2023-02-15 20:01:37,228 INFO [StoreOpener-5a8c9c21a9831b445d533dd705940e06-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5a8c9c21a9831b445d533dd705940e06 columnFamilyName f1 2023-02-15 20:01:37,228 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-15 20:01:37,228 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=13, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=85c1d4ec199a8eac4595716bde5173ab, ASSIGN in 352 msec 2023-02-15 20:01:37,228 INFO [StoreOpener-5a8c9c21a9831b445d533dd705940e06-1] regionserver.HStore(310): Store=5a8c9c21a9831b445d533dd705940e06/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 20:01:37,228 INFO [StoreOpener-5a8c9c21a9831b445d533dd705940e06-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 5a8c9c21a9831b445d533dd705940e06 2023-02-15 20:01:37,229 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 81644ccf4d63c864b007cbc1043831d7 2023-02-15 20:01:37,230 DEBUG [StoreOpener-5a8c9c21a9831b445d533dd705940e06-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/data/default/testWithMockedMapReduceMultiRegion/5a8c9c21a9831b445d533dd705940e06/f2 2023-02-15 20:01:37,230 DEBUG [StoreOpener-5a8c9c21a9831b445d533dd705940e06-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/data/default/testWithMockedMapReduceMultiRegion/5a8c9c21a9831b445d533dd705940e06/f2 2023-02-15 20:01:37,230 INFO [StoreOpener-5a8c9c21a9831b445d533dd705940e06-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5a8c9c21a9831b445d533dd705940e06 columnFamilyName f2 2023-02-15 20:01:37,230 INFO [StoreOpener-5a8c9c21a9831b445d533dd705940e06-1] regionserver.HStore(310): Store=5a8c9c21a9831b445d533dd705940e06/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 20:01:37,231 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/data/default/testWithMockedMapReduceMultiRegion/81644ccf4d63c864b007cbc1043831d7/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-15 20:01:37,231 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/data/default/testWithMockedMapReduceMultiRegion/5a8c9c21a9831b445d533dd705940e06 2023-02-15 20:01:37,231 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 81644ccf4d63c864b007cbc1043831d7; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61851397, jitterRate=-0.07834236323833466}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-15 20:01:37,231 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/data/default/testWithMockedMapReduceMultiRegion/5a8c9c21a9831b445d533dd705940e06 2023-02-15 20:01:37,231 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 81644ccf4d63c864b007cbc1043831d7: 2023-02-15 20:01:37,232 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,q\x11\x10,1676491296789.81644ccf4d63c864b007cbc1043831d7., pid=27, masterSystemTime=1676491297195 2023-02-15 20:01:37,233 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-15 20:01:37,233 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,q\x11\x10,1676491296789.81644ccf4d63c864b007cbc1043831d7. 2023-02-15 20:01:37,233 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,q\x11\x10,1676491296789.81644ccf4d63c864b007cbc1043831d7. 2023-02-15 20:01:37,233 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676491296789.007dd63b20f9d2149ba11df9b0cddc4c. 2023-02-15 20:01:37,234 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 007dd63b20f9d2149ba11df9b0cddc4c, NAME => 'testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676491296789.007dd63b20f9d2149ba11df9b0cddc4c.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'} 2023-02-15 20:01:37,234 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=17 updating hbase:meta row=81644ccf4d63c864b007cbc1043831d7, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,36625,1676491293696 2023-02-15 20:01:37,234 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion 007dd63b20f9d2149ba11df9b0cddc4c 2023-02-15 20:01:37,234 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,q\\x11\\x10,1676491296789.81644ccf4d63c864b007cbc1043831d7.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676491297234"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676491297234"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676491297234"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676491297234"}]},"ts":"1676491297234"} 2023-02-15 20:01:37,234 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676491296789.007dd63b20f9d2149ba11df9b0cddc4c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 20:01:37,234 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 007dd63b20f9d2149ba11df9b0cddc4c 2023-02-15 20:01:37,234 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 007dd63b20f9d2149ba11df9b0cddc4c 2023-02-15 20:01:37,234 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 5a8c9c21a9831b445d533dd705940e06 2023-02-15 20:01:37,237 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=27, resume processing ppid=17 2023-02-15 20:01:37,237 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=27, ppid=17, state=SUCCESS; OpenRegionProcedure 81644ccf4d63c864b007cbc1043831d7, server=jenkins-hbase4.apache.org,36625,1676491293696 in 190 msec 2023-02-15 20:01:37,238 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=81644ccf4d63c864b007cbc1043831d7, ASSIGN in 362 msec 2023-02-15 20:01:37,244 INFO [StoreOpener-007dd63b20f9d2149ba11df9b0cddc4c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 007dd63b20f9d2149ba11df9b0cddc4c 2023-02-15 20:01:37,244 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/data/default/testWithMockedMapReduceMultiRegion/5a8c9c21a9831b445d533dd705940e06/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-15 20:01:37,245 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 5a8c9c21a9831b445d533dd705940e06; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73840692, jitterRate=0.10031205415725708}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-15 20:01:37,245 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 5a8c9c21a9831b445d533dd705940e06: 2023-02-15 20:01:37,245 DEBUG [StoreOpener-007dd63b20f9d2149ba11df9b0cddc4c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/data/default/testWithMockedMapReduceMultiRegion/007dd63b20f9d2149ba11df9b0cddc4c/f1 2023-02-15 20:01:37,245 DEBUG [StoreOpener-007dd63b20f9d2149ba11df9b0cddc4c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/data/default/testWithMockedMapReduceMultiRegion/007dd63b20f9d2149ba11df9b0cddc4c/f1 2023-02-15 20:01:37,245 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676491296789.5a8c9c21a9831b445d533dd705940e06., pid=25, masterSystemTime=1676491297188 2023-02-15 20:01:37,246 INFO [StoreOpener-007dd63b20f9d2149ba11df9b0cddc4c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 007dd63b20f9d2149ba11df9b0cddc4c columnFamilyName f1 2023-02-15 20:01:37,246 INFO [StoreOpener-007dd63b20f9d2149ba11df9b0cddc4c-1] regionserver.HStore(310): Store=007dd63b20f9d2149ba11df9b0cddc4c/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 20:01:37,246 INFO [StoreOpener-007dd63b20f9d2149ba11df9b0cddc4c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 007dd63b20f9d2149ba11df9b0cddc4c 2023-02-15 20:01:37,247 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676491296789.5a8c9c21a9831b445d533dd705940e06. 2023-02-15 20:01:37,247 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676491296789.5a8c9c21a9831b445d533dd705940e06. 2023-02-15 20:01:37,247 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,zz{,1676491296789.4229d692a52fca982c3f6193911c155d. 2023-02-15 20:01:37,247 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 4229d692a52fca982c3f6193911c155d, NAME => 'testWithMockedMapReduceMultiRegion,zz{,1676491296789.4229d692a52fca982c3f6193911c155d.', STARTKEY => 'zz{', ENDKEY => ''} 2023-02-15 20:01:37,247 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=5a8c9c21a9831b445d533dd705940e06, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40517,1676491293664 2023-02-15 20:01:37,248 DEBUG [StoreOpener-007dd63b20f9d2149ba11df9b0cddc4c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/data/default/testWithMockedMapReduceMultiRegion/007dd63b20f9d2149ba11df9b0cddc4c/f2 2023-02-15 20:01:37,248 DEBUG [StoreOpener-007dd63b20f9d2149ba11df9b0cddc4c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/data/default/testWithMockedMapReduceMultiRegion/007dd63b20f9d2149ba11df9b0cddc4c/f2 2023-02-15 20:01:37,248 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion 4229d692a52fca982c3f6193911c155d 2023-02-15 20:01:37,248 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,g\\xA7\\xA7,1676491296789.5a8c9c21a9831b445d533dd705940e06.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676491297247"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676491297247"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676491297247"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676491297247"}]},"ts":"1676491297247"} 2023-02-15 20:01:37,248 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,zz{,1676491296789.4229d692a52fca982c3f6193911c155d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 20:01:37,248 INFO [StoreOpener-007dd63b20f9d2149ba11df9b0cddc4c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 007dd63b20f9d2149ba11df9b0cddc4c columnFamilyName f2 2023-02-15 20:01:37,248 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 4229d692a52fca982c3f6193911c155d 2023-02-15 20:01:37,249 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 4229d692a52fca982c3f6193911c155d 2023-02-15 20:01:37,249 INFO [StoreOpener-007dd63b20f9d2149ba11df9b0cddc4c-1] regionserver.HStore(310): Store=007dd63b20f9d2149ba11df9b0cddc4c/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 20:01:37,250 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/data/default/testWithMockedMapReduceMultiRegion/007dd63b20f9d2149ba11df9b0cddc4c 2023-02-15 20:01:37,251 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/data/default/testWithMockedMapReduceMultiRegion/007dd63b20f9d2149ba11df9b0cddc4c 2023-02-15 20:01:37,252 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=25, resume processing ppid=14 2023-02-15 20:01:37,252 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=25, ppid=14, state=SUCCESS; OpenRegionProcedure 5a8c9c21a9831b445d533dd705940e06, server=jenkins-hbase4.apache.org,40517,1676491293664 in 207 msec 2023-02-15 20:01:37,253 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=14, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=5a8c9c21a9831b445d533dd705940e06, ASSIGN in 377 msec 2023-02-15 20:01:37,253 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-15 20:01:37,254 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 007dd63b20f9d2149ba11df9b0cddc4c 2023-02-15 20:01:37,256 INFO [StoreOpener-4229d692a52fca982c3f6193911c155d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 4229d692a52fca982c3f6193911c155d 2023-02-15 20:01:37,261 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/data/default/testWithMockedMapReduceMultiRegion/007dd63b20f9d2149ba11df9b0cddc4c/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-15 20:01:37,261 DEBUG [StoreOpener-4229d692a52fca982c3f6193911c155d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/data/default/testWithMockedMapReduceMultiRegion/4229d692a52fca982c3f6193911c155d/f1 2023-02-15 20:01:37,261 DEBUG [StoreOpener-4229d692a52fca982c3f6193911c155d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/data/default/testWithMockedMapReduceMultiRegion/4229d692a52fca982c3f6193911c155d/f1 2023-02-15 20:01:37,261 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 007dd63b20f9d2149ba11df9b0cddc4c; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71433683, jitterRate=0.06444482505321503}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-15 20:01:37,261 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 007dd63b20f9d2149ba11df9b0cddc4c: 2023-02-15 20:01:37,262 INFO [StoreOpener-4229d692a52fca982c3f6193911c155d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4229d692a52fca982c3f6193911c155d columnFamilyName f1 2023-02-15 20:01:37,262 INFO [StoreOpener-4229d692a52fca982c3f6193911c155d-1] regionserver.HStore(310): Store=4229d692a52fca982c3f6193911c155d/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 20:01:37,262 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676491296789.007dd63b20f9d2149ba11df9b0cddc4c., pid=29, masterSystemTime=1676491297195 2023-02-15 20:01:37,262 INFO [StoreOpener-4229d692a52fca982c3f6193911c155d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 4229d692a52fca982c3f6193911c155d 2023-02-15 20:01:37,264 DEBUG [StoreOpener-4229d692a52fca982c3f6193911c155d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/data/default/testWithMockedMapReduceMultiRegion/4229d692a52fca982c3f6193911c155d/f2 2023-02-15 20:01:37,264 DEBUG [StoreOpener-4229d692a52fca982c3f6193911c155d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/data/default/testWithMockedMapReduceMultiRegion/4229d692a52fca982c3f6193911c155d/f2 2023-02-15 20:01:37,264 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676491296789.007dd63b20f9d2149ba11df9b0cddc4c. 2023-02-15 20:01:37,264 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676491296789.007dd63b20f9d2149ba11df9b0cddc4c. 2023-02-15 20:01:37,264 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,,1676491296789.5e40ee2d96ae1cbe88d7c194cd72dda2. 2023-02-15 20:01:37,264 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 5e40ee2d96ae1cbe88d7c194cd72dda2, NAME => 'testWithMockedMapReduceMultiRegion,,1676491296789.5e40ee2d96ae1cbe88d7c194cd72dda2.', STARTKEY => '', ENDKEY => 'aaa'} 2023-02-15 20:01:37,264 INFO [StoreOpener-4229d692a52fca982c3f6193911c155d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4229d692a52fca982c3f6193911c155d columnFamilyName f2 2023-02-15 20:01:37,264 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=007dd63b20f9d2149ba11df9b0cddc4c, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,36625,1676491293696 2023-02-15 20:01:37,264 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion 5e40ee2d96ae1cbe88d7c194cd72dda2 2023-02-15 20:01:37,264 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,,1676491296789.5e40ee2d96ae1cbe88d7c194cd72dda2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 20:01:37,264 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,j\\xCA\\xCA,1676491296789.007dd63b20f9d2149ba11df9b0cddc4c.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676491297264"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676491297264"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676491297264"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676491297264"}]},"ts":"1676491297264"} 2023-02-15 20:01:37,264 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 5e40ee2d96ae1cbe88d7c194cd72dda2 2023-02-15 20:01:37,265 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 5e40ee2d96ae1cbe88d7c194cd72dda2 2023-02-15 20:01:37,265 INFO [StoreOpener-4229d692a52fca982c3f6193911c155d-1] regionserver.HStore(310): Store=4229d692a52fca982c3f6193911c155d/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 20:01:37,265 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/data/default/testWithMockedMapReduceMultiRegion/4229d692a52fca982c3f6193911c155d 2023-02-15 20:01:37,266 INFO [StoreOpener-5e40ee2d96ae1cbe88d7c194cd72dda2-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 5e40ee2d96ae1cbe88d7c194cd72dda2 2023-02-15 20:01:37,266 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/data/default/testWithMockedMapReduceMultiRegion/4229d692a52fca982c3f6193911c155d 2023-02-15 20:01:37,267 DEBUG [StoreOpener-5e40ee2d96ae1cbe88d7c194cd72dda2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/data/default/testWithMockedMapReduceMultiRegion/5e40ee2d96ae1cbe88d7c194cd72dda2/f1 2023-02-15 20:01:37,267 DEBUG [StoreOpener-5e40ee2d96ae1cbe88d7c194cd72dda2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/data/default/testWithMockedMapReduceMultiRegion/5e40ee2d96ae1cbe88d7c194cd72dda2/f1 2023-02-15 20:01:37,268 INFO [StoreOpener-5e40ee2d96ae1cbe88d7c194cd72dda2-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5e40ee2d96ae1cbe88d7c194cd72dda2 columnFamilyName f1 2023-02-15 20:01:37,268 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-15 20:01:37,268 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=29, resume processing ppid=15 2023-02-15 20:01:37,268 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=29, ppid=15, state=SUCCESS; OpenRegionProcedure 007dd63b20f9d2149ba11df9b0cddc4c, server=jenkins-hbase4.apache.org,36625,1676491293696 in 219 msec 2023-02-15 20:01:37,268 INFO [StoreOpener-5e40ee2d96ae1cbe88d7c194cd72dda2-1] regionserver.HStore(310): Store=5e40ee2d96ae1cbe88d7c194cd72dda2/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 20:01:37,269 INFO [StoreOpener-5e40ee2d96ae1cbe88d7c194cd72dda2-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 5e40ee2d96ae1cbe88d7c194cd72dda2 2023-02-15 20:01:37,269 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 4229d692a52fca982c3f6193911c155d 2023-02-15 20:01:37,269 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=15, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=007dd63b20f9d2149ba11df9b0cddc4c, ASSIGN in 393 msec 2023-02-15 20:01:37,270 DEBUG [StoreOpener-5e40ee2d96ae1cbe88d7c194cd72dda2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/data/default/testWithMockedMapReduceMultiRegion/5e40ee2d96ae1cbe88d7c194cd72dda2/f2 2023-02-15 20:01:37,270 DEBUG [StoreOpener-5e40ee2d96ae1cbe88d7c194cd72dda2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/data/default/testWithMockedMapReduceMultiRegion/5e40ee2d96ae1cbe88d7c194cd72dda2/f2 2023-02-15 20:01:37,270 INFO [StoreOpener-5e40ee2d96ae1cbe88d7c194cd72dda2-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5e40ee2d96ae1cbe88d7c194cd72dda2 columnFamilyName f2 2023-02-15 20:01:37,270 INFO [StoreOpener-5e40ee2d96ae1cbe88d7c194cd72dda2-1] regionserver.HStore(310): Store=5e40ee2d96ae1cbe88d7c194cd72dda2/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 20:01:37,271 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/data/default/testWithMockedMapReduceMultiRegion/4229d692a52fca982c3f6193911c155d/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-15 20:01:37,271 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 4229d692a52fca982c3f6193911c155d; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66927186, jitterRate=-0.0027072131633758545}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-15 20:01:37,271 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 4229d692a52fca982c3f6193911c155d: 2023-02-15 20:01:37,272 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,zz{,1676491296789.4229d692a52fca982c3f6193911c155d., pid=22, masterSystemTime=1676491297188 2023-02-15 20:01:37,272 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/data/default/testWithMockedMapReduceMultiRegion/5e40ee2d96ae1cbe88d7c194cd72dda2 2023-02-15 20:01:37,273 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/data/default/testWithMockedMapReduceMultiRegion/5e40ee2d96ae1cbe88d7c194cd72dda2 2023-02-15 20:01:37,273 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,zz{,1676491296789.4229d692a52fca982c3f6193911c155d. 2023-02-15 20:01:37,273 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,zz{,1676491296789.4229d692a52fca982c3f6193911c155d. 2023-02-15 20:01:37,273 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,t43,1676491296789.fe51e97cb822f497ca56994d85f7310f. 2023-02-15 20:01:37,273 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => fe51e97cb822f497ca56994d85f7310f, NAME => 'testWithMockedMapReduceMultiRegion,t43,1676491296789.fe51e97cb822f497ca56994d85f7310f.', STARTKEY => 't43', ENDKEY => 'wWV'} 2023-02-15 20:01:37,273 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=4229d692a52fca982c3f6193911c155d, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40517,1676491293664 2023-02-15 20:01:37,273 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,zz{,1676491296789.4229d692a52fca982c3f6193911c155d.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1676491297273"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676491297273"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676491297273"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676491297273"}]},"ts":"1676491297273"} 2023-02-15 20:01:37,273 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion fe51e97cb822f497ca56994d85f7310f 2023-02-15 20:01:37,273 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,t43,1676491296789.fe51e97cb822f497ca56994d85f7310f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 20:01:37,274 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for fe51e97cb822f497ca56994d85f7310f 2023-02-15 20:01:37,274 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for fe51e97cb822f497ca56994d85f7310f 2023-02-15 20:01:37,275 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-15 20:01:37,275 INFO [StoreOpener-fe51e97cb822f497ca56994d85f7310f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region fe51e97cb822f497ca56994d85f7310f 2023-02-15 20:01:37,276 DEBUG [StoreOpener-fe51e97cb822f497ca56994d85f7310f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/data/default/testWithMockedMapReduceMultiRegion/fe51e97cb822f497ca56994d85f7310f/f1 2023-02-15 20:01:37,276 DEBUG [StoreOpener-fe51e97cb822f497ca56994d85f7310f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/data/default/testWithMockedMapReduceMultiRegion/fe51e97cb822f497ca56994d85f7310f/f1 2023-02-15 20:01:37,276 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 5e40ee2d96ae1cbe88d7c194cd72dda2 2023-02-15 20:01:37,276 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=22, resume processing ppid=20 2023-02-15 20:01:37,276 INFO [StoreOpener-fe51e97cb822f497ca56994d85f7310f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region fe51e97cb822f497ca56994d85f7310f columnFamilyName f1 2023-02-15 20:01:37,276 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=22, ppid=20, state=SUCCESS; OpenRegionProcedure 4229d692a52fca982c3f6193911c155d, server=jenkins-hbase4.apache.org,40517,1676491293664 in 238 msec 2023-02-15 20:01:37,277 INFO [StoreOpener-fe51e97cb822f497ca56994d85f7310f-1] regionserver.HStore(310): Store=fe51e97cb822f497ca56994d85f7310f/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 20:01:37,277 INFO [StoreOpener-fe51e97cb822f497ca56994d85f7310f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region fe51e97cb822f497ca56994d85f7310f 2023-02-15 20:01:37,277 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=20, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=4229d692a52fca982c3f6193911c155d, ASSIGN in 401 msec 2023-02-15 20:01:37,278 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/data/default/testWithMockedMapReduceMultiRegion/5e40ee2d96ae1cbe88d7c194cd72dda2/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-15 20:01:37,278 DEBUG [StoreOpener-fe51e97cb822f497ca56994d85f7310f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/data/default/testWithMockedMapReduceMultiRegion/fe51e97cb822f497ca56994d85f7310f/f2 2023-02-15 20:01:37,278 DEBUG [StoreOpener-fe51e97cb822f497ca56994d85f7310f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/data/default/testWithMockedMapReduceMultiRegion/fe51e97cb822f497ca56994d85f7310f/f2 2023-02-15 20:01:37,279 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 5e40ee2d96ae1cbe88d7c194cd72dda2; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68999696, jitterRate=0.02817559242248535}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-15 20:01:37,279 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 5e40ee2d96ae1cbe88d7c194cd72dda2: 2023-02-15 20:01:37,279 INFO [StoreOpener-fe51e97cb822f497ca56994d85f7310f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region fe51e97cb822f497ca56994d85f7310f columnFamilyName f2 2023-02-15 20:01:37,279 INFO [StoreOpener-fe51e97cb822f497ca56994d85f7310f-1] regionserver.HStore(310): Store=fe51e97cb822f497ca56994d85f7310f/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 20:01:37,279 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,,1676491296789.5e40ee2d96ae1cbe88d7c194cd72dda2., pid=26, masterSystemTime=1676491297195 2023-02-15 20:01:37,280 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/data/default/testWithMockedMapReduceMultiRegion/fe51e97cb822f497ca56994d85f7310f 2023-02-15 20:01:37,280 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/data/default/testWithMockedMapReduceMultiRegion/fe51e97cb822f497ca56994d85f7310f 2023-02-15 20:01:37,280 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,,1676491296789.5e40ee2d96ae1cbe88d7c194cd72dda2. 2023-02-15 20:01:37,281 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,,1676491296789.5e40ee2d96ae1cbe88d7c194cd72dda2. 2023-02-15 20:01:37,281 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,wWV,1676491296789.8a79eee6aefc962407df2ed05672c891. 2023-02-15 20:01:37,281 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 8a79eee6aefc962407df2ed05672c891, NAME => 'testWithMockedMapReduceMultiRegion,wWV,1676491296789.8a79eee6aefc962407df2ed05672c891.', STARTKEY => 'wWV', ENDKEY => 'zz{'} 2023-02-15 20:01:37,281 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=5e40ee2d96ae1cbe88d7c194cd72dda2, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,36625,1676491293696 2023-02-15 20:01:37,281 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion 8a79eee6aefc962407df2ed05672c891 2023-02-15 20:01:37,281 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,,1676491296789.5e40ee2d96ae1cbe88d7c194cd72dda2.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1676491297281"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676491297281"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676491297281"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676491297281"}]},"ts":"1676491297281"} 2023-02-15 20:01:37,281 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,wWV,1676491296789.8a79eee6aefc962407df2ed05672c891.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 20:01:37,281 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 8a79eee6aefc962407df2ed05672c891 2023-02-15 20:01:37,281 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 8a79eee6aefc962407df2ed05672c891 2023-02-15 20:01:37,282 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-15 20:01:37,282 INFO [StoreOpener-8a79eee6aefc962407df2ed05672c891-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 8a79eee6aefc962407df2ed05672c891 2023-02-15 20:01:37,283 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for fe51e97cb822f497ca56994d85f7310f 2023-02-15 20:01:37,284 DEBUG [StoreOpener-8a79eee6aefc962407df2ed05672c891-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/data/default/testWithMockedMapReduceMultiRegion/8a79eee6aefc962407df2ed05672c891/f1 2023-02-15 20:01:37,284 DEBUG [StoreOpener-8a79eee6aefc962407df2ed05672c891-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/data/default/testWithMockedMapReduceMultiRegion/8a79eee6aefc962407df2ed05672c891/f1 2023-02-15 20:01:37,284 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=26, resume processing ppid=11 2023-02-15 20:01:37,284 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=26, ppid=11, state=SUCCESS; OpenRegionProcedure 5e40ee2d96ae1cbe88d7c194cd72dda2, server=jenkins-hbase4.apache.org,36625,1676491293696 in 238 msec 2023-02-15 20:01:37,284 INFO [StoreOpener-8a79eee6aefc962407df2ed05672c891-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8a79eee6aefc962407df2ed05672c891 columnFamilyName f1 2023-02-15 20:01:37,285 INFO [StoreOpener-8a79eee6aefc962407df2ed05672c891-1] regionserver.HStore(310): Store=8a79eee6aefc962407df2ed05672c891/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 20:01:37,285 INFO [StoreOpener-8a79eee6aefc962407df2ed05672c891-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 8a79eee6aefc962407df2ed05672c891 2023-02-15 20:01:37,285 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=5e40ee2d96ae1cbe88d7c194cd72dda2, ASSIGN in 409 msec 2023-02-15 20:01:37,285 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/data/default/testWithMockedMapReduceMultiRegion/fe51e97cb822f497ca56994d85f7310f/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-15 20:01:37,286 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened fe51e97cb822f497ca56994d85f7310f; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=75374019, jitterRate=0.12316040694713593}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-15 20:01:37,286 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for fe51e97cb822f497ca56994d85f7310f: 2023-02-15 20:01:37,286 DEBUG [StoreOpener-8a79eee6aefc962407df2ed05672c891-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/data/default/testWithMockedMapReduceMultiRegion/8a79eee6aefc962407df2ed05672c891/f2 2023-02-15 20:01:37,286 DEBUG [StoreOpener-8a79eee6aefc962407df2ed05672c891-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/data/default/testWithMockedMapReduceMultiRegion/8a79eee6aefc962407df2ed05672c891/f2 2023-02-15 20:01:37,286 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,t43,1676491296789.fe51e97cb822f497ca56994d85f7310f., pid=21, masterSystemTime=1676491297188 2023-02-15 20:01:37,286 INFO [StoreOpener-8a79eee6aefc962407df2ed05672c891-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8a79eee6aefc962407df2ed05672c891 columnFamilyName f2 2023-02-15 20:01:37,287 INFO [StoreOpener-8a79eee6aefc962407df2ed05672c891-1] regionserver.HStore(310): Store=8a79eee6aefc962407df2ed05672c891/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 20:01:37,287 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/data/default/testWithMockedMapReduceMultiRegion/8a79eee6aefc962407df2ed05672c891 2023-02-15 20:01:37,287 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,t43,1676491296789.fe51e97cb822f497ca56994d85f7310f. 2023-02-15 20:01:37,287 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,t43,1676491296789.fe51e97cb822f497ca56994d85f7310f. 2023-02-15 20:01:37,288 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=18 updating hbase:meta row=fe51e97cb822f497ca56994d85f7310f, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40517,1676491293664 2023-02-15 20:01:37,288 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/data/default/testWithMockedMapReduceMultiRegion/8a79eee6aefc962407df2ed05672c891 2023-02-15 20:01:37,288 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,t43,1676491296789.fe51e97cb822f497ca56994d85f7310f.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676491297287"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676491297287"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676491297287"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676491297287"}]},"ts":"1676491297287"} 2023-02-15 20:01:37,289 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-15 20:01:37,290 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=21, resume processing ppid=18 2023-02-15 20:01:37,290 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 8a79eee6aefc962407df2ed05672c891 2023-02-15 20:01:37,290 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=21, ppid=18, state=SUCCESS; OpenRegionProcedure fe51e97cb822f497ca56994d85f7310f, server=jenkins-hbase4.apache.org,40517,1676491293664 in 253 msec 2023-02-15 20:01:37,291 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=18, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=fe51e97cb822f497ca56994d85f7310f, ASSIGN in 415 msec 2023-02-15 20:01:37,292 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/data/default/testWithMockedMapReduceMultiRegion/8a79eee6aefc962407df2ed05672c891/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-15 20:01:37,293 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 8a79eee6aefc962407df2ed05672c891; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59277102, jitterRate=-0.11670234799385071}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-15 20:01:37,293 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 8a79eee6aefc962407df2ed05672c891: 2023-02-15 20:01:37,293 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,wWV,1676491296789.8a79eee6aefc962407df2ed05672c891., pid=28, masterSystemTime=1676491297195 2023-02-15 20:01:37,294 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,wWV,1676491296789.8a79eee6aefc962407df2ed05672c891. 2023-02-15 20:01:37,294 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,wWV,1676491296789.8a79eee6aefc962407df2ed05672c891. 2023-02-15 20:01:37,295 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=19 updating hbase:meta row=8a79eee6aefc962407df2ed05672c891, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,36625,1676491293696 2023-02-15 20:01:37,295 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,wWV,1676491296789.8a79eee6aefc962407df2ed05672c891.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676491297295"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676491297295"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676491297295"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676491297295"}]},"ts":"1676491297295"} 2023-02-15 20:01:37,297 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=28, resume processing ppid=19 2023-02-15 20:01:37,297 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=28, ppid=19, state=SUCCESS; OpenRegionProcedure 8a79eee6aefc962407df2ed05672c891, server=jenkins-hbase4.apache.org,36625,1676491293696 in 250 msec 2023-02-15 20:01:37,298 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=19, resume processing ppid=10 2023-02-15 20:01:37,298 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=19, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=8a79eee6aefc962407df2ed05672c891, ASSIGN in 422 msec 2023-02-15 20:01:37,299 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testWithMockedMapReduceMultiRegion execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-15 20:01:37,299 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676491297299"}]},"ts":"1676491297299"} 2023-02-15 20:01:37,300 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testWithMockedMapReduceMultiRegion, state=ENABLED in hbase:meta 2023-02-15 20:01:37,302 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testWithMockedMapReduceMultiRegion execute state=CREATE_TABLE_POST_OPERATION 2023-02-15 20:01:37,303 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=10, state=SUCCESS; CreateTableProcedure table=testWithMockedMapReduceMultiRegion in 513 msec 2023-02-15 20:01:37,398 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35467] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-15 20:01:37,398 INFO [Listener at localhost/43553] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testWithMockedMapReduceMultiRegion, procId: 10 completed 2023-02-15 20:01:37,398 DEBUG [Listener at localhost/43553] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testWithMockedMapReduceMultiRegion get assigned. Timeout = 60000ms 2023-02-15 20:01:37,398 INFO [Listener at localhost/43553] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-15 20:01:37,401 INFO [Listener at localhost/43553] hbase.HBaseTestingUtility(3484): All regions for table testWithMockedMapReduceMultiRegion assigned to meta. Checking AM states. 2023-02-15 20:01:37,401 INFO [Listener at localhost/43553] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-15 20:01:37,401 INFO [Listener at localhost/43553] hbase.HBaseTestingUtility(3504): All regions for table testWithMockedMapReduceMultiRegion assigned. 2023-02-15 20:01:37,401 INFO [Listener at localhost/43553] mapreduce.TableSnapshotInputFormatTestBase(207): put some stuff in the table 2023-02-15 20:01:37,438 DEBUG [hconnection-0x5980165c-shared-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-15 20:01:37,451 INFO [RS-EventLoopGroup-14-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33988, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-15 20:01:37,453 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40517] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 8112 Client: jenkins//172.31.14.131 first region in multi=testWithMockedMapReduceMultiRegion,d\x84\x84,1676491296789.85c1d4ec199a8eac4595716bde5173ab. 2023-02-15 20:01:37,458 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36625] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 9464 Client: jenkins//172.31.14.131 first region in multi=testWithMockedMapReduceMultiRegion,aaa,1676491296789.6f4ab26e6b0d69c90f3b3b848034eb88. 2023-02-15 20:01:37,523 INFO [Listener at localhost/43553] mapreduce.TableSnapshotInputFormatTestBase(214): snapshot 2023-02-15 20:01:37,523 INFO [Listener at localhost/43553] snapshot.SnapshotTestingUtils(396): taking snapshot. 2023-02-15 20:01:37,525 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35467] master.MasterRpcServices(1580): Client=jenkins//172.31.14.131 snapshot request for:{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 } 2023-02-15 20:01:37,525 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35467] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1676491297525 (current time:1676491297525). 2023-02-15 20:01:37,525 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35467] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-02-15 20:01:37,525 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35467] zookeeper.ReadOnlyZKClient(139): Connect 0x06f48cc8 to 127.0.0.1:49184 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-15 20:01:37,532 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35467] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2aba13dd, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-15 20:01:37,534 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35467] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-15 20:01:37,535 INFO [RS-EventLoopGroup-13-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56774, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-15 20:01:37,536 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35467] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x06f48cc8 to 127.0.0.1:49184 2023-02-15 20:01:37,536 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35467] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-15 20:01:37,537 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35467] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-02-15 20:01:37,537 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35467] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 } 2023-02-15 20:01:37,539 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35467] procedure2.ProcedureExecutor(1029): Stored pid=31, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=EXCLUSIVE 2023-02-15 20:01:37,540 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=31, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=EXCLUSIVE 2023-02-15 20:01:37,541 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=31, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=EXCLUSIVE; timeout=600000, timestamp=1676491897541 2023-02-15 20:01:37,541 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35467] snapshot.SnapshotManager(653): Started snapshot: { ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 } 2023-02-15 20:01:37,541 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot testWithMockedMapReduceMultiRegion C_M_SNAPSHOT_TABLE on table testWithMockedMapReduceMultiRegion 2023-02-15 20:01:37,542 DEBUG [Listener at localhost/43553] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-02-15 20:01:37,542 DEBUG [Listener at localhost/43553] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-02-15 20:01:37,543 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=31, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=EXCLUSIVE 2023-02-15 20:01:37,543 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=SHARED 2023-02-15 20:01:37,544 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=31, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=EXCLUSIVE in 5 msec 2023-02-15 20:01:37,544 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=SHARED 2023-02-15 20:01:37,545 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=32, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=SHARED; timeout=600000, timestamp=1676491897545 2023-02-15 20:01:37,557 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure testWithMockedMapReduceMultiRegion 2023-02-15 20:01:37,557 INFO [(jenkins-hbase4.apache.org,35467,1676491293605)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMockedMapReduceMultiRegion' 2023-02-15 20:01:37,557 DEBUG [(jenkins-hbase4.apache.org,35467,1676491293605)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-15 20:01:37,558 DEBUG [(jenkins-hbase4.apache.org,35467,1676491293605)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMockedMapReduceMultiRegion' starting 'acquire' 2023-02-15 20:01:37,558 DEBUG [(jenkins-hbase4.apache.org,35467,1676491293605)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMockedMapReduceMultiRegion', kicking off acquire phase on members. 2023-02-15 20:01:37,558 DEBUG [(jenkins-hbase4.apache.org,35467,1676491293605)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35467-0x1005992ed530000, quorum=127.0.0.1:49184, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-15 20:01:37,558 DEBUG [(jenkins-hbase4.apache.org,35467,1676491293605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion 2023-02-15 20:01:37,559 DEBUG [Listener at localhost/43553-EventThread] zookeeper.ZKWatcher(600): regionserver:36625-0x1005992ed530002, quorum=127.0.0.1:49184, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-15 20:01:37,559 DEBUG [(jenkins-hbase4.apache.org,35467,1676491293605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,36625,1676491293696 2023-02-15 20:01:37,559 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-15 20:01:37,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-15 20:01:37,559 DEBUG [Listener at localhost/43553-EventThread] zookeeper.ZKWatcher(600): regionserver:40517-0x1005992ed530001, quorum=127.0.0.1:49184, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-15 20:01:37,559 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-15 20:01:37,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-15 20:01:37,560 DEBUG [(jenkins-hbase4.apache.org,35467,1676491293605)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35467-0x1005992ed530000, quorum=127.0.0.1:49184, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,36625,1676491293696 2023-02-15 20:01:37,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion 2023-02-15 20:01:37,560 DEBUG [(jenkins-hbase4.apache.org,35467,1676491293605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,40517,1676491293664 2023-02-15 20:01:37,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion 2023-02-15 20:01:37,560 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36625-0x1005992ed530002, quorum=127.0.0.1:49184, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-15 20:01:37,560 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40517-0x1005992ed530001, quorum=127.0.0.1:49184, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-15 20:01:37,560 DEBUG [(jenkins-hbase4.apache.org,35467,1676491293605)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35467-0x1005992ed530000, quorum=127.0.0.1:49184, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,40517,1676491293664 2023-02-15 20:01:37,560 DEBUG [(jenkins-hbase4.apache.org,35467,1676491293605)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-15 20:01:37,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 89 2023-02-15 20:01:37,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion 2023-02-15 20:01:37,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 89 2023-02-15 20:01:37,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion 2023-02-15 20:01:37,560 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMockedMapReduceMultiRegion from table testWithMockedMapReduceMultiRegion type FLUSH 2023-02-15 20:01:37,561 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMockedMapReduceMultiRegion from table testWithMockedMapReduceMultiRegion type FLUSH 2023-02-15 20:01:37,561 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMockedMapReduceMultiRegion 2023-02-15 20:01:37,561 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMockedMapReduceMultiRegion 2023-02-15 20:01:37,561 DEBUG [member: 'jenkins-hbase4.apache.org,36625,1676491293696' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMockedMapReduceMultiRegion' with timeout 300000ms 2023-02-15 20:01:37,561 DEBUG [member: 'jenkins-hbase4.apache.org,36625,1676491293696' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-15 20:01:37,561 DEBUG [member: 'jenkins-hbase4.apache.org,40517,1676491293664' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMockedMapReduceMultiRegion' with timeout 300000ms 2023-02-15 20:01:37,561 DEBUG [member: 'jenkins-hbase4.apache.org,40517,1676491293664' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-15 20:01:37,563 DEBUG [member: 'jenkins-hbase4.apache.org,36625,1676491293696' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMockedMapReduceMultiRegion' starting 'acquire' stage 2023-02-15 20:01:37,563 DEBUG [member: 'jenkins-hbase4.apache.org,36625,1676491293696' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMockedMapReduceMultiRegion' locally acquired 2023-02-15 20:01:37,563 DEBUG [member: 'jenkins-hbase4.apache.org,40517,1676491293664' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMockedMapReduceMultiRegion' starting 'acquire' stage 2023-02-15 20:01:37,563 DEBUG [member: 'jenkins-hbase4.apache.org,40517,1676491293664' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMockedMapReduceMultiRegion' locally acquired 2023-02-15 20:01:37,563 DEBUG [member: 'jenkins-hbase4.apache.org,40517,1676491293664' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40517,1676491293664' joining acquired barrier for procedure (testWithMockedMapReduceMultiRegion) in zk 2023-02-15 20:01:37,563 DEBUG [member: 'jenkins-hbase4.apache.org,36625,1676491293696' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36625,1676491293696' joining acquired barrier for procedure (testWithMockedMapReduceMultiRegion) in zk 2023-02-15 20:01:37,565 DEBUG [Listener at localhost/43553-EventThread] zookeeper.ZKWatcher(600): master:35467-0x1005992ed530000, quorum=127.0.0.1:49184, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,40517,1676491293664 2023-02-15 20:01:37,565 DEBUG [member: 'jenkins-hbase4.apache.org,36625,1676491293696' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-15 20:01:37,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,40517,1676491293664 2023-02-15 20:01:37,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-15 20:01:37,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-15 20:01:37,565 DEBUG [member: 'jenkins-hbase4.apache.org,40517,1676491293664' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-15 20:01:37,565 DEBUG [Listener at localhost/43553-EventThread] zookeeper.ZKWatcher(600): master:35467-0x1005992ed530000, quorum=127.0.0.1:49184, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,36625,1676491293696 2023-02-15 20:01:37,565 DEBUG [member: 'jenkins-hbase4.apache.org,36625,1676491293696' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36625-0x1005992ed530002, quorum=127.0.0.1:49184, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-15 20:01:37,565 DEBUG [member: 'jenkins-hbase4.apache.org,36625,1676491293696' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMockedMapReduceMultiRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-15 20:01:37,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-15 20:01:37,565 DEBUG [member: 'jenkins-hbase4.apache.org,40517,1676491293664' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40517-0x1005992ed530001, quorum=127.0.0.1:49184, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-15 20:01:37,565 DEBUG [member: 'jenkins-hbase4.apache.org,40517,1676491293664' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMockedMapReduceMultiRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-15 20:01:37,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-15 20:01:37,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-15 20:01:37,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40517,1676491293664 2023-02-15 20:01:37,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36625,1676491293696 2023-02-15 20:01:37,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-15 20:01:37,567 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40517,1676491293664' joining acquired barrier for procedure 'testWithMockedMapReduceMultiRegion' on coordinator 2023-02-15 20:01:37,567 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6300bd06[Count = 1] remaining members to acquire global barrier 2023-02-15 20:01:37,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,36625,1676491293696 2023-02-15 20:01:37,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-15 20:01:37,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-15 20:01:37,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-15 20:01:37,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-15 20:01:37,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-15 20:01:37,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40517,1676491293664 2023-02-15 20:01:37,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36625,1676491293696 2023-02-15 20:01:37,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-15 20:01:37,568 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36625,1676491293696' joining acquired barrier for procedure 'testWithMockedMapReduceMultiRegion' on coordinator 2023-02-15 20:01:37,569 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6300bd06[Count = 0] remaining members to acquire global barrier 2023-02-15 20:01:37,569 DEBUG [(jenkins-hbase4.apache.org,35467,1676491293605)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMockedMapReduceMultiRegion' starting 'in-barrier' execution. 2023-02-15 20:01:37,569 DEBUG [(jenkins-hbase4.apache.org,35467,1676491293605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-15 20:01:37,571 DEBUG [Listener at localhost/43553-EventThread] zookeeper.ZKWatcher(600): regionserver:40517-0x1005992ed530001, quorum=127.0.0.1:49184, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-15 20:01:37,571 DEBUG [Listener at localhost/43553-EventThread] zookeeper.ZKWatcher(600): regionserver:36625-0x1005992ed530002, quorum=127.0.0.1:49184, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-15 20:01:37,571 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-15 20:01:37,571 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-15 20:01:37,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-15 20:01:37,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-15 20:01:37,571 DEBUG [member: 'jenkins-hbase4.apache.org,40517,1676491293664' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMockedMapReduceMultiRegion' received 'reached' from coordinator. 2023-02-15 20:01:37,571 DEBUG [member: 'jenkins-hbase4.apache.org,36625,1676491293696' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMockedMapReduceMultiRegion' received 'reached' from coordinator. 2023-02-15 20:01:37,571 DEBUG [(jenkins-hbase4.apache.org,35467,1676491293605)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35467-0x1005992ed530000, quorum=127.0.0.1:49184, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,40517,1676491293664 2023-02-15 20:01:37,571 DEBUG [rs(jenkins-hbase4.apache.org,40517,1676491293664)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,d\x84\x84,1676491296789.85c1d4ec199a8eac4595716bde5173ab. 2023-02-15 20:01:37,571 DEBUG [rs(jenkins-hbase4.apache.org,40517,1676491293664)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,d\x84\x84,1676491296789.85c1d4ec199a8eac4595716bde5173ab. started... 2023-02-15 20:01:37,571 DEBUG [(jenkins-hbase4.apache.org,35467,1676491293605)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35467-0x1005992ed530000, quorum=127.0.0.1:49184, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,36625,1676491293696 2023-02-15 20:01:37,571 DEBUG [(jenkins-hbase4.apache.org,35467,1676491293605)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-15 20:01:37,571 DEBUG [rs(jenkins-hbase4.apache.org,40517,1676491293664)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676491296789.5a8c9c21a9831b445d533dd705940e06. 2023-02-15 20:01:37,571 DEBUG [rs(jenkins-hbase4.apache.org,36625,1676491293696)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,q\x11\x10,1676491296789.81644ccf4d63c864b007cbc1043831d7. 2023-02-15 20:01:37,572 DEBUG [rs(jenkins-hbase4.apache.org,40517,1676491293664)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676491296789.5a8c9c21a9831b445d533dd705940e06. started... 2023-02-15 20:01:37,572 DEBUG [rs(jenkins-hbase4.apache.org,36625,1676491293696)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,q\x11\x10,1676491296789.81644ccf4d63c864b007cbc1043831d7. started... 2023-02-15 20:01:37,572 INFO [rs(jenkins-hbase4.apache.org,40517,1676491293664)-snapshot-pool-0] regionserver.HRegion(2744): Flushing 85c1d4ec199a8eac4595716bde5173ab 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-15 20:01:37,573 DEBUG [member: 'jenkins-hbase4.apache.org,40517,1676491293664' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 5 regions 2023-02-15 20:01:37,573 DEBUG [rs(jenkins-hbase4.apache.org,40517,1676491293664)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,zz{,1676491296789.4229d692a52fca982c3f6193911c155d. 2023-02-15 20:01:37,573 DEBUG [member: 'jenkins-hbase4.apache.org,40517,1676491293664' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-15 20:01:37,572 INFO [rs(jenkins-hbase4.apache.org,36625,1676491293696)-snapshot-pool-0] regionserver.HRegion(2744): Flushing 81644ccf4d63c864b007cbc1043831d7 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-15 20:01:37,572 INFO [rs(jenkins-hbase4.apache.org,40517,1676491293664)-snapshot-pool-1] regionserver.HRegion(2744): Flushing 5a8c9c21a9831b445d533dd705940e06 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-15 20:01:37,573 DEBUG [rs(jenkins-hbase4.apache.org,36625,1676491293696)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,aaa,1676491296789.6f4ab26e6b0d69c90f3b3b848034eb88. 2023-02-15 20:01:37,573 DEBUG [rs(jenkins-hbase4.apache.org,36625,1676491293696)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,aaa,1676491296789.6f4ab26e6b0d69c90f3b3b848034eb88. started... 2023-02-15 20:01:37,573 DEBUG [rs(jenkins-hbase4.apache.org,36625,1676491293696)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,,1676491296789.5e40ee2d96ae1cbe88d7c194cd72dda2. 2023-02-15 20:01:37,573 DEBUG [member: 'jenkins-hbase4.apache.org,36625,1676491293696' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 5 regions 2023-02-15 20:01:37,574 DEBUG [member: 'jenkins-hbase4.apache.org,36625,1676491293696' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-15 20:01:37,573 DEBUG [rs(jenkins-hbase4.apache.org,40517,1676491293664)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,zz{,1676491296789.4229d692a52fca982c3f6193911c155d. started... 2023-02-15 20:01:37,574 INFO [rs(jenkins-hbase4.apache.org,36625,1676491293696)-snapshot-pool-2] regionserver.HRegion(2744): Flushing 6f4ab26e6b0d69c90f3b3b848034eb88 2/2 column families, dataSize=158.44 KB heapSize=549.75 KB 2023-02-15 20:01:37,573 DEBUG [rs(jenkins-hbase4.apache.org,36625,1676491293696)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,,1676491296789.5e40ee2d96ae1cbe88d7c194cd72dda2. started... 2023-02-15 20:01:37,575 DEBUG [rs(jenkins-hbase4.apache.org,40517,1676491293664)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for 4229d692a52fca982c3f6193911c155d: 2023-02-15 20:01:37,576 DEBUG [rs(jenkins-hbase4.apache.org,36625,1676491293696)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for 5e40ee2d96ae1cbe88d7c194cd72dda2: 2023-02-15 20:01:37,576 DEBUG [rs(jenkins-hbase4.apache.org,40517,1676491293664)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,zz{,1676491296789.4229d692a52fca982c3f6193911c155d.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-15 20:01:37,576 DEBUG [rs(jenkins-hbase4.apache.org,40517,1676491293664)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-15 20:01:37,576 DEBUG [rs(jenkins-hbase4.apache.org,40517,1676491293664)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-15 20:01:37,576 DEBUG [rs(jenkins-hbase4.apache.org,36625,1676491293696)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,,1676491296789.5e40ee2d96ae1cbe88d7c194cd72dda2.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-15 20:01:37,577 DEBUG [rs(jenkins-hbase4.apache.org,40517,1676491293664)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-15 20:01:37,577 DEBUG [rs(jenkins-hbase4.apache.org,36625,1676491293696)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-15 20:01:37,577 DEBUG [rs(jenkins-hbase4.apache.org,36625,1676491293696)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-15 20:01:37,577 DEBUG [rs(jenkins-hbase4.apache.org,36625,1676491293696)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-15 20:01:37,607 DEBUG [rs(jenkins-hbase4.apache.org,40517,1676491293664)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,zz{,1676491296789.4229d692a52fca982c3f6193911c155d. completed. 2023-02-15 20:01:37,607 DEBUG [rs(jenkins-hbase4.apache.org,40517,1676491293664)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,zz{,1676491296789.4229d692a52fca982c3f6193911c155d. 2023-02-15 20:01:37,607 DEBUG [member: 'jenkins-hbase4.apache.org,40517,1676491293664' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/5 local region snapshots. 2023-02-15 20:01:37,607 DEBUG [rs(jenkins-hbase4.apache.org,40517,1676491293664)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,t43,1676491296789.fe51e97cb822f497ca56994d85f7310f. 2023-02-15 20:01:37,607 DEBUG [rs(jenkins-hbase4.apache.org,40517,1676491293664)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,t43,1676491296789.fe51e97cb822f497ca56994d85f7310f. started... 2023-02-15 20:01:37,612 DEBUG [rs(jenkins-hbase4.apache.org,36625,1676491293696)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,,1676491296789.5e40ee2d96ae1cbe88d7c194cd72dda2. completed. 2023-02-15 20:01:37,612 INFO [rs(jenkins-hbase4.apache.org,40517,1676491293664)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/data/default/testWithMockedMapReduceMultiRegion/85c1d4ec199a8eac4595716bde5173ab/.tmp/f1/962aca7e712640d4b681c9c3a5fba101 2023-02-15 20:01:37,612 DEBUG [rs(jenkins-hbase4.apache.org,36625,1676491293696)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,,1676491296789.5e40ee2d96ae1cbe88d7c194cd72dda2. 2023-02-15 20:01:37,612 DEBUG [rs(jenkins-hbase4.apache.org,36625,1676491293696)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,wWV,1676491296789.8a79eee6aefc962407df2ed05672c891. 2023-02-15 20:01:37,612 DEBUG [rs(jenkins-hbase4.apache.org,36625,1676491293696)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,wWV,1676491296789.8a79eee6aefc962407df2ed05672c891. started... 2023-02-15 20:01:37,612 DEBUG [member: 'jenkins-hbase4.apache.org,36625,1676491293696' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/5 local region snapshots. 2023-02-15 20:01:37,621 INFO [rs(jenkins-hbase4.apache.org,40517,1676491293664)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/data/default/testWithMockedMapReduceMultiRegion/5a8c9c21a9831b445d533dd705940e06/.tmp/f1/9234478382f54f4bb536e887f01e40aa 2023-02-15 20:01:37,621 INFO [rs(jenkins-hbase4.apache.org,40517,1676491293664)-snapshot-pool-2] regionserver.HRegion(2744): Flushing fe51e97cb822f497ca56994d85f7310f 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-15 20:01:37,621 INFO [rs(jenkins-hbase4.apache.org,36625,1676491293696)-snapshot-pool-1] regionserver.HRegion(2744): Flushing 8a79eee6aefc962407df2ed05672c891 2/2 column families, dataSize=158.44 KB heapSize=549.75 KB 2023-02-15 20:01:37,621 INFO [rs(jenkins-hbase4.apache.org,36625,1676491293696)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/data/default/testWithMockedMapReduceMultiRegion/6f4ab26e6b0d69c90f3b3b848034eb88/.tmp/f1/3f7b594ca3bd4926a8a99a9121c8d412 2023-02-15 20:01:37,629 INFO [rs(jenkins-hbase4.apache.org,36625,1676491293696)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/data/default/testWithMockedMapReduceMultiRegion/81644ccf4d63c864b007cbc1043831d7/.tmp/f1/2771400ae1e3406092833cb8cde650c5 2023-02-15 20:01:37,642 DEBUG [Listener at localhost/43553] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-15 20:01:37,643 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35467] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 } is done 2023-02-15 20:01:37,643 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35467] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 }' is still in progress! 2023-02-15 20:01:37,644 DEBUG [Listener at localhost/43553] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-02-15 20:01:37,652 INFO [rs(jenkins-hbase4.apache.org,36625,1676491293696)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/data/default/testWithMockedMapReduceMultiRegion/6f4ab26e6b0d69c90f3b3b848034eb88/.tmp/f2/0109ebdc9a594bde949d22a23c8a64cb 2023-02-15 20:01:37,653 INFO [rs(jenkins-hbase4.apache.org,36625,1676491293696)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/data/default/testWithMockedMapReduceMultiRegion/8a79eee6aefc962407df2ed05672c891/.tmp/f1/5faa164e7bce4249bbe09f7924d8ab21 2023-02-15 20:01:37,660 DEBUG [rs(jenkins-hbase4.apache.org,36625,1676491293696)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/data/default/testWithMockedMapReduceMultiRegion/6f4ab26e6b0d69c90f3b3b848034eb88/.tmp/f1/3f7b594ca3bd4926a8a99a9121c8d412 as hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/data/default/testWithMockedMapReduceMultiRegion/6f4ab26e6b0d69c90f3b3b848034eb88/f1/3f7b594ca3bd4926a8a99a9121c8d412 2023-02-15 20:01:37,665 INFO [rs(jenkins-hbase4.apache.org,36625,1676491293696)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/data/default/testWithMockedMapReduceMultiRegion/6f4ab26e6b0d69c90f3b3b848034eb88/f1/3f7b594ca3bd4926a8a99a9121c8d412, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-15 20:01:37,666 DEBUG [rs(jenkins-hbase4.apache.org,36625,1676491293696)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/data/default/testWithMockedMapReduceMultiRegion/6f4ab26e6b0d69c90f3b3b848034eb88/.tmp/f2/0109ebdc9a594bde949d22a23c8a64cb as hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/data/default/testWithMockedMapReduceMultiRegion/6f4ab26e6b0d69c90f3b3b848034eb88/f2/0109ebdc9a594bde949d22a23c8a64cb 2023-02-15 20:01:37,674 INFO [rs(jenkins-hbase4.apache.org,40517,1676491293664)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/data/default/testWithMockedMapReduceMultiRegion/85c1d4ec199a8eac4595716bde5173ab/.tmp/f2/e929536a3a6a46789ae2ba83a0ba01f2 2023-02-15 20:01:37,683 INFO [rs(jenkins-hbase4.apache.org,40517,1676491293664)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/data/default/testWithMockedMapReduceMultiRegion/fe51e97cb822f497ca56994d85f7310f/.tmp/f1/0da61d44a36946a49779016090ef9445 2023-02-15 20:01:37,688 INFO [rs(jenkins-hbase4.apache.org,36625,1676491293696)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/data/default/testWithMockedMapReduceMultiRegion/81644ccf4d63c864b007cbc1043831d7/.tmp/f2/2f1f47a490914b27b07597aeb3ec00b8 2023-02-15 20:01:37,692 INFO [rs(jenkins-hbase4.apache.org,36625,1676491293696)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/data/default/testWithMockedMapReduceMultiRegion/6f4ab26e6b0d69c90f3b3b848034eb88/f2/0109ebdc9a594bde949d22a23c8a64cb, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-15 20:01:37,693 INFO [rs(jenkins-hbase4.apache.org,36625,1676491293696)-snapshot-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~158.44 KB/162240, heapSize ~549.72 KB/562912, currentSize=0 B/0 for 6f4ab26e6b0d69c90f3b3b848034eb88 in 119ms, sequenceid=5, compaction requested=false 2023-02-15 20:01:37,693 DEBUG [rs(jenkins-hbase4.apache.org,36625,1676491293696)-snapshot-pool-2] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testWithMockedMapReduceMultiRegion' 2023-02-15 20:01:37,693 DEBUG [rs(jenkins-hbase4.apache.org,36625,1676491293696)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for 6f4ab26e6b0d69c90f3b3b848034eb88: 2023-02-15 20:01:37,694 DEBUG [rs(jenkins-hbase4.apache.org,36625,1676491293696)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,aaa,1676491296789.6f4ab26e6b0d69c90f3b3b848034eb88.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-15 20:01:37,694 DEBUG [rs(jenkins-hbase4.apache.org,36625,1676491293696)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-15 20:01:37,694 DEBUG [rs(jenkins-hbase4.apache.org,36625,1676491293696)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/data/default/testWithMockedMapReduceMultiRegion/6f4ab26e6b0d69c90f3b3b848034eb88/f1/3f7b594ca3bd4926a8a99a9121c8d412] hfiles 2023-02-15 20:01:37,694 DEBUG [rs(jenkins-hbase4.apache.org,36625,1676491293696)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/data/default/testWithMockedMapReduceMultiRegion/6f4ab26e6b0d69c90f3b3b848034eb88/f1/3f7b594ca3bd4926a8a99a9121c8d412 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-15 20:01:37,694 DEBUG [rs(jenkins-hbase4.apache.org,36625,1676491293696)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/data/default/testWithMockedMapReduceMultiRegion/6f4ab26e6b0d69c90f3b3b848034eb88/f2/0109ebdc9a594bde949d22a23c8a64cb] hfiles 2023-02-15 20:01:37,694 DEBUG [rs(jenkins-hbase4.apache.org,36625,1676491293696)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/data/default/testWithMockedMapReduceMultiRegion/6f4ab26e6b0d69c90f3b3b848034eb88/f2/0109ebdc9a594bde949d22a23c8a64cb for snapshot=testWithMockedMapReduceMultiRegion 2023-02-15 20:01:37,701 DEBUG [rs(jenkins-hbase4.apache.org,40517,1676491293664)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/data/default/testWithMockedMapReduceMultiRegion/85c1d4ec199a8eac4595716bde5173ab/.tmp/f1/962aca7e712640d4b681c9c3a5fba101 as hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/data/default/testWithMockedMapReduceMultiRegion/85c1d4ec199a8eac4595716bde5173ab/f1/962aca7e712640d4b681c9c3a5fba101 2023-02-15 20:01:37,702 DEBUG [rs(jenkins-hbase4.apache.org,36625,1676491293696)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/data/default/testWithMockedMapReduceMultiRegion/81644ccf4d63c864b007cbc1043831d7/.tmp/f1/2771400ae1e3406092833cb8cde650c5 as hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/data/default/testWithMockedMapReduceMultiRegion/81644ccf4d63c864b007cbc1043831d7/f1/2771400ae1e3406092833cb8cde650c5 2023-02-15 20:01:37,702 INFO [rs(jenkins-hbase4.apache.org,36625,1676491293696)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/data/default/testWithMockedMapReduceMultiRegion/8a79eee6aefc962407df2ed05672c891/.tmp/f2/c2016df0893c44b3a6b0164ad4a4d968 2023-02-15 20:01:37,707 INFO [rs(jenkins-hbase4.apache.org,40517,1676491293664)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/data/default/testWithMockedMapReduceMultiRegion/85c1d4ec199a8eac4595716bde5173ab/f1/962aca7e712640d4b681c9c3a5fba101, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-15 20:01:37,707 INFO [rs(jenkins-hbase4.apache.org,36625,1676491293696)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/data/default/testWithMockedMapReduceMultiRegion/81644ccf4d63c864b007cbc1043831d7/f1/2771400ae1e3406092833cb8cde650c5, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-15 20:01:37,707 DEBUG [rs(jenkins-hbase4.apache.org,40517,1676491293664)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/data/default/testWithMockedMapReduceMultiRegion/85c1d4ec199a8eac4595716bde5173ab/.tmp/f2/e929536a3a6a46789ae2ba83a0ba01f2 as hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/data/default/testWithMockedMapReduceMultiRegion/85c1d4ec199a8eac4595716bde5173ab/f2/e929536a3a6a46789ae2ba83a0ba01f2 2023-02-15 20:01:37,708 DEBUG [rs(jenkins-hbase4.apache.org,36625,1676491293696)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,aaa,1676491296789.6f4ab26e6b0d69c90f3b3b848034eb88. completed. 2023-02-15 20:01:37,708 DEBUG [rs(jenkins-hbase4.apache.org,36625,1676491293696)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,aaa,1676491296789.6f4ab26e6b0d69c90f3b3b848034eb88. 2023-02-15 20:01:37,708 DEBUG [member: 'jenkins-hbase4.apache.org,36625,1676491293696' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 2/5 local region snapshots. 2023-02-15 20:01:37,708 DEBUG [rs(jenkins-hbase4.apache.org,36625,1676491293696)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676491296789.007dd63b20f9d2149ba11df9b0cddc4c. 2023-02-15 20:01:37,708 DEBUG [rs(jenkins-hbase4.apache.org,36625,1676491293696)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676491296789.007dd63b20f9d2149ba11df9b0cddc4c. started... 2023-02-15 20:01:37,709 INFO [rs(jenkins-hbase4.apache.org,36625,1676491293696)-snapshot-pool-2] regionserver.HRegion(2744): Flushing 007dd63b20f9d2149ba11df9b0cddc4c 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-15 20:01:37,710 DEBUG [rs(jenkins-hbase4.apache.org,36625,1676491293696)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/data/default/testWithMockedMapReduceMultiRegion/8a79eee6aefc962407df2ed05672c891/.tmp/f1/5faa164e7bce4249bbe09f7924d8ab21 as hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/data/default/testWithMockedMapReduceMultiRegion/8a79eee6aefc962407df2ed05672c891/f1/5faa164e7bce4249bbe09f7924d8ab21 2023-02-15 20:01:37,710 DEBUG [rs(jenkins-hbase4.apache.org,36625,1676491293696)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/data/default/testWithMockedMapReduceMultiRegion/81644ccf4d63c864b007cbc1043831d7/.tmp/f2/2f1f47a490914b27b07597aeb3ec00b8 as hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/data/default/testWithMockedMapReduceMultiRegion/81644ccf4d63c864b007cbc1043831d7/f2/2f1f47a490914b27b07597aeb3ec00b8 2023-02-15 20:01:37,714 INFO [rs(jenkins-hbase4.apache.org,40517,1676491293664)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/data/default/testWithMockedMapReduceMultiRegion/fe51e97cb822f497ca56994d85f7310f/.tmp/f2/f3c0d03963c14c6198531acdd3e68d60 2023-02-15 20:01:37,716 INFO [rs(jenkins-hbase4.apache.org,36625,1676491293696)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/data/default/testWithMockedMapReduceMultiRegion/8a79eee6aefc962407df2ed05672c891/f1/5faa164e7bce4249bbe09f7924d8ab21, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-15 20:01:37,716 INFO [rs(jenkins-hbase4.apache.org,36625,1676491293696)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/data/default/testWithMockedMapReduceMultiRegion/81644ccf4d63c864b007cbc1043831d7/f2/2f1f47a490914b27b07597aeb3ec00b8, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-15 20:01:37,716 INFO [rs(jenkins-hbase4.apache.org,36625,1676491293696)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 81644ccf4d63c864b007cbc1043831d7 in 144ms, sequenceid=5, compaction requested=false 2023-02-15 20:01:37,716 DEBUG [rs(jenkins-hbase4.apache.org,36625,1676491293696)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/data/default/testWithMockedMapReduceMultiRegion/8a79eee6aefc962407df2ed05672c891/.tmp/f2/c2016df0893c44b3a6b0164ad4a4d968 as hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/data/default/testWithMockedMapReduceMultiRegion/8a79eee6aefc962407df2ed05672c891/f2/c2016df0893c44b3a6b0164ad4a4d968 2023-02-15 20:01:37,721 DEBUG [rs(jenkins-hbase4.apache.org,36625,1676491293696)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 81644ccf4d63c864b007cbc1043831d7: 2023-02-15 20:01:37,721 DEBUG [rs(jenkins-hbase4.apache.org,36625,1676491293696)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,q\x11\x10,1676491296789.81644ccf4d63c864b007cbc1043831d7.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-15 20:01:37,721 DEBUG [rs(jenkins-hbase4.apache.org,36625,1676491293696)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-15 20:01:37,721 DEBUG [rs(jenkins-hbase4.apache.org,36625,1676491293696)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/data/default/testWithMockedMapReduceMultiRegion/81644ccf4d63c864b007cbc1043831d7/f1/2771400ae1e3406092833cb8cde650c5] hfiles 2023-02-15 20:01:37,721 DEBUG [rs(jenkins-hbase4.apache.org,36625,1676491293696)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/data/default/testWithMockedMapReduceMultiRegion/81644ccf4d63c864b007cbc1043831d7/f1/2771400ae1e3406092833cb8cde650c5 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-15 20:01:37,721 DEBUG [rs(jenkins-hbase4.apache.org,36625,1676491293696)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/data/default/testWithMockedMapReduceMultiRegion/81644ccf4d63c864b007cbc1043831d7/f2/2f1f47a490914b27b07597aeb3ec00b8] hfiles 2023-02-15 20:01:37,721 DEBUG [rs(jenkins-hbase4.apache.org,36625,1676491293696)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/data/default/testWithMockedMapReduceMultiRegion/81644ccf4d63c864b007cbc1043831d7/f2/2f1f47a490914b27b07597aeb3ec00b8 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-15 20:01:37,721 INFO [rs(jenkins-hbase4.apache.org,40517,1676491293664)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/data/default/testWithMockedMapReduceMultiRegion/85c1d4ec199a8eac4595716bde5173ab/f2/e929536a3a6a46789ae2ba83a0ba01f2, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-15 20:01:37,722 INFO [rs(jenkins-hbase4.apache.org,40517,1676491293664)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 85c1d4ec199a8eac4595716bde5173ab in 150ms, sequenceid=5, compaction requested=false 2023-02-15 20:01:37,722 DEBUG [rs(jenkins-hbase4.apache.org,40517,1676491293664)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 85c1d4ec199a8eac4595716bde5173ab: 2023-02-15 20:01:37,722 DEBUG [rs(jenkins-hbase4.apache.org,40517,1676491293664)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,d\x84\x84,1676491296789.85c1d4ec199a8eac4595716bde5173ab.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-15 20:01:37,722 DEBUG [rs(jenkins-hbase4.apache.org,40517,1676491293664)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-15 20:01:37,722 DEBUG [rs(jenkins-hbase4.apache.org,40517,1676491293664)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/data/default/testWithMockedMapReduceMultiRegion/85c1d4ec199a8eac4595716bde5173ab/f1/962aca7e712640d4b681c9c3a5fba101] hfiles 2023-02-15 20:01:37,723 DEBUG [rs(jenkins-hbase4.apache.org,40517,1676491293664)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/data/default/testWithMockedMapReduceMultiRegion/85c1d4ec199a8eac4595716bde5173ab/f1/962aca7e712640d4b681c9c3a5fba101 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-15 20:01:37,723 DEBUG [rs(jenkins-hbase4.apache.org,40517,1676491293664)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/data/default/testWithMockedMapReduceMultiRegion/85c1d4ec199a8eac4595716bde5173ab/f2/e929536a3a6a46789ae2ba83a0ba01f2] hfiles 2023-02-15 20:01:37,723 DEBUG [rs(jenkins-hbase4.apache.org,40517,1676491293664)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/data/default/testWithMockedMapReduceMultiRegion/85c1d4ec199a8eac4595716bde5173ab/f2/e929536a3a6a46789ae2ba83a0ba01f2 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-15 20:01:37,724 DEBUG [rs(jenkins-hbase4.apache.org,40517,1676491293664)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/data/default/testWithMockedMapReduceMultiRegion/fe51e97cb822f497ca56994d85f7310f/.tmp/f1/0da61d44a36946a49779016090ef9445 as hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/data/default/testWithMockedMapReduceMultiRegion/fe51e97cb822f497ca56994d85f7310f/f1/0da61d44a36946a49779016090ef9445 2023-02-15 20:01:37,728 INFO [rs(jenkins-hbase4.apache.org,40517,1676491293664)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/data/default/testWithMockedMapReduceMultiRegion/fe51e97cb822f497ca56994d85f7310f/f1/0da61d44a36946a49779016090ef9445, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-15 20:01:37,729 DEBUG [rs(jenkins-hbase4.apache.org,40517,1676491293664)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/data/default/testWithMockedMapReduceMultiRegion/fe51e97cb822f497ca56994d85f7310f/.tmp/f2/f3c0d03963c14c6198531acdd3e68d60 as hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/data/default/testWithMockedMapReduceMultiRegion/fe51e97cb822f497ca56994d85f7310f/f2/f3c0d03963c14c6198531acdd3e68d60 2023-02-15 20:01:37,734 INFO [rs(jenkins-hbase4.apache.org,40517,1676491293664)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/data/default/testWithMockedMapReduceMultiRegion/fe51e97cb822f497ca56994d85f7310f/f2/f3c0d03963c14c6198531acdd3e68d60, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-15 20:01:37,735 INFO [rs(jenkins-hbase4.apache.org,40517,1676491293664)-snapshot-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for fe51e97cb822f497ca56994d85f7310f in 114ms, sequenceid=5, compaction requested=false 2023-02-15 20:01:37,735 DEBUG [rs(jenkins-hbase4.apache.org,40517,1676491293664)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for fe51e97cb822f497ca56994d85f7310f: 2023-02-15 20:01:37,735 DEBUG [rs(jenkins-hbase4.apache.org,40517,1676491293664)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,t43,1676491296789.fe51e97cb822f497ca56994d85f7310f.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-15 20:01:37,735 DEBUG [rs(jenkins-hbase4.apache.org,40517,1676491293664)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-15 20:01:37,735 DEBUG [rs(jenkins-hbase4.apache.org,40517,1676491293664)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/data/default/testWithMockedMapReduceMultiRegion/fe51e97cb822f497ca56994d85f7310f/f1/0da61d44a36946a49779016090ef9445] hfiles 2023-02-15 20:01:37,735 DEBUG [rs(jenkins-hbase4.apache.org,40517,1676491293664)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/data/default/testWithMockedMapReduceMultiRegion/fe51e97cb822f497ca56994d85f7310f/f1/0da61d44a36946a49779016090ef9445 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-15 20:01:37,735 DEBUG [rs(jenkins-hbase4.apache.org,40517,1676491293664)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/data/default/testWithMockedMapReduceMultiRegion/fe51e97cb822f497ca56994d85f7310f/f2/f3c0d03963c14c6198531acdd3e68d60] hfiles 2023-02-15 20:01:37,735 DEBUG [rs(jenkins-hbase4.apache.org,40517,1676491293664)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/data/default/testWithMockedMapReduceMultiRegion/fe51e97cb822f497ca56994d85f7310f/f2/f3c0d03963c14c6198531acdd3e68d60 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-15 20:01:37,741 INFO [rs(jenkins-hbase4.apache.org,36625,1676491293696)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/data/default/testWithMockedMapReduceMultiRegion/8a79eee6aefc962407df2ed05672c891/f2/c2016df0893c44b3a6b0164ad4a4d968, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-15 20:01:37,742 INFO [rs(jenkins-hbase4.apache.org,36625,1676491293696)-snapshot-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~158.44 KB/162240, heapSize ~549.72 KB/562912, currentSize=0 B/0 for 8a79eee6aefc962407df2ed05672c891 in 121ms, sequenceid=5, compaction requested=false 2023-02-15 20:01:37,742 DEBUG [rs(jenkins-hbase4.apache.org,36625,1676491293696)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for 8a79eee6aefc962407df2ed05672c891: 2023-02-15 20:01:37,742 DEBUG [rs(jenkins-hbase4.apache.org,36625,1676491293696)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,wWV,1676491296789.8a79eee6aefc962407df2ed05672c891.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-15 20:01:37,742 DEBUG [rs(jenkins-hbase4.apache.org,36625,1676491293696)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-15 20:01:37,742 DEBUG [rs(jenkins-hbase4.apache.org,36625,1676491293696)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/data/default/testWithMockedMapReduceMultiRegion/8a79eee6aefc962407df2ed05672c891/f1/5faa164e7bce4249bbe09f7924d8ab21] hfiles 2023-02-15 20:01:37,742 DEBUG [rs(jenkins-hbase4.apache.org,36625,1676491293696)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/data/default/testWithMockedMapReduceMultiRegion/8a79eee6aefc962407df2ed05672c891/f1/5faa164e7bce4249bbe09f7924d8ab21 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-15 20:01:37,742 DEBUG [rs(jenkins-hbase4.apache.org,36625,1676491293696)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/data/default/testWithMockedMapReduceMultiRegion/8a79eee6aefc962407df2ed05672c891/f2/c2016df0893c44b3a6b0164ad4a4d968] hfiles 2023-02-15 20:01:37,742 DEBUG [rs(jenkins-hbase4.apache.org,36625,1676491293696)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/data/default/testWithMockedMapReduceMultiRegion/8a79eee6aefc962407df2ed05672c891/f2/c2016df0893c44b3a6b0164ad4a4d968 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-15 20:01:37,748 INFO [rs(jenkins-hbase4.apache.org,36625,1676491293696)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/data/default/testWithMockedMapReduceMultiRegion/007dd63b20f9d2149ba11df9b0cddc4c/.tmp/f1/aa1115a9d4064ac3aa45dca955ad1677 2023-02-15 20:01:37,752 DEBUG [rs(jenkins-hbase4.apache.org,40517,1676491293664)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,t43,1676491296789.fe51e97cb822f497ca56994d85f7310f. completed. 2023-02-15 20:01:37,752 DEBUG [rs(jenkins-hbase4.apache.org,40517,1676491293664)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,t43,1676491296789.fe51e97cb822f497ca56994d85f7310f. 2023-02-15 20:01:37,752 DEBUG [rs(jenkins-hbase4.apache.org,40517,1676491293664)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,m\xED\xED,1676491296789.c069ee68dab22f36ea73f04b91933c1f. 2023-02-15 20:01:37,752 DEBUG [rs(jenkins-hbase4.apache.org,40517,1676491293664)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,m\xED\xED,1676491296789.c069ee68dab22f36ea73f04b91933c1f. started... 2023-02-15 20:01:37,752 DEBUG [member: 'jenkins-hbase4.apache.org,40517,1676491293664' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 2/5 local region snapshots. 2023-02-15 20:01:37,752 DEBUG [rs(jenkins-hbase4.apache.org,40517,1676491293664)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,d\x84\x84,1676491296789.85c1d4ec199a8eac4595716bde5173ab. completed. 2023-02-15 20:01:37,753 DEBUG [rs(jenkins-hbase4.apache.org,40517,1676491293664)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,d\x84\x84,1676491296789.85c1d4ec199a8eac4595716bde5173ab. 2023-02-15 20:01:37,753 DEBUG [member: 'jenkins-hbase4.apache.org,40517,1676491293664' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 3/5 local region snapshots. 2023-02-15 20:01:37,761 DEBUG [rs(jenkins-hbase4.apache.org,36625,1676491293696)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,q\x11\x10,1676491296789.81644ccf4d63c864b007cbc1043831d7. completed. 2023-02-15 20:01:37,761 DEBUG [rs(jenkins-hbase4.apache.org,36625,1676491293696)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,q\x11\x10,1676491296789.81644ccf4d63c864b007cbc1043831d7. 2023-02-15 20:01:37,761 INFO [rs(jenkins-hbase4.apache.org,40517,1676491293664)-snapshot-pool-2] regionserver.HRegion(2744): Flushing c069ee68dab22f36ea73f04b91933c1f 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-15 20:01:37,761 DEBUG [member: 'jenkins-hbase4.apache.org,36625,1676491293696' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 3/5 local region snapshots. 2023-02-15 20:01:37,764 DEBUG [rs(jenkins-hbase4.apache.org,36625,1676491293696)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,wWV,1676491296789.8a79eee6aefc962407df2ed05672c891. completed. 2023-02-15 20:01:37,764 DEBUG [rs(jenkins-hbase4.apache.org,36625,1676491293696)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,wWV,1676491296789.8a79eee6aefc962407df2ed05672c891. 2023-02-15 20:01:37,764 DEBUG [member: 'jenkins-hbase4.apache.org,36625,1676491293696' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 4/5 local region snapshots. 2023-02-15 20:01:37,772 INFO [rs(jenkins-hbase4.apache.org,36625,1676491293696)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/data/default/testWithMockedMapReduceMultiRegion/007dd63b20f9d2149ba11df9b0cddc4c/.tmp/f2/7c62395ed7814233afd59bd1a605f28b 2023-02-15 20:01:37,776 DEBUG [rs(jenkins-hbase4.apache.org,36625,1676491293696)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/data/default/testWithMockedMapReduceMultiRegion/007dd63b20f9d2149ba11df9b0cddc4c/.tmp/f1/aa1115a9d4064ac3aa45dca955ad1677 as hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/data/default/testWithMockedMapReduceMultiRegion/007dd63b20f9d2149ba11df9b0cddc4c/f1/aa1115a9d4064ac3aa45dca955ad1677 2023-02-15 20:01:37,778 INFO [rs(jenkins-hbase4.apache.org,40517,1676491293664)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/data/default/testWithMockedMapReduceMultiRegion/c069ee68dab22f36ea73f04b91933c1f/.tmp/f1/fed3c1f0213342888f3271582470bf94 2023-02-15 20:01:37,781 INFO [rs(jenkins-hbase4.apache.org,36625,1676491293696)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/data/default/testWithMockedMapReduceMultiRegion/007dd63b20f9d2149ba11df9b0cddc4c/f1/aa1115a9d4064ac3aa45dca955ad1677, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-15 20:01:37,782 DEBUG [rs(jenkins-hbase4.apache.org,36625,1676491293696)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/data/default/testWithMockedMapReduceMultiRegion/007dd63b20f9d2149ba11df9b0cddc4c/.tmp/f2/7c62395ed7814233afd59bd1a605f28b as hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/data/default/testWithMockedMapReduceMultiRegion/007dd63b20f9d2149ba11df9b0cddc4c/f2/7c62395ed7814233afd59bd1a605f28b 2023-02-15 20:01:37,787 INFO [rs(jenkins-hbase4.apache.org,36625,1676491293696)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/data/default/testWithMockedMapReduceMultiRegion/007dd63b20f9d2149ba11df9b0cddc4c/f2/7c62395ed7814233afd59bd1a605f28b, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-15 20:01:37,788 INFO [rs(jenkins-hbase4.apache.org,36625,1676491293696)-snapshot-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 007dd63b20f9d2149ba11df9b0cddc4c in 79ms, sequenceid=5, compaction requested=false 2023-02-15 20:01:37,788 DEBUG [rs(jenkins-hbase4.apache.org,36625,1676491293696)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for 007dd63b20f9d2149ba11df9b0cddc4c: 2023-02-15 20:01:37,788 DEBUG [rs(jenkins-hbase4.apache.org,36625,1676491293696)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676491296789.007dd63b20f9d2149ba11df9b0cddc4c.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-15 20:01:37,788 DEBUG [rs(jenkins-hbase4.apache.org,36625,1676491293696)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-15 20:01:37,788 DEBUG [rs(jenkins-hbase4.apache.org,36625,1676491293696)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/data/default/testWithMockedMapReduceMultiRegion/007dd63b20f9d2149ba11df9b0cddc4c/f1/aa1115a9d4064ac3aa45dca955ad1677] hfiles 2023-02-15 20:01:37,788 DEBUG [rs(jenkins-hbase4.apache.org,36625,1676491293696)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/data/default/testWithMockedMapReduceMultiRegion/007dd63b20f9d2149ba11df9b0cddc4c/f1/aa1115a9d4064ac3aa45dca955ad1677 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-15 20:01:37,788 DEBUG [rs(jenkins-hbase4.apache.org,36625,1676491293696)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/data/default/testWithMockedMapReduceMultiRegion/007dd63b20f9d2149ba11df9b0cddc4c/f2/7c62395ed7814233afd59bd1a605f28b] hfiles 2023-02-15 20:01:37,788 DEBUG [rs(jenkins-hbase4.apache.org,36625,1676491293696)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/data/default/testWithMockedMapReduceMultiRegion/007dd63b20f9d2149ba11df9b0cddc4c/f2/7c62395ed7814233afd59bd1a605f28b for snapshot=testWithMockedMapReduceMultiRegion 2023-02-15 20:01:37,798 INFO [rs(jenkins-hbase4.apache.org,40517,1676491293664)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/data/default/testWithMockedMapReduceMultiRegion/c069ee68dab22f36ea73f04b91933c1f/.tmp/f2/9bdc52e7055042b9a096d19df5046458 2023-02-15 20:01:37,810 DEBUG [rs(jenkins-hbase4.apache.org,36625,1676491293696)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676491296789.007dd63b20f9d2149ba11df9b0cddc4c. completed. 2023-02-15 20:01:37,810 DEBUG [rs(jenkins-hbase4.apache.org,36625,1676491293696)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676491296789.007dd63b20f9d2149ba11df9b0cddc4c. 2023-02-15 20:01:37,810 DEBUG [member: 'jenkins-hbase4.apache.org,36625,1676491293696' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 5/5 local region snapshots. 2023-02-15 20:01:37,810 DEBUG [member: 'jenkins-hbase4.apache.org,36625,1676491293696' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 5 local region snapshots. 2023-02-15 20:01:37,810 DEBUG [member: 'jenkins-hbase4.apache.org,36625,1676491293696' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,36625,1676491293696 2023-02-15 20:01:37,810 DEBUG [member: 'jenkins-hbase4.apache.org,36625,1676491293696' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMockedMapReduceMultiRegion' locally completed 2023-02-15 20:01:37,810 DEBUG [member: 'jenkins-hbase4.apache.org,36625,1676491293696' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMockedMapReduceMultiRegion' completed for member 'jenkins-hbase4.apache.org,36625,1676491293696' in zk 2023-02-15 20:01:37,812 DEBUG [member: 'jenkins-hbase4.apache.org,36625,1676491293696' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMockedMapReduceMultiRegion' has notified controller of completion 2023-02-15 20:01:37,812 DEBUG [Listener at localhost/43553-EventThread] zookeeper.ZKWatcher(600): master:35467-0x1005992ed530000, quorum=127.0.0.1:49184, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,36625,1676491293696 2023-02-15 20:01:37,812 DEBUG [member: 'jenkins-hbase4.apache.org,36625,1676491293696' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-15 20:01:37,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,36625,1676491293696 2023-02-15 20:01:37,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-15 20:01:37,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-15 20:01:37,812 DEBUG [member: 'jenkins-hbase4.apache.org,36625,1676491293696' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMockedMapReduceMultiRegion' completed. 2023-02-15 20:01:37,813 DEBUG [rs(jenkins-hbase4.apache.org,40517,1676491293664)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/data/default/testWithMockedMapReduceMultiRegion/c069ee68dab22f36ea73f04b91933c1f/.tmp/f1/fed3c1f0213342888f3271582470bf94 as hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/data/default/testWithMockedMapReduceMultiRegion/c069ee68dab22f36ea73f04b91933c1f/f1/fed3c1f0213342888f3271582470bf94 2023-02-15 20:01:37,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-15 20:01:37,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-15 20:01:37,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-15 20:01:37,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40517,1676491293664 2023-02-15 20:01:37,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36625,1676491293696 2023-02-15 20:01:37,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-15 20:01:37,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-15 20:01:37,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36625,1676491293696 2023-02-15 20:01:37,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMockedMapReduceMultiRegion' member 'jenkins-hbase4.apache.org,36625,1676491293696': 2023-02-15 20:01:37,816 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36625,1676491293696' released barrier for procedure'testWithMockedMapReduceMultiRegion', counting down latch. Waiting for 1 more 2023-02-15 20:01:37,818 INFO [rs(jenkins-hbase4.apache.org,40517,1676491293664)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/data/default/testWithMockedMapReduceMultiRegion/c069ee68dab22f36ea73f04b91933c1f/f1/fed3c1f0213342888f3271582470bf94, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-15 20:01:37,819 DEBUG [rs(jenkins-hbase4.apache.org,40517,1676491293664)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/data/default/testWithMockedMapReduceMultiRegion/c069ee68dab22f36ea73f04b91933c1f/.tmp/f2/9bdc52e7055042b9a096d19df5046458 as hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/data/default/testWithMockedMapReduceMultiRegion/c069ee68dab22f36ea73f04b91933c1f/f2/9bdc52e7055042b9a096d19df5046458 2023-02-15 20:01:37,824 INFO [rs(jenkins-hbase4.apache.org,40517,1676491293664)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/data/default/testWithMockedMapReduceMultiRegion/c069ee68dab22f36ea73f04b91933c1f/f2/9bdc52e7055042b9a096d19df5046458, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-15 20:01:37,825 INFO [rs(jenkins-hbase4.apache.org,40517,1676491293664)-snapshot-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for c069ee68dab22f36ea73f04b91933c1f in 64ms, sequenceid=5, compaction requested=false 2023-02-15 20:01:37,825 DEBUG [rs(jenkins-hbase4.apache.org,40517,1676491293664)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for c069ee68dab22f36ea73f04b91933c1f: 2023-02-15 20:01:37,825 DEBUG [rs(jenkins-hbase4.apache.org,40517,1676491293664)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,m\xED\xED,1676491296789.c069ee68dab22f36ea73f04b91933c1f.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-15 20:01:37,825 DEBUG [rs(jenkins-hbase4.apache.org,40517,1676491293664)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-15 20:01:37,825 DEBUG [rs(jenkins-hbase4.apache.org,40517,1676491293664)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/data/default/testWithMockedMapReduceMultiRegion/c069ee68dab22f36ea73f04b91933c1f/f1/fed3c1f0213342888f3271582470bf94] hfiles 2023-02-15 20:01:37,825 DEBUG [rs(jenkins-hbase4.apache.org,40517,1676491293664)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/data/default/testWithMockedMapReduceMultiRegion/c069ee68dab22f36ea73f04b91933c1f/f1/fed3c1f0213342888f3271582470bf94 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-15 20:01:37,825 DEBUG [rs(jenkins-hbase4.apache.org,40517,1676491293664)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/data/default/testWithMockedMapReduceMultiRegion/c069ee68dab22f36ea73f04b91933c1f/f2/9bdc52e7055042b9a096d19df5046458] hfiles 2023-02-15 20:01:37,825 DEBUG [rs(jenkins-hbase4.apache.org,40517,1676491293664)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/data/default/testWithMockedMapReduceMultiRegion/c069ee68dab22f36ea73f04b91933c1f/f2/9bdc52e7055042b9a096d19df5046458 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-15 20:01:37,834 DEBUG [rs(jenkins-hbase4.apache.org,40517,1676491293664)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,m\xED\xED,1676491296789.c069ee68dab22f36ea73f04b91933c1f. completed. 2023-02-15 20:01:37,834 DEBUG [rs(jenkins-hbase4.apache.org,40517,1676491293664)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,m\xED\xED,1676491296789.c069ee68dab22f36ea73f04b91933c1f. 2023-02-15 20:01:37,834 DEBUG [member: 'jenkins-hbase4.apache.org,40517,1676491293664' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 4/5 local region snapshots. 2023-02-15 20:01:37,844 DEBUG [Listener at localhost/43553] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-15 20:01:37,845 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35467] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 } is done 2023-02-15 20:01:37,845 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35467] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 }' is still in progress! 2023-02-15 20:01:37,845 DEBUG [Listener at localhost/43553] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-02-15 20:01:38,057 INFO [rs(jenkins-hbase4.apache.org,40517,1676491293664)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/data/default/testWithMockedMapReduceMultiRegion/5a8c9c21a9831b445d533dd705940e06/.tmp/f2/12f96a77e5ac4e01a5e7db780638b575 2023-02-15 20:01:38,062 DEBUG [rs(jenkins-hbase4.apache.org,40517,1676491293664)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/data/default/testWithMockedMapReduceMultiRegion/5a8c9c21a9831b445d533dd705940e06/.tmp/f1/9234478382f54f4bb536e887f01e40aa as hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/data/default/testWithMockedMapReduceMultiRegion/5a8c9c21a9831b445d533dd705940e06/f1/9234478382f54f4bb536e887f01e40aa 2023-02-15 20:01:38,066 INFO [rs(jenkins-hbase4.apache.org,40517,1676491293664)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/data/default/testWithMockedMapReduceMultiRegion/5a8c9c21a9831b445d533dd705940e06/f1/9234478382f54f4bb536e887f01e40aa, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-15 20:01:38,066 DEBUG [rs(jenkins-hbase4.apache.org,40517,1676491293664)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/data/default/testWithMockedMapReduceMultiRegion/5a8c9c21a9831b445d533dd705940e06/.tmp/f2/12f96a77e5ac4e01a5e7db780638b575 as hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/data/default/testWithMockedMapReduceMultiRegion/5a8c9c21a9831b445d533dd705940e06/f2/12f96a77e5ac4e01a5e7db780638b575 2023-02-15 20:01:38,071 INFO [rs(jenkins-hbase4.apache.org,40517,1676491293664)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/data/default/testWithMockedMapReduceMultiRegion/5a8c9c21a9831b445d533dd705940e06/f2/12f96a77e5ac4e01a5e7db780638b575, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-15 20:01:38,071 INFO [rs(jenkins-hbase4.apache.org,40517,1676491293664)-snapshot-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 5a8c9c21a9831b445d533dd705940e06 in 499ms, sequenceid=5, compaction requested=false 2023-02-15 20:01:38,071 DEBUG [rs(jenkins-hbase4.apache.org,40517,1676491293664)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for 5a8c9c21a9831b445d533dd705940e06: 2023-02-15 20:01:38,072 DEBUG [rs(jenkins-hbase4.apache.org,40517,1676491293664)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676491296789.5a8c9c21a9831b445d533dd705940e06.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-15 20:01:38,072 DEBUG [rs(jenkins-hbase4.apache.org,40517,1676491293664)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-15 20:01:38,072 DEBUG [rs(jenkins-hbase4.apache.org,40517,1676491293664)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/data/default/testWithMockedMapReduceMultiRegion/5a8c9c21a9831b445d533dd705940e06/f1/9234478382f54f4bb536e887f01e40aa] hfiles 2023-02-15 20:01:38,072 DEBUG [rs(jenkins-hbase4.apache.org,40517,1676491293664)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/data/default/testWithMockedMapReduceMultiRegion/5a8c9c21a9831b445d533dd705940e06/f1/9234478382f54f4bb536e887f01e40aa for snapshot=testWithMockedMapReduceMultiRegion 2023-02-15 20:01:38,072 DEBUG [rs(jenkins-hbase4.apache.org,40517,1676491293664)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/data/default/testWithMockedMapReduceMultiRegion/5a8c9c21a9831b445d533dd705940e06/f2/12f96a77e5ac4e01a5e7db780638b575] hfiles 2023-02-15 20:01:38,072 DEBUG [rs(jenkins-hbase4.apache.org,40517,1676491293664)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/data/default/testWithMockedMapReduceMultiRegion/5a8c9c21a9831b445d533dd705940e06/f2/12f96a77e5ac4e01a5e7db780638b575 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-15 20:01:38,081 DEBUG [rs(jenkins-hbase4.apache.org,40517,1676491293664)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676491296789.5a8c9c21a9831b445d533dd705940e06. completed. 2023-02-15 20:01:38,081 DEBUG [rs(jenkins-hbase4.apache.org,40517,1676491293664)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676491296789.5a8c9c21a9831b445d533dd705940e06. 2023-02-15 20:01:38,081 DEBUG [member: 'jenkins-hbase4.apache.org,40517,1676491293664' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 5/5 local region snapshots. 2023-02-15 20:01:38,081 DEBUG [member: 'jenkins-hbase4.apache.org,40517,1676491293664' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 5 local region snapshots. 2023-02-15 20:01:38,081 DEBUG [member: 'jenkins-hbase4.apache.org,40517,1676491293664' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,40517,1676491293664 2023-02-15 20:01:38,081 DEBUG [member: 'jenkins-hbase4.apache.org,40517,1676491293664' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMockedMapReduceMultiRegion' locally completed 2023-02-15 20:01:38,081 DEBUG [member: 'jenkins-hbase4.apache.org,40517,1676491293664' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMockedMapReduceMultiRegion' completed for member 'jenkins-hbase4.apache.org,40517,1676491293664' in zk 2023-02-15 20:01:38,083 DEBUG [Listener at localhost/43553-EventThread] zookeeper.ZKWatcher(600): master:35467-0x1005992ed530000, quorum=127.0.0.1:49184, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,40517,1676491293664 2023-02-15 20:01:38,083 DEBUG [member: 'jenkins-hbase4.apache.org,40517,1676491293664' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMockedMapReduceMultiRegion' has notified controller of completion 2023-02-15 20:01:38,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,40517,1676491293664 2023-02-15 20:01:38,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-15 20:01:38,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-15 20:01:38,083 DEBUG [member: 'jenkins-hbase4.apache.org,40517,1676491293664' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-15 20:01:38,083 DEBUG [member: 'jenkins-hbase4.apache.org,40517,1676491293664' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMockedMapReduceMultiRegion' completed. 2023-02-15 20:01:38,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-15 20:01:38,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-15 20:01:38,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-15 20:01:38,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40517,1676491293664 2023-02-15 20:01:38,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36625,1676491293696 2023-02-15 20:01:38,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-15 20:01:38,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-15 20:01:38,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36625,1676491293696 2023-02-15 20:01:38,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40517,1676491293664 2023-02-15 20:01:38,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMockedMapReduceMultiRegion' member 'jenkins-hbase4.apache.org,40517,1676491293664': 2023-02-15 20:01:38,086 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40517,1676491293664' released barrier for procedure'testWithMockedMapReduceMultiRegion', counting down latch. Waiting for 0 more 2023-02-15 20:01:38,086 INFO [(jenkins-hbase4.apache.org,35467,1676491293605)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMockedMapReduceMultiRegion' execution completed 2023-02-15 20:01:38,086 DEBUG [(jenkins-hbase4.apache.org,35467,1676491293605)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-15 20:01:38,086 DEBUG [(jenkins-hbase4.apache.org,35467,1676491293605)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-15 20:01:38,086 DEBUG [(jenkins-hbase4.apache.org,35467,1676491293605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMockedMapReduceMultiRegion 2023-02-15 20:01:38,086 INFO [(jenkins-hbase4.apache.org,35467,1676491293605)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMockedMapReduceMultiRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-02-15 20:01:38,088 DEBUG [Listener at localhost/43553-EventThread] zookeeper.ZKWatcher(600): regionserver:40517-0x1005992ed530001, quorum=127.0.0.1:49184, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-15 20:01:38,088 DEBUG [Listener at localhost/43553-EventThread] zookeeper.ZKWatcher(600): regionserver:36625-0x1005992ed530002, quorum=127.0.0.1:49184, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-15 20:01:38,088 DEBUG [Listener at localhost/43553-EventThread] zookeeper.ZKWatcher(600): master:35467-0x1005992ed530000, quorum=127.0.0.1:49184, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-15 20:01:38,088 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-15 20:01:38,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-15 20:01:38,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-15 20:01:38,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-15 20:01:38,088 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-15 20:01:38,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-15 20:01:38,088 DEBUG [Listener at localhost/43553-EventThread] zookeeper.ZKWatcher(600): regionserver:40517-0x1005992ed530001, quorum=127.0.0.1:49184, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-15 20:01:38,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-15 20:01:38,088 DEBUG [Listener at localhost/43553-EventThread] zookeeper.ZKWatcher(600): regionserver:36625-0x1005992ed530002, quorum=127.0.0.1:49184, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-15 20:01:38,089 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-15 20:01:38,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-15 20:01:38,089 DEBUG [(jenkins-hbase4.apache.org,35467,1676491293605)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35467-0x1005992ed530000, quorum=127.0.0.1:49184, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,40517,1676491293664 2023-02-15 20:01:38,089 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-15 20:01:38,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-15 20:01:38,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-15 20:01:38,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-15 20:01:38,089 DEBUG [(jenkins-hbase4.apache.org,35467,1676491293605)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35467-0x1005992ed530000, quorum=127.0.0.1:49184, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,36625,1676491293696 2023-02-15 20:01:38,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-15 20:01:38,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-15 20:01:38,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-15 20:01:38,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-15 20:01:38,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40517,1676491293664 2023-02-15 20:01:38,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36625,1676491293696 2023-02-15 20:01:38,090 DEBUG [(jenkins-hbase4.apache.org,35467,1676491293605)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35467-0x1005992ed530000, quorum=127.0.0.1:49184, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,36625,1676491293696 2023-02-15 20:01:38,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-15 20:01:38,091 DEBUG [(jenkins-hbase4.apache.org,35467,1676491293605)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35467-0x1005992ed530000, quorum=127.0.0.1:49184, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,40517,1676491293664 2023-02-15 20:01:38,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-15 20:01:38,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36625,1676491293696 2023-02-15 20:01:38,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40517,1676491293664 2023-02-15 20:01:38,098 DEBUG [Listener at localhost/43553-EventThread] zookeeper.ZKWatcher(600): master:35467-0x1005992ed530000, quorum=127.0.0.1:49184, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,36625,1676491293696 2023-02-15 20:01:38,098 DEBUG [Listener at localhost/43553-EventThread] zookeeper.ZKWatcher(600): master:35467-0x1005992ed530000, quorum=127.0.0.1:49184, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion 2023-02-15 20:01:38,098 DEBUG [Listener at localhost/43553-EventThread] zookeeper.ZKWatcher(600): regionserver:36625-0x1005992ed530002, quorum=127.0.0.1:49184, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-15 20:01:38,098 DEBUG [Listener at localhost/43553-EventThread] zookeeper.ZKWatcher(600): regionserver:40517-0x1005992ed530001, quorum=127.0.0.1:49184, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-15 20:01:38,098 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-15 20:01:38,098 DEBUG [Listener at localhost/43553-EventThread] zookeeper.ZKWatcher(600): regionserver:36625-0x1005992ed530002, quorum=127.0.0.1:49184, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-15 20:01:38,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-15 20:01:38,098 DEBUG [Listener at localhost/43553-EventThread] zookeeper.ZKWatcher(600): master:35467-0x1005992ed530000, quorum=127.0.0.1:49184, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,40517,1676491293664 2023-02-15 20:01:38,098 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-15 20:01:38,098 DEBUG [(jenkins-hbase4.apache.org,35467,1676491293605)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-15 20:01:38,098 DEBUG [Listener at localhost/43553-EventThread] zookeeper.ZKWatcher(600): regionserver:40517-0x1005992ed530001, quorum=127.0.0.1:49184, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-15 20:01:38,098 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for testWithMockedMapReduceMultiRegion 2023-02-15 20:01:38,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-15 20:01:38,099 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for testWithMockedMapReduceMultiRegion 2023-02-15 20:01:38,098 DEBUG [Listener at localhost/43553-EventThread] zookeeper.ZKWatcher(600): master:35467-0x1005992ed530000, quorum=127.0.0.1:49184, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion 2023-02-15 20:01:38,099 DEBUG [Listener at localhost/43553-EventThread] zookeeper.ZKWatcher(600): master:35467-0x1005992ed530000, quorum=127.0.0.1:49184, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,40517,1676491293664 2023-02-15 20:01:38,099 DEBUG [Listener at localhost/43553-EventThread] zookeeper.ZKWatcher(600): master:35467-0x1005992ed530000, quorum=127.0.0.1:49184, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-15 20:01:38,099 DEBUG [Listener at localhost/43553-EventThread] zookeeper.ZKWatcher(600): master:35467-0x1005992ed530000, quorum=127.0.0.1:49184, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,36625,1676491293696 2023-02-15 20:01:38,099 DEBUG [Listener at localhost/43553-EventThread] zookeeper.ZKWatcher(600): master:35467-0x1005992ed530000, quorum=127.0.0.1:49184, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-15 20:01:38,099 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-15 20:01:38,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-15 20:01:38,099 DEBUG [Listener at localhost/43553-EventThread] zookeeper.ZKWatcher(600): master:35467-0x1005992ed530000, quorum=127.0.0.1:49184, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-15 20:01:38,099 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-15 20:01:38,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-15 20:01:38,099 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/.hbase-snapshot/.tmp/testWithMockedMapReduceMultiRegion 2023-02-15 20:01:38,140 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/.hbase-snapshot/.tmp/testWithMockedMapReduceMultiRegion to hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/.hbase-snapshot/testWithMockedMapReduceMultiRegion 2023-02-15 20:01:38,146 DEBUG [Listener at localhost/43553] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-15 20:01:38,147 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35467] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 } is done 2023-02-15 20:01:38,147 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35467] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 }' is still in progress! 2023-02-15 20:01:38,147 DEBUG [Listener at localhost/43553] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-02-15 20:01:38,167 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot testWithMockedMapReduceMultiRegion of table testWithMockedMapReduceMultiRegion completed 2023-02-15 20:01:38,167 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/.hbase-snapshot/.tmp/testWithMockedMapReduceMultiRegion 2023-02-15 20:01:38,167 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/.hbase-snapshot/.tmp/testWithMockedMapReduceMultiRegion 2023-02-15 20:01:38,167 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot testWithMockedMapReduceMultiRegion C_M_SNAPSHOT_TABLE on table testWithMockedMapReduceMultiRegion at 1676491297541Consolidate snapshot: testWithMockedMapReduceMultiRegion at 1676491298099 (+558 ms)Loading Region manifests for testWithMockedMapReduceMultiRegion at 1676491298099Writing data manifest for testWithMockedMapReduceMultiRegion at 1676491298110 (+11 ms)Verifying snapshot: testWithMockedMapReduceMultiRegion at 1676491298122 (+12 ms)Snapshot testWithMockedMapReduceMultiRegion of table testWithMockedMapReduceMultiRegion completed at 1676491298167 (+45 ms) 2023-02-15 20:01:38,169 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=32, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=SHARED 2023-02-15 20:01:38,170 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=32, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=SHARED in 627 msec 2023-02-15 20:01:38,647 DEBUG [Listener at localhost/43553] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-15 20:01:38,649 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35467] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 } is done 2023-02-15 20:01:38,649 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35467] snapshot.SnapshotManager(401): Snapshot '{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-02-15 20:01:38,649 INFO [Listener at localhost/43553] snapshot.SnapshotTestingUtils(399): Confirming snapshot exists. 2023-02-15 20:01:38,654 INFO [Listener at localhost/43553] snapshot.SnapshotTestingUtils(406): validating snapshot. 2023-02-15 20:01:38,660 INFO [Listener at localhost/43553] mapreduce.TableSnapshotInputFormatTestBase(218): load different values 2023-02-15 20:01:38,688 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40517] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 8112 Client: jenkins//172.31.14.131 first region in multi=testWithMockedMapReduceMultiRegion,d\x84\x84,1676491296789.85c1d4ec199a8eac4595716bde5173ab. 2023-02-15 20:01:38,688 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36625] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 9464 Client: jenkins//172.31.14.131 first region in multi=testWithMockedMapReduceMultiRegion,aaa,1676491296789.6f4ab26e6b0d69c90f3b3b848034eb88. 2023-02-15 20:01:38,741 INFO [Listener at localhost/43553] mapreduce.TableSnapshotInputFormatTestBase(222): cause flush to create new files in the region 2023-02-15 20:01:38,748 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35467] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-15 20:01:38,751 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35467] procedure.ProcedureCoordinator(165): Submitting procedure testWithMockedMapReduceMultiRegion 2023-02-15 20:01:38,751 INFO [(jenkins-hbase4.apache.org,35467,1676491293605)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMockedMapReduceMultiRegion' 2023-02-15 20:01:38,751 DEBUG [(jenkins-hbase4.apache.org,35467,1676491293605)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-15 20:01:38,752 DEBUG [(jenkins-hbase4.apache.org,35467,1676491293605)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMockedMapReduceMultiRegion' starting 'acquire' 2023-02-15 20:01:38,752 DEBUG [(jenkins-hbase4.apache.org,35467,1676491293605)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMockedMapReduceMultiRegion', kicking off acquire phase on members. 2023-02-15 20:01:38,753 DEBUG [(jenkins-hbase4.apache.org,35467,1676491293605)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35467-0x1005992ed530000, quorum=127.0.0.1:49184, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-15 20:01:38,753 DEBUG [(jenkins-hbase4.apache.org,35467,1676491293605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion 2023-02-15 20:01:38,754 DEBUG [Listener at localhost/43553-EventThread] zookeeper.ZKWatcher(600): regionserver:40517-0x1005992ed530001, quorum=127.0.0.1:49184, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-15 20:01:38,754 DEBUG [(jenkins-hbase4.apache.org,35467,1676491293605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,36625,1676491293696 2023-02-15 20:01:38,754 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-15 20:01:38,754 DEBUG [Listener at localhost/43553-EventThread] zookeeper.ZKWatcher(600): regionserver:36625-0x1005992ed530002, quorum=127.0.0.1:49184, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-15 20:01:38,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-15 20:01:38,754 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-15 20:01:38,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-15 20:01:38,754 DEBUG [(jenkins-hbase4.apache.org,35467,1676491293605)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35467-0x1005992ed530000, quorum=127.0.0.1:49184, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,36625,1676491293696 2023-02-15 20:01:38,754 DEBUG [(jenkins-hbase4.apache.org,35467,1676491293605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,40517,1676491293664 2023-02-15 20:01:38,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion 2023-02-15 20:01:38,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion 2023-02-15 20:01:38,755 DEBUG [(jenkins-hbase4.apache.org,35467,1676491293605)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35467-0x1005992ed530000, quorum=127.0.0.1:49184, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,40517,1676491293664 2023-02-15 20:01:38,755 DEBUG [(jenkins-hbase4.apache.org,35467,1676491293605)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-15 20:01:38,755 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40517-0x1005992ed530001, quorum=127.0.0.1:49184, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-15 20:01:38,755 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36625-0x1005992ed530002, quorum=127.0.0.1:49184, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-15 20:01:38,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-15 20:01:38,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-15 20:01:38,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion 2023-02-15 20:01:38,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion 2023-02-15 20:01:38,755 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMockedMapReduceMultiRegion 2023-02-15 20:01:38,755 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMockedMapReduceMultiRegion 2023-02-15 20:01:38,760 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMockedMapReduceMultiRegion 2023-02-15 20:01:38,760 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMockedMapReduceMultiRegion 2023-02-15 20:01:38,761 DEBUG [member: 'jenkins-hbase4.apache.org,36625,1676491293696' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMockedMapReduceMultiRegion' with timeout 60000ms 2023-02-15 20:01:38,761 DEBUG [member: 'jenkins-hbase4.apache.org,36625,1676491293696' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-15 20:01:38,761 DEBUG [member: 'jenkins-hbase4.apache.org,40517,1676491293664' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMockedMapReduceMultiRegion' with timeout 60000ms 2023-02-15 20:01:38,762 DEBUG [member: 'jenkins-hbase4.apache.org,36625,1676491293696' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMockedMapReduceMultiRegion' starting 'acquire' stage 2023-02-15 20:01:38,762 DEBUG [member: 'jenkins-hbase4.apache.org,40517,1676491293664' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-15 20:01:38,762 DEBUG [member: 'jenkins-hbase4.apache.org,40517,1676491293664' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMockedMapReduceMultiRegion' starting 'acquire' stage 2023-02-15 20:01:38,763 DEBUG [rs(jenkins-hbase4.apache.org,36625,1676491293696)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,q\x11\x10,1676491296789.81644ccf4d63c864b007cbc1043831d7. 2023-02-15 20:01:38,763 DEBUG [rs(jenkins-hbase4.apache.org,36625,1676491293696)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,q\x11\x10,1676491296789.81644ccf4d63c864b007cbc1043831d7. started... 2023-02-15 20:01:38,763 INFO [rs(jenkins-hbase4.apache.org,36625,1676491293696)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 81644ccf4d63c864b007cbc1043831d7 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-15 20:01:38,763 DEBUG [rs(jenkins-hbase4.apache.org,36625,1676491293696)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,,1676491296789.5e40ee2d96ae1cbe88d7c194cd72dda2. 2023-02-15 20:01:38,763 DEBUG [rs(jenkins-hbase4.apache.org,36625,1676491293696)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,,1676491296789.5e40ee2d96ae1cbe88d7c194cd72dda2. started... 2023-02-15 20:01:38,763 DEBUG [rs(jenkins-hbase4.apache.org,40517,1676491293664)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,d\x84\x84,1676491296789.85c1d4ec199a8eac4595716bde5173ab. 2023-02-15 20:01:38,763 DEBUG [rs(jenkins-hbase4.apache.org,36625,1676491293696)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 5e40ee2d96ae1cbe88d7c194cd72dda2: 2023-02-15 20:01:38,763 DEBUG [member: 'jenkins-hbase4.apache.org,36625,1676491293696' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 5 regions 2023-02-15 20:01:38,763 DEBUG [member: 'jenkins-hbase4.apache.org,36625,1676491293696' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-15 20:01:38,763 DEBUG [rs(jenkins-hbase4.apache.org,40517,1676491293664)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,d\x84\x84,1676491296789.85c1d4ec199a8eac4595716bde5173ab. started... 2023-02-15 20:01:38,763 DEBUG [rs(jenkins-hbase4.apache.org,36625,1676491293696)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,aaa,1676491296789.6f4ab26e6b0d69c90f3b3b848034eb88. 2023-02-15 20:01:38,763 DEBUG [rs(jenkins-hbase4.apache.org,36625,1676491293696)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,,1676491296789.5e40ee2d96ae1cbe88d7c194cd72dda2. 2023-02-15 20:01:38,764 INFO [rs(jenkins-hbase4.apache.org,40517,1676491293664)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 85c1d4ec199a8eac4595716bde5173ab 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-15 20:01:38,764 DEBUG [rs(jenkins-hbase4.apache.org,36625,1676491293696)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,aaa,1676491296789.6f4ab26e6b0d69c90f3b3b848034eb88. started... 2023-02-15 20:01:38,764 INFO [rs(jenkins-hbase4.apache.org,36625,1676491293696)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 6f4ab26e6b0d69c90f3b3b848034eb88 2/2 column families, dataSize=248.22 KB heapSize=634.25 KB 2023-02-15 20:01:38,768 DEBUG [rs(jenkins-hbase4.apache.org,36625,1676491293696)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,wWV,1676491296789.8a79eee6aefc962407df2ed05672c891. 2023-02-15 20:01:38,768 DEBUG [rs(jenkins-hbase4.apache.org,40517,1676491293664)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676491296789.5a8c9c21a9831b445d533dd705940e06. 2023-02-15 20:01:38,768 DEBUG [member: 'jenkins-hbase4.apache.org,40517,1676491293664' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 5 regions 2023-02-15 20:01:38,769 DEBUG [member: 'jenkins-hbase4.apache.org,40517,1676491293664' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-15 20:01:38,769 DEBUG [rs(jenkins-hbase4.apache.org,40517,1676491293664)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,zz{,1676491296789.4229d692a52fca982c3f6193911c155d. 2023-02-15 20:01:38,769 DEBUG [rs(jenkins-hbase4.apache.org,40517,1676491293664)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,zz{,1676491296789.4229d692a52fca982c3f6193911c155d. started... 2023-02-15 20:01:38,768 DEBUG [rs(jenkins-hbase4.apache.org,40517,1676491293664)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676491296789.5a8c9c21a9831b445d533dd705940e06. started... 2023-02-15 20:01:38,769 DEBUG [rs(jenkins-hbase4.apache.org,40517,1676491293664)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 4229d692a52fca982c3f6193911c155d: 2023-02-15 20:01:38,769 DEBUG [rs(jenkins-hbase4.apache.org,40517,1676491293664)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,zz{,1676491296789.4229d692a52fca982c3f6193911c155d. 2023-02-15 20:01:38,768 DEBUG [rs(jenkins-hbase4.apache.org,36625,1676491293696)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,wWV,1676491296789.8a79eee6aefc962407df2ed05672c891. started... 2023-02-15 20:01:38,768 DEBUG [member: 'jenkins-hbase4.apache.org,36625,1676491293696' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/5 local region flush tasks. 2023-02-15 20:01:38,769 INFO [rs(jenkins-hbase4.apache.org,36625,1676491293696)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 8a79eee6aefc962407df2ed05672c891 2/2 column families, dataSize=248.22 KB heapSize=634.25 KB 2023-02-15 20:01:38,769 DEBUG [rs(jenkins-hbase4.apache.org,40517,1676491293664)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,t43,1676491296789.fe51e97cb822f497ca56994d85f7310f. 2023-02-15 20:01:38,769 DEBUG [member: 'jenkins-hbase4.apache.org,40517,1676491293664' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/5 local region flush tasks. 2023-02-15 20:01:38,769 INFO [rs(jenkins-hbase4.apache.org,40517,1676491293664)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 5a8c9c21a9831b445d533dd705940e06 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-15 20:01:38,769 DEBUG [rs(jenkins-hbase4.apache.org,40517,1676491293664)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,t43,1676491296789.fe51e97cb822f497ca56994d85f7310f. started... 2023-02-15 20:01:38,771 INFO [rs(jenkins-hbase4.apache.org,40517,1676491293664)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing fe51e97cb822f497ca56994d85f7310f 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-15 20:01:38,812 INFO [rs(jenkins-hbase4.apache.org,40517,1676491293664)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/data/default/testWithMockedMapReduceMultiRegion/85c1d4ec199a8eac4595716bde5173ab/.tmp/f1/b5aef1f75a2242a8bdcd7dd44b0b4202 2023-02-15 20:01:38,812 INFO [rs(jenkins-hbase4.apache.org,36625,1676491293696)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/data/default/testWithMockedMapReduceMultiRegion/6f4ab26e6b0d69c90f3b3b848034eb88/.tmp/f1/1b36597b06c345f989d18290d69f759e 2023-02-15 20:01:38,812 INFO [rs(jenkins-hbase4.apache.org,40517,1676491293664)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/data/default/testWithMockedMapReduceMultiRegion/fe51e97cb822f497ca56994d85f7310f/.tmp/f1/c1a97639638e4b599326b2351fb63a31 2023-02-15 20:01:38,812 INFO [rs(jenkins-hbase4.apache.org,36625,1676491293696)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/data/default/testWithMockedMapReduceMultiRegion/81644ccf4d63c864b007cbc1043831d7/.tmp/f1/fb4bdc3d94724124875e2d8667bf63a6 2023-02-15 20:01:38,836 INFO [rs(jenkins-hbase4.apache.org,40517,1676491293664)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/data/default/testWithMockedMapReduceMultiRegion/5a8c9c21a9831b445d533dd705940e06/.tmp/f1/1d2809fc4a064e16b6346360287eb0f5 2023-02-15 20:01:38,851 INFO [rs(jenkins-hbase4.apache.org,36625,1676491293696)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/data/default/testWithMockedMapReduceMultiRegion/8a79eee6aefc962407df2ed05672c891/.tmp/f1/ecc16de3dc1744a0b3e45b3b32a65dcb 2023-02-15 20:01:38,872 INFO [rs(jenkins-hbase4.apache.org,40517,1676491293664)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/data/default/testWithMockedMapReduceMultiRegion/fe51e97cb822f497ca56994d85f7310f/.tmp/f2/f89e99f5a66b446dbbd303d1e48989e0 2023-02-15 20:01:38,879 DEBUG [rs(jenkins-hbase4.apache.org,40517,1676491293664)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/data/default/testWithMockedMapReduceMultiRegion/fe51e97cb822f497ca56994d85f7310f/.tmp/f1/c1a97639638e4b599326b2351fb63a31 as hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/data/default/testWithMockedMapReduceMultiRegion/fe51e97cb822f497ca56994d85f7310f/f1/c1a97639638e4b599326b2351fb63a31 2023-02-15 20:01:38,884 INFO [rs(jenkins-hbase4.apache.org,40517,1676491293664)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/data/default/testWithMockedMapReduceMultiRegion/fe51e97cb822f497ca56994d85f7310f/f1/c1a97639638e4b599326b2351fb63a31, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-15 20:01:38,885 DEBUG [rs(jenkins-hbase4.apache.org,40517,1676491293664)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/data/default/testWithMockedMapReduceMultiRegion/fe51e97cb822f497ca56994d85f7310f/.tmp/f2/f89e99f5a66b446dbbd303d1e48989e0 as hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/data/default/testWithMockedMapReduceMultiRegion/fe51e97cb822f497ca56994d85f7310f/f2/f89e99f5a66b446dbbd303d1e48989e0 2023-02-15 20:01:38,889 INFO [rs(jenkins-hbase4.apache.org,40517,1676491293664)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/data/default/testWithMockedMapReduceMultiRegion/5a8c9c21a9831b445d533dd705940e06/.tmp/f2/1a99564336744e84ab20ab08428e951b 2023-02-15 20:01:38,889 INFO [rs(jenkins-hbase4.apache.org,40517,1676491293664)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/data/default/testWithMockedMapReduceMultiRegion/fe51e97cb822f497ca56994d85f7310f/f2/f89e99f5a66b446dbbd303d1e48989e0, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-15 20:01:38,890 INFO [rs(jenkins-hbase4.apache.org,40517,1676491293664)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for fe51e97cb822f497ca56994d85f7310f in 119ms, sequenceid=9, compaction requested=false 2023-02-15 20:01:38,890 DEBUG [rs(jenkins-hbase4.apache.org,40517,1676491293664)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for fe51e97cb822f497ca56994d85f7310f: 2023-02-15 20:01:38,891 DEBUG [rs(jenkins-hbase4.apache.org,40517,1676491293664)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,t43,1676491296789.fe51e97cb822f497ca56994d85f7310f. 2023-02-15 20:01:38,891 DEBUG [rs(jenkins-hbase4.apache.org,40517,1676491293664)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,m\xED\xED,1676491296789.c069ee68dab22f36ea73f04b91933c1f. 2023-02-15 20:01:38,891 DEBUG [rs(jenkins-hbase4.apache.org,40517,1676491293664)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,m\xED\xED,1676491296789.c069ee68dab22f36ea73f04b91933c1f. started... 2023-02-15 20:01:38,891 DEBUG [member: 'jenkins-hbase4.apache.org,40517,1676491293664' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/5 local region flush tasks. 2023-02-15 20:01:38,891 INFO [rs(jenkins-hbase4.apache.org,40517,1676491293664)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing c069ee68dab22f36ea73f04b91933c1f 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-15 20:01:38,894 DEBUG [rs(jenkins-hbase4.apache.org,40517,1676491293664)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/data/default/testWithMockedMapReduceMultiRegion/5a8c9c21a9831b445d533dd705940e06/.tmp/f1/1d2809fc4a064e16b6346360287eb0f5 as hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/data/default/testWithMockedMapReduceMultiRegion/5a8c9c21a9831b445d533dd705940e06/f1/1d2809fc4a064e16b6346360287eb0f5 2023-02-15 20:01:38,896 INFO [rs(jenkins-hbase4.apache.org,36625,1676491293696)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/data/default/testWithMockedMapReduceMultiRegion/6f4ab26e6b0d69c90f3b3b848034eb88/.tmp/f2/bca56c6bf49b42d698c76d01b9f6faef 2023-02-15 20:01:38,898 INFO [rs(jenkins-hbase4.apache.org,40517,1676491293664)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/data/default/testWithMockedMapReduceMultiRegion/5a8c9c21a9831b445d533dd705940e06/f1/1d2809fc4a064e16b6346360287eb0f5, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-15 20:01:38,902 DEBUG [rs(jenkins-hbase4.apache.org,40517,1676491293664)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/data/default/testWithMockedMapReduceMultiRegion/5a8c9c21a9831b445d533dd705940e06/.tmp/f2/1a99564336744e84ab20ab08428e951b as hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/data/default/testWithMockedMapReduceMultiRegion/5a8c9c21a9831b445d533dd705940e06/f2/1a99564336744e84ab20ab08428e951b 2023-02-15 20:01:38,902 DEBUG [rs(jenkins-hbase4.apache.org,36625,1676491293696)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/data/default/testWithMockedMapReduceMultiRegion/6f4ab26e6b0d69c90f3b3b848034eb88/.tmp/f1/1b36597b06c345f989d18290d69f759e as hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/data/default/testWithMockedMapReduceMultiRegion/6f4ab26e6b0d69c90f3b3b848034eb88/f1/1b36597b06c345f989d18290d69f759e 2023-02-15 20:01:38,907 INFO [rs(jenkins-hbase4.apache.org,40517,1676491293664)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/data/default/testWithMockedMapReduceMultiRegion/5a8c9c21a9831b445d533dd705940e06/f2/1a99564336744e84ab20ab08428e951b, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-15 20:01:38,907 INFO [rs(jenkins-hbase4.apache.org,36625,1676491293696)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/data/default/testWithMockedMapReduceMultiRegion/6f4ab26e6b0d69c90f3b3b848034eb88/f1/1b36597b06c345f989d18290d69f759e, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-15 20:01:38,908 INFO [rs(jenkins-hbase4.apache.org,40517,1676491293664)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 5a8c9c21a9831b445d533dd705940e06 in 139ms, sequenceid=9, compaction requested=false 2023-02-15 20:01:38,908 DEBUG [rs(jenkins-hbase4.apache.org,40517,1676491293664)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 5a8c9c21a9831b445d533dd705940e06: 2023-02-15 20:01:38,908 DEBUG [rs(jenkins-hbase4.apache.org,40517,1676491293664)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676491296789.5a8c9c21a9831b445d533dd705940e06. 2023-02-15 20:01:38,908 DEBUG [member: 'jenkins-hbase4.apache.org,40517,1676491293664' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/5 local region flush tasks. 2023-02-15 20:01:38,910 INFO [rs(jenkins-hbase4.apache.org,40517,1676491293664)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/data/default/testWithMockedMapReduceMultiRegion/85c1d4ec199a8eac4595716bde5173ab/.tmp/f2/a28dbcbe704a4e08bc1990b76ccf55bb 2023-02-15 20:01:38,910 DEBUG [rs(jenkins-hbase4.apache.org,36625,1676491293696)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/data/default/testWithMockedMapReduceMultiRegion/6f4ab26e6b0d69c90f3b3b848034eb88/.tmp/f2/bca56c6bf49b42d698c76d01b9f6faef as hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/data/default/testWithMockedMapReduceMultiRegion/6f4ab26e6b0d69c90f3b3b848034eb88/f2/bca56c6bf49b42d698c76d01b9f6faef 2023-02-15 20:01:38,911 INFO [rs(jenkins-hbase4.apache.org,36625,1676491293696)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/data/default/testWithMockedMapReduceMultiRegion/81644ccf4d63c864b007cbc1043831d7/.tmp/f2/733954210de04b5bbfdd845e215b9699 2023-02-15 20:01:38,915 INFO [rs(jenkins-hbase4.apache.org,36625,1676491293696)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/data/default/testWithMockedMapReduceMultiRegion/8a79eee6aefc962407df2ed05672c891/.tmp/f2/651f82f738544655af089e98533e03fb 2023-02-15 20:01:38,918 DEBUG [rs(jenkins-hbase4.apache.org,40517,1676491293664)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/data/default/testWithMockedMapReduceMultiRegion/85c1d4ec199a8eac4595716bde5173ab/.tmp/f1/b5aef1f75a2242a8bdcd7dd44b0b4202 as hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/data/default/testWithMockedMapReduceMultiRegion/85c1d4ec199a8eac4595716bde5173ab/f1/b5aef1f75a2242a8bdcd7dd44b0b4202 2023-02-15 20:01:38,919 DEBUG [rs(jenkins-hbase4.apache.org,36625,1676491293696)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/data/default/testWithMockedMapReduceMultiRegion/81644ccf4d63c864b007cbc1043831d7/.tmp/f1/fb4bdc3d94724124875e2d8667bf63a6 as hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/data/default/testWithMockedMapReduceMultiRegion/81644ccf4d63c864b007cbc1043831d7/f1/fb4bdc3d94724124875e2d8667bf63a6 2023-02-15 20:01:38,920 INFO [rs(jenkins-hbase4.apache.org,36625,1676491293696)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/data/default/testWithMockedMapReduceMultiRegion/6f4ab26e6b0d69c90f3b3b848034eb88/f2/bca56c6bf49b42d698c76d01b9f6faef, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-15 20:01:38,921 INFO [rs(jenkins-hbase4.apache.org,36625,1676491293696)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~248.22 KB/254176, heapSize ~634.22 KB/649440, currentSize=0 B/0 for 6f4ab26e6b0d69c90f3b3b848034eb88 in 157ms, sequenceid=9, compaction requested=false 2023-02-15 20:01:38,921 DEBUG [rs(jenkins-hbase4.apache.org,36625,1676491293696)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 6f4ab26e6b0d69c90f3b3b848034eb88: 2023-02-15 20:01:38,921 DEBUG [rs(jenkins-hbase4.apache.org,36625,1676491293696)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,aaa,1676491296789.6f4ab26e6b0d69c90f3b3b848034eb88. 2023-02-15 20:01:38,921 DEBUG [rs(jenkins-hbase4.apache.org,36625,1676491293696)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676491296789.007dd63b20f9d2149ba11df9b0cddc4c. 2023-02-15 20:01:38,921 DEBUG [member: 'jenkins-hbase4.apache.org,36625,1676491293696' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/5 local region flush tasks. 2023-02-15 20:01:38,921 DEBUG [rs(jenkins-hbase4.apache.org,36625,1676491293696)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676491296789.007dd63b20f9d2149ba11df9b0cddc4c. started... 2023-02-15 20:01:38,921 INFO [rs(jenkins-hbase4.apache.org,36625,1676491293696)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 007dd63b20f9d2149ba11df9b0cddc4c 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-15 20:01:38,922 DEBUG [rs(jenkins-hbase4.apache.org,36625,1676491293696)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/data/default/testWithMockedMapReduceMultiRegion/8a79eee6aefc962407df2ed05672c891/.tmp/f1/ecc16de3dc1744a0b3e45b3b32a65dcb as hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/data/default/testWithMockedMapReduceMultiRegion/8a79eee6aefc962407df2ed05672c891/f1/ecc16de3dc1744a0b3e45b3b32a65dcb 2023-02-15 20:01:38,928 INFO [rs(jenkins-hbase4.apache.org,36625,1676491293696)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/data/default/testWithMockedMapReduceMultiRegion/81644ccf4d63c864b007cbc1043831d7/f1/fb4bdc3d94724124875e2d8667bf63a6, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-15 20:01:38,928 INFO [rs(jenkins-hbase4.apache.org,40517,1676491293664)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/data/default/testWithMockedMapReduceMultiRegion/85c1d4ec199a8eac4595716bde5173ab/f1/b5aef1f75a2242a8bdcd7dd44b0b4202, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-15 20:01:38,929 DEBUG [rs(jenkins-hbase4.apache.org,36625,1676491293696)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/data/default/testWithMockedMapReduceMultiRegion/81644ccf4d63c864b007cbc1043831d7/.tmp/f2/733954210de04b5bbfdd845e215b9699 as hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/data/default/testWithMockedMapReduceMultiRegion/81644ccf4d63c864b007cbc1043831d7/f2/733954210de04b5bbfdd845e215b9699 2023-02-15 20:01:38,929 DEBUG [rs(jenkins-hbase4.apache.org,40517,1676491293664)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/data/default/testWithMockedMapReduceMultiRegion/85c1d4ec199a8eac4595716bde5173ab/.tmp/f2/a28dbcbe704a4e08bc1990b76ccf55bb as hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/data/default/testWithMockedMapReduceMultiRegion/85c1d4ec199a8eac4595716bde5173ab/f2/a28dbcbe704a4e08bc1990b76ccf55bb 2023-02-15 20:01:38,930 INFO [rs(jenkins-hbase4.apache.org,36625,1676491293696)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/data/default/testWithMockedMapReduceMultiRegion/8a79eee6aefc962407df2ed05672c891/f1/ecc16de3dc1744a0b3e45b3b32a65dcb, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-15 20:01:38,931 DEBUG [rs(jenkins-hbase4.apache.org,36625,1676491293696)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/data/default/testWithMockedMapReduceMultiRegion/8a79eee6aefc962407df2ed05672c891/.tmp/f2/651f82f738544655af089e98533e03fb as hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/data/default/testWithMockedMapReduceMultiRegion/8a79eee6aefc962407df2ed05672c891/f2/651f82f738544655af089e98533e03fb 2023-02-15 20:01:38,940 INFO [rs(jenkins-hbase4.apache.org,40517,1676491293664)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/data/default/testWithMockedMapReduceMultiRegion/85c1d4ec199a8eac4595716bde5173ab/f2/a28dbcbe704a4e08bc1990b76ccf55bb, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-15 20:01:38,941 INFO [rs(jenkins-hbase4.apache.org,40517,1676491293664)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 85c1d4ec199a8eac4595716bde5173ab in 177ms, sequenceid=9, compaction requested=false 2023-02-15 20:01:38,941 DEBUG [rs(jenkins-hbase4.apache.org,40517,1676491293664)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 85c1d4ec199a8eac4595716bde5173ab: 2023-02-15 20:01:38,941 DEBUG [rs(jenkins-hbase4.apache.org,40517,1676491293664)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,d\x84\x84,1676491296789.85c1d4ec199a8eac4595716bde5173ab. 2023-02-15 20:01:38,941 DEBUG [member: 'jenkins-hbase4.apache.org,40517,1676491293664' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 4/5 local region flush tasks. 2023-02-15 20:01:38,944 INFO [rs(jenkins-hbase4.apache.org,40517,1676491293664)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/data/default/testWithMockedMapReduceMultiRegion/c069ee68dab22f36ea73f04b91933c1f/.tmp/f1/2f4c6c52f5c344889299ea3c60a85a43 2023-02-15 20:01:38,945 INFO [rs(jenkins-hbase4.apache.org,36625,1676491293696)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/data/default/testWithMockedMapReduceMultiRegion/81644ccf4d63c864b007cbc1043831d7/f2/733954210de04b5bbfdd845e215b9699, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-15 20:01:38,946 INFO [rs(jenkins-hbase4.apache.org,36625,1676491293696)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 81644ccf4d63c864b007cbc1043831d7 in 182ms, sequenceid=9, compaction requested=false 2023-02-15 20:01:38,946 DEBUG [rs(jenkins-hbase4.apache.org,36625,1676491293696)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 81644ccf4d63c864b007cbc1043831d7: 2023-02-15 20:01:38,946 DEBUG [rs(jenkins-hbase4.apache.org,36625,1676491293696)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,q\x11\x10,1676491296789.81644ccf4d63c864b007cbc1043831d7. 2023-02-15 20:01:38,946 DEBUG [member: 'jenkins-hbase4.apache.org,36625,1676491293696' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/5 local region flush tasks. 2023-02-15 20:01:38,946 INFO [rs(jenkins-hbase4.apache.org,36625,1676491293696)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/data/default/testWithMockedMapReduceMultiRegion/8a79eee6aefc962407df2ed05672c891/f2/651f82f738544655af089e98533e03fb, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-15 20:01:38,947 INFO [rs(jenkins-hbase4.apache.org,36625,1676491293696)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~248.22 KB/254176, heapSize ~634.22 KB/649440, currentSize=0 B/0 for 8a79eee6aefc962407df2ed05672c891 in 178ms, sequenceid=9, compaction requested=false 2023-02-15 20:01:38,947 DEBUG [rs(jenkins-hbase4.apache.org,36625,1676491293696)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 8a79eee6aefc962407df2ed05672c891: 2023-02-15 20:01:38,947 DEBUG [rs(jenkins-hbase4.apache.org,36625,1676491293696)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,wWV,1676491296789.8a79eee6aefc962407df2ed05672c891. 2023-02-15 20:01:38,947 DEBUG [member: 'jenkins-hbase4.apache.org,36625,1676491293696' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 4/5 local region flush tasks. 2023-02-15 20:01:38,952 INFO [rs(jenkins-hbase4.apache.org,36625,1676491293696)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/data/default/testWithMockedMapReduceMultiRegion/007dd63b20f9d2149ba11df9b0cddc4c/.tmp/f1/d178029f0da34cc3a3f4cc28583f9032 2023-02-15 20:01:38,958 INFO [rs(jenkins-hbase4.apache.org,40517,1676491293664)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/data/default/testWithMockedMapReduceMultiRegion/c069ee68dab22f36ea73f04b91933c1f/.tmp/f2/df5dba58e6904d49b1574ce8bae69d2e 2023-02-15 20:01:38,963 DEBUG [rs(jenkins-hbase4.apache.org,40517,1676491293664)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/data/default/testWithMockedMapReduceMultiRegion/c069ee68dab22f36ea73f04b91933c1f/.tmp/f1/2f4c6c52f5c344889299ea3c60a85a43 as hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/data/default/testWithMockedMapReduceMultiRegion/c069ee68dab22f36ea73f04b91933c1f/f1/2f4c6c52f5c344889299ea3c60a85a43 2023-02-15 20:01:38,968 INFO [rs(jenkins-hbase4.apache.org,40517,1676491293664)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/data/default/testWithMockedMapReduceMultiRegion/c069ee68dab22f36ea73f04b91933c1f/f1/2f4c6c52f5c344889299ea3c60a85a43, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-15 20:01:38,968 DEBUG [rs(jenkins-hbase4.apache.org,40517,1676491293664)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/data/default/testWithMockedMapReduceMultiRegion/c069ee68dab22f36ea73f04b91933c1f/.tmp/f2/df5dba58e6904d49b1574ce8bae69d2e as hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/data/default/testWithMockedMapReduceMultiRegion/c069ee68dab22f36ea73f04b91933c1f/f2/df5dba58e6904d49b1574ce8bae69d2e 2023-02-15 20:01:38,973 INFO [rs(jenkins-hbase4.apache.org,36625,1676491293696)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/data/default/testWithMockedMapReduceMultiRegion/007dd63b20f9d2149ba11df9b0cddc4c/.tmp/f2/5e5a7c1eb19242da9b6862d34233d0ee 2023-02-15 20:01:38,974 INFO [rs(jenkins-hbase4.apache.org,40517,1676491293664)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/data/default/testWithMockedMapReduceMultiRegion/c069ee68dab22f36ea73f04b91933c1f/f2/df5dba58e6904d49b1574ce8bae69d2e, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-15 20:01:38,975 INFO [rs(jenkins-hbase4.apache.org,40517,1676491293664)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for c069ee68dab22f36ea73f04b91933c1f in 84ms, sequenceid=9, compaction requested=false 2023-02-15 20:01:38,975 DEBUG [rs(jenkins-hbase4.apache.org,40517,1676491293664)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for c069ee68dab22f36ea73f04b91933c1f: 2023-02-15 20:01:38,975 DEBUG [rs(jenkins-hbase4.apache.org,40517,1676491293664)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,m\xED\xED,1676491296789.c069ee68dab22f36ea73f04b91933c1f. 2023-02-15 20:01:38,975 DEBUG [member: 'jenkins-hbase4.apache.org,40517,1676491293664' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 5/5 local region flush tasks. 2023-02-15 20:01:38,975 DEBUG [member: 'jenkins-hbase4.apache.org,40517,1676491293664' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 5 local region flush tasks. 2023-02-15 20:01:38,975 DEBUG [member: 'jenkins-hbase4.apache.org,40517,1676491293664' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,40517,1676491293664 2023-02-15 20:01:38,975 DEBUG [member: 'jenkins-hbase4.apache.org,40517,1676491293664' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMockedMapReduceMultiRegion' locally acquired 2023-02-15 20:01:38,975 DEBUG [member: 'jenkins-hbase4.apache.org,40517,1676491293664' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40517,1676491293664' joining acquired barrier for procedure (testWithMockedMapReduceMultiRegion) in zk 2023-02-15 20:01:38,977 DEBUG [Listener at localhost/43553-EventThread] zookeeper.ZKWatcher(600): master:35467-0x1005992ed530000, quorum=127.0.0.1:49184, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,40517,1676491293664 2023-02-15 20:01:38,977 DEBUG [member: 'jenkins-hbase4.apache.org,40517,1676491293664' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-15 20:01:38,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,40517,1676491293664 2023-02-15 20:01:38,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-15 20:01:38,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-15 20:01:38,978 DEBUG [member: 'jenkins-hbase4.apache.org,40517,1676491293664' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40517-0x1005992ed530001, quorum=127.0.0.1:49184, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-15 20:01:38,978 DEBUG [member: 'jenkins-hbase4.apache.org,40517,1676491293664' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMockedMapReduceMultiRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-15 20:01:38,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-15 20:01:38,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-15 20:01:38,979 DEBUG [rs(jenkins-hbase4.apache.org,36625,1676491293696)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/data/default/testWithMockedMapReduceMultiRegion/007dd63b20f9d2149ba11df9b0cddc4c/.tmp/f1/d178029f0da34cc3a3f4cc28583f9032 as hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/data/default/testWithMockedMapReduceMultiRegion/007dd63b20f9d2149ba11df9b0cddc4c/f1/d178029f0da34cc3a3f4cc28583f9032 2023-02-15 20:01:38,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-15 20:01:38,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40517,1676491293664 2023-02-15 20:01:38,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-15 20:01:38,980 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40517,1676491293664' joining acquired barrier for procedure 'testWithMockedMapReduceMultiRegion' on coordinator 2023-02-15 20:01:38,980 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@673f35be[Count = 1] remaining members to acquire global barrier 2023-02-15 20:01:38,983 INFO [rs(jenkins-hbase4.apache.org,36625,1676491293696)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/data/default/testWithMockedMapReduceMultiRegion/007dd63b20f9d2149ba11df9b0cddc4c/f1/d178029f0da34cc3a3f4cc28583f9032, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-15 20:01:38,984 DEBUG [rs(jenkins-hbase4.apache.org,36625,1676491293696)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/data/default/testWithMockedMapReduceMultiRegion/007dd63b20f9d2149ba11df9b0cddc4c/.tmp/f2/5e5a7c1eb19242da9b6862d34233d0ee as hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/data/default/testWithMockedMapReduceMultiRegion/007dd63b20f9d2149ba11df9b0cddc4c/f2/5e5a7c1eb19242da9b6862d34233d0ee 2023-02-15 20:01:39,007 INFO [rs(jenkins-hbase4.apache.org,36625,1676491293696)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/data/default/testWithMockedMapReduceMultiRegion/007dd63b20f9d2149ba11df9b0cddc4c/f2/5e5a7c1eb19242da9b6862d34233d0ee, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-15 20:01:39,008 INFO [rs(jenkins-hbase4.apache.org,36625,1676491293696)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 007dd63b20f9d2149ba11df9b0cddc4c in 87ms, sequenceid=9, compaction requested=false 2023-02-15 20:01:39,008 DEBUG [rs(jenkins-hbase4.apache.org,36625,1676491293696)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 007dd63b20f9d2149ba11df9b0cddc4c: 2023-02-15 20:01:39,008 DEBUG [rs(jenkins-hbase4.apache.org,36625,1676491293696)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676491296789.007dd63b20f9d2149ba11df9b0cddc4c. 2023-02-15 20:01:39,008 DEBUG [member: 'jenkins-hbase4.apache.org,36625,1676491293696' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 5/5 local region flush tasks. 2023-02-15 20:01:39,008 DEBUG [member: 'jenkins-hbase4.apache.org,36625,1676491293696' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 5 local region flush tasks. 2023-02-15 20:01:39,008 DEBUG [member: 'jenkins-hbase4.apache.org,36625,1676491293696' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,36625,1676491293696 2023-02-15 20:01:39,008 DEBUG [member: 'jenkins-hbase4.apache.org,36625,1676491293696' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMockedMapReduceMultiRegion' locally acquired 2023-02-15 20:01:39,009 DEBUG [member: 'jenkins-hbase4.apache.org,36625,1676491293696' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36625,1676491293696' joining acquired barrier for procedure (testWithMockedMapReduceMultiRegion) in zk 2023-02-15 20:01:39,010 DEBUG [Listener at localhost/43553-EventThread] zookeeper.ZKWatcher(600): master:35467-0x1005992ed530000, quorum=127.0.0.1:49184, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,36625,1676491293696 2023-02-15 20:01:39,010 DEBUG [member: 'jenkins-hbase4.apache.org,36625,1676491293696' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-15 20:01:39,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,36625,1676491293696 2023-02-15 20:01:39,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-15 20:01:39,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-15 20:01:39,011 DEBUG [member: 'jenkins-hbase4.apache.org,36625,1676491293696' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36625-0x1005992ed530002, quorum=127.0.0.1:49184, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-15 20:01:39,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-15 20:01:39,011 DEBUG [member: 'jenkins-hbase4.apache.org,36625,1676491293696' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMockedMapReduceMultiRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-15 20:01:39,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-15 20:01:39,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-15 20:01:39,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40517,1676491293664 2023-02-15 20:01:39,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36625,1676491293696 2023-02-15 20:01:39,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-15 20:01:39,012 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36625,1676491293696' joining acquired barrier for procedure 'testWithMockedMapReduceMultiRegion' on coordinator 2023-02-15 20:01:39,012 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@673f35be[Count = 0] remaining members to acquire global barrier 2023-02-15 20:01:39,012 DEBUG [(jenkins-hbase4.apache.org,35467,1676491293605)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMockedMapReduceMultiRegion' starting 'in-barrier' execution. 2023-02-15 20:01:39,012 DEBUG [(jenkins-hbase4.apache.org,35467,1676491293605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-15 20:01:39,015 DEBUG [Listener at localhost/43553-EventThread] zookeeper.ZKWatcher(600): regionserver:36625-0x1005992ed530002, quorum=127.0.0.1:49184, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-15 20:01:39,015 DEBUG [Listener at localhost/43553-EventThread] zookeeper.ZKWatcher(600): regionserver:40517-0x1005992ed530001, quorum=127.0.0.1:49184, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-15 20:01:39,015 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-15 20:01:39,015 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-15 20:01:39,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-15 20:01:39,015 DEBUG [(jenkins-hbase4.apache.org,35467,1676491293605)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35467-0x1005992ed530000, quorum=127.0.0.1:49184, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,40517,1676491293664 2023-02-15 20:01:39,015 DEBUG [member: 'jenkins-hbase4.apache.org,36625,1676491293696' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMockedMapReduceMultiRegion' received 'reached' from coordinator. 2023-02-15 20:01:39,015 DEBUG [member: 'jenkins-hbase4.apache.org,36625,1676491293696' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMockedMapReduceMultiRegion' locally completed 2023-02-15 20:01:39,015 DEBUG [member: 'jenkins-hbase4.apache.org,36625,1676491293696' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMockedMapReduceMultiRegion' completed for member 'jenkins-hbase4.apache.org,36625,1676491293696' in zk 2023-02-15 20:01:39,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-15 20:01:39,015 DEBUG [member: 'jenkins-hbase4.apache.org,40517,1676491293664' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMockedMapReduceMultiRegion' received 'reached' from coordinator. 2023-02-15 20:01:39,015 DEBUG [member: 'jenkins-hbase4.apache.org,40517,1676491293664' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMockedMapReduceMultiRegion' locally completed 2023-02-15 20:01:39,015 DEBUG [member: 'jenkins-hbase4.apache.org,40517,1676491293664' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMockedMapReduceMultiRegion' completed for member 'jenkins-hbase4.apache.org,40517,1676491293664' in zk 2023-02-15 20:01:39,015 DEBUG [(jenkins-hbase4.apache.org,35467,1676491293605)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35467-0x1005992ed530000, quorum=127.0.0.1:49184, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,36625,1676491293696 2023-02-15 20:01:39,015 DEBUG [(jenkins-hbase4.apache.org,35467,1676491293605)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-15 20:01:39,017 DEBUG [member: 'jenkins-hbase4.apache.org,40517,1676491293664' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMockedMapReduceMultiRegion' has notified controller of completion 2023-02-15 20:01:39,017 DEBUG [member: 'jenkins-hbase4.apache.org,40517,1676491293664' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-15 20:01:39,017 DEBUG [Listener at localhost/43553-EventThread] zookeeper.ZKWatcher(600): master:35467-0x1005992ed530000, quorum=127.0.0.1:49184, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,40517,1676491293664 2023-02-15 20:01:39,017 DEBUG [member: 'jenkins-hbase4.apache.org,40517,1676491293664' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMockedMapReduceMultiRegion' completed. 2023-02-15 20:01:39,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,40517,1676491293664 2023-02-15 20:01:39,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-15 20:01:39,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-15 20:01:39,017 DEBUG [member: 'jenkins-hbase4.apache.org,36625,1676491293696' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMockedMapReduceMultiRegion' has notified controller of completion 2023-02-15 20:01:39,017 DEBUG [Listener at localhost/43553-EventThread] zookeeper.ZKWatcher(600): master:35467-0x1005992ed530000, quorum=127.0.0.1:49184, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,36625,1676491293696 2023-02-15 20:01:39,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-15 20:01:39,017 DEBUG [member: 'jenkins-hbase4.apache.org,36625,1676491293696' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-15 20:01:39,018 DEBUG [member: 'jenkins-hbase4.apache.org,36625,1676491293696' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMockedMapReduceMultiRegion' completed. 2023-02-15 20:01:39,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-15 20:01:39,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-15 20:01:39,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40517,1676491293664 2023-02-15 20:01:39,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36625,1676491293696 2023-02-15 20:01:39,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-15 20:01:39,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-15 20:01:39,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40517,1676491293664 2023-02-15 20:01:39,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36625,1676491293696 2023-02-15 20:01:39,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMockedMapReduceMultiRegion' member 'jenkins-hbase4.apache.org,40517,1676491293664': 2023-02-15 20:01:39,020 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40517,1676491293664' released barrier for procedure'testWithMockedMapReduceMultiRegion', counting down latch. Waiting for 1 more 2023-02-15 20:01:39,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,36625,1676491293696 2023-02-15 20:01:39,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-15 20:01:39,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-15 20:01:39,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-15 20:01:39,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-15 20:01:39,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-15 20:01:39,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40517,1676491293664 2023-02-15 20:01:39,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36625,1676491293696 2023-02-15 20:01:39,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-15 20:01:39,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-15 20:01:39,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40517,1676491293664 2023-02-15 20:01:39,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36625,1676491293696 2023-02-15 20:01:39,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMockedMapReduceMultiRegion' member 'jenkins-hbase4.apache.org,36625,1676491293696': 2023-02-15 20:01:39,023 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36625,1676491293696' released barrier for procedure'testWithMockedMapReduceMultiRegion', counting down latch. Waiting for 0 more 2023-02-15 20:01:39,023 INFO [(jenkins-hbase4.apache.org,35467,1676491293605)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMockedMapReduceMultiRegion' execution completed 2023-02-15 20:01:39,023 DEBUG [(jenkins-hbase4.apache.org,35467,1676491293605)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-15 20:01:39,023 DEBUG [(jenkins-hbase4.apache.org,35467,1676491293605)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-15 20:01:39,023 DEBUG [(jenkins-hbase4.apache.org,35467,1676491293605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMockedMapReduceMultiRegion 2023-02-15 20:01:39,023 INFO [(jenkins-hbase4.apache.org,35467,1676491293605)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMockedMapReduceMultiRegionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-15 20:01:39,025 DEBUG [Listener at localhost/43553-EventThread] zookeeper.ZKWatcher(600): master:35467-0x1005992ed530000, quorum=127.0.0.1:49184, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-15 20:01:39,025 DEBUG [Listener at localhost/43553-EventThread] zookeeper.ZKWatcher(600): regionserver:36625-0x1005992ed530002, quorum=127.0.0.1:49184, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-15 20:01:39,025 DEBUG [Listener at localhost/43553-EventThread] zookeeper.ZKWatcher(600): regionserver:40517-0x1005992ed530001, quorum=127.0.0.1:49184, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-15 20:01:39,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-15 20:01:39,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-15 20:01:39,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-15 20:01:39,025 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-15 20:01:39,025 DEBUG [Listener at localhost/43553-EventThread] zookeeper.ZKWatcher(600): regionserver:40517-0x1005992ed530001, quorum=127.0.0.1:49184, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-15 20:01:39,025 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-15 20:01:39,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-15 20:01:39,025 DEBUG [Listener at localhost/43553-EventThread] zookeeper.ZKWatcher(600): regionserver:36625-0x1005992ed530002, quorum=127.0.0.1:49184, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-15 20:01:39,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-15 20:01:39,025 DEBUG [(jenkins-hbase4.apache.org,35467,1676491293605)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35467-0x1005992ed530000, quorum=127.0.0.1:49184, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,40517,1676491293664 2023-02-15 20:01:39,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-15 20:01:39,026 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-15 20:01:39,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-15 20:01:39,026 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-15 20:01:39,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-15 20:01:39,026 DEBUG [(jenkins-hbase4.apache.org,35467,1676491293605)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35467-0x1005992ed530000, quorum=127.0.0.1:49184, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,36625,1676491293696 2023-02-15 20:01:39,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-15 20:01:39,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-15 20:01:39,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-15 20:01:39,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-15 20:01:39,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-15 20:01:39,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40517,1676491293664 2023-02-15 20:01:39,029 DEBUG [(jenkins-hbase4.apache.org,35467,1676491293605)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35467-0x1005992ed530000, quorum=127.0.0.1:49184, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,40517,1676491293664 2023-02-15 20:01:39,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36625,1676491293696 2023-02-15 20:01:39,030 DEBUG [(jenkins-hbase4.apache.org,35467,1676491293605)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35467-0x1005992ed530000, quorum=127.0.0.1:49184, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,36625,1676491293696 2023-02-15 20:01:39,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-15 20:01:39,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-15 20:01:39,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40517,1676491293664 2023-02-15 20:01:39,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36625,1676491293696 2023-02-15 20:01:39,033 DEBUG [Listener at localhost/43553-EventThread] zookeeper.ZKWatcher(600): master:35467-0x1005992ed530000, quorum=127.0.0.1:49184, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,36625,1676491293696 2023-02-15 20:01:39,033 DEBUG [Listener at localhost/43553-EventThread] zookeeper.ZKWatcher(600): regionserver:40517-0x1005992ed530001, quorum=127.0.0.1:49184, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-15 20:01:39,034 DEBUG [Listener at localhost/43553-EventThread] zookeeper.ZKWatcher(600): master:35467-0x1005992ed530000, quorum=127.0.0.1:49184, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion 2023-02-15 20:01:39,034 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-15 20:01:39,034 DEBUG [Listener at localhost/43553-EventThread] zookeeper.ZKWatcher(600): master:35467-0x1005992ed530000, quorum=127.0.0.1:49184, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,40517,1676491293664 2023-02-15 20:01:39,034 DEBUG [Listener at localhost/43553-EventThread] zookeeper.ZKWatcher(600): regionserver:36625-0x1005992ed530002, quorum=127.0.0.1:49184, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-15 20:01:39,034 DEBUG [Listener at localhost/43553-EventThread] zookeeper.ZKWatcher(600): regionserver:40517-0x1005992ed530001, quorum=127.0.0.1:49184, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-15 20:01:39,034 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35467] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testWithMockedMapReduceMultiRegion' 2023-02-15 20:01:39,034 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35467] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-15 20:01:39,034 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-15 20:01:39,034 DEBUG [(jenkins-hbase4.apache.org,35467,1676491293605)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-15 20:01:39,034 DEBUG [Listener at localhost/43553-EventThread] zookeeper.ZKWatcher(600): regionserver:36625-0x1005992ed530002, quorum=127.0.0.1:49184, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-15 20:01:39,034 DEBUG [Listener at localhost/43553-EventThread] zookeeper.ZKWatcher(600): master:35467-0x1005992ed530000, quorum=127.0.0.1:49184, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion 2023-02-15 20:01:39,034 DEBUG [Listener at localhost/43553-EventThread] zookeeper.ZKWatcher(600): master:35467-0x1005992ed530000, quorum=127.0.0.1:49184, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,36625,1676491293696 2023-02-15 20:01:39,034 DEBUG [Listener at localhost/43553-EventThread] zookeeper.ZKWatcher(600): master:35467-0x1005992ed530000, quorum=127.0.0.1:49184, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-15 20:01:39,034 DEBUG [Listener at localhost/43553-EventThread] zookeeper.ZKWatcher(600): master:35467-0x1005992ed530000, quorum=127.0.0.1:49184, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,40517,1676491293664 2023-02-15 20:01:39,034 DEBUG [Listener at localhost/43553-EventThread] zookeeper.ZKWatcher(600): master:35467-0x1005992ed530000, quorum=127.0.0.1:49184, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-15 20:01:39,034 DEBUG [Listener at localhost/43553-EventThread] zookeeper.ZKWatcher(600): master:35467-0x1005992ed530000, quorum=127.0.0.1:49184, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-15 20:01:39,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-15 20:01:39,034 DEBUG [Listener at localhost/43553] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testWithMockedMapReduceMultiRegion'' to complete. (max 20000 ms per retry) 2023-02-15 20:01:39,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-15 20:01:39,034 DEBUG [Listener at localhost/43553] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-15 20:01:39,035 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-15 20:01:39,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-15 20:01:39,035 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-15 20:01:39,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-15 20:01:39,135 DEBUG [Listener at localhost/43553] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-15 20:01:39,136 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35467] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-15 20:01:39,141 INFO [Listener at localhost/43553] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "testWithMockedMapReduceMultiRegion" table: "testWithMockedMapReduceMultiRegion" creation_time: 1676491297525 type: FLUSH version: 2 ttl: 0 2023-02-15 20:01:39,141 DEBUG [Listener at localhost/43553] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost:43597/user/jenkins/test-data/af11d76e-1f10-9ba9-86e0-eb3a3c9ec018/testWithMockedMapReduceMultiRegion/48fff4b9-a31b-4144-b837-fcce4c781b1a/data/default/testWithMockedMapReduceMultiRegion 2023-02-15 20:01:39,142 INFO [Listener at localhost/43553] snapshot.RestoreSnapshotHelper(239): region to add: 81644ccf4d63c864b007cbc1043831d7 2023-02-15 20:01:39,142 INFO [Listener at localhost/43553] snapshot.RestoreSnapshotHelper(239): region to add: 5e40ee2d96ae1cbe88d7c194cd72dda2 2023-02-15 20:01:39,142 INFO [Listener at localhost/43553] snapshot.RestoreSnapshotHelper(239): region to add: 6f4ab26e6b0d69c90f3b3b848034eb88 2023-02-15 20:01:39,142 INFO [Listener at localhost/43553] snapshot.RestoreSnapshotHelper(239): region to add: 85c1d4ec199a8eac4595716bde5173ab 2023-02-15 20:01:39,142 INFO [Listener at localhost/43553] snapshot.RestoreSnapshotHelper(239): region to add: 8a79eee6aefc962407df2ed05672c891 2023-02-15 20:01:39,142 INFO [Listener at localhost/43553] snapshot.RestoreSnapshotHelper(239): region to add: 5a8c9c21a9831b445d533dd705940e06 2023-02-15 20:01:39,142 INFO [Listener at localhost/43553] snapshot.RestoreSnapshotHelper(239): region to add: 4229d692a52fca982c3f6193911c155d 2023-02-15 20:01:39,142 INFO [Listener at localhost/43553] snapshot.RestoreSnapshotHelper(239): region to add: fe51e97cb822f497ca56994d85f7310f 2023-02-15 20:01:39,142 INFO [Listener at localhost/43553] snapshot.RestoreSnapshotHelper(239): region to add: 007dd63b20f9d2149ba11df9b0cddc4c 2023-02-15 20:01:39,142 INFO [Listener at localhost/43553] snapshot.RestoreSnapshotHelper(239): region to add: c069ee68dab22f36ea73f04b91933c1f 2023-02-15 20:01:39,142 INFO [Listener at localhost/43553] snapshot.RestoreSnapshotHelper(585): clone region=81644ccf4d63c864b007cbc1043831d7 as 81644ccf4d63c864b007cbc1043831d7 in snapshot testWithMockedMapReduceMultiRegion 2023-02-15 20:01:39,142 INFO [Listener at localhost/43553] snapshot.RestoreSnapshotHelper(585): clone region=5e40ee2d96ae1cbe88d7c194cd72dda2 as 5e40ee2d96ae1cbe88d7c194cd72dda2 in snapshot testWithMockedMapReduceMultiRegion 2023-02-15 20:01:39,142 INFO [Listener at localhost/43553] snapshot.RestoreSnapshotHelper(585): clone region=6f4ab26e6b0d69c90f3b3b848034eb88 as 6f4ab26e6b0d69c90f3b3b848034eb88 in snapshot testWithMockedMapReduceMultiRegion 2023-02-15 20:01:39,142 INFO [Listener at localhost/43553] snapshot.RestoreSnapshotHelper(585): clone region=85c1d4ec199a8eac4595716bde5173ab as 85c1d4ec199a8eac4595716bde5173ab in snapshot testWithMockedMapReduceMultiRegion 2023-02-15 20:01:39,142 INFO [Listener at localhost/43553] snapshot.RestoreSnapshotHelper(585): clone region=8a79eee6aefc962407df2ed05672c891 as 8a79eee6aefc962407df2ed05672c891 in snapshot testWithMockedMapReduceMultiRegion 2023-02-15 20:01:39,142 INFO [Listener at localhost/43553] snapshot.RestoreSnapshotHelper(585): clone region=5a8c9c21a9831b445d533dd705940e06 as 5a8c9c21a9831b445d533dd705940e06 in snapshot testWithMockedMapReduceMultiRegion 2023-02-15 20:01:39,143 INFO [Listener at localhost/43553] snapshot.RestoreSnapshotHelper(585): clone region=4229d692a52fca982c3f6193911c155d as 4229d692a52fca982c3f6193911c155d in snapshot testWithMockedMapReduceMultiRegion 2023-02-15 20:01:39,143 INFO [Listener at localhost/43553] snapshot.RestoreSnapshotHelper(585): clone region=fe51e97cb822f497ca56994d85f7310f as fe51e97cb822f497ca56994d85f7310f in snapshot testWithMockedMapReduceMultiRegion 2023-02-15 20:01:39,143 INFO [Listener at localhost/43553] snapshot.RestoreSnapshotHelper(585): clone region=007dd63b20f9d2149ba11df9b0cddc4c as 007dd63b20f9d2149ba11df9b0cddc4c in snapshot testWithMockedMapReduceMultiRegion 2023-02-15 20:01:39,143 INFO [Listener at localhost/43553] snapshot.RestoreSnapshotHelper(585): clone region=c069ee68dab22f36ea73f04b91933c1f as c069ee68dab22f36ea73f04b91933c1f in snapshot testWithMockedMapReduceMultiRegion 2023-02-15 20:01:39,144 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(7671): creating {ENCODED => 6f4ab26e6b0d69c90f3b3b848034eb88, NAME => 'testWithMockedMapReduceMultiRegion,aaa,1676491296789.6f4ab26e6b0d69c90f3b3b848034eb88.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43597/user/jenkins/test-data/af11d76e-1f10-9ba9-86e0-eb3a3c9ec018/testWithMockedMapReduceMultiRegion/48fff4b9-a31b-4144-b837-fcce4c781b1a 2023-02-15 20:01:39,144 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(7671): creating {ENCODED => 81644ccf4d63c864b007cbc1043831d7, NAME => 'testWithMockedMapReduceMultiRegion,q\x11\x10,1676491296789.81644ccf4d63c864b007cbc1043831d7.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43597/user/jenkins/test-data/af11d76e-1f10-9ba9-86e0-eb3a3c9ec018/testWithMockedMapReduceMultiRegion/48fff4b9-a31b-4144-b837-fcce4c781b1a 2023-02-15 20:01:39,144 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(7671): creating {ENCODED => 5e40ee2d96ae1cbe88d7c194cd72dda2, NAME => 'testWithMockedMapReduceMultiRegion,,1676491296789.5e40ee2d96ae1cbe88d7c194cd72dda2.', STARTKEY => '', ENDKEY => 'aaa'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43597/user/jenkins/test-data/af11d76e-1f10-9ba9-86e0-eb3a3c9ec018/testWithMockedMapReduceMultiRegion/48fff4b9-a31b-4144-b837-fcce4c781b1a 2023-02-15 20:01:39,145 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(7671): creating {ENCODED => 85c1d4ec199a8eac4595716bde5173ab, NAME => 'testWithMockedMapReduceMultiRegion,d\x84\x84,1676491296789.85c1d4ec199a8eac4595716bde5173ab.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43597/user/jenkins/test-data/af11d76e-1f10-9ba9-86e0-eb3a3c9ec018/testWithMockedMapReduceMultiRegion/48fff4b9-a31b-4144-b837-fcce4c781b1a 2023-02-15 20:01:39,145 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(7671): creating {ENCODED => 8a79eee6aefc962407df2ed05672c891, NAME => 'testWithMockedMapReduceMultiRegion,wWV,1676491296789.8a79eee6aefc962407df2ed05672c891.', STARTKEY => 'wWV', ENDKEY => 'zz{'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43597/user/jenkins/test-data/af11d76e-1f10-9ba9-86e0-eb3a3c9ec018/testWithMockedMapReduceMultiRegion/48fff4b9-a31b-4144-b837-fcce4c781b1a 2023-02-15 20:01:39,148 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(7671): creating {ENCODED => 5a8c9c21a9831b445d533dd705940e06, NAME => 'testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676491296789.5a8c9c21a9831b445d533dd705940e06.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43597/user/jenkins/test-data/af11d76e-1f10-9ba9-86e0-eb3a3c9ec018/testWithMockedMapReduceMultiRegion/48fff4b9-a31b-4144-b837-fcce4c781b1a 2023-02-15 20:01:39,148 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(7671): creating {ENCODED => 4229d692a52fca982c3f6193911c155d, NAME => 'testWithMockedMapReduceMultiRegion,zz{,1676491296789.4229d692a52fca982c3f6193911c155d.', STARTKEY => 'zz{', ENDKEY => ''}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43597/user/jenkins/test-data/af11d76e-1f10-9ba9-86e0-eb3a3c9ec018/testWithMockedMapReduceMultiRegion/48fff4b9-a31b-4144-b837-fcce4c781b1a 2023-02-15 20:01:39,149 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(7671): creating {ENCODED => fe51e97cb822f497ca56994d85f7310f, NAME => 'testWithMockedMapReduceMultiRegion,t43,1676491296789.fe51e97cb822f497ca56994d85f7310f.', STARTKEY => 't43', ENDKEY => 'wWV'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43597/user/jenkins/test-data/af11d76e-1f10-9ba9-86e0-eb3a3c9ec018/testWithMockedMapReduceMultiRegion/48fff4b9-a31b-4144-b837-fcce4c781b1a 2023-02-15 20:01:39,179 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,aaa,1676491296789.6f4ab26e6b0d69c90f3b3b848034eb88.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 20:01:39,179 INFO [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 3f7b594ca3bd4926a8a99a9121c8d412 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-15 20:01:39,189 INFO [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 0109ebdc9a594bde949d22a23c8a64cb from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-15 20:01:39,192 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1603): Closing 6f4ab26e6b0d69c90f3b3b848034eb88, disabling compactions & flushes 2023-02-15 20:01:39,193 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,aaa,1676491296789.6f4ab26e6b0d69c90f3b3b848034eb88. 2023-02-15 20:01:39,192 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,wWV,1676491296789.8a79eee6aefc962407df2ed05672c891.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 20:01:39,193 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,d\x84\x84,1676491296789.85c1d4ec199a8eac4595716bde5173ab.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 20:01:39,193 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,aaa,1676491296789.6f4ab26e6b0d69c90f3b3b848034eb88. 2023-02-15 20:01:39,193 INFO [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 962aca7e712640d4b681c9c3a5fba101 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-15 20:01:39,193 INFO [RestoreSnapshot-pool-4] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 5faa164e7bce4249bbe09f7924d8ab21 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-15 20:01:39,193 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,aaa,1676491296789.6f4ab26e6b0d69c90f3b3b848034eb88. after waiting 0 ms 2023-02-15 20:01:39,193 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,aaa,1676491296789.6f4ab26e6b0d69c90f3b3b848034eb88. 2023-02-15 20:01:39,193 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,aaa,1676491296789.6f4ab26e6b0d69c90f3b3b848034eb88. 2023-02-15 20:01:39,193 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1557): Region close journal for 6f4ab26e6b0d69c90f3b3b848034eb88: 2023-02-15 20:01:39,194 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(7671): creating {ENCODED => 007dd63b20f9d2149ba11df9b0cddc4c, NAME => 'testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676491296789.007dd63b20f9d2149ba11df9b0cddc4c.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43597/user/jenkins/test-data/af11d76e-1f10-9ba9-86e0-eb3a3c9ec018/testWithMockedMapReduceMultiRegion/48fff4b9-a31b-4144-b837-fcce4c781b1a 2023-02-15 20:01:39,197 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676491296789.5a8c9c21a9831b445d533dd705940e06.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 20:01:39,197 INFO [RestoreSnapshot-pool-5] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 9234478382f54f4bb536e887f01e40aa from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-15 20:01:39,198 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,,1676491296789.5e40ee2d96ae1cbe88d7c194cd72dda2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 20:01:39,198 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1603): Closing 5e40ee2d96ae1cbe88d7c194cd72dda2, disabling compactions & flushes 2023-02-15 20:01:39,198 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,,1676491296789.5e40ee2d96ae1cbe88d7c194cd72dda2. 2023-02-15 20:01:39,198 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,,1676491296789.5e40ee2d96ae1cbe88d7c194cd72dda2. 2023-02-15 20:01:39,198 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,,1676491296789.5e40ee2d96ae1cbe88d7c194cd72dda2. after waiting 0 ms 2023-02-15 20:01:39,198 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,,1676491296789.5e40ee2d96ae1cbe88d7c194cd72dda2. 2023-02-15 20:01:39,198 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,,1676491296789.5e40ee2d96ae1cbe88d7c194cd72dda2. 2023-02-15 20:01:39,198 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1557): Region close journal for 5e40ee2d96ae1cbe88d7c194cd72dda2: 2023-02-15 20:01:39,199 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(7671): creating {ENCODED => c069ee68dab22f36ea73f04b91933c1f, NAME => 'testWithMockedMapReduceMultiRegion,m\xED\xED,1676491296789.c069ee68dab22f36ea73f04b91933c1f.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43597/user/jenkins/test-data/af11d76e-1f10-9ba9-86e0-eb3a3c9ec018/testWithMockedMapReduceMultiRegion/48fff4b9-a31b-4144-b837-fcce4c781b1a 2023-02-15 20:01:39,208 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,t43,1676491296789.fe51e97cb822f497ca56994d85f7310f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 20:01:39,208 INFO [RestoreSnapshot-pool-7] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 0da61d44a36946a49779016090ef9445 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-15 20:01:39,208 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,q\x11\x10,1676491296789.81644ccf4d63c864b007cbc1043831d7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 20:01:39,208 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 2771400ae1e3406092833cb8cde650c5 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-15 20:01:39,209 INFO [RestoreSnapshot-pool-4] snapshot.RestoreSnapshotHelper(628): Adding HFileLink c2016df0893c44b3a6b0164ad4a4d968 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-15 20:01:39,210 INFO [RestoreSnapshot-pool-5] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 12f96a77e5ac4e01a5e7db780638b575 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-15 20:01:39,210 INFO [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(628): Adding HFileLink e929536a3a6a46789ae2ba83a0ba01f2 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-15 20:01:39,210 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,zz{,1676491296789.4229d692a52fca982c3f6193911c155d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 20:01:39,211 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1603): Closing 4229d692a52fca982c3f6193911c155d, disabling compactions & flushes 2023-02-15 20:01:39,211 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,zz{,1676491296789.4229d692a52fca982c3f6193911c155d. 2023-02-15 20:01:39,211 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,zz{,1676491296789.4229d692a52fca982c3f6193911c155d. 2023-02-15 20:01:39,211 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,zz{,1676491296789.4229d692a52fca982c3f6193911c155d. after waiting 0 ms 2023-02-15 20:01:39,211 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,zz{,1676491296789.4229d692a52fca982c3f6193911c155d. 2023-02-15 20:01:39,211 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,zz{,1676491296789.4229d692a52fca982c3f6193911c155d. 2023-02-15 20:01:39,211 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1557): Region close journal for 4229d692a52fca982c3f6193911c155d: 2023-02-15 20:01:39,220 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1603): Closing 8a79eee6aefc962407df2ed05672c891, disabling compactions & flushes 2023-02-15 20:01:39,220 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,wWV,1676491296789.8a79eee6aefc962407df2ed05672c891. 2023-02-15 20:01:39,220 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,wWV,1676491296789.8a79eee6aefc962407df2ed05672c891. 2023-02-15 20:01:39,220 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,wWV,1676491296789.8a79eee6aefc962407df2ed05672c891. after waiting 0 ms 2023-02-15 20:01:39,220 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676491296789.007dd63b20f9d2149ba11df9b0cddc4c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 20:01:39,220 INFO [RestoreSnapshot-pool-7] snapshot.RestoreSnapshotHelper(628): Adding HFileLink f3c0d03963c14c6198531acdd3e68d60 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-15 20:01:39,220 INFO [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(628): Adding HFileLink aa1115a9d4064ac3aa45dca955ad1677 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-15 20:01:39,220 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,wWV,1676491296789.8a79eee6aefc962407df2ed05672c891. 2023-02-15 20:01:39,220 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1603): Closing 85c1d4ec199a8eac4595716bde5173ab, disabling compactions & flushes 2023-02-15 20:01:39,220 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 2f1f47a490914b27b07597aeb3ec00b8 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-15 20:01:39,221 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,d\x84\x84,1676491296789.85c1d4ec199a8eac4595716bde5173ab. 2023-02-15 20:01:39,221 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,wWV,1676491296789.8a79eee6aefc962407df2ed05672c891. 2023-02-15 20:01:39,221 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1603): Closing 5a8c9c21a9831b445d533dd705940e06, disabling compactions & flushes 2023-02-15 20:01:39,221 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676491296789.5a8c9c21a9831b445d533dd705940e06. 2023-02-15 20:01:39,221 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676491296789.5a8c9c21a9831b445d533dd705940e06. 2023-02-15 20:01:39,221 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676491296789.5a8c9c21a9831b445d533dd705940e06. after waiting 0 ms 2023-02-15 20:01:39,221 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676491296789.5a8c9c21a9831b445d533dd705940e06. 2023-02-15 20:01:39,221 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676491296789.5a8c9c21a9831b445d533dd705940e06. 2023-02-15 20:01:39,221 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1557): Region close journal for 5a8c9c21a9831b445d533dd705940e06: 2023-02-15 20:01:39,221 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,d\x84\x84,1676491296789.85c1d4ec199a8eac4595716bde5173ab. 2023-02-15 20:01:39,221 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1557): Region close journal for 8a79eee6aefc962407df2ed05672c891: 2023-02-15 20:01:39,221 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,d\x84\x84,1676491296789.85c1d4ec199a8eac4595716bde5173ab. after waiting 0 ms 2023-02-15 20:01:39,221 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,d\x84\x84,1676491296789.85c1d4ec199a8eac4595716bde5173ab. 2023-02-15 20:01:39,221 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,d\x84\x84,1676491296789.85c1d4ec199a8eac4595716bde5173ab. 2023-02-15 20:01:39,221 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1557): Region close journal for 85c1d4ec199a8eac4595716bde5173ab: 2023-02-15 20:01:39,226 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,m\xED\xED,1676491296789.c069ee68dab22f36ea73f04b91933c1f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 20:01:39,226 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1603): Closing fe51e97cb822f497ca56994d85f7310f, disabling compactions & flushes 2023-02-15 20:01:39,226 INFO [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(628): Adding HFileLink fed3c1f0213342888f3271582470bf94 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-15 20:01:39,226 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,t43,1676491296789.fe51e97cb822f497ca56994d85f7310f. 2023-02-15 20:01:39,226 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,t43,1676491296789.fe51e97cb822f497ca56994d85f7310f. 2023-02-15 20:01:39,226 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,t43,1676491296789.fe51e97cb822f497ca56994d85f7310f. after waiting 0 ms 2023-02-15 20:01:39,226 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,t43,1676491296789.fe51e97cb822f497ca56994d85f7310f. 2023-02-15 20:01:39,226 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,t43,1676491296789.fe51e97cb822f497ca56994d85f7310f. 2023-02-15 20:01:39,226 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1557): Region close journal for fe51e97cb822f497ca56994d85f7310f: 2023-02-15 20:01:39,227 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1603): Closing 81644ccf4d63c864b007cbc1043831d7, disabling compactions & flushes 2023-02-15 20:01:39,227 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,q\x11\x10,1676491296789.81644ccf4d63c864b007cbc1043831d7. 2023-02-15 20:01:39,227 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,q\x11\x10,1676491296789.81644ccf4d63c864b007cbc1043831d7. 2023-02-15 20:01:39,227 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,q\x11\x10,1676491296789.81644ccf4d63c864b007cbc1043831d7. after waiting 0 ms 2023-02-15 20:01:39,227 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,q\x11\x10,1676491296789.81644ccf4d63c864b007cbc1043831d7. 2023-02-15 20:01:39,227 INFO [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 7c62395ed7814233afd59bd1a605f28b from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-15 20:01:39,227 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,q\x11\x10,1676491296789.81644ccf4d63c864b007cbc1043831d7. 2023-02-15 20:01:39,227 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1557): Region close journal for 81644ccf4d63c864b007cbc1043831d7: 2023-02-15 20:01:39,228 INFO [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 9bdc52e7055042b9a096d19df5046458 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-15 20:01:39,229 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1603): Closing 007dd63b20f9d2149ba11df9b0cddc4c, disabling compactions & flushes 2023-02-15 20:01:39,229 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676491296789.007dd63b20f9d2149ba11df9b0cddc4c. 2023-02-15 20:01:39,229 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676491296789.007dd63b20f9d2149ba11df9b0cddc4c. 2023-02-15 20:01:39,229 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676491296789.007dd63b20f9d2149ba11df9b0cddc4c. after waiting 0 ms 2023-02-15 20:01:39,229 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676491296789.007dd63b20f9d2149ba11df9b0cddc4c. 2023-02-15 20:01:39,229 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676491296789.007dd63b20f9d2149ba11df9b0cddc4c. 2023-02-15 20:01:39,229 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1557): Region close journal for 007dd63b20f9d2149ba11df9b0cddc4c: 2023-02-15 20:01:39,230 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1603): Closing c069ee68dab22f36ea73f04b91933c1f, disabling compactions & flushes 2023-02-15 20:01:39,230 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,m\xED\xED,1676491296789.c069ee68dab22f36ea73f04b91933c1f. 2023-02-15 20:01:39,230 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,m\xED\xED,1676491296789.c069ee68dab22f36ea73f04b91933c1f. 2023-02-15 20:01:39,230 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,m\xED\xED,1676491296789.c069ee68dab22f36ea73f04b91933c1f. after waiting 0 ms 2023-02-15 20:01:39,230 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,m\xED\xED,1676491296789.c069ee68dab22f36ea73f04b91933c1f. 2023-02-15 20:01:39,230 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,m\xED\xED,1676491296789.c069ee68dab22f36ea73f04b91933c1f. 2023-02-15 20:01:39,230 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1557): Region close journal for c069ee68dab22f36ea73f04b91933c1f: 2023-02-15 20:01:39,230 INFO [Listener at localhost/43553] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "testWithMockedMapReduceMultiRegion" table: "testWithMockedMapReduceMultiRegion" creation_time: 1676491297525 type: FLUSH version: 2 ttl: 0 2023-02-15 20:01:39,231 DEBUG [Listener at localhost/43553] snapshot.RestoreSnapshotHelper(832): Restored table dir:hdfs://localhost:43597/user/jenkins/test-data/af11d76e-1f10-9ba9-86e0-eb3a3c9ec018/testWithMockedMapReduceMultiRegion/48fff4b9-a31b-4144-b837-fcce4c781b1a 2023-02-15 20:01:39,231 DEBUG [Listener at localhost/43553] util.CommonFSUtils(682): File system contents for path hdfs://localhost:43597/user/jenkins/test-data/af11d76e-1f10-9ba9-86e0-eb3a3c9ec018/testWithMockedMapReduceMultiRegion/48fff4b9-a31b-4144-b837-fcce4c781b1a 2023-02-15 20:01:39,231 DEBUG [Listener at localhost/43553] util.CommonFSUtils(699): |-data/ 2023-02-15 20:01:39,231 DEBUG [Listener at localhost/43553] util.CommonFSUtils(699): |----default/ 2023-02-15 20:01:39,232 DEBUG [Listener at localhost/43553] util.CommonFSUtils(699): |-------testWithMockedMapReduceMultiRegion/ 2023-02-15 20:01:39,232 DEBUG [Listener at localhost/43553] util.CommonFSUtils(699): |----------007dd63b20f9d2149ba11df9b0cddc4c/ 2023-02-15 20:01:39,232 DEBUG [Listener at localhost/43553] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-15 20:01:39,233 DEBUG [Listener at localhost/43553] util.CommonFSUtils(699): |-------------f1/ 2023-02-15 20:01:39,233 DEBUG [Listener at localhost/43553] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=007dd63b20f9d2149ba11df9b0cddc4c-aa1115a9d4064ac3aa45dca955ad1677 2023-02-15 20:01:39,233 DEBUG [Listener at localhost/43553] util.CommonFSUtils(699): |-------------f2/ 2023-02-15 20:01:39,233 DEBUG [Listener at localhost/43553] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=007dd63b20f9d2149ba11df9b0cddc4c-7c62395ed7814233afd59bd1a605f28b 2023-02-15 20:01:39,233 DEBUG [Listener at localhost/43553] util.CommonFSUtils(699): |----------4229d692a52fca982c3f6193911c155d/ 2023-02-15 20:01:39,234 DEBUG [Listener at localhost/43553] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-15 20:01:39,234 DEBUG [Listener at localhost/43553] util.CommonFSUtils(699): |----------5a8c9c21a9831b445d533dd705940e06/ 2023-02-15 20:01:39,234 DEBUG [Listener at localhost/43553] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-15 20:01:39,234 DEBUG [Listener at localhost/43553] util.CommonFSUtils(699): |-------------f1/ 2023-02-15 20:01:39,234 DEBUG [Listener at localhost/43553] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=5a8c9c21a9831b445d533dd705940e06-9234478382f54f4bb536e887f01e40aa 2023-02-15 20:01:39,234 DEBUG [Listener at localhost/43553] util.CommonFSUtils(699): |-------------f2/ 2023-02-15 20:01:39,235 DEBUG [Listener at localhost/43553] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=5a8c9c21a9831b445d533dd705940e06-12f96a77e5ac4e01a5e7db780638b575 2023-02-15 20:01:39,235 DEBUG [Listener at localhost/43553] util.CommonFSUtils(699): |----------5e40ee2d96ae1cbe88d7c194cd72dda2/ 2023-02-15 20:01:39,235 DEBUG [Listener at localhost/43553] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-15 20:01:39,235 DEBUG [Listener at localhost/43553] util.CommonFSUtils(699): |----------6f4ab26e6b0d69c90f3b3b848034eb88/ 2023-02-15 20:01:39,235 DEBUG [Listener at localhost/43553] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-15 20:01:39,235 DEBUG [Listener at localhost/43553] util.CommonFSUtils(699): |-------------f1/ 2023-02-15 20:01:39,236 DEBUG [Listener at localhost/43553] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=6f4ab26e6b0d69c90f3b3b848034eb88-3f7b594ca3bd4926a8a99a9121c8d412 2023-02-15 20:01:39,236 DEBUG [Listener at localhost/43553] util.CommonFSUtils(699): |-------------f2/ 2023-02-15 20:01:39,236 DEBUG [Listener at localhost/43553] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=6f4ab26e6b0d69c90f3b3b848034eb88-0109ebdc9a594bde949d22a23c8a64cb 2023-02-15 20:01:39,236 DEBUG [Listener at localhost/43553] util.CommonFSUtils(699): |----------81644ccf4d63c864b007cbc1043831d7/ 2023-02-15 20:01:39,236 DEBUG [Listener at localhost/43553] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-15 20:01:39,236 DEBUG [Listener at localhost/43553] util.CommonFSUtils(699): |-------------f1/ 2023-02-15 20:01:39,237 DEBUG [Listener at localhost/43553] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=81644ccf4d63c864b007cbc1043831d7-2771400ae1e3406092833cb8cde650c5 2023-02-15 20:01:39,237 DEBUG [Listener at localhost/43553] util.CommonFSUtils(699): |-------------f2/ 2023-02-15 20:01:39,237 DEBUG [Listener at localhost/43553] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=81644ccf4d63c864b007cbc1043831d7-2f1f47a490914b27b07597aeb3ec00b8 2023-02-15 20:01:39,237 DEBUG [Listener at localhost/43553] util.CommonFSUtils(699): |----------85c1d4ec199a8eac4595716bde5173ab/ 2023-02-15 20:01:39,237 DEBUG [Listener at localhost/43553] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-15 20:01:39,237 DEBUG [Listener at localhost/43553] util.CommonFSUtils(699): |-------------f1/ 2023-02-15 20:01:39,238 DEBUG [Listener at localhost/43553] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=85c1d4ec199a8eac4595716bde5173ab-962aca7e712640d4b681c9c3a5fba101 2023-02-15 20:01:39,238 DEBUG [Listener at localhost/43553] util.CommonFSUtils(699): |-------------f2/ 2023-02-15 20:01:39,238 DEBUG [Listener at localhost/43553] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=85c1d4ec199a8eac4595716bde5173ab-e929536a3a6a46789ae2ba83a0ba01f2 2023-02-15 20:01:39,238 DEBUG [Listener at localhost/43553] util.CommonFSUtils(699): |----------8a79eee6aefc962407df2ed05672c891/ 2023-02-15 20:01:39,238 DEBUG [Listener at localhost/43553] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-15 20:01:39,238 DEBUG [Listener at localhost/43553] util.CommonFSUtils(699): |-------------f1/ 2023-02-15 20:01:39,239 DEBUG [Listener at localhost/43553] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=8a79eee6aefc962407df2ed05672c891-5faa164e7bce4249bbe09f7924d8ab21 2023-02-15 20:01:39,239 DEBUG [Listener at localhost/43553] util.CommonFSUtils(699): |-------------f2/ 2023-02-15 20:01:39,239 DEBUG [Listener at localhost/43553] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=8a79eee6aefc962407df2ed05672c891-c2016df0893c44b3a6b0164ad4a4d968 2023-02-15 20:01:39,239 DEBUG [Listener at localhost/43553] util.CommonFSUtils(699): |----------c069ee68dab22f36ea73f04b91933c1f/ 2023-02-15 20:01:39,239 DEBUG [Listener at localhost/43553] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-15 20:01:39,239 DEBUG [Listener at localhost/43553] util.CommonFSUtils(699): |-------------f1/ 2023-02-15 20:01:39,240 DEBUG [Listener at localhost/43553] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=c069ee68dab22f36ea73f04b91933c1f-fed3c1f0213342888f3271582470bf94 2023-02-15 20:01:39,240 DEBUG [Listener at localhost/43553] util.CommonFSUtils(699): |-------------f2/ 2023-02-15 20:01:39,240 DEBUG [Listener at localhost/43553] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=c069ee68dab22f36ea73f04b91933c1f-9bdc52e7055042b9a096d19df5046458 2023-02-15 20:01:39,240 DEBUG [Listener at localhost/43553] util.CommonFSUtils(699): |----------fe51e97cb822f497ca56994d85f7310f/ 2023-02-15 20:01:39,240 DEBUG [Listener at localhost/43553] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-15 20:01:39,240 DEBUG [Listener at localhost/43553] util.CommonFSUtils(699): |-------------f1/ 2023-02-15 20:01:39,241 DEBUG [Listener at localhost/43553] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=fe51e97cb822f497ca56994d85f7310f-0da61d44a36946a49779016090ef9445 2023-02-15 20:01:39,241 DEBUG [Listener at localhost/43553] util.CommonFSUtils(699): |-------------f2/ 2023-02-15 20:01:39,241 DEBUG [Listener at localhost/43553] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=fe51e97cb822f497ca56994d85f7310f-f3c0d03963c14c6198531acdd3e68d60 2023-02-15 20:01:39,244 INFO [Listener at localhost/43553] mapreduce.TableSnapshotInputFormatImpl(392): Provided Scan has DEFAULT ReadType, updating STREAM for Snapshot-based InputFormat 2023-02-15 20:01:39,913 DEBUG [Listener at localhost/43553] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676491296789.007dd63b20f9d2149ba11df9b0cddc4c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 20:01:39,913 INFO [Listener at localhost/43553] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-15 20:01:39,915 DEBUG [Listener at localhost/43553] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-15 20:01:39,917 INFO [StoreOpener-007dd63b20f9d2149ba11df9b0cddc4c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 007dd63b20f9d2149ba11df9b0cddc4c 2023-02-15 20:01:39,918 DEBUG [StoreOpener-007dd63b20f9d2149ba11df9b0cddc4c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43597/user/jenkins/test-data/af11d76e-1f10-9ba9-86e0-eb3a3c9ec018/testWithMockedMapReduceMultiRegion/48fff4b9-a31b-4144-b837-fcce4c781b1a/data/default/testWithMockedMapReduceMultiRegion/007dd63b20f9d2149ba11df9b0cddc4c/f1 2023-02-15 20:01:39,918 INFO [StoreOpener-007dd63b20f9d2149ba11df9b0cddc4c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 007dd63b20f9d2149ba11df9b0cddc4c columnFamilyName f1 2023-02-15 20:01:39,923 DEBUG [StoreOpener-007dd63b20f9d2149ba11df9b0cddc4c-1] regionserver.HStore(539): loaded hdfs://localhost:43597/user/jenkins/test-data/af11d76e-1f10-9ba9-86e0-eb3a3c9ec018/testWithMockedMapReduceMultiRegion/48fff4b9-a31b-4144-b837-fcce4c781b1a/data/default/testWithMockedMapReduceMultiRegion/007dd63b20f9d2149ba11df9b0cddc4c/f1/testWithMockedMapReduceMultiRegion=007dd63b20f9d2149ba11df9b0cddc4c-aa1115a9d4064ac3aa45dca955ad1677 2023-02-15 20:01:39,923 INFO [StoreOpener-007dd63b20f9d2149ba11df9b0cddc4c-1] regionserver.HStore(310): Store=007dd63b20f9d2149ba11df9b0cddc4c/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 20:01:39,923 INFO [StoreOpener-007dd63b20f9d2149ba11df9b0cddc4c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 007dd63b20f9d2149ba11df9b0cddc4c 2023-02-15 20:01:39,924 DEBUG [StoreOpener-007dd63b20f9d2149ba11df9b0cddc4c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43597/user/jenkins/test-data/af11d76e-1f10-9ba9-86e0-eb3a3c9ec018/testWithMockedMapReduceMultiRegion/48fff4b9-a31b-4144-b837-fcce4c781b1a/data/default/testWithMockedMapReduceMultiRegion/007dd63b20f9d2149ba11df9b0cddc4c/f2 2023-02-15 20:01:39,924 INFO [StoreOpener-007dd63b20f9d2149ba11df9b0cddc4c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 007dd63b20f9d2149ba11df9b0cddc4c columnFamilyName f2 2023-02-15 20:01:39,931 DEBUG [StoreOpener-007dd63b20f9d2149ba11df9b0cddc4c-1] regionserver.HStore(539): loaded hdfs://localhost:43597/user/jenkins/test-data/af11d76e-1f10-9ba9-86e0-eb3a3c9ec018/testWithMockedMapReduceMultiRegion/48fff4b9-a31b-4144-b837-fcce4c781b1a/data/default/testWithMockedMapReduceMultiRegion/007dd63b20f9d2149ba11df9b0cddc4c/f2/testWithMockedMapReduceMultiRegion=007dd63b20f9d2149ba11df9b0cddc4c-7c62395ed7814233afd59bd1a605f28b 2023-02-15 20:01:39,931 INFO [StoreOpener-007dd63b20f9d2149ba11df9b0cddc4c-1] regionserver.HStore(310): Store=007dd63b20f9d2149ba11df9b0cddc4c/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 20:01:39,932 DEBUG [Listener at localhost/43553] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-15 20:01:39,932 INFO [Listener at localhost/43553] regionserver.HRegion(1071): Opened 007dd63b20f9d2149ba11df9b0cddc4c; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69874686, jitterRate=0.04121395945549011}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-15 20:01:39,932 DEBUG [Listener at localhost/43553] regionserver.HRegion(964): Region open journal for 007dd63b20f9d2149ba11df9b0cddc4c: 2023-02-15 20:01:39,941 DEBUG [Listener at localhost/43553] regionserver.HRegion(1603): Closing 007dd63b20f9d2149ba11df9b0cddc4c, disabling compactions & flushes 2023-02-15 20:01:39,941 INFO [Listener at localhost/43553] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676491296789.007dd63b20f9d2149ba11df9b0cddc4c. 2023-02-15 20:01:39,941 DEBUG [Listener at localhost/43553] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676491296789.007dd63b20f9d2149ba11df9b0cddc4c. 2023-02-15 20:01:39,941 DEBUG [Listener at localhost/43553] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676491296789.007dd63b20f9d2149ba11df9b0cddc4c. after waiting 0 ms 2023-02-15 20:01:39,941 DEBUG [Listener at localhost/43553] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676491296789.007dd63b20f9d2149ba11df9b0cddc4c. 2023-02-15 20:01:39,942 INFO [Listener at localhost/43553] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676491296789.007dd63b20f9d2149ba11df9b0cddc4c. 2023-02-15 20:01:39,942 DEBUG [Listener at localhost/43553] regionserver.HRegion(1557): Region close journal for 007dd63b20f9d2149ba11df9b0cddc4c: 2023-02-15 20:01:39,943 DEBUG [Listener at localhost/43553] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676491296789.5a8c9c21a9831b445d533dd705940e06.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 20:01:39,943 INFO [Listener at localhost/43553] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-15 20:01:39,944 DEBUG [Listener at localhost/43553] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-15 20:01:39,947 INFO [StoreOpener-5a8c9c21a9831b445d533dd705940e06-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 5a8c9c21a9831b445d533dd705940e06 2023-02-15 20:01:39,948 DEBUG [StoreOpener-5a8c9c21a9831b445d533dd705940e06-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43597/user/jenkins/test-data/af11d76e-1f10-9ba9-86e0-eb3a3c9ec018/testWithMockedMapReduceMultiRegion/48fff4b9-a31b-4144-b837-fcce4c781b1a/data/default/testWithMockedMapReduceMultiRegion/5a8c9c21a9831b445d533dd705940e06/f1 2023-02-15 20:01:39,948 INFO [StoreOpener-5a8c9c21a9831b445d533dd705940e06-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5a8c9c21a9831b445d533dd705940e06 columnFamilyName f1 2023-02-15 20:01:39,952 DEBUG [StoreOpener-5a8c9c21a9831b445d533dd705940e06-1] regionserver.HStore(539): loaded hdfs://localhost:43597/user/jenkins/test-data/af11d76e-1f10-9ba9-86e0-eb3a3c9ec018/testWithMockedMapReduceMultiRegion/48fff4b9-a31b-4144-b837-fcce4c781b1a/data/default/testWithMockedMapReduceMultiRegion/5a8c9c21a9831b445d533dd705940e06/f1/testWithMockedMapReduceMultiRegion=5a8c9c21a9831b445d533dd705940e06-9234478382f54f4bb536e887f01e40aa 2023-02-15 20:01:39,953 INFO [StoreOpener-5a8c9c21a9831b445d533dd705940e06-1] regionserver.HStore(310): Store=5a8c9c21a9831b445d533dd705940e06/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 20:01:39,953 INFO [StoreOpener-5a8c9c21a9831b445d533dd705940e06-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 5a8c9c21a9831b445d533dd705940e06 2023-02-15 20:01:39,953 DEBUG [StoreOpener-5a8c9c21a9831b445d533dd705940e06-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43597/user/jenkins/test-data/af11d76e-1f10-9ba9-86e0-eb3a3c9ec018/testWithMockedMapReduceMultiRegion/48fff4b9-a31b-4144-b837-fcce4c781b1a/data/default/testWithMockedMapReduceMultiRegion/5a8c9c21a9831b445d533dd705940e06/f2 2023-02-15 20:01:39,954 INFO [StoreOpener-5a8c9c21a9831b445d533dd705940e06-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5a8c9c21a9831b445d533dd705940e06 columnFamilyName f2 2023-02-15 20:01:39,958 DEBUG [StoreOpener-5a8c9c21a9831b445d533dd705940e06-1] regionserver.HStore(539): loaded hdfs://localhost:43597/user/jenkins/test-data/af11d76e-1f10-9ba9-86e0-eb3a3c9ec018/testWithMockedMapReduceMultiRegion/48fff4b9-a31b-4144-b837-fcce4c781b1a/data/default/testWithMockedMapReduceMultiRegion/5a8c9c21a9831b445d533dd705940e06/f2/testWithMockedMapReduceMultiRegion=5a8c9c21a9831b445d533dd705940e06-12f96a77e5ac4e01a5e7db780638b575 2023-02-15 20:01:39,958 INFO [StoreOpener-5a8c9c21a9831b445d533dd705940e06-1] regionserver.HStore(310): Store=5a8c9c21a9831b445d533dd705940e06/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 20:01:39,958 DEBUG [Listener at localhost/43553] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-15 20:01:39,958 INFO [Listener at localhost/43553] regionserver.HRegion(1071): Opened 5a8c9c21a9831b445d533dd705940e06; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60179897, jitterRate=-0.10324965417385101}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-15 20:01:39,958 DEBUG [Listener at localhost/43553] regionserver.HRegion(964): Region open journal for 5a8c9c21a9831b445d533dd705940e06: 2023-02-15 20:01:39,966 DEBUG [Listener at localhost/43553] regionserver.HRegion(1603): Closing 5a8c9c21a9831b445d533dd705940e06, disabling compactions & flushes 2023-02-15 20:01:39,968 INFO [Listener at localhost/43553] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676491296789.5a8c9c21a9831b445d533dd705940e06. 2023-02-15 20:01:39,968 DEBUG [Listener at localhost/43553] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676491296789.5a8c9c21a9831b445d533dd705940e06. 2023-02-15 20:01:39,968 DEBUG [Listener at localhost/43553] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676491296789.5a8c9c21a9831b445d533dd705940e06. after waiting 0 ms 2023-02-15 20:01:39,968 DEBUG [Listener at localhost/43553] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676491296789.5a8c9c21a9831b445d533dd705940e06. 2023-02-15 20:01:39,969 INFO [Listener at localhost/43553] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676491296789.5a8c9c21a9831b445d533dd705940e06. 2023-02-15 20:01:39,969 DEBUG [Listener at localhost/43553] regionserver.HRegion(1557): Region close journal for 5a8c9c21a9831b445d533dd705940e06: 2023-02-15 20:01:39,969 DEBUG [Listener at localhost/43553] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,zz{,1676491296789.4229d692a52fca982c3f6193911c155d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 20:01:39,970 INFO [Listener at localhost/43553] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-15 20:01:39,971 DEBUG [Listener at localhost/43553] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-15 20:01:39,973 INFO [StoreOpener-4229d692a52fca982c3f6193911c155d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 4229d692a52fca982c3f6193911c155d 2023-02-15 20:01:39,974 DEBUG [StoreOpener-4229d692a52fca982c3f6193911c155d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43597/user/jenkins/test-data/af11d76e-1f10-9ba9-86e0-eb3a3c9ec018/testWithMockedMapReduceMultiRegion/48fff4b9-a31b-4144-b837-fcce4c781b1a/data/default/testWithMockedMapReduceMultiRegion/4229d692a52fca982c3f6193911c155d/f1 2023-02-15 20:01:39,974 INFO [StoreOpener-4229d692a52fca982c3f6193911c155d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4229d692a52fca982c3f6193911c155d columnFamilyName f1 2023-02-15 20:01:39,975 INFO [StoreOpener-4229d692a52fca982c3f6193911c155d-1] regionserver.HStore(310): Store=4229d692a52fca982c3f6193911c155d/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 20:01:39,975 INFO [StoreOpener-4229d692a52fca982c3f6193911c155d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 4229d692a52fca982c3f6193911c155d 2023-02-15 20:01:39,976 DEBUG [StoreOpener-4229d692a52fca982c3f6193911c155d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43597/user/jenkins/test-data/af11d76e-1f10-9ba9-86e0-eb3a3c9ec018/testWithMockedMapReduceMultiRegion/48fff4b9-a31b-4144-b837-fcce4c781b1a/data/default/testWithMockedMapReduceMultiRegion/4229d692a52fca982c3f6193911c155d/f2 2023-02-15 20:01:39,976 INFO [StoreOpener-4229d692a52fca982c3f6193911c155d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4229d692a52fca982c3f6193911c155d columnFamilyName f2 2023-02-15 20:01:39,977 INFO [StoreOpener-4229d692a52fca982c3f6193911c155d-1] regionserver.HStore(310): Store=4229d692a52fca982c3f6193911c155d/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 20:01:39,977 DEBUG [Listener at localhost/43553] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-15 20:01:39,977 INFO [Listener at localhost/43553] regionserver.HRegion(1071): Opened 4229d692a52fca982c3f6193911c155d; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=58951159, jitterRate=-0.121559277176857}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-15 20:01:39,977 DEBUG [Listener at localhost/43553] regionserver.HRegion(964): Region open journal for 4229d692a52fca982c3f6193911c155d: 2023-02-15 20:01:39,977 DEBUG [Listener at localhost/43553] regionserver.HRegion(1603): Closing 4229d692a52fca982c3f6193911c155d, disabling compactions & flushes 2023-02-15 20:01:39,977 INFO [Listener at localhost/43553] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,zz{,1676491296789.4229d692a52fca982c3f6193911c155d. 2023-02-15 20:01:39,977 DEBUG [Listener at localhost/43553] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,zz{,1676491296789.4229d692a52fca982c3f6193911c155d. 2023-02-15 20:01:39,977 DEBUG [Listener at localhost/43553] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,zz{,1676491296789.4229d692a52fca982c3f6193911c155d. after waiting 0 ms 2023-02-15 20:01:39,977 DEBUG [Listener at localhost/43553] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,zz{,1676491296789.4229d692a52fca982c3f6193911c155d. 2023-02-15 20:01:39,978 INFO [Listener at localhost/43553] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,zz{,1676491296789.4229d692a52fca982c3f6193911c155d. 2023-02-15 20:01:39,978 DEBUG [Listener at localhost/43553] regionserver.HRegion(1557): Region close journal for 4229d692a52fca982c3f6193911c155d: 2023-02-15 20:01:39,978 DEBUG [Listener at localhost/43553] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,q\x11\x10,1676491296789.81644ccf4d63c864b007cbc1043831d7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 20:01:39,978 INFO [Listener at localhost/43553] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-15 20:01:39,980 DEBUG [Listener at localhost/43553] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-15 20:01:39,981 INFO [StoreOpener-81644ccf4d63c864b007cbc1043831d7-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 81644ccf4d63c864b007cbc1043831d7 2023-02-15 20:01:39,982 DEBUG [StoreOpener-81644ccf4d63c864b007cbc1043831d7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43597/user/jenkins/test-data/af11d76e-1f10-9ba9-86e0-eb3a3c9ec018/testWithMockedMapReduceMultiRegion/48fff4b9-a31b-4144-b837-fcce4c781b1a/data/default/testWithMockedMapReduceMultiRegion/81644ccf4d63c864b007cbc1043831d7/f1 2023-02-15 20:01:39,982 INFO [StoreOpener-81644ccf4d63c864b007cbc1043831d7-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 81644ccf4d63c864b007cbc1043831d7 columnFamilyName f1 2023-02-15 20:01:39,987 DEBUG [StoreOpener-81644ccf4d63c864b007cbc1043831d7-1] regionserver.HStore(539): loaded hdfs://localhost:43597/user/jenkins/test-data/af11d76e-1f10-9ba9-86e0-eb3a3c9ec018/testWithMockedMapReduceMultiRegion/48fff4b9-a31b-4144-b837-fcce4c781b1a/data/default/testWithMockedMapReduceMultiRegion/81644ccf4d63c864b007cbc1043831d7/f1/testWithMockedMapReduceMultiRegion=81644ccf4d63c864b007cbc1043831d7-2771400ae1e3406092833cb8cde650c5 2023-02-15 20:01:39,987 INFO [StoreOpener-81644ccf4d63c864b007cbc1043831d7-1] regionserver.HStore(310): Store=81644ccf4d63c864b007cbc1043831d7/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 20:01:39,987 INFO [StoreOpener-81644ccf4d63c864b007cbc1043831d7-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 81644ccf4d63c864b007cbc1043831d7 2023-02-15 20:01:39,988 DEBUG [StoreOpener-81644ccf4d63c864b007cbc1043831d7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43597/user/jenkins/test-data/af11d76e-1f10-9ba9-86e0-eb3a3c9ec018/testWithMockedMapReduceMultiRegion/48fff4b9-a31b-4144-b837-fcce4c781b1a/data/default/testWithMockedMapReduceMultiRegion/81644ccf4d63c864b007cbc1043831d7/f2 2023-02-15 20:01:39,988 INFO [StoreOpener-81644ccf4d63c864b007cbc1043831d7-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 81644ccf4d63c864b007cbc1043831d7 columnFamilyName f2 2023-02-15 20:01:39,994 DEBUG [StoreOpener-81644ccf4d63c864b007cbc1043831d7-1] regionserver.HStore(539): loaded hdfs://localhost:43597/user/jenkins/test-data/af11d76e-1f10-9ba9-86e0-eb3a3c9ec018/testWithMockedMapReduceMultiRegion/48fff4b9-a31b-4144-b837-fcce4c781b1a/data/default/testWithMockedMapReduceMultiRegion/81644ccf4d63c864b007cbc1043831d7/f2/testWithMockedMapReduceMultiRegion=81644ccf4d63c864b007cbc1043831d7-2f1f47a490914b27b07597aeb3ec00b8 2023-02-15 20:01:39,994 INFO [StoreOpener-81644ccf4d63c864b007cbc1043831d7-1] regionserver.HStore(310): Store=81644ccf4d63c864b007cbc1043831d7/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 20:01:39,994 DEBUG [Listener at localhost/43553] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-15 20:01:39,994 INFO [Listener at localhost/43553] regionserver.HRegion(1071): Opened 81644ccf4d63c864b007cbc1043831d7; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70960672, jitterRate=0.05739641189575195}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-15 20:01:39,994 DEBUG [Listener at localhost/43553] regionserver.HRegion(964): Region open journal for 81644ccf4d63c864b007cbc1043831d7: 2023-02-15 20:01:40,002 DEBUG [Listener at localhost/43553] regionserver.HRegion(1603): Closing 81644ccf4d63c864b007cbc1043831d7, disabling compactions & flushes 2023-02-15 20:01:40,003 INFO [Listener at localhost/43553] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,q\x11\x10,1676491296789.81644ccf4d63c864b007cbc1043831d7. 2023-02-15 20:01:40,003 DEBUG [Listener at localhost/43553] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,q\x11\x10,1676491296789.81644ccf4d63c864b007cbc1043831d7. 2023-02-15 20:01:40,003 DEBUG [Listener at localhost/43553] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,q\x11\x10,1676491296789.81644ccf4d63c864b007cbc1043831d7. after waiting 0 ms 2023-02-15 20:01:40,003 DEBUG [Listener at localhost/43553] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,q\x11\x10,1676491296789.81644ccf4d63c864b007cbc1043831d7. 2023-02-15 20:01:40,004 INFO [Listener at localhost/43553] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,q\x11\x10,1676491296789.81644ccf4d63c864b007cbc1043831d7. 2023-02-15 20:01:40,004 DEBUG [Listener at localhost/43553] regionserver.HRegion(1557): Region close journal for 81644ccf4d63c864b007cbc1043831d7: 2023-02-15 20:01:40,005 DEBUG [Listener at localhost/43553] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,aaa,1676491296789.6f4ab26e6b0d69c90f3b3b848034eb88.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 20:01:40,005 INFO [Listener at localhost/43553] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-15 20:01:40,006 DEBUG [Listener at localhost/43553] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-15 20:01:40,008 INFO [StoreOpener-6f4ab26e6b0d69c90f3b3b848034eb88-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 6f4ab26e6b0d69c90f3b3b848034eb88 2023-02-15 20:01:40,009 DEBUG [StoreOpener-6f4ab26e6b0d69c90f3b3b848034eb88-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43597/user/jenkins/test-data/af11d76e-1f10-9ba9-86e0-eb3a3c9ec018/testWithMockedMapReduceMultiRegion/48fff4b9-a31b-4144-b837-fcce4c781b1a/data/default/testWithMockedMapReduceMultiRegion/6f4ab26e6b0d69c90f3b3b848034eb88/f1 2023-02-15 20:01:40,009 INFO [StoreOpener-6f4ab26e6b0d69c90f3b3b848034eb88-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6f4ab26e6b0d69c90f3b3b848034eb88 columnFamilyName f1 2023-02-15 20:01:40,013 DEBUG [StoreOpener-6f4ab26e6b0d69c90f3b3b848034eb88-1] regionserver.HStore(539): loaded hdfs://localhost:43597/user/jenkins/test-data/af11d76e-1f10-9ba9-86e0-eb3a3c9ec018/testWithMockedMapReduceMultiRegion/48fff4b9-a31b-4144-b837-fcce4c781b1a/data/default/testWithMockedMapReduceMultiRegion/6f4ab26e6b0d69c90f3b3b848034eb88/f1/testWithMockedMapReduceMultiRegion=6f4ab26e6b0d69c90f3b3b848034eb88-3f7b594ca3bd4926a8a99a9121c8d412 2023-02-15 20:01:40,014 INFO [StoreOpener-6f4ab26e6b0d69c90f3b3b848034eb88-1] regionserver.HStore(310): Store=6f4ab26e6b0d69c90f3b3b848034eb88/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 20:01:40,014 INFO [StoreOpener-6f4ab26e6b0d69c90f3b3b848034eb88-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 6f4ab26e6b0d69c90f3b3b848034eb88 2023-02-15 20:01:40,015 DEBUG [StoreOpener-6f4ab26e6b0d69c90f3b3b848034eb88-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43597/user/jenkins/test-data/af11d76e-1f10-9ba9-86e0-eb3a3c9ec018/testWithMockedMapReduceMultiRegion/48fff4b9-a31b-4144-b837-fcce4c781b1a/data/default/testWithMockedMapReduceMultiRegion/6f4ab26e6b0d69c90f3b3b848034eb88/f2 2023-02-15 20:01:40,015 INFO [StoreOpener-6f4ab26e6b0d69c90f3b3b848034eb88-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6f4ab26e6b0d69c90f3b3b848034eb88 columnFamilyName f2 2023-02-15 20:01:40,019 DEBUG [StoreOpener-6f4ab26e6b0d69c90f3b3b848034eb88-1] regionserver.HStore(539): loaded hdfs://localhost:43597/user/jenkins/test-data/af11d76e-1f10-9ba9-86e0-eb3a3c9ec018/testWithMockedMapReduceMultiRegion/48fff4b9-a31b-4144-b837-fcce4c781b1a/data/default/testWithMockedMapReduceMultiRegion/6f4ab26e6b0d69c90f3b3b848034eb88/f2/testWithMockedMapReduceMultiRegion=6f4ab26e6b0d69c90f3b3b848034eb88-0109ebdc9a594bde949d22a23c8a64cb 2023-02-15 20:01:40,019 INFO [StoreOpener-6f4ab26e6b0d69c90f3b3b848034eb88-1] regionserver.HStore(310): Store=6f4ab26e6b0d69c90f3b3b848034eb88/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 20:01:40,019 DEBUG [Listener at localhost/43553] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-15 20:01:40,020 INFO [Listener at localhost/43553] regionserver.HRegion(1071): Opened 6f4ab26e6b0d69c90f3b3b848034eb88; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71513169, jitterRate=0.0656292587518692}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-15 20:01:40,020 DEBUG [Listener at localhost/43553] regionserver.HRegion(964): Region open journal for 6f4ab26e6b0d69c90f3b3b848034eb88: 2023-02-15 20:01:40,035 DEBUG [Listener at localhost/43553] regionserver.HRegion(1603): Closing 6f4ab26e6b0d69c90f3b3b848034eb88, disabling compactions & flushes 2023-02-15 20:01:40,036 INFO [Listener at localhost/43553] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,aaa,1676491296789.6f4ab26e6b0d69c90f3b3b848034eb88. 2023-02-15 20:01:40,036 DEBUG [Listener at localhost/43553] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,aaa,1676491296789.6f4ab26e6b0d69c90f3b3b848034eb88. 2023-02-15 20:01:40,036 DEBUG [Listener at localhost/43553] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,aaa,1676491296789.6f4ab26e6b0d69c90f3b3b848034eb88. after waiting 0 ms 2023-02-15 20:01:40,036 DEBUG [Listener at localhost/43553] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,aaa,1676491296789.6f4ab26e6b0d69c90f3b3b848034eb88. 2023-02-15 20:01:40,040 INFO [Listener at localhost/43553] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,aaa,1676491296789.6f4ab26e6b0d69c90f3b3b848034eb88. 2023-02-15 20:01:40,040 DEBUG [Listener at localhost/43553] regionserver.HRegion(1557): Region close journal for 6f4ab26e6b0d69c90f3b3b848034eb88: 2023-02-15 20:01:40,040 DEBUG [Listener at localhost/43553] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,,1676491296789.5e40ee2d96ae1cbe88d7c194cd72dda2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 20:01:40,040 INFO [Listener at localhost/43553] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-15 20:01:40,042 DEBUG [Listener at localhost/43553] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-15 20:01:40,044 INFO [StoreOpener-5e40ee2d96ae1cbe88d7c194cd72dda2-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 5e40ee2d96ae1cbe88d7c194cd72dda2 2023-02-15 20:01:40,046 DEBUG [StoreOpener-5e40ee2d96ae1cbe88d7c194cd72dda2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43597/user/jenkins/test-data/af11d76e-1f10-9ba9-86e0-eb3a3c9ec018/testWithMockedMapReduceMultiRegion/48fff4b9-a31b-4144-b837-fcce4c781b1a/data/default/testWithMockedMapReduceMultiRegion/5e40ee2d96ae1cbe88d7c194cd72dda2/f1 2023-02-15 20:01:40,046 INFO [StoreOpener-5e40ee2d96ae1cbe88d7c194cd72dda2-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5e40ee2d96ae1cbe88d7c194cd72dda2 columnFamilyName f1 2023-02-15 20:01:40,047 INFO [StoreOpener-5e40ee2d96ae1cbe88d7c194cd72dda2-1] regionserver.HStore(310): Store=5e40ee2d96ae1cbe88d7c194cd72dda2/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 20:01:40,047 INFO [StoreOpener-5e40ee2d96ae1cbe88d7c194cd72dda2-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 5e40ee2d96ae1cbe88d7c194cd72dda2 2023-02-15 20:01:40,048 DEBUG [StoreOpener-5e40ee2d96ae1cbe88d7c194cd72dda2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43597/user/jenkins/test-data/af11d76e-1f10-9ba9-86e0-eb3a3c9ec018/testWithMockedMapReduceMultiRegion/48fff4b9-a31b-4144-b837-fcce4c781b1a/data/default/testWithMockedMapReduceMultiRegion/5e40ee2d96ae1cbe88d7c194cd72dda2/f2 2023-02-15 20:01:40,048 INFO [StoreOpener-5e40ee2d96ae1cbe88d7c194cd72dda2-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5e40ee2d96ae1cbe88d7c194cd72dda2 columnFamilyName f2 2023-02-15 20:01:40,049 INFO [StoreOpener-5e40ee2d96ae1cbe88d7c194cd72dda2-1] regionserver.HStore(310): Store=5e40ee2d96ae1cbe88d7c194cd72dda2/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 20:01:40,049 DEBUG [Listener at localhost/43553] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-15 20:01:40,049 INFO [Listener at localhost/43553] regionserver.HRegion(1071): Opened 5e40ee2d96ae1cbe88d7c194cd72dda2; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64236522, jitterRate=-0.042801231145858765}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-15 20:01:40,049 DEBUG [Listener at localhost/43553] regionserver.HRegion(964): Region open journal for 5e40ee2d96ae1cbe88d7c194cd72dda2: 2023-02-15 20:01:40,049 DEBUG [Listener at localhost/43553] regionserver.HRegion(1603): Closing 5e40ee2d96ae1cbe88d7c194cd72dda2, disabling compactions & flushes 2023-02-15 20:01:40,050 INFO [Listener at localhost/43553] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,,1676491296789.5e40ee2d96ae1cbe88d7c194cd72dda2. 2023-02-15 20:01:40,050 DEBUG [Listener at localhost/43553] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,,1676491296789.5e40ee2d96ae1cbe88d7c194cd72dda2. 2023-02-15 20:01:40,050 DEBUG [Listener at localhost/43553] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,,1676491296789.5e40ee2d96ae1cbe88d7c194cd72dda2. after waiting 0 ms 2023-02-15 20:01:40,050 DEBUG [Listener at localhost/43553] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,,1676491296789.5e40ee2d96ae1cbe88d7c194cd72dda2. 2023-02-15 20:01:40,051 INFO [Listener at localhost/43553] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,,1676491296789.5e40ee2d96ae1cbe88d7c194cd72dda2. 2023-02-15 20:01:40,051 DEBUG [Listener at localhost/43553] regionserver.HRegion(1557): Region close journal for 5e40ee2d96ae1cbe88d7c194cd72dda2: 2023-02-15 20:01:40,052 DEBUG [Listener at localhost/43553] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,d\x84\x84,1676491296789.85c1d4ec199a8eac4595716bde5173ab.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 20:01:40,052 INFO [Listener at localhost/43553] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-15 20:01:40,053 DEBUG [Listener at localhost/43553] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-15 20:01:40,055 INFO [StoreOpener-85c1d4ec199a8eac4595716bde5173ab-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 85c1d4ec199a8eac4595716bde5173ab 2023-02-15 20:01:40,056 DEBUG [StoreOpener-85c1d4ec199a8eac4595716bde5173ab-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43597/user/jenkins/test-data/af11d76e-1f10-9ba9-86e0-eb3a3c9ec018/testWithMockedMapReduceMultiRegion/48fff4b9-a31b-4144-b837-fcce4c781b1a/data/default/testWithMockedMapReduceMultiRegion/85c1d4ec199a8eac4595716bde5173ab/f1 2023-02-15 20:01:40,056 INFO [StoreOpener-85c1d4ec199a8eac4595716bde5173ab-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 85c1d4ec199a8eac4595716bde5173ab columnFamilyName f1 2023-02-15 20:01:40,060 DEBUG [StoreOpener-85c1d4ec199a8eac4595716bde5173ab-1] regionserver.HStore(539): loaded hdfs://localhost:43597/user/jenkins/test-data/af11d76e-1f10-9ba9-86e0-eb3a3c9ec018/testWithMockedMapReduceMultiRegion/48fff4b9-a31b-4144-b837-fcce4c781b1a/data/default/testWithMockedMapReduceMultiRegion/85c1d4ec199a8eac4595716bde5173ab/f1/testWithMockedMapReduceMultiRegion=85c1d4ec199a8eac4595716bde5173ab-962aca7e712640d4b681c9c3a5fba101 2023-02-15 20:01:40,060 INFO [StoreOpener-85c1d4ec199a8eac4595716bde5173ab-1] regionserver.HStore(310): Store=85c1d4ec199a8eac4595716bde5173ab/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 20:01:40,061 INFO [StoreOpener-85c1d4ec199a8eac4595716bde5173ab-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 85c1d4ec199a8eac4595716bde5173ab 2023-02-15 20:01:40,061 DEBUG [StoreOpener-85c1d4ec199a8eac4595716bde5173ab-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43597/user/jenkins/test-data/af11d76e-1f10-9ba9-86e0-eb3a3c9ec018/testWithMockedMapReduceMultiRegion/48fff4b9-a31b-4144-b837-fcce4c781b1a/data/default/testWithMockedMapReduceMultiRegion/85c1d4ec199a8eac4595716bde5173ab/f2 2023-02-15 20:01:40,062 INFO [StoreOpener-85c1d4ec199a8eac4595716bde5173ab-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 85c1d4ec199a8eac4595716bde5173ab columnFamilyName f2 2023-02-15 20:01:40,065 DEBUG [StoreOpener-85c1d4ec199a8eac4595716bde5173ab-1] regionserver.HStore(539): loaded hdfs://localhost:43597/user/jenkins/test-data/af11d76e-1f10-9ba9-86e0-eb3a3c9ec018/testWithMockedMapReduceMultiRegion/48fff4b9-a31b-4144-b837-fcce4c781b1a/data/default/testWithMockedMapReduceMultiRegion/85c1d4ec199a8eac4595716bde5173ab/f2/testWithMockedMapReduceMultiRegion=85c1d4ec199a8eac4595716bde5173ab-e929536a3a6a46789ae2ba83a0ba01f2 2023-02-15 20:01:40,066 INFO [StoreOpener-85c1d4ec199a8eac4595716bde5173ab-1] regionserver.HStore(310): Store=85c1d4ec199a8eac4595716bde5173ab/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 20:01:40,066 DEBUG [Listener at localhost/43553] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-15 20:01:40,066 INFO [Listener at localhost/43553] regionserver.HRegion(1071): Opened 85c1d4ec199a8eac4595716bde5173ab; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74943209, jitterRate=0.11674083769321442}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-15 20:01:40,066 DEBUG [Listener at localhost/43553] regionserver.HRegion(964): Region open journal for 85c1d4ec199a8eac4595716bde5173ab: 2023-02-15 20:01:40,074 DEBUG [Listener at localhost/43553] regionserver.HRegion(1603): Closing 85c1d4ec199a8eac4595716bde5173ab, disabling compactions & flushes 2023-02-15 20:01:40,074 INFO [Listener at localhost/43553] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,d\x84\x84,1676491296789.85c1d4ec199a8eac4595716bde5173ab. 2023-02-15 20:01:40,074 DEBUG [Listener at localhost/43553] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,d\x84\x84,1676491296789.85c1d4ec199a8eac4595716bde5173ab. 2023-02-15 20:01:40,074 DEBUG [Listener at localhost/43553] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,d\x84\x84,1676491296789.85c1d4ec199a8eac4595716bde5173ab. after waiting 0 ms 2023-02-15 20:01:40,074 DEBUG [Listener at localhost/43553] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,d\x84\x84,1676491296789.85c1d4ec199a8eac4595716bde5173ab. 2023-02-15 20:01:40,075 INFO [Listener at localhost/43553] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,d\x84\x84,1676491296789.85c1d4ec199a8eac4595716bde5173ab. 2023-02-15 20:01:40,075 DEBUG [Listener at localhost/43553] regionserver.HRegion(1557): Region close journal for 85c1d4ec199a8eac4595716bde5173ab: 2023-02-15 20:01:40,076 DEBUG [Listener at localhost/43553] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,t43,1676491296789.fe51e97cb822f497ca56994d85f7310f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 20:01:40,076 INFO [Listener at localhost/43553] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-15 20:01:40,079 DEBUG [Listener at localhost/43553] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-15 20:01:40,085 INFO [StoreOpener-fe51e97cb822f497ca56994d85f7310f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region fe51e97cb822f497ca56994d85f7310f 2023-02-15 20:01:40,086 DEBUG [StoreOpener-fe51e97cb822f497ca56994d85f7310f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43597/user/jenkins/test-data/af11d76e-1f10-9ba9-86e0-eb3a3c9ec018/testWithMockedMapReduceMultiRegion/48fff4b9-a31b-4144-b837-fcce4c781b1a/data/default/testWithMockedMapReduceMultiRegion/fe51e97cb822f497ca56994d85f7310f/f1 2023-02-15 20:01:40,086 INFO [StoreOpener-fe51e97cb822f497ca56994d85f7310f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region fe51e97cb822f497ca56994d85f7310f columnFamilyName f1 2023-02-15 20:01:40,128 DEBUG [StoreOpener-fe51e97cb822f497ca56994d85f7310f-1] regionserver.HStore(539): loaded hdfs://localhost:43597/user/jenkins/test-data/af11d76e-1f10-9ba9-86e0-eb3a3c9ec018/testWithMockedMapReduceMultiRegion/48fff4b9-a31b-4144-b837-fcce4c781b1a/data/default/testWithMockedMapReduceMultiRegion/fe51e97cb822f497ca56994d85f7310f/f1/testWithMockedMapReduceMultiRegion=fe51e97cb822f497ca56994d85f7310f-0da61d44a36946a49779016090ef9445 2023-02-15 20:01:40,128 INFO [StoreOpener-fe51e97cb822f497ca56994d85f7310f-1] regionserver.HStore(310): Store=fe51e97cb822f497ca56994d85f7310f/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 20:01:40,128 INFO [StoreOpener-fe51e97cb822f497ca56994d85f7310f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region fe51e97cb822f497ca56994d85f7310f 2023-02-15 20:01:40,129 DEBUG [StoreOpener-fe51e97cb822f497ca56994d85f7310f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43597/user/jenkins/test-data/af11d76e-1f10-9ba9-86e0-eb3a3c9ec018/testWithMockedMapReduceMultiRegion/48fff4b9-a31b-4144-b837-fcce4c781b1a/data/default/testWithMockedMapReduceMultiRegion/fe51e97cb822f497ca56994d85f7310f/f2 2023-02-15 20:01:40,130 INFO [StoreOpener-fe51e97cb822f497ca56994d85f7310f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region fe51e97cb822f497ca56994d85f7310f columnFamilyName f2 2023-02-15 20:01:40,135 DEBUG [StoreOpener-fe51e97cb822f497ca56994d85f7310f-1] regionserver.HStore(539): loaded hdfs://localhost:43597/user/jenkins/test-data/af11d76e-1f10-9ba9-86e0-eb3a3c9ec018/testWithMockedMapReduceMultiRegion/48fff4b9-a31b-4144-b837-fcce4c781b1a/data/default/testWithMockedMapReduceMultiRegion/fe51e97cb822f497ca56994d85f7310f/f2/testWithMockedMapReduceMultiRegion=fe51e97cb822f497ca56994d85f7310f-f3c0d03963c14c6198531acdd3e68d60 2023-02-15 20:01:40,135 INFO [StoreOpener-fe51e97cb822f497ca56994d85f7310f-1] regionserver.HStore(310): Store=fe51e97cb822f497ca56994d85f7310f/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 20:01:40,136 DEBUG [Listener at localhost/43553] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-15 20:01:40,136 INFO [Listener at localhost/43553] regionserver.HRegion(1071): Opened fe51e97cb822f497ca56994d85f7310f; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67775861, jitterRate=0.009939029812812805}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-15 20:01:40,136 DEBUG [Listener at localhost/43553] regionserver.HRegion(964): Region open journal for fe51e97cb822f497ca56994d85f7310f: 2023-02-15 20:01:40,149 DEBUG [Listener at localhost/43553] regionserver.HRegion(1603): Closing fe51e97cb822f497ca56994d85f7310f, disabling compactions & flushes 2023-02-15 20:01:40,149 INFO [Listener at localhost/43553] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,t43,1676491296789.fe51e97cb822f497ca56994d85f7310f. 2023-02-15 20:01:40,149 DEBUG [Listener at localhost/43553] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,t43,1676491296789.fe51e97cb822f497ca56994d85f7310f. 2023-02-15 20:01:40,149 DEBUG [Listener at localhost/43553] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,t43,1676491296789.fe51e97cb822f497ca56994d85f7310f. after waiting 0 ms 2023-02-15 20:01:40,149 DEBUG [Listener at localhost/43553] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,t43,1676491296789.fe51e97cb822f497ca56994d85f7310f. 2023-02-15 20:01:40,150 INFO [Listener at localhost/43553] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,t43,1676491296789.fe51e97cb822f497ca56994d85f7310f. 2023-02-15 20:01:40,150 DEBUG [Listener at localhost/43553] regionserver.HRegion(1557): Region close journal for fe51e97cb822f497ca56994d85f7310f: 2023-02-15 20:01:40,151 DEBUG [Listener at localhost/43553] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,wWV,1676491296789.8a79eee6aefc962407df2ed05672c891.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 20:01:40,151 INFO [Listener at localhost/43553] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-15 20:01:40,153 DEBUG [Listener at localhost/43553] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-15 20:01:40,155 INFO [StoreOpener-8a79eee6aefc962407df2ed05672c891-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 8a79eee6aefc962407df2ed05672c891 2023-02-15 20:01:40,157 DEBUG [StoreOpener-8a79eee6aefc962407df2ed05672c891-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43597/user/jenkins/test-data/af11d76e-1f10-9ba9-86e0-eb3a3c9ec018/testWithMockedMapReduceMultiRegion/48fff4b9-a31b-4144-b837-fcce4c781b1a/data/default/testWithMockedMapReduceMultiRegion/8a79eee6aefc962407df2ed05672c891/f1 2023-02-15 20:01:40,157 INFO [StoreOpener-8a79eee6aefc962407df2ed05672c891-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8a79eee6aefc962407df2ed05672c891 columnFamilyName f1 2023-02-15 20:01:40,162 DEBUG [StoreOpener-8a79eee6aefc962407df2ed05672c891-1] regionserver.HStore(539): loaded hdfs://localhost:43597/user/jenkins/test-data/af11d76e-1f10-9ba9-86e0-eb3a3c9ec018/testWithMockedMapReduceMultiRegion/48fff4b9-a31b-4144-b837-fcce4c781b1a/data/default/testWithMockedMapReduceMultiRegion/8a79eee6aefc962407df2ed05672c891/f1/testWithMockedMapReduceMultiRegion=8a79eee6aefc962407df2ed05672c891-5faa164e7bce4249bbe09f7924d8ab21 2023-02-15 20:01:40,163 INFO [StoreOpener-8a79eee6aefc962407df2ed05672c891-1] regionserver.HStore(310): Store=8a79eee6aefc962407df2ed05672c891/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 20:01:40,163 INFO [StoreOpener-8a79eee6aefc962407df2ed05672c891-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 8a79eee6aefc962407df2ed05672c891 2023-02-15 20:01:40,164 DEBUG [StoreOpener-8a79eee6aefc962407df2ed05672c891-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43597/user/jenkins/test-data/af11d76e-1f10-9ba9-86e0-eb3a3c9ec018/testWithMockedMapReduceMultiRegion/48fff4b9-a31b-4144-b837-fcce4c781b1a/data/default/testWithMockedMapReduceMultiRegion/8a79eee6aefc962407df2ed05672c891/f2 2023-02-15 20:01:40,164 INFO [StoreOpener-8a79eee6aefc962407df2ed05672c891-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8a79eee6aefc962407df2ed05672c891 columnFamilyName f2 2023-02-15 20:01:40,168 DEBUG [StoreOpener-8a79eee6aefc962407df2ed05672c891-1] regionserver.HStore(539): loaded hdfs://localhost:43597/user/jenkins/test-data/af11d76e-1f10-9ba9-86e0-eb3a3c9ec018/testWithMockedMapReduceMultiRegion/48fff4b9-a31b-4144-b837-fcce4c781b1a/data/default/testWithMockedMapReduceMultiRegion/8a79eee6aefc962407df2ed05672c891/f2/testWithMockedMapReduceMultiRegion=8a79eee6aefc962407df2ed05672c891-c2016df0893c44b3a6b0164ad4a4d968 2023-02-15 20:01:40,169 INFO [StoreOpener-8a79eee6aefc962407df2ed05672c891-1] regionserver.HStore(310): Store=8a79eee6aefc962407df2ed05672c891/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 20:01:40,169 DEBUG [Listener at localhost/43553] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-15 20:01:40,169 INFO [Listener at localhost/43553] regionserver.HRegion(1071): Opened 8a79eee6aefc962407df2ed05672c891; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74291511, jitterRate=0.10702978074550629}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-15 20:01:40,169 DEBUG [Listener at localhost/43553] regionserver.HRegion(964): Region open journal for 8a79eee6aefc962407df2ed05672c891: 2023-02-15 20:01:40,180 DEBUG [Listener at localhost/43553] regionserver.HRegion(1603): Closing 8a79eee6aefc962407df2ed05672c891, disabling compactions & flushes 2023-02-15 20:01:40,180 INFO [Listener at localhost/43553] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,wWV,1676491296789.8a79eee6aefc962407df2ed05672c891. 2023-02-15 20:01:40,180 DEBUG [Listener at localhost/43553] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,wWV,1676491296789.8a79eee6aefc962407df2ed05672c891. 2023-02-15 20:01:40,180 DEBUG [Listener at localhost/43553] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,wWV,1676491296789.8a79eee6aefc962407df2ed05672c891. after waiting 0 ms 2023-02-15 20:01:40,180 DEBUG [Listener at localhost/43553] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,wWV,1676491296789.8a79eee6aefc962407df2ed05672c891. 2023-02-15 20:01:40,181 INFO [Listener at localhost/43553] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,wWV,1676491296789.8a79eee6aefc962407df2ed05672c891. 2023-02-15 20:01:40,181 DEBUG [Listener at localhost/43553] regionserver.HRegion(1557): Region close journal for 8a79eee6aefc962407df2ed05672c891: 2023-02-15 20:01:40,181 DEBUG [Listener at localhost/43553] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,m\xED\xED,1676491296789.c069ee68dab22f36ea73f04b91933c1f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 20:01:40,181 INFO [Listener at localhost/43553] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-15 20:01:40,183 DEBUG [Listener at localhost/43553] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-15 20:01:40,185 INFO [StoreOpener-c069ee68dab22f36ea73f04b91933c1f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region c069ee68dab22f36ea73f04b91933c1f 2023-02-15 20:01:40,186 DEBUG [StoreOpener-c069ee68dab22f36ea73f04b91933c1f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43597/user/jenkins/test-data/af11d76e-1f10-9ba9-86e0-eb3a3c9ec018/testWithMockedMapReduceMultiRegion/48fff4b9-a31b-4144-b837-fcce4c781b1a/data/default/testWithMockedMapReduceMultiRegion/c069ee68dab22f36ea73f04b91933c1f/f1 2023-02-15 20:01:40,187 INFO [StoreOpener-c069ee68dab22f36ea73f04b91933c1f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c069ee68dab22f36ea73f04b91933c1f columnFamilyName f1 2023-02-15 20:01:40,191 DEBUG [StoreOpener-c069ee68dab22f36ea73f04b91933c1f-1] regionserver.HStore(539): loaded hdfs://localhost:43597/user/jenkins/test-data/af11d76e-1f10-9ba9-86e0-eb3a3c9ec018/testWithMockedMapReduceMultiRegion/48fff4b9-a31b-4144-b837-fcce4c781b1a/data/default/testWithMockedMapReduceMultiRegion/c069ee68dab22f36ea73f04b91933c1f/f1/testWithMockedMapReduceMultiRegion=c069ee68dab22f36ea73f04b91933c1f-fed3c1f0213342888f3271582470bf94 2023-02-15 20:01:40,191 INFO [StoreOpener-c069ee68dab22f36ea73f04b91933c1f-1] regionserver.HStore(310): Store=c069ee68dab22f36ea73f04b91933c1f/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 20:01:40,191 INFO [StoreOpener-c069ee68dab22f36ea73f04b91933c1f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region c069ee68dab22f36ea73f04b91933c1f 2023-02-15 20:01:40,192 DEBUG [StoreOpener-c069ee68dab22f36ea73f04b91933c1f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43597/user/jenkins/test-data/af11d76e-1f10-9ba9-86e0-eb3a3c9ec018/testWithMockedMapReduceMultiRegion/48fff4b9-a31b-4144-b837-fcce4c781b1a/data/default/testWithMockedMapReduceMultiRegion/c069ee68dab22f36ea73f04b91933c1f/f2 2023-02-15 20:01:40,192 INFO [StoreOpener-c069ee68dab22f36ea73f04b91933c1f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c069ee68dab22f36ea73f04b91933c1f columnFamilyName f2 2023-02-15 20:01:40,196 DEBUG [StoreOpener-c069ee68dab22f36ea73f04b91933c1f-1] regionserver.HStore(539): loaded hdfs://localhost:43597/user/jenkins/test-data/af11d76e-1f10-9ba9-86e0-eb3a3c9ec018/testWithMockedMapReduceMultiRegion/48fff4b9-a31b-4144-b837-fcce4c781b1a/data/default/testWithMockedMapReduceMultiRegion/c069ee68dab22f36ea73f04b91933c1f/f2/testWithMockedMapReduceMultiRegion=c069ee68dab22f36ea73f04b91933c1f-9bdc52e7055042b9a096d19df5046458 2023-02-15 20:01:40,197 INFO [StoreOpener-c069ee68dab22f36ea73f04b91933c1f-1] regionserver.HStore(310): Store=c069ee68dab22f36ea73f04b91933c1f/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 20:01:40,197 DEBUG [Listener at localhost/43553] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-15 20:01:40,197 INFO [Listener at localhost/43553] regionserver.HRegion(1071): Opened c069ee68dab22f36ea73f04b91933c1f; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61509992, jitterRate=-0.08342969417572021}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-15 20:01:40,197 DEBUG [Listener at localhost/43553] regionserver.HRegion(964): Region open journal for c069ee68dab22f36ea73f04b91933c1f: 2023-02-15 20:01:40,205 DEBUG [Listener at localhost/43553] regionserver.HRegion(1603): Closing c069ee68dab22f36ea73f04b91933c1f, disabling compactions & flushes 2023-02-15 20:01:40,205 INFO [Listener at localhost/43553] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,m\xED\xED,1676491296789.c069ee68dab22f36ea73f04b91933c1f. 2023-02-15 20:01:40,205 DEBUG [Listener at localhost/43553] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,m\xED\xED,1676491296789.c069ee68dab22f36ea73f04b91933c1f. 2023-02-15 20:01:40,205 DEBUG [Listener at localhost/43553] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,m\xED\xED,1676491296789.c069ee68dab22f36ea73f04b91933c1f. after waiting 0 ms 2023-02-15 20:01:40,205 DEBUG [Listener at localhost/43553] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,m\xED\xED,1676491296789.c069ee68dab22f36ea73f04b91933c1f. 2023-02-15 20:01:40,206 INFO [Listener at localhost/43553] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,m\xED\xED,1676491296789.c069ee68dab22f36ea73f04b91933c1f. 2023-02-15 20:01:40,206 DEBUG [Listener at localhost/43553] regionserver.HRegion(1557): Region close journal for c069ee68dab22f36ea73f04b91933c1f: 2023-02-15 20:01:40,211 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35467] master.MasterRpcServices(748): Client=jenkins//172.31.14.131 delete name: "testWithMockedMapReduceMultiRegion" 2023-02-15 20:01:40,213 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35467] snapshot.SnapshotManager(333): Deleting snapshot: testWithMockedMapReduceMultiRegion 2023-02-15 20:01:40,215 INFO [Listener at localhost/43553] client.HBaseAdmin$15(890): Started disable of testWithMockedMapReduceMultiRegion 2023-02-15 20:01:40,215 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35467] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testWithMockedMapReduceMultiRegion 2023-02-15 20:01:40,216 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35467] procedure2.ProcedureExecutor(1029): Stored pid=33, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testWithMockedMapReduceMultiRegion 2023-02-15 20:01:40,219 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676491300219"}]},"ts":"1676491300219"} 2023-02-15 20:01:40,219 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35467] master.MasterRpcServices(1227): Checking to see if procedure is done pid=33 2023-02-15 20:01:40,220 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testWithMockedMapReduceMultiRegion, state=DISABLING in hbase:meta 2023-02-15 20:01:40,222 INFO [PEWorker-5] procedure.DisableTableProcedure(293): Set testWithMockedMapReduceMultiRegion to state=DISABLING 2023-02-15 20:01:40,222 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=34, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=5e40ee2d96ae1cbe88d7c194cd72dda2, UNASSIGN}, {pid=35, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=6f4ab26e6b0d69c90f3b3b848034eb88, UNASSIGN}, {pid=36, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=85c1d4ec199a8eac4595716bde5173ab, UNASSIGN}, {pid=37, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=5a8c9c21a9831b445d533dd705940e06, UNASSIGN}, {pid=38, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=007dd63b20f9d2149ba11df9b0cddc4c, UNASSIGN}, {pid=39, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=c069ee68dab22f36ea73f04b91933c1f, UNASSIGN}, {pid=40, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=81644ccf4d63c864b007cbc1043831d7, UNASSIGN}, {pid=41, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=fe51e97cb822f497ca56994d85f7310f, UNASSIGN}, {pid=42, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=8a79eee6aefc962407df2ed05672c891, UNASSIGN}, {pid=43, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=4229d692a52fca982c3f6193911c155d, UNASSIGN}] 2023-02-15 20:01:40,224 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=35, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=6f4ab26e6b0d69c90f3b3b848034eb88, UNASSIGN 2023-02-15 20:01:40,224 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=34, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=5e40ee2d96ae1cbe88d7c194cd72dda2, UNASSIGN 2023-02-15 20:01:40,224 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=36, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=85c1d4ec199a8eac4595716bde5173ab, UNASSIGN 2023-02-15 20:01:40,225 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=37, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=5a8c9c21a9831b445d533dd705940e06, UNASSIGN 2023-02-15 20:01:40,225 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=43, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=4229d692a52fca982c3f6193911c155d, UNASSIGN 2023-02-15 20:01:40,225 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=35 updating hbase:meta row=6f4ab26e6b0d69c90f3b3b848034eb88, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,36625,1676491293696 2023-02-15 20:01:40,225 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=36 updating hbase:meta row=85c1d4ec199a8eac4595716bde5173ab, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,40517,1676491293664 2023-02-15 20:01:40,225 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=34 updating hbase:meta row=5e40ee2d96ae1cbe88d7c194cd72dda2, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,36625,1676491293696 2023-02-15 20:01:40,225 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,aaa,1676491296789.6f4ab26e6b0d69c90f3b3b848034eb88.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676491300225"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676491300225"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676491300225"}]},"ts":"1676491300225"} 2023-02-15 20:01:40,225 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,,1676491296789.5e40ee2d96ae1cbe88d7c194cd72dda2.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1676491300225"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676491300225"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676491300225"}]},"ts":"1676491300225"} 2023-02-15 20:01:40,225 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,d\\x84\\x84,1676491296789.85c1d4ec199a8eac4595716bde5173ab.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676491300225"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676491300225"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676491300225"}]},"ts":"1676491300225"} 2023-02-15 20:01:40,226 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=5a8c9c21a9831b445d533dd705940e06, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,40517,1676491293664 2023-02-15 20:01:40,226 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,g\\xA7\\xA7,1676491296789.5a8c9c21a9831b445d533dd705940e06.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676491300226"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676491300226"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676491300226"}]},"ts":"1676491300226"} 2023-02-15 20:01:40,226 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=4229d692a52fca982c3f6193911c155d, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,40517,1676491293664 2023-02-15 20:01:40,226 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,zz{,1676491296789.4229d692a52fca982c3f6193911c155d.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1676491300226"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676491300226"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676491300226"}]},"ts":"1676491300226"} 2023-02-15 20:01:40,227 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=44, ppid=35, state=RUNNABLE; CloseRegionProcedure 6f4ab26e6b0d69c90f3b3b848034eb88, server=jenkins-hbase4.apache.org,36625,1676491293696}] 2023-02-15 20:01:40,228 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=45, ppid=34, state=RUNNABLE; CloseRegionProcedure 5e40ee2d96ae1cbe88d7c194cd72dda2, server=jenkins-hbase4.apache.org,36625,1676491293696}] 2023-02-15 20:01:40,228 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=46, ppid=36, state=RUNNABLE; CloseRegionProcedure 85c1d4ec199a8eac4595716bde5173ab, server=jenkins-hbase4.apache.org,40517,1676491293664}] 2023-02-15 20:01:40,229 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=47, ppid=37, state=RUNNABLE; CloseRegionProcedure 5a8c9c21a9831b445d533dd705940e06, server=jenkins-hbase4.apache.org,40517,1676491293664}] 2023-02-15 20:01:40,231 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=48, ppid=43, state=RUNNABLE; CloseRegionProcedure 4229d692a52fca982c3f6193911c155d, server=jenkins-hbase4.apache.org,40517,1676491293664}] 2023-02-15 20:01:40,231 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=42, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=8a79eee6aefc962407df2ed05672c891, UNASSIGN 2023-02-15 20:01:40,232 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=41, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=fe51e97cb822f497ca56994d85f7310f, UNASSIGN 2023-02-15 20:01:40,232 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=40, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=81644ccf4d63c864b007cbc1043831d7, UNASSIGN 2023-02-15 20:01:40,232 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=42 updating hbase:meta row=8a79eee6aefc962407df2ed05672c891, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,36625,1676491293696 2023-02-15 20:01:40,232 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,wWV,1676491296789.8a79eee6aefc962407df2ed05672c891.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676491300232"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676491300232"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676491300232"}]},"ts":"1676491300232"} 2023-02-15 20:01:40,233 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=39, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=c069ee68dab22f36ea73f04b91933c1f, UNASSIGN 2023-02-15 20:01:40,233 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=40 updating hbase:meta row=81644ccf4d63c864b007cbc1043831d7, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,36625,1676491293696 2023-02-15 20:01:40,233 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=41 updating hbase:meta row=fe51e97cb822f497ca56994d85f7310f, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,40517,1676491293664 2023-02-15 20:01:40,233 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,t43,1676491296789.fe51e97cb822f497ca56994d85f7310f.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676491300233"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676491300233"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676491300233"}]},"ts":"1676491300233"} 2023-02-15 20:01:40,234 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,q\\x11\\x10,1676491296789.81644ccf4d63c864b007cbc1043831d7.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676491300233"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676491300233"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676491300233"}]},"ts":"1676491300233"} 2023-02-15 20:01:40,234 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=38, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=007dd63b20f9d2149ba11df9b0cddc4c, UNASSIGN 2023-02-15 20:01:40,234 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=39 updating hbase:meta row=c069ee68dab22f36ea73f04b91933c1f, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,40517,1676491293664 2023-02-15 20:01:40,234 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=49, ppid=42, state=RUNNABLE; CloseRegionProcedure 8a79eee6aefc962407df2ed05672c891, server=jenkins-hbase4.apache.org,36625,1676491293696}] 2023-02-15 20:01:40,234 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,m\\xED\\xED,1676491296789.c069ee68dab22f36ea73f04b91933c1f.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676491300234"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676491300234"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676491300234"}]},"ts":"1676491300234"} 2023-02-15 20:01:40,235 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=007dd63b20f9d2149ba11df9b0cddc4c, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,36625,1676491293696 2023-02-15 20:01:40,235 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,j\\xCA\\xCA,1676491296789.007dd63b20f9d2149ba11df9b0cddc4c.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676491300235"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676491300235"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676491300235"}]},"ts":"1676491300235"} 2023-02-15 20:01:40,235 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=50, ppid=41, state=RUNNABLE; CloseRegionProcedure fe51e97cb822f497ca56994d85f7310f, server=jenkins-hbase4.apache.org,40517,1676491293664}] 2023-02-15 20:01:40,236 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=51, ppid=40, state=RUNNABLE; CloseRegionProcedure 81644ccf4d63c864b007cbc1043831d7, server=jenkins-hbase4.apache.org,36625,1676491293696}] 2023-02-15 20:01:40,241 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=52, ppid=39, state=RUNNABLE; CloseRegionProcedure c069ee68dab22f36ea73f04b91933c1f, server=jenkins-hbase4.apache.org,40517,1676491293664}] 2023-02-15 20:01:40,242 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=53, ppid=38, state=RUNNABLE; CloseRegionProcedure 007dd63b20f9d2149ba11df9b0cddc4c, server=jenkins-hbase4.apache.org,36625,1676491293696}] 2023-02-15 20:01:40,321 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35467] master.MasterRpcServices(1227): Checking to see if procedure is done pid=33 2023-02-15 20:01:40,380 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 81644ccf4d63c864b007cbc1043831d7 2023-02-15 20:01:40,380 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 81644ccf4d63c864b007cbc1043831d7, disabling compactions & flushes 2023-02-15 20:01:40,380 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,q\x11\x10,1676491296789.81644ccf4d63c864b007cbc1043831d7. 2023-02-15 20:01:40,380 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,q\x11\x10,1676491296789.81644ccf4d63c864b007cbc1043831d7. 2023-02-15 20:01:40,380 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,q\x11\x10,1676491296789.81644ccf4d63c864b007cbc1043831d7. after waiting 0 ms 2023-02-15 20:01:40,380 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,q\x11\x10,1676491296789.81644ccf4d63c864b007cbc1043831d7. 2023-02-15 20:01:40,381 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 4229d692a52fca982c3f6193911c155d 2023-02-15 20:01:40,381 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 4229d692a52fca982c3f6193911c155d, disabling compactions & flushes 2023-02-15 20:01:40,381 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,zz{,1676491296789.4229d692a52fca982c3f6193911c155d. 2023-02-15 20:01:40,381 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,zz{,1676491296789.4229d692a52fca982c3f6193911c155d. 2023-02-15 20:01:40,381 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,zz{,1676491296789.4229d692a52fca982c3f6193911c155d. after waiting 0 ms 2023-02-15 20:01:40,381 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,zz{,1676491296789.4229d692a52fca982c3f6193911c155d. 2023-02-15 20:01:40,384 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/data/default/testWithMockedMapReduceMultiRegion/4229d692a52fca982c3f6193911c155d/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-02-15 20:01:40,384 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/data/default/testWithMockedMapReduceMultiRegion/81644ccf4d63c864b007cbc1043831d7/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-15 20:01:40,385 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,zz{,1676491296789.4229d692a52fca982c3f6193911c155d. 2023-02-15 20:01:40,385 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 4229d692a52fca982c3f6193911c155d: 2023-02-15 20:01:40,385 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,q\x11\x10,1676491296789.81644ccf4d63c864b007cbc1043831d7. 2023-02-15 20:01:40,385 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 81644ccf4d63c864b007cbc1043831d7: 2023-02-15 20:01:40,386 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 81644ccf4d63c864b007cbc1043831d7 2023-02-15 20:01:40,386 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 5e40ee2d96ae1cbe88d7c194cd72dda2 2023-02-15 20:01:40,386 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 5e40ee2d96ae1cbe88d7c194cd72dda2, disabling compactions & flushes 2023-02-15 20:01:40,386 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,,1676491296789.5e40ee2d96ae1cbe88d7c194cd72dda2. 2023-02-15 20:01:40,386 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,,1676491296789.5e40ee2d96ae1cbe88d7c194cd72dda2. 2023-02-15 20:01:40,386 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,,1676491296789.5e40ee2d96ae1cbe88d7c194cd72dda2. after waiting 0 ms 2023-02-15 20:01:40,386 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,,1676491296789.5e40ee2d96ae1cbe88d7c194cd72dda2. 2023-02-15 20:01:40,386 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=40 updating hbase:meta row=81644ccf4d63c864b007cbc1043831d7, regionState=CLOSED 2023-02-15 20:01:40,387 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,q\\x11\\x10,1676491296789.81644ccf4d63c864b007cbc1043831d7.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676491300386"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676491300386"}]},"ts":"1676491300386"} 2023-02-15 20:01:40,387 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 4229d692a52fca982c3f6193911c155d 2023-02-15 20:01:40,387 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 5a8c9c21a9831b445d533dd705940e06 2023-02-15 20:01:40,387 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 5a8c9c21a9831b445d533dd705940e06, disabling compactions & flushes 2023-02-15 20:01:40,387 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676491296789.5a8c9c21a9831b445d533dd705940e06. 2023-02-15 20:01:40,387 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676491296789.5a8c9c21a9831b445d533dd705940e06. 2023-02-15 20:01:40,387 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676491296789.5a8c9c21a9831b445d533dd705940e06. after waiting 0 ms 2023-02-15 20:01:40,387 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676491296789.5a8c9c21a9831b445d533dd705940e06. 2023-02-15 20:01:40,387 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=4229d692a52fca982c3f6193911c155d, regionState=CLOSED 2023-02-15 20:01:40,387 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,zz{,1676491296789.4229d692a52fca982c3f6193911c155d.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1676491300387"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676491300387"}]},"ts":"1676491300387"} 2023-02-15 20:01:40,390 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=51, resume processing ppid=40 2023-02-15 20:01:40,390 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=51, ppid=40, state=SUCCESS; CloseRegionProcedure 81644ccf4d63c864b007cbc1043831d7, server=jenkins-hbase4.apache.org,36625,1676491293696 in 152 msec 2023-02-15 20:01:40,390 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/data/default/testWithMockedMapReduceMultiRegion/5e40ee2d96ae1cbe88d7c194cd72dda2/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-02-15 20:01:40,390 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=48, resume processing ppid=43 2023-02-15 20:01:40,391 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=48, ppid=43, state=SUCCESS; CloseRegionProcedure 4229d692a52fca982c3f6193911c155d, server=jenkins-hbase4.apache.org,40517,1676491293664 in 158 msec 2023-02-15 20:01:40,391 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,,1676491296789.5e40ee2d96ae1cbe88d7c194cd72dda2. 2023-02-15 20:01:40,391 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 5e40ee2d96ae1cbe88d7c194cd72dda2: 2023-02-15 20:01:40,391 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=40, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=81644ccf4d63c864b007cbc1043831d7, UNASSIGN in 168 msec 2023-02-15 20:01:40,391 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/data/default/testWithMockedMapReduceMultiRegion/5a8c9c21a9831b445d533dd705940e06/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-15 20:01:40,391 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676491296789.5a8c9c21a9831b445d533dd705940e06. 2023-02-15 20:01:40,391 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 5a8c9c21a9831b445d533dd705940e06: 2023-02-15 20:01:40,392 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=43, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=4229d692a52fca982c3f6193911c155d, UNASSIGN in 168 msec 2023-02-15 20:01:40,392 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 5e40ee2d96ae1cbe88d7c194cd72dda2 2023-02-15 20:01:40,392 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 8a79eee6aefc962407df2ed05672c891 2023-02-15 20:01:40,392 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 8a79eee6aefc962407df2ed05672c891, disabling compactions & flushes 2023-02-15 20:01:40,392 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,wWV,1676491296789.8a79eee6aefc962407df2ed05672c891. 2023-02-15 20:01:40,392 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,wWV,1676491296789.8a79eee6aefc962407df2ed05672c891. 2023-02-15 20:01:40,392 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,wWV,1676491296789.8a79eee6aefc962407df2ed05672c891. after waiting 0 ms 2023-02-15 20:01:40,392 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,wWV,1676491296789.8a79eee6aefc962407df2ed05672c891. 2023-02-15 20:01:40,393 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=34 updating hbase:meta row=5e40ee2d96ae1cbe88d7c194cd72dda2, regionState=CLOSED 2023-02-15 20:01:40,393 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,,1676491296789.5e40ee2d96ae1cbe88d7c194cd72dda2.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1676491300392"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676491300392"}]},"ts":"1676491300392"} 2023-02-15 20:01:40,393 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 5a8c9c21a9831b445d533dd705940e06 2023-02-15 20:01:40,393 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 85c1d4ec199a8eac4595716bde5173ab 2023-02-15 20:01:40,393 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 85c1d4ec199a8eac4595716bde5173ab, disabling compactions & flushes 2023-02-15 20:01:40,393 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,d\x84\x84,1676491296789.85c1d4ec199a8eac4595716bde5173ab. 2023-02-15 20:01:40,393 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,d\x84\x84,1676491296789.85c1d4ec199a8eac4595716bde5173ab. 2023-02-15 20:01:40,393 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,d\x84\x84,1676491296789.85c1d4ec199a8eac4595716bde5173ab. after waiting 0 ms 2023-02-15 20:01:40,393 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,d\x84\x84,1676491296789.85c1d4ec199a8eac4595716bde5173ab. 2023-02-15 20:01:40,393 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=5a8c9c21a9831b445d533dd705940e06, regionState=CLOSED 2023-02-15 20:01:40,394 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,g\\xA7\\xA7,1676491296789.5a8c9c21a9831b445d533dd705940e06.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676491300393"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676491300393"}]},"ts":"1676491300393"} 2023-02-15 20:01:40,396 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=45, resume processing ppid=34 2023-02-15 20:01:40,396 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=45, ppid=34, state=SUCCESS; CloseRegionProcedure 5e40ee2d96ae1cbe88d7c194cd72dda2, server=jenkins-hbase4.apache.org,36625,1676491293696 in 166 msec 2023-02-15 20:01:40,397 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=47, resume processing ppid=37 2023-02-15 20:01:40,397 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=34, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=5e40ee2d96ae1cbe88d7c194cd72dda2, UNASSIGN in 174 msec 2023-02-15 20:01:40,397 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=47, ppid=37, state=SUCCESS; CloseRegionProcedure 5a8c9c21a9831b445d533dd705940e06, server=jenkins-hbase4.apache.org,40517,1676491293664 in 166 msec 2023-02-15 20:01:40,397 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/data/default/testWithMockedMapReduceMultiRegion/8a79eee6aefc962407df2ed05672c891/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-15 20:01:40,398 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,wWV,1676491296789.8a79eee6aefc962407df2ed05672c891. 2023-02-15 20:01:40,398 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 8a79eee6aefc962407df2ed05672c891: 2023-02-15 20:01:40,398 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=37, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=5a8c9c21a9831b445d533dd705940e06, UNASSIGN in 175 msec 2023-02-15 20:01:40,398 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/data/default/testWithMockedMapReduceMultiRegion/85c1d4ec199a8eac4595716bde5173ab/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-15 20:01:40,399 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 8a79eee6aefc962407df2ed05672c891 2023-02-15 20:01:40,399 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 6f4ab26e6b0d69c90f3b3b848034eb88 2023-02-15 20:01:40,399 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,d\x84\x84,1676491296789.85c1d4ec199a8eac4595716bde5173ab. 2023-02-15 20:01:40,399 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 6f4ab26e6b0d69c90f3b3b848034eb88, disabling compactions & flushes 2023-02-15 20:01:40,399 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 85c1d4ec199a8eac4595716bde5173ab: 2023-02-15 20:01:40,399 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,aaa,1676491296789.6f4ab26e6b0d69c90f3b3b848034eb88. 2023-02-15 20:01:40,399 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,aaa,1676491296789.6f4ab26e6b0d69c90f3b3b848034eb88. 2023-02-15 20:01:40,399 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=42 updating hbase:meta row=8a79eee6aefc962407df2ed05672c891, regionState=CLOSED 2023-02-15 20:01:40,399 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,aaa,1676491296789.6f4ab26e6b0d69c90f3b3b848034eb88. after waiting 0 ms 2023-02-15 20:01:40,399 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,aaa,1676491296789.6f4ab26e6b0d69c90f3b3b848034eb88. 2023-02-15 20:01:40,399 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,wWV,1676491296789.8a79eee6aefc962407df2ed05672c891.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676491300399"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676491300399"}]},"ts":"1676491300399"} 2023-02-15 20:01:40,400 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 85c1d4ec199a8eac4595716bde5173ab 2023-02-15 20:01:40,400 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close fe51e97cb822f497ca56994d85f7310f 2023-02-15 20:01:40,400 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing fe51e97cb822f497ca56994d85f7310f, disabling compactions & flushes 2023-02-15 20:01:40,401 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,t43,1676491296789.fe51e97cb822f497ca56994d85f7310f. 2023-02-15 20:01:40,401 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,t43,1676491296789.fe51e97cb822f497ca56994d85f7310f. 2023-02-15 20:01:40,401 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,t43,1676491296789.fe51e97cb822f497ca56994d85f7310f. after waiting 0 ms 2023-02-15 20:01:40,401 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,t43,1676491296789.fe51e97cb822f497ca56994d85f7310f. 2023-02-15 20:01:40,401 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=36 updating hbase:meta row=85c1d4ec199a8eac4595716bde5173ab, regionState=CLOSED 2023-02-15 20:01:40,401 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,d\\x84\\x84,1676491296789.85c1d4ec199a8eac4595716bde5173ab.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676491300401"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676491300401"}]},"ts":"1676491300401"} 2023-02-15 20:01:40,403 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=49, resume processing ppid=42 2023-02-15 20:01:40,403 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=49, ppid=42, state=SUCCESS; CloseRegionProcedure 8a79eee6aefc962407df2ed05672c891, server=jenkins-hbase4.apache.org,36625,1676491293696 in 167 msec 2023-02-15 20:01:40,404 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/data/default/testWithMockedMapReduceMultiRegion/6f4ab26e6b0d69c90f3b3b848034eb88/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-15 20:01:40,404 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=46, resume processing ppid=36 2023-02-15 20:01:40,404 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=42, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=8a79eee6aefc962407df2ed05672c891, UNASSIGN in 181 msec 2023-02-15 20:01:40,405 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=46, ppid=36, state=SUCCESS; CloseRegionProcedure 85c1d4ec199a8eac4595716bde5173ab, server=jenkins-hbase4.apache.org,40517,1676491293664 in 174 msec 2023-02-15 20:01:40,405 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,aaa,1676491296789.6f4ab26e6b0d69c90f3b3b848034eb88. 2023-02-15 20:01:40,405 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 6f4ab26e6b0d69c90f3b3b848034eb88: 2023-02-15 20:01:40,406 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=36, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=85c1d4ec199a8eac4595716bde5173ab, UNASSIGN in 183 msec 2023-02-15 20:01:40,408 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/data/default/testWithMockedMapReduceMultiRegion/fe51e97cb822f497ca56994d85f7310f/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-15 20:01:40,409 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=35 updating hbase:meta row=6f4ab26e6b0d69c90f3b3b848034eb88, regionState=CLOSED 2023-02-15 20:01:40,409 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,t43,1676491296789.fe51e97cb822f497ca56994d85f7310f. 2023-02-15 20:01:40,409 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for fe51e97cb822f497ca56994d85f7310f: 2023-02-15 20:01:40,409 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,aaa,1676491296789.6f4ab26e6b0d69c90f3b3b848034eb88.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676491300408"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676491300408"}]},"ts":"1676491300408"} 2023-02-15 20:01:40,411 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 6f4ab26e6b0d69c90f3b3b848034eb88 2023-02-15 20:01:40,411 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 007dd63b20f9d2149ba11df9b0cddc4c 2023-02-15 20:01:40,411 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 007dd63b20f9d2149ba11df9b0cddc4c, disabling compactions & flushes 2023-02-15 20:01:40,411 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676491296789.007dd63b20f9d2149ba11df9b0cddc4c. 2023-02-15 20:01:40,411 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676491296789.007dd63b20f9d2149ba11df9b0cddc4c. 2023-02-15 20:01:40,411 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676491296789.007dd63b20f9d2149ba11df9b0cddc4c. after waiting 0 ms 2023-02-15 20:01:40,411 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676491296789.007dd63b20f9d2149ba11df9b0cddc4c. 2023-02-15 20:01:40,417 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed fe51e97cb822f497ca56994d85f7310f 2023-02-15 20:01:40,417 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close c069ee68dab22f36ea73f04b91933c1f 2023-02-15 20:01:40,417 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing c069ee68dab22f36ea73f04b91933c1f, disabling compactions & flushes 2023-02-15 20:01:40,417 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,m\xED\xED,1676491296789.c069ee68dab22f36ea73f04b91933c1f. 2023-02-15 20:01:40,417 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,m\xED\xED,1676491296789.c069ee68dab22f36ea73f04b91933c1f. 2023-02-15 20:01:40,417 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,m\xED\xED,1676491296789.c069ee68dab22f36ea73f04b91933c1f. after waiting 0 ms 2023-02-15 20:01:40,417 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,m\xED\xED,1676491296789.c069ee68dab22f36ea73f04b91933c1f. 2023-02-15 20:01:40,418 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=41 updating hbase:meta row=fe51e97cb822f497ca56994d85f7310f, regionState=CLOSED 2023-02-15 20:01:40,418 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,t43,1676491296789.fe51e97cb822f497ca56994d85f7310f.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676491300417"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676491300417"}]},"ts":"1676491300417"} 2023-02-15 20:01:40,418 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=44, resume processing ppid=35 2023-02-15 20:01:40,418 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=44, ppid=35, state=SUCCESS; CloseRegionProcedure 6f4ab26e6b0d69c90f3b3b848034eb88, server=jenkins-hbase4.apache.org,36625,1676491293696 in 183 msec 2023-02-15 20:01:40,420 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=35, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=6f4ab26e6b0d69c90f3b3b848034eb88, UNASSIGN in 196 msec 2023-02-15 20:01:40,420 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/data/default/testWithMockedMapReduceMultiRegion/007dd63b20f9d2149ba11df9b0cddc4c/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-15 20:01:40,421 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=50, resume processing ppid=41 2023-02-15 20:01:40,421 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676491296789.007dd63b20f9d2149ba11df9b0cddc4c. 2023-02-15 20:01:40,421 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=50, ppid=41, state=SUCCESS; CloseRegionProcedure fe51e97cb822f497ca56994d85f7310f, server=jenkins-hbase4.apache.org,40517,1676491293664 in 184 msec 2023-02-15 20:01:40,421 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 007dd63b20f9d2149ba11df9b0cddc4c: 2023-02-15 20:01:40,422 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=41, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=fe51e97cb822f497ca56994d85f7310f, UNASSIGN in 199 msec 2023-02-15 20:01:40,423 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 007dd63b20f9d2149ba11df9b0cddc4c 2023-02-15 20:01:40,423 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=007dd63b20f9d2149ba11df9b0cddc4c, regionState=CLOSED 2023-02-15 20:01:40,423 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,j\\xCA\\xCA,1676491296789.007dd63b20f9d2149ba11df9b0cddc4c.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676491300423"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676491300423"}]},"ts":"1676491300423"} 2023-02-15 20:01:40,423 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/data/default/testWithMockedMapReduceMultiRegion/c069ee68dab22f36ea73f04b91933c1f/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-15 20:01:40,424 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,m\xED\xED,1676491296789.c069ee68dab22f36ea73f04b91933c1f. 2023-02-15 20:01:40,424 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for c069ee68dab22f36ea73f04b91933c1f: 2023-02-15 20:01:40,425 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed c069ee68dab22f36ea73f04b91933c1f 2023-02-15 20:01:40,425 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=39 updating hbase:meta row=c069ee68dab22f36ea73f04b91933c1f, regionState=CLOSED 2023-02-15 20:01:40,426 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,m\\xED\\xED,1676491296789.c069ee68dab22f36ea73f04b91933c1f.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676491300425"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676491300425"}]},"ts":"1676491300425"} 2023-02-15 20:01:40,426 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=53, resume processing ppid=38 2023-02-15 20:01:40,426 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=53, ppid=38, state=SUCCESS; CloseRegionProcedure 007dd63b20f9d2149ba11df9b0cddc4c, server=jenkins-hbase4.apache.org,36625,1676491293696 in 182 msec 2023-02-15 20:01:40,427 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=38, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=007dd63b20f9d2149ba11df9b0cddc4c, UNASSIGN in 204 msec 2023-02-15 20:01:40,428 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=52, resume processing ppid=39 2023-02-15 20:01:40,428 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=52, ppid=39, state=SUCCESS; CloseRegionProcedure c069ee68dab22f36ea73f04b91933c1f, server=jenkins-hbase4.apache.org,40517,1676491293664 in 190 msec 2023-02-15 20:01:40,429 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=39, resume processing ppid=33 2023-02-15 20:01:40,429 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=39, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=c069ee68dab22f36ea73f04b91933c1f, UNASSIGN in 206 msec 2023-02-15 20:01:40,430 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676491300430"}]},"ts":"1676491300430"} 2023-02-15 20:01:40,431 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testWithMockedMapReduceMultiRegion, state=DISABLED in hbase:meta 2023-02-15 20:01:40,432 INFO [PEWorker-5] procedure.DisableTableProcedure(305): Set testWithMockedMapReduceMultiRegion to state=DISABLED 2023-02-15 20:01:40,434 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=33, state=SUCCESS; DisableTableProcedure table=testWithMockedMapReduceMultiRegion in 218 msec 2023-02-15 20:01:40,522 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35467] master.MasterRpcServices(1227): Checking to see if procedure is done pid=33 2023-02-15 20:01:40,522 INFO [Listener at localhost/43553] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testWithMockedMapReduceMultiRegion, procId: 33 completed 2023-02-15 20:01:40,523 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35467] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testWithMockedMapReduceMultiRegion 2023-02-15 20:01:40,524 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35467] procedure2.ProcedureExecutor(1029): Stored pid=54, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testWithMockedMapReduceMultiRegion 2023-02-15 20:01:40,526 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=54, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testWithMockedMapReduceMultiRegion 2023-02-15 20:01:40,527 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=54, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testWithMockedMapReduceMultiRegion 2023-02-15 20:01:40,527 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35467] master.MasterRpcServices(1227): Checking to see if procedure is done pid=54 2023-02-15 20:01:40,537 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/.tmp/data/default/testWithMockedMapReduceMultiRegion/5e40ee2d96ae1cbe88d7c194cd72dda2 2023-02-15 20:01:40,537 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/.tmp/data/default/testWithMockedMapReduceMultiRegion/007dd63b20f9d2149ba11df9b0cddc4c 2023-02-15 20:01:40,537 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/.tmp/data/default/testWithMockedMapReduceMultiRegion/c069ee68dab22f36ea73f04b91933c1f 2023-02-15 20:01:40,537 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/.tmp/data/default/testWithMockedMapReduceMultiRegion/81644ccf4d63c864b007cbc1043831d7 2023-02-15 20:01:40,537 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/.tmp/data/default/testWithMockedMapReduceMultiRegion/85c1d4ec199a8eac4595716bde5173ab 2023-02-15 20:01:40,537 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/.tmp/data/default/testWithMockedMapReduceMultiRegion/5a8c9c21a9831b445d533dd705940e06 2023-02-15 20:01:40,537 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/.tmp/data/default/testWithMockedMapReduceMultiRegion/6f4ab26e6b0d69c90f3b3b848034eb88 2023-02-15 20:01:40,538 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/.tmp/data/default/testWithMockedMapReduceMultiRegion/fe51e97cb822f497ca56994d85f7310f 2023-02-15 20:01:40,541 DEBUG [HFileArchiver-1] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/.tmp/data/default/testWithMockedMapReduceMultiRegion/5e40ee2d96ae1cbe88d7c194cd72dda2/f1, FileablePath, hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/.tmp/data/default/testWithMockedMapReduceMultiRegion/5e40ee2d96ae1cbe88d7c194cd72dda2/f2, FileablePath, hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/.tmp/data/default/testWithMockedMapReduceMultiRegion/5e40ee2d96ae1cbe88d7c194cd72dda2/recovered.edits] 2023-02-15 20:01:40,542 DEBUG [HFileArchiver-3] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/.tmp/data/default/testWithMockedMapReduceMultiRegion/81644ccf4d63c864b007cbc1043831d7/f1, FileablePath, hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/.tmp/data/default/testWithMockedMapReduceMultiRegion/81644ccf4d63c864b007cbc1043831d7/f2, FileablePath, hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/.tmp/data/default/testWithMockedMapReduceMultiRegion/81644ccf4d63c864b007cbc1043831d7/recovered.edits] 2023-02-15 20:01:40,542 DEBUG [HFileArchiver-8] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/.tmp/data/default/testWithMockedMapReduceMultiRegion/5a8c9c21a9831b445d533dd705940e06/f1, FileablePath, hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/.tmp/data/default/testWithMockedMapReduceMultiRegion/5a8c9c21a9831b445d533dd705940e06/f2, FileablePath, hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/.tmp/data/default/testWithMockedMapReduceMultiRegion/5a8c9c21a9831b445d533dd705940e06/recovered.edits] 2023-02-15 20:01:40,542 DEBUG [HFileArchiver-4] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/.tmp/data/default/testWithMockedMapReduceMultiRegion/fe51e97cb822f497ca56994d85f7310f/f1, FileablePath, hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/.tmp/data/default/testWithMockedMapReduceMultiRegion/fe51e97cb822f497ca56994d85f7310f/f2, FileablePath, hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/.tmp/data/default/testWithMockedMapReduceMultiRegion/fe51e97cb822f497ca56994d85f7310f/recovered.edits] 2023-02-15 20:01:40,543 DEBUG [HFileArchiver-2] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/.tmp/data/default/testWithMockedMapReduceMultiRegion/c069ee68dab22f36ea73f04b91933c1f/f1, FileablePath, hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/.tmp/data/default/testWithMockedMapReduceMultiRegion/c069ee68dab22f36ea73f04b91933c1f/f2, FileablePath, hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/.tmp/data/default/testWithMockedMapReduceMultiRegion/c069ee68dab22f36ea73f04b91933c1f/recovered.edits] 2023-02-15 20:01:40,543 DEBUG [HFileArchiver-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/.tmp/data/default/testWithMockedMapReduceMultiRegion/007dd63b20f9d2149ba11df9b0cddc4c/f1, FileablePath, hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/.tmp/data/default/testWithMockedMapReduceMultiRegion/007dd63b20f9d2149ba11df9b0cddc4c/f2, FileablePath, hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/.tmp/data/default/testWithMockedMapReduceMultiRegion/007dd63b20f9d2149ba11df9b0cddc4c/recovered.edits] 2023-02-15 20:01:40,544 DEBUG [HFileArchiver-6] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/.tmp/data/default/testWithMockedMapReduceMultiRegion/6f4ab26e6b0d69c90f3b3b848034eb88/f1, FileablePath, hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/.tmp/data/default/testWithMockedMapReduceMultiRegion/6f4ab26e6b0d69c90f3b3b848034eb88/f2, FileablePath, hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/.tmp/data/default/testWithMockedMapReduceMultiRegion/6f4ab26e6b0d69c90f3b3b848034eb88/recovered.edits] 2023-02-15 20:01:40,545 DEBUG [HFileArchiver-7] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/.tmp/data/default/testWithMockedMapReduceMultiRegion/85c1d4ec199a8eac4595716bde5173ab/f1, FileablePath, hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/.tmp/data/default/testWithMockedMapReduceMultiRegion/85c1d4ec199a8eac4595716bde5173ab/f2, FileablePath, hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/.tmp/data/default/testWithMockedMapReduceMultiRegion/85c1d4ec199a8eac4595716bde5173ab/recovered.edits] 2023-02-15 20:01:40,551 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/.tmp/data/default/testWithMockedMapReduceMultiRegion/c069ee68dab22f36ea73f04b91933c1f/f1/2f4c6c52f5c344889299ea3c60a85a43 to hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/archive/data/default/testWithMockedMapReduceMultiRegion/c069ee68dab22f36ea73f04b91933c1f/f1/2f4c6c52f5c344889299ea3c60a85a43 2023-02-15 20:01:40,552 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/.tmp/data/default/testWithMockedMapReduceMultiRegion/81644ccf4d63c864b007cbc1043831d7/f1/2771400ae1e3406092833cb8cde650c5 to hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/archive/data/default/testWithMockedMapReduceMultiRegion/81644ccf4d63c864b007cbc1043831d7/f1/2771400ae1e3406092833cb8cde650c5 2023-02-15 20:01:40,552 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/.tmp/data/default/testWithMockedMapReduceMultiRegion/5a8c9c21a9831b445d533dd705940e06/f1/1d2809fc4a064e16b6346360287eb0f5 to hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/archive/data/default/testWithMockedMapReduceMultiRegion/5a8c9c21a9831b445d533dd705940e06/f1/1d2809fc4a064e16b6346360287eb0f5 2023-02-15 20:01:40,554 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/.tmp/data/default/testWithMockedMapReduceMultiRegion/007dd63b20f9d2149ba11df9b0cddc4c/f1/aa1115a9d4064ac3aa45dca955ad1677 to hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/archive/data/default/testWithMockedMapReduceMultiRegion/007dd63b20f9d2149ba11df9b0cddc4c/f1/aa1115a9d4064ac3aa45dca955ad1677 2023-02-15 20:01:40,554 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/.tmp/data/default/testWithMockedMapReduceMultiRegion/fe51e97cb822f497ca56994d85f7310f/f1/0da61d44a36946a49779016090ef9445 to hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/archive/data/default/testWithMockedMapReduceMultiRegion/fe51e97cb822f497ca56994d85f7310f/f1/0da61d44a36946a49779016090ef9445 2023-02-15 20:01:40,554 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/.tmp/data/default/testWithMockedMapReduceMultiRegion/6f4ab26e6b0d69c90f3b3b848034eb88/f1/1b36597b06c345f989d18290d69f759e to hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/archive/data/default/testWithMockedMapReduceMultiRegion/6f4ab26e6b0d69c90f3b3b848034eb88/f1/1b36597b06c345f989d18290d69f759e 2023-02-15 20:01:40,555 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/.tmp/data/default/testWithMockedMapReduceMultiRegion/85c1d4ec199a8eac4595716bde5173ab/f1/962aca7e712640d4b681c9c3a5fba101 to hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/archive/data/default/testWithMockedMapReduceMultiRegion/85c1d4ec199a8eac4595716bde5173ab/f1/962aca7e712640d4b681c9c3a5fba101 2023-02-15 20:01:40,555 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/.tmp/data/default/testWithMockedMapReduceMultiRegion/5a8c9c21a9831b445d533dd705940e06/f1/9234478382f54f4bb536e887f01e40aa to hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/archive/data/default/testWithMockedMapReduceMultiRegion/5a8c9c21a9831b445d533dd705940e06/f1/9234478382f54f4bb536e887f01e40aa 2023-02-15 20:01:40,555 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/.tmp/data/default/testWithMockedMapReduceMultiRegion/c069ee68dab22f36ea73f04b91933c1f/f1/fed3c1f0213342888f3271582470bf94 to hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/archive/data/default/testWithMockedMapReduceMultiRegion/c069ee68dab22f36ea73f04b91933c1f/f1/fed3c1f0213342888f3271582470bf94 2023-02-15 20:01:40,556 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/.tmp/data/default/testWithMockedMapReduceMultiRegion/81644ccf4d63c864b007cbc1043831d7/f1/fb4bdc3d94724124875e2d8667bf63a6 to hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/archive/data/default/testWithMockedMapReduceMultiRegion/81644ccf4d63c864b007cbc1043831d7/f1/fb4bdc3d94724124875e2d8667bf63a6 2023-02-15 20:01:40,556 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/.tmp/data/default/testWithMockedMapReduceMultiRegion/5e40ee2d96ae1cbe88d7c194cd72dda2/recovered.edits/6.seqid to hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/archive/data/default/testWithMockedMapReduceMultiRegion/5e40ee2d96ae1cbe88d7c194cd72dda2/recovered.edits/6.seqid 2023-02-15 20:01:40,557 DEBUG [HFileArchiver-1] backup.HFileArchiver(596): Deleted hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/.tmp/data/default/testWithMockedMapReduceMultiRegion/5e40ee2d96ae1cbe88d7c194cd72dda2 2023-02-15 20:01:40,557 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/.tmp/data/default/testWithMockedMapReduceMultiRegion/8a79eee6aefc962407df2ed05672c891 2023-02-15 20:01:40,558 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/.tmp/data/default/testWithMockedMapReduceMultiRegion/fe51e97cb822f497ca56994d85f7310f/f1/c1a97639638e4b599326b2351fb63a31 to hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/archive/data/default/testWithMockedMapReduceMultiRegion/fe51e97cb822f497ca56994d85f7310f/f1/c1a97639638e4b599326b2351fb63a31 2023-02-15 20:01:40,558 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/.tmp/data/default/testWithMockedMapReduceMultiRegion/007dd63b20f9d2149ba11df9b0cddc4c/f1/d178029f0da34cc3a3f4cc28583f9032 to hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/archive/data/default/testWithMockedMapReduceMultiRegion/007dd63b20f9d2149ba11df9b0cddc4c/f1/d178029f0da34cc3a3f4cc28583f9032 2023-02-15 20:01:40,558 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/.tmp/data/default/testWithMockedMapReduceMultiRegion/6f4ab26e6b0d69c90f3b3b848034eb88/f1/3f7b594ca3bd4926a8a99a9121c8d412 to hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/archive/data/default/testWithMockedMapReduceMultiRegion/6f4ab26e6b0d69c90f3b3b848034eb88/f1/3f7b594ca3bd4926a8a99a9121c8d412 2023-02-15 20:01:40,559 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/.tmp/data/default/testWithMockedMapReduceMultiRegion/85c1d4ec199a8eac4595716bde5173ab/f1/b5aef1f75a2242a8bdcd7dd44b0b4202 to hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/archive/data/default/testWithMockedMapReduceMultiRegion/85c1d4ec199a8eac4595716bde5173ab/f1/b5aef1f75a2242a8bdcd7dd44b0b4202 2023-02-15 20:01:40,561 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/.tmp/data/default/testWithMockedMapReduceMultiRegion/81644ccf4d63c864b007cbc1043831d7/f2/2f1f47a490914b27b07597aeb3ec00b8 to hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/archive/data/default/testWithMockedMapReduceMultiRegion/81644ccf4d63c864b007cbc1043831d7/f2/2f1f47a490914b27b07597aeb3ec00b8 2023-02-15 20:01:40,563 DEBUG [HFileArchiver-1] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/.tmp/data/default/testWithMockedMapReduceMultiRegion/8a79eee6aefc962407df2ed05672c891/f1, FileablePath, hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/.tmp/data/default/testWithMockedMapReduceMultiRegion/8a79eee6aefc962407df2ed05672c891/f2, FileablePath, hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/.tmp/data/default/testWithMockedMapReduceMultiRegion/8a79eee6aefc962407df2ed05672c891/recovered.edits] 2023-02-15 20:01:40,563 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/.tmp/data/default/testWithMockedMapReduceMultiRegion/c069ee68dab22f36ea73f04b91933c1f/f2/9bdc52e7055042b9a096d19df5046458 to hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/archive/data/default/testWithMockedMapReduceMultiRegion/c069ee68dab22f36ea73f04b91933c1f/f2/9bdc52e7055042b9a096d19df5046458 2023-02-15 20:01:40,564 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/.tmp/data/default/testWithMockedMapReduceMultiRegion/85c1d4ec199a8eac4595716bde5173ab/f2/a28dbcbe704a4e08bc1990b76ccf55bb to hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/archive/data/default/testWithMockedMapReduceMultiRegion/85c1d4ec199a8eac4595716bde5173ab/f2/a28dbcbe704a4e08bc1990b76ccf55bb 2023-02-15 20:01:40,564 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/.tmp/data/default/testWithMockedMapReduceMultiRegion/5a8c9c21a9831b445d533dd705940e06/f2/12f96a77e5ac4e01a5e7db780638b575 to hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/archive/data/default/testWithMockedMapReduceMultiRegion/5a8c9c21a9831b445d533dd705940e06/f2/12f96a77e5ac4e01a5e7db780638b575 2023-02-15 20:01:40,564 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/.tmp/data/default/testWithMockedMapReduceMultiRegion/81644ccf4d63c864b007cbc1043831d7/f2/733954210de04b5bbfdd845e215b9699 to hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/archive/data/default/testWithMockedMapReduceMultiRegion/81644ccf4d63c864b007cbc1043831d7/f2/733954210de04b5bbfdd845e215b9699 2023-02-15 20:01:40,565 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/.tmp/data/default/testWithMockedMapReduceMultiRegion/fe51e97cb822f497ca56994d85f7310f/f2/f3c0d03963c14c6198531acdd3e68d60 to hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/archive/data/default/testWithMockedMapReduceMultiRegion/fe51e97cb822f497ca56994d85f7310f/f2/f3c0d03963c14c6198531acdd3e68d60 2023-02-15 20:01:40,565 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/.tmp/data/default/testWithMockedMapReduceMultiRegion/007dd63b20f9d2149ba11df9b0cddc4c/f2/5e5a7c1eb19242da9b6862d34233d0ee to hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/archive/data/default/testWithMockedMapReduceMultiRegion/007dd63b20f9d2149ba11df9b0cddc4c/f2/5e5a7c1eb19242da9b6862d34233d0ee 2023-02-15 20:01:40,566 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/.tmp/data/default/testWithMockedMapReduceMultiRegion/5a8c9c21a9831b445d533dd705940e06/f2/1a99564336744e84ab20ab08428e951b to hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/archive/data/default/testWithMockedMapReduceMultiRegion/5a8c9c21a9831b445d533dd705940e06/f2/1a99564336744e84ab20ab08428e951b 2023-02-15 20:01:40,566 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/.tmp/data/default/testWithMockedMapReduceMultiRegion/6f4ab26e6b0d69c90f3b3b848034eb88/f2/0109ebdc9a594bde949d22a23c8a64cb to hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/archive/data/default/testWithMockedMapReduceMultiRegion/6f4ab26e6b0d69c90f3b3b848034eb88/f2/0109ebdc9a594bde949d22a23c8a64cb 2023-02-15 20:01:40,567 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/.tmp/data/default/testWithMockedMapReduceMultiRegion/85c1d4ec199a8eac4595716bde5173ab/f2/e929536a3a6a46789ae2ba83a0ba01f2 to hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/archive/data/default/testWithMockedMapReduceMultiRegion/85c1d4ec199a8eac4595716bde5173ab/f2/e929536a3a6a46789ae2ba83a0ba01f2 2023-02-15 20:01:40,567 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/.tmp/data/default/testWithMockedMapReduceMultiRegion/c069ee68dab22f36ea73f04b91933c1f/f2/df5dba58e6904d49b1574ce8bae69d2e to hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/archive/data/default/testWithMockedMapReduceMultiRegion/c069ee68dab22f36ea73f04b91933c1f/f2/df5dba58e6904d49b1574ce8bae69d2e 2023-02-15 20:01:40,577 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/.tmp/data/default/testWithMockedMapReduceMultiRegion/6f4ab26e6b0d69c90f3b3b848034eb88/f2/bca56c6bf49b42d698c76d01b9f6faef to hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/archive/data/default/testWithMockedMapReduceMultiRegion/6f4ab26e6b0d69c90f3b3b848034eb88/f2/bca56c6bf49b42d698c76d01b9f6faef 2023-02-15 20:01:40,577 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/.tmp/data/default/testWithMockedMapReduceMultiRegion/fe51e97cb822f497ca56994d85f7310f/f2/f89e99f5a66b446dbbd303d1e48989e0 to hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/archive/data/default/testWithMockedMapReduceMultiRegion/fe51e97cb822f497ca56994d85f7310f/f2/f89e99f5a66b446dbbd303d1e48989e0 2023-02-15 20:01:40,578 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/.tmp/data/default/testWithMockedMapReduceMultiRegion/007dd63b20f9d2149ba11df9b0cddc4c/f2/7c62395ed7814233afd59bd1a605f28b to hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/archive/data/default/testWithMockedMapReduceMultiRegion/007dd63b20f9d2149ba11df9b0cddc4c/f2/7c62395ed7814233afd59bd1a605f28b 2023-02-15 20:01:40,581 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/.tmp/data/default/testWithMockedMapReduceMultiRegion/5a8c9c21a9831b445d533dd705940e06/recovered.edits/12.seqid to hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/archive/data/default/testWithMockedMapReduceMultiRegion/5a8c9c21a9831b445d533dd705940e06/recovered.edits/12.seqid 2023-02-15 20:01:40,582 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/.tmp/data/default/testWithMockedMapReduceMultiRegion/85c1d4ec199a8eac4595716bde5173ab/recovered.edits/12.seqid to hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/archive/data/default/testWithMockedMapReduceMultiRegion/85c1d4ec199a8eac4595716bde5173ab/recovered.edits/12.seqid 2023-02-15 20:01:40,582 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/.tmp/data/default/testWithMockedMapReduceMultiRegion/81644ccf4d63c864b007cbc1043831d7/recovered.edits/12.seqid to hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/archive/data/default/testWithMockedMapReduceMultiRegion/81644ccf4d63c864b007cbc1043831d7/recovered.edits/12.seqid 2023-02-15 20:01:40,582 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/.tmp/data/default/testWithMockedMapReduceMultiRegion/8a79eee6aefc962407df2ed05672c891/f1/5faa164e7bce4249bbe09f7924d8ab21 to hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/archive/data/default/testWithMockedMapReduceMultiRegion/8a79eee6aefc962407df2ed05672c891/f1/5faa164e7bce4249bbe09f7924d8ab21 2023-02-15 20:01:40,584 DEBUG [HFileArchiver-8] backup.HFileArchiver(596): Deleted hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/.tmp/data/default/testWithMockedMapReduceMultiRegion/5a8c9c21a9831b445d533dd705940e06 2023-02-15 20:01:40,584 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/.tmp/data/default/testWithMockedMapReduceMultiRegion/4229d692a52fca982c3f6193911c155d 2023-02-15 20:01:40,585 DEBUG [HFileArchiver-7] backup.HFileArchiver(596): Deleted hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/.tmp/data/default/testWithMockedMapReduceMultiRegion/85c1d4ec199a8eac4595716bde5173ab 2023-02-15 20:01:40,586 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/.tmp/data/default/testWithMockedMapReduceMultiRegion/c069ee68dab22f36ea73f04b91933c1f/recovered.edits/12.seqid to hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/archive/data/default/testWithMockedMapReduceMultiRegion/c069ee68dab22f36ea73f04b91933c1f/recovered.edits/12.seqid 2023-02-15 20:01:40,586 DEBUG [HFileArchiver-3] backup.HFileArchiver(596): Deleted hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/.tmp/data/default/testWithMockedMapReduceMultiRegion/81644ccf4d63c864b007cbc1043831d7 2023-02-15 20:01:40,587 DEBUG [HFileArchiver-2] backup.HFileArchiver(596): Deleted hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/.tmp/data/default/testWithMockedMapReduceMultiRegion/c069ee68dab22f36ea73f04b91933c1f 2023-02-15 20:01:40,587 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/.tmp/data/default/testWithMockedMapReduceMultiRegion/6f4ab26e6b0d69c90f3b3b848034eb88/recovered.edits/12.seqid to hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/archive/data/default/testWithMockedMapReduceMultiRegion/6f4ab26e6b0d69c90f3b3b848034eb88/recovered.edits/12.seqid 2023-02-15 20:01:40,587 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/.tmp/data/default/testWithMockedMapReduceMultiRegion/fe51e97cb822f497ca56994d85f7310f/recovered.edits/12.seqid to hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/archive/data/default/testWithMockedMapReduceMultiRegion/fe51e97cb822f497ca56994d85f7310f/recovered.edits/12.seqid 2023-02-15 20:01:40,588 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/.tmp/data/default/testWithMockedMapReduceMultiRegion/007dd63b20f9d2149ba11df9b0cddc4c/recovered.edits/12.seqid to hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/archive/data/default/testWithMockedMapReduceMultiRegion/007dd63b20f9d2149ba11df9b0cddc4c/recovered.edits/12.seqid 2023-02-15 20:01:40,588 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/.tmp/data/default/testWithMockedMapReduceMultiRegion/8a79eee6aefc962407df2ed05672c891/f1/ecc16de3dc1744a0b3e45b3b32a65dcb to hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/archive/data/default/testWithMockedMapReduceMultiRegion/8a79eee6aefc962407df2ed05672c891/f1/ecc16de3dc1744a0b3e45b3b32a65dcb 2023-02-15 20:01:40,588 DEBUG [HFileArchiver-6] backup.HFileArchiver(596): Deleted hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/.tmp/data/default/testWithMockedMapReduceMultiRegion/6f4ab26e6b0d69c90f3b3b848034eb88 2023-02-15 20:01:40,588 DEBUG [HFileArchiver-4] backup.HFileArchiver(596): Deleted hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/.tmp/data/default/testWithMockedMapReduceMultiRegion/fe51e97cb822f497ca56994d85f7310f 2023-02-15 20:01:40,588 DEBUG [HFileArchiver-8] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/.tmp/data/default/testWithMockedMapReduceMultiRegion/4229d692a52fca982c3f6193911c155d/f1, FileablePath, hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/.tmp/data/default/testWithMockedMapReduceMultiRegion/4229d692a52fca982c3f6193911c155d/f2, FileablePath, hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/.tmp/data/default/testWithMockedMapReduceMultiRegion/4229d692a52fca982c3f6193911c155d/recovered.edits] 2023-02-15 20:01:40,588 DEBUG [HFileArchiver-5] backup.HFileArchiver(596): Deleted hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/.tmp/data/default/testWithMockedMapReduceMultiRegion/007dd63b20f9d2149ba11df9b0cddc4c 2023-02-15 20:01:40,591 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/.tmp/data/default/testWithMockedMapReduceMultiRegion/8a79eee6aefc962407df2ed05672c891/f2/651f82f738544655af089e98533e03fb to hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/archive/data/default/testWithMockedMapReduceMultiRegion/8a79eee6aefc962407df2ed05672c891/f2/651f82f738544655af089e98533e03fb 2023-02-15 20:01:40,592 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/.tmp/data/default/testWithMockedMapReduceMultiRegion/8a79eee6aefc962407df2ed05672c891/f2/c2016df0893c44b3a6b0164ad4a4d968 to hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/archive/data/default/testWithMockedMapReduceMultiRegion/8a79eee6aefc962407df2ed05672c891/f2/c2016df0893c44b3a6b0164ad4a4d968 2023-02-15 20:01:40,593 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/.tmp/data/default/testWithMockedMapReduceMultiRegion/4229d692a52fca982c3f6193911c155d/recovered.edits/6.seqid to hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/archive/data/default/testWithMockedMapReduceMultiRegion/4229d692a52fca982c3f6193911c155d/recovered.edits/6.seqid 2023-02-15 20:01:40,594 DEBUG [HFileArchiver-8] backup.HFileArchiver(596): Deleted hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/.tmp/data/default/testWithMockedMapReduceMultiRegion/4229d692a52fca982c3f6193911c155d 2023-02-15 20:01:40,595 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/.tmp/data/default/testWithMockedMapReduceMultiRegion/8a79eee6aefc962407df2ed05672c891/recovered.edits/12.seqid to hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/archive/data/default/testWithMockedMapReduceMultiRegion/8a79eee6aefc962407df2ed05672c891/recovered.edits/12.seqid 2023-02-15 20:01:40,595 DEBUG [HFileArchiver-1] backup.HFileArchiver(596): Deleted hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/.tmp/data/default/testWithMockedMapReduceMultiRegion/8a79eee6aefc962407df2ed05672c891 2023-02-15 20:01:40,595 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testWithMockedMapReduceMultiRegion regions 2023-02-15 20:01:40,597 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=54, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testWithMockedMapReduceMultiRegion 2023-02-15 20:01:40,600 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 10 rows of testWithMockedMapReduceMultiRegion from hbase:meta 2023-02-15 20:01:40,603 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testWithMockedMapReduceMultiRegion' descriptor. 2023-02-15 20:01:40,604 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=54, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testWithMockedMapReduceMultiRegion 2023-02-15 20:01:40,604 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testWithMockedMapReduceMultiRegion' from region states. 2023-02-15 20:01:40,604 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,,1676491296789.5e40ee2d96ae1cbe88d7c194cd72dda2.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676491300604"}]},"ts":"9223372036854775807"} 2023-02-15 20:01:40,604 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,aaa,1676491296789.6f4ab26e6b0d69c90f3b3b848034eb88.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676491300604"}]},"ts":"9223372036854775807"} 2023-02-15 20:01:40,604 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,d\\x84\\x84,1676491296789.85c1d4ec199a8eac4595716bde5173ab.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676491300604"}]},"ts":"9223372036854775807"} 2023-02-15 20:01:40,604 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,g\\xA7\\xA7,1676491296789.5a8c9c21a9831b445d533dd705940e06.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676491300604"}]},"ts":"9223372036854775807"} 2023-02-15 20:01:40,604 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,j\\xCA\\xCA,1676491296789.007dd63b20f9d2149ba11df9b0cddc4c.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676491300604"}]},"ts":"9223372036854775807"} 2023-02-15 20:01:40,604 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,m\\xED\\xED,1676491296789.c069ee68dab22f36ea73f04b91933c1f.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676491300604"}]},"ts":"9223372036854775807"} 2023-02-15 20:01:40,604 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,q\\x11\\x10,1676491296789.81644ccf4d63c864b007cbc1043831d7.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676491300604"}]},"ts":"9223372036854775807"} 2023-02-15 20:01:40,604 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,t43,1676491296789.fe51e97cb822f497ca56994d85f7310f.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676491300604"}]},"ts":"9223372036854775807"} 2023-02-15 20:01:40,604 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,wWV,1676491296789.8a79eee6aefc962407df2ed05672c891.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676491300604"}]},"ts":"9223372036854775807"} 2023-02-15 20:01:40,604 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,zz{,1676491296789.4229d692a52fca982c3f6193911c155d.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676491300604"}]},"ts":"9223372036854775807"} 2023-02-15 20:01:40,606 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 10 regions from META 2023-02-15 20:01:40,606 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 5e40ee2d96ae1cbe88d7c194cd72dda2, NAME => 'testWithMockedMapReduceMultiRegion,,1676491296789.5e40ee2d96ae1cbe88d7c194cd72dda2.', STARTKEY => '', ENDKEY => 'aaa'}, {ENCODED => 6f4ab26e6b0d69c90f3b3b848034eb88, NAME => 'testWithMockedMapReduceMultiRegion,aaa,1676491296789.6f4ab26e6b0d69c90f3b3b848034eb88.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'}, {ENCODED => 85c1d4ec199a8eac4595716bde5173ab, NAME => 'testWithMockedMapReduceMultiRegion,d\x84\x84,1676491296789.85c1d4ec199a8eac4595716bde5173ab.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'}, {ENCODED => 5a8c9c21a9831b445d533dd705940e06, NAME => 'testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676491296789.5a8c9c21a9831b445d533dd705940e06.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'}, {ENCODED => 007dd63b20f9d2149ba11df9b0cddc4c, NAME => 'testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676491296789.007dd63b20f9d2149ba11df9b0cddc4c.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'}, {ENCODED => c069ee68dab22f36ea73f04b91933c1f, NAME => 'testWithMockedMapReduceMultiRegion,m\xED\xED,1676491296789.c069ee68dab22f36ea73f04b91933c1f.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'}, {ENCODED => 81644ccf4d63c864b007cbc1043831d7, NAME => 'testWithMockedMapReduceMultiRegion,q\x11\x10,1676491296789.81644ccf4d63c864b007cbc1043831d7.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'}, {ENCODED => fe51e97cb822f497ca56994d85f7310f, NAME => 'testWithMockedMapReduceMultiRegion,t43,1676491296789.fe51e97cb822f497ca56994d85f7310f.', STARTKEY => 't43', ENDKEY => 'wWV'}, {ENCODED => 8a79eee6aefc962407df2ed05672c891, NAME => 'testWithMockedMapReduceMultiRegion,wWV,1676491296789.8a79eee6aefc962407df2ed05672c891.', STARTKEY => 'wWV', ENDKEY => 'zz{'}, {ENCODED => 4229d692a52fca982c3f6193911c155d, NAME => 'testWithMockedMapReduceMultiRegion,zz{,1676491296789.4229d692a52fca982c3f6193911c155d.', STARTKEY => 'zz{', ENDKEY => ''}] 2023-02-15 20:01:40,606 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testWithMockedMapReduceMultiRegion' as deleted. 2023-02-15 20:01:40,606 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1676491300606"}]},"ts":"9223372036854775807"} 2023-02-15 20:01:40,608 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testWithMockedMapReduceMultiRegion state from META 2023-02-15 20:01:40,610 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=54, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testWithMockedMapReduceMultiRegion 2023-02-15 20:01:40,611 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=54, state=SUCCESS; DeleteTableProcedure table=testWithMockedMapReduceMultiRegion in 87 msec 2023-02-15 20:01:40,629 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35467] master.MasterRpcServices(1227): Checking to see if procedure is done pid=54 2023-02-15 20:01:40,629 INFO [Listener at localhost/43553] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testWithMockedMapReduceMultiRegion, procId: 54 completed 2023-02-15 20:01:40,629 INFO [Listener at localhost/43553] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-02-15 20:01:40,629 INFO [Listener at localhost/43553] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-15 20:01:40,630 DEBUG [Listener at localhost/43553] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x22c6b7ea to 127.0.0.1:49184 2023-02-15 20:01:40,630 DEBUG [Listener at localhost/43553] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-15 20:01:40,630 DEBUG [Listener at localhost/43553] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-02-15 20:01:40,630 DEBUG [Listener at localhost/43553] util.JVMClusterUtil(257): Found active master hash=1134250908, stopped=false 2023-02-15 20:01:40,630 INFO [Listener at localhost/43553] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,35467,1676491293605 2023-02-15 20:01:40,633 DEBUG [Listener at localhost/43553-EventThread] zookeeper.ZKWatcher(600): master:35467-0x1005992ed530000, quorum=127.0.0.1:49184, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-15 20:01:40,633 DEBUG [Listener at localhost/43553-EventThread] zookeeper.ZKWatcher(600): regionserver:36625-0x1005992ed530002, quorum=127.0.0.1:49184, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-15 20:01:40,633 DEBUG [Listener at localhost/43553-EventThread] zookeeper.ZKWatcher(600): master:35467-0x1005992ed530000, quorum=127.0.0.1:49184, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-15 20:01:40,633 INFO [Listener at localhost/43553] procedure2.ProcedureExecutor(629): Stopping 2023-02-15 20:01:40,633 DEBUG [Listener at localhost/43553-EventThread] zookeeper.ZKWatcher(600): regionserver:40517-0x1005992ed530001, quorum=127.0.0.1:49184, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-15 20:01:40,634 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:35467-0x1005992ed530000, quorum=127.0.0.1:49184, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-15 20:01:40,634 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36625-0x1005992ed530002, quorum=127.0.0.1:49184, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-15 20:01:40,635 DEBUG [Listener at localhost/43553] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x35955abd to 127.0.0.1:49184 2023-02-15 20:01:40,635 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40517-0x1005992ed530001, quorum=127.0.0.1:49184, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-15 20:01:40,635 DEBUG [Listener at localhost/43553] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-15 20:01:40,635 INFO [Listener at localhost/43553] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,40517,1676491293664' ***** 2023-02-15 20:01:40,635 INFO [Listener at localhost/43553] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-15 20:01:40,635 INFO [Listener at localhost/43553] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,36625,1676491293696' ***** 2023-02-15 20:01:40,635 INFO [Listener at localhost/43553] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-15 20:01:40,635 INFO [RS:1;jenkins-hbase4:36625] regionserver.HeapMemoryManager(220): Stopping 2023-02-15 20:01:40,636 INFO [RS:1;jenkins-hbase4:36625] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-15 20:01:40,636 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-15 20:01:40,636 INFO [RS:1;jenkins-hbase4:36625] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-15 20:01:40,637 INFO [RS:0;jenkins-hbase4:40517] regionserver.HeapMemoryManager(220): Stopping 2023-02-15 20:01:40,637 INFO [RS:1;jenkins-hbase4:36625] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,36625,1676491293696 2023-02-15 20:01:40,637 INFO [RS:0;jenkins-hbase4:40517] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-15 20:01:40,637 DEBUG [RS:1;jenkins-hbase4:36625] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x68cc14e7 to 127.0.0.1:49184 2023-02-15 20:01:40,637 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-15 20:01:40,637 DEBUG [RS:1;jenkins-hbase4:36625] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-15 20:01:40,637 INFO [RS:0;jenkins-hbase4:40517] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-15 20:01:40,639 INFO [RS:1;jenkins-hbase4:36625] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,36625,1676491293696; all regions closed. 2023-02-15 20:01:40,639 INFO [RS:0;jenkins-hbase4:40517] regionserver.HRegionServer(3304): Received CLOSE for c723e21a7ef92eed0b6fdf5f063344e2 2023-02-15 20:01:40,639 INFO [RS:0;jenkins-hbase4:40517] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,40517,1676491293664 2023-02-15 20:01:40,639 DEBUG [RS:0;jenkins-hbase4:40517] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3ceb3b0c to 127.0.0.1:49184 2023-02-15 20:01:40,640 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing c723e21a7ef92eed0b6fdf5f063344e2, disabling compactions & flushes 2023-02-15 20:01:40,640 DEBUG [RS:0;jenkins-hbase4:40517] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-15 20:01:40,640 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676491295980.c723e21a7ef92eed0b6fdf5f063344e2. 2023-02-15 20:01:40,640 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676491295980.c723e21a7ef92eed0b6fdf5f063344e2. 2023-02-15 20:01:40,640 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676491295980.c723e21a7ef92eed0b6fdf5f063344e2. after waiting 0 ms 2023-02-15 20:01:40,640 INFO [RS:0;jenkins-hbase4:40517] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-15 20:01:40,640 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676491295980.c723e21a7ef92eed0b6fdf5f063344e2. 2023-02-15 20:01:40,640 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing c723e21a7ef92eed0b6fdf5f063344e2 1/1 column families, dataSize=78 B heapSize=488 B 2023-02-15 20:01:40,640 INFO [RS:0;jenkins-hbase4:40517] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-15 20:01:40,640 INFO [RS:0;jenkins-hbase4:40517] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-15 20:01:40,641 INFO [RS:0;jenkins-hbase4:40517] regionserver.HRegionServer(3304): Received CLOSE for 1588230740 2023-02-15 20:01:40,641 INFO [RS:0;jenkins-hbase4:40517] regionserver.HRegionServer(1475): Waiting on 2 regions to close 2023-02-15 20:01:40,641 DEBUG [RS:0;jenkins-hbase4:40517] regionserver.HRegionServer(1479): Online Regions={1588230740=hbase:meta,,1.1588230740, c723e21a7ef92eed0b6fdf5f063344e2=hbase:namespace,,1676491295980.c723e21a7ef92eed0b6fdf5f063344e2.} 2023-02-15 20:01:40,643 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-15 20:01:40,643 DEBUG [RS:0;jenkins-hbase4:40517] regionserver.HRegionServer(1505): Waiting on 1588230740, c723e21a7ef92eed0b6fdf5f063344e2 2023-02-15 20:01:40,643 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-15 20:01:40,643 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-15 20:01:40,643 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-15 20:01:40,643 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-15 20:01:40,643 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 1588230740 3/3 column families, dataSize=28.36 KB heapSize=44.48 KB 2023-02-15 20:01:40,647 DEBUG [RS:1;jenkins-hbase4:36625] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/oldWALs 2023-02-15 20:01:40,647 INFO [RS:1;jenkins-hbase4:36625] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C36625%2C1676491293696:(num 1676491296579) 2023-02-15 20:01:40,647 DEBUG [RS:1;jenkins-hbase4:36625] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-15 20:01:40,647 INFO [RS:1;jenkins-hbase4:36625] regionserver.LeaseManager(133): Closed leases 2023-02-15 20:01:40,647 INFO [RS:1;jenkins-hbase4:36625] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-02-15 20:01:40,647 INFO [RS:1;jenkins-hbase4:36625] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-15 20:01:40,647 INFO [RS:1;jenkins-hbase4:36625] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-15 20:01:40,648 INFO [RS:1;jenkins-hbase4:36625] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-15 20:01:40,648 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-15 20:01:40,653 INFO [RS:1;jenkins-hbase4:36625] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:36625 2023-02-15 20:01:40,657 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-15 20:01:40,662 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-15 20:01:40,664 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/data/hbase/namespace/c723e21a7ef92eed0b6fdf5f063344e2/.tmp/info/afb17e480ddd4097b9169848154417d7 2023-02-15 20:01:40,666 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=25.73 KB at sequenceid=57 (bloomFilter=false), to=hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/data/hbase/meta/1588230740/.tmp/info/6ce5f20e250b48788a20cdea4d87403c 2023-02-15 20:01:40,670 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/data/hbase/namespace/c723e21a7ef92eed0b6fdf5f063344e2/.tmp/info/afb17e480ddd4097b9169848154417d7 as hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/data/hbase/namespace/c723e21a7ef92eed0b6fdf5f063344e2/info/afb17e480ddd4097b9169848154417d7 2023-02-15 20:01:40,670 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 6ce5f20e250b48788a20cdea4d87403c 2023-02-15 20:01:40,674 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/data/hbase/namespace/c723e21a7ef92eed0b6fdf5f063344e2/info/afb17e480ddd4097b9169848154417d7, entries=2, sequenceid=6, filesize=4.8 K 2023-02-15 20:01:40,675 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for c723e21a7ef92eed0b6fdf5f063344e2 in 35ms, sequenceid=6, compaction requested=false 2023-02-15 20:01:40,684 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/data/hbase/namespace/c723e21a7ef92eed0b6fdf5f063344e2/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-02-15 20:01:40,685 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676491295980.c723e21a7ef92eed0b6fdf5f063344e2. 2023-02-15 20:01:40,685 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for c723e21a7ef92eed0b6fdf5f063344e2: 2023-02-15 20:01:40,685 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1676491295980.c723e21a7ef92eed0b6fdf5f063344e2. 2023-02-15 20:01:40,686 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.14 KB at sequenceid=57 (bloomFilter=false), to=hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/data/hbase/meta/1588230740/.tmp/rep_barrier/7da9d1e769634dc6a10f7db09cee2dfd 2023-02-15 20:01:40,690 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 7da9d1e769634dc6a10f7db09cee2dfd 2023-02-15 20:01:40,697 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.49 KB at sequenceid=57 (bloomFilter=false), to=hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/data/hbase/meta/1588230740/.tmp/table/b97a4d5667574ff58e09dbf79360177b 2023-02-15 20:01:40,700 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for b97a4d5667574ff58e09dbf79360177b 2023-02-15 20:01:40,701 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/data/hbase/meta/1588230740/.tmp/info/6ce5f20e250b48788a20cdea4d87403c as hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/data/hbase/meta/1588230740/info/6ce5f20e250b48788a20cdea4d87403c 2023-02-15 20:01:40,704 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 6ce5f20e250b48788a20cdea4d87403c 2023-02-15 20:01:40,704 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/data/hbase/meta/1588230740/info/6ce5f20e250b48788a20cdea4d87403c, entries=30, sequenceid=57, filesize=8.3 K 2023-02-15 20:01:40,705 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/data/hbase/meta/1588230740/.tmp/rep_barrier/7da9d1e769634dc6a10f7db09cee2dfd as hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/data/hbase/meta/1588230740/rep_barrier/7da9d1e769634dc6a10f7db09cee2dfd 2023-02-15 20:01:40,709 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 7da9d1e769634dc6a10f7db09cee2dfd 2023-02-15 20:01:40,709 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/data/hbase/meta/1588230740/rep_barrier/7da9d1e769634dc6a10f7db09cee2dfd, entries=10, sequenceid=57, filesize=6.1 K 2023-02-15 20:01:40,709 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/data/hbase/meta/1588230740/.tmp/table/b97a4d5667574ff58e09dbf79360177b as hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/data/hbase/meta/1588230740/table/b97a4d5667574ff58e09dbf79360177b 2023-02-15 20:01:40,713 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for b97a4d5667574ff58e09dbf79360177b 2023-02-15 20:01:40,713 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/data/hbase/meta/1588230740/table/b97a4d5667574ff58e09dbf79360177b, entries=13, sequenceid=57, filesize=6.1 K 2023-02-15 20:01:40,714 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~28.36 KB/29041, heapSize ~44.44 KB/45504, currentSize=0 B/0 for 1588230740 in 71ms, sequenceid=57, compaction requested=false 2023-02-15 20:01:40,722 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/data/hbase/meta/1588230740/recovered.edits/60.seqid, newMaxSeqId=60, maxSeqId=1 2023-02-15 20:01:40,723 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-15 20:01:40,723 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-15 20:01:40,723 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 1588230740: 2023-02-15 20:01:40,723 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-02-15 20:01:40,742 DEBUG [Listener at localhost/43553-EventThread] zookeeper.ZKWatcher(600): regionserver:36625-0x1005992ed530002, quorum=127.0.0.1:49184, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,36625,1676491293696 2023-02-15 20:01:40,742 DEBUG [Listener at localhost/43553-EventThread] zookeeper.ZKWatcher(600): regionserver:40517-0x1005992ed530001, quorum=127.0.0.1:49184, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,36625,1676491293696 2023-02-15 20:01:40,742 DEBUG [Listener at localhost/43553-EventThread] zookeeper.ZKWatcher(600): master:35467-0x1005992ed530000, quorum=127.0.0.1:49184, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-15 20:01:40,742 DEBUG [Listener at localhost/43553-EventThread] zookeeper.ZKWatcher(600): regionserver:40517-0x1005992ed530001, quorum=127.0.0.1:49184, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-15 20:01:40,742 ERROR [Listener at localhost/43553-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@6273eeef rejected from java.util.concurrent.ThreadPoolExecutor@664c7679[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-15 20:01:40,743 DEBUG [Listener at localhost/43553-EventThread] zookeeper.ZKWatcher(600): regionserver:36625-0x1005992ed530002, quorum=127.0.0.1:49184, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-15 20:01:40,743 ERROR [Listener at localhost/43553-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@6fdef9e1 rejected from java.util.concurrent.ThreadPoolExecutor@664c7679[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-15 20:01:40,743 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,36625,1676491293696] 2023-02-15 20:01:40,743 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,36625,1676491293696; numProcessing=1 2023-02-15 20:01:40,744 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,36625,1676491293696 already deleted, retry=false 2023-02-15 20:01:40,744 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,36625,1676491293696 expired; onlineServers=1 2023-02-15 20:01:40,843 INFO [RS:0;jenkins-hbase4:40517] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,40517,1676491293664; all regions closed. 2023-02-15 20:01:40,846 WARN [Close-WAL-Writer-0] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(641): complete file /user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/WALs/jenkins-hbase4.apache.org,40517,1676491293664/jenkins-hbase4.apache.org%2C40517%2C1676491293664.meta.1676491295697.meta not finished, retry = 0 2023-02-15 20:01:40,949 DEBUG [RS:0;jenkins-hbase4:40517] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/oldWALs 2023-02-15 20:01:40,949 INFO [RS:0;jenkins-hbase4:40517] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C40517%2C1676491293664.meta:.meta(num 1676491295697) 2023-02-15 20:01:40,953 DEBUG [RS:0;jenkins-hbase4:40517] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/oldWALs 2023-02-15 20:01:40,953 INFO [RS:0;jenkins-hbase4:40517] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C40517%2C1676491293664:(num 1676491296443) 2023-02-15 20:01:40,953 DEBUG [RS:0;jenkins-hbase4:40517] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-15 20:01:40,953 INFO [RS:0;jenkins-hbase4:40517] regionserver.LeaseManager(133): Closed leases 2023-02-15 20:01:40,953 INFO [RS:0;jenkins-hbase4:40517] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-02-15 20:01:40,953 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-15 20:01:40,954 INFO [RS:0;jenkins-hbase4:40517] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:40517 2023-02-15 20:01:40,957 DEBUG [Listener at localhost/43553-EventThread] zookeeper.ZKWatcher(600): master:35467-0x1005992ed530000, quorum=127.0.0.1:49184, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-15 20:01:40,957 DEBUG [Listener at localhost/43553-EventThread] zookeeper.ZKWatcher(600): regionserver:40517-0x1005992ed530001, quorum=127.0.0.1:49184, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,40517,1676491293664 2023-02-15 20:01:40,957 ERROR [Listener at localhost/43553-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@3679040f rejected from java.util.concurrent.ThreadPoolExecutor@32469618[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-15 20:01:40,958 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,40517,1676491293664] 2023-02-15 20:01:40,958 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,40517,1676491293664; numProcessing=2 2023-02-15 20:01:40,959 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,40517,1676491293664 already deleted, retry=false 2023-02-15 20:01:40,959 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,40517,1676491293664 expired; onlineServers=0 2023-02-15 20:01:40,959 INFO [RegionServerTracker-0] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,35467,1676491293605' ***** 2023-02-15 20:01:40,959 INFO [RegionServerTracker-0] regionserver.HRegionServer(2310): STOPPED: Cluster shutdown set; onlineServer=0 2023-02-15 20:01:40,960 DEBUG [M:0;jenkins-hbase4:35467] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@47a4d737, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-15 20:01:40,960 INFO [M:0;jenkins-hbase4:35467] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,35467,1676491293605 2023-02-15 20:01:40,961 INFO [M:0;jenkins-hbase4:35467] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,35467,1676491293605; all regions closed. 2023-02-15 20:01:40,961 DEBUG [M:0;jenkins-hbase4:35467] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-15 20:01:40,961 DEBUG [M:0;jenkins-hbase4:35467] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-02-15 20:01:40,961 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-02-15 20:01:40,961 DEBUG [M:0;jenkins-hbase4:35467] cleaner.HFileCleaner(317): Stopping file delete threads 2023-02-15 20:01:40,961 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676491294701] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676491294701,5,FailOnTimeoutGroup] 2023-02-15 20:01:40,961 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676491294701] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676491294701,5,FailOnTimeoutGroup] 2023-02-15 20:01:40,961 INFO [M:0;jenkins-hbase4:35467] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-02-15 20:01:40,962 INFO [M:0;jenkins-hbase4:35467] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-02-15 20:01:40,962 DEBUG [Listener at localhost/43553-EventThread] zookeeper.ZKWatcher(600): master:35467-0x1005992ed530000, quorum=127.0.0.1:49184, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-02-15 20:01:40,962 INFO [M:0;jenkins-hbase4:35467] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-02-15 20:01:40,962 DEBUG [Listener at localhost/43553-EventThread] zookeeper.ZKWatcher(600): master:35467-0x1005992ed530000, quorum=127.0.0.1:49184, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-15 20:01:40,962 DEBUG [M:0;jenkins-hbase4:35467] master.HMaster(1512): Stopping service threads 2023-02-15 20:01:40,963 INFO [M:0;jenkins-hbase4:35467] procedure2.RemoteProcedureDispatcher(118): Stopping procedure remote dispatcher 2023-02-15 20:01:40,963 ERROR [M:0;jenkins-hbase4:35467] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-02-15 20:01:40,963 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:35467-0x1005992ed530000, quorum=127.0.0.1:49184, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-15 20:01:40,963 INFO [M:0;jenkins-hbase4:35467] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-02-15 20:01:40,963 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-02-15 20:01:40,964 DEBUG [M:0;jenkins-hbase4:35467] zookeeper.ZKUtil(398): master:35467-0x1005992ed530000, quorum=127.0.0.1:49184, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-02-15 20:01:40,964 WARN [M:0;jenkins-hbase4:35467] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-02-15 20:01:40,964 INFO [M:0;jenkins-hbase4:35467] assignment.AssignmentManager(315): Stopping assignment manager 2023-02-15 20:01:40,964 INFO [M:0;jenkins-hbase4:35467] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-02-15 20:01:40,964 DEBUG [M:0;jenkins-hbase4:35467] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-15 20:01:40,964 INFO [M:0;jenkins-hbase4:35467] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-15 20:01:40,964 DEBUG [M:0;jenkins-hbase4:35467] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-15 20:01:40,964 DEBUG [M:0;jenkins-hbase4:35467] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-15 20:01:40,964 DEBUG [M:0;jenkins-hbase4:35467] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-15 20:01:40,965 INFO [M:0;jenkins-hbase4:35467] regionserver.HRegion(2744): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=167.12 KB heapSize=200.04 KB 2023-02-15 20:01:40,973 INFO [M:0;jenkins-hbase4:35467] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=167.12 KB at sequenceid=357 (bloomFilter=true), to=hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/e4518891c94841ca804c5d8ec804d729 2023-02-15 20:01:40,977 DEBUG [M:0;jenkins-hbase4:35467] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/e4518891c94841ca804c5d8ec804d729 as hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/e4518891c94841ca804c5d8ec804d729 2023-02-15 20:01:40,980 INFO [M:0;jenkins-hbase4:35467] regionserver.HStore(1080): Added hdfs://localhost:43597/user/jenkins/test-data/a31f1204-2058-e56a-0327-e96aa7aba789/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/e4518891c94841ca804c5d8ec804d729, entries=53, sequenceid=357, filesize=10.7 K 2023-02-15 20:01:40,981 INFO [M:0;jenkins-hbase4:35467] regionserver.HRegion(2947): Finished flush of dataSize ~167.12 KB/171134, heapSize ~200.02 KB/204824, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 16ms, sequenceid=357, compaction requested=false 2023-02-15 20:01:40,982 INFO [M:0;jenkins-hbase4:35467] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-15 20:01:40,982 DEBUG [M:0;jenkins-hbase4:35467] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-15 20:01:40,985 INFO [M:0;jenkins-hbase4:35467] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-02-15 20:01:40,985 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-15 20:01:40,986 INFO [M:0;jenkins-hbase4:35467] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:35467 2023-02-15 20:01:40,989 DEBUG [M:0;jenkins-hbase4:35467] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,35467,1676491293605 already deleted, retry=false 2023-02-15 20:01:41,034 DEBUG [Listener at localhost/43553-EventThread] zookeeper.ZKWatcher(600): regionserver:36625-0x1005992ed530002, quorum=127.0.0.1:49184, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-15 20:01:41,034 INFO [RS:1;jenkins-hbase4:36625] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,36625,1676491293696; zookeeper connection closed. 2023-02-15 20:01:41,034 ERROR [Listener at localhost/43553-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@17dd25f0 rejected from java.util.concurrent.ThreadPoolExecutor@664c7679[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-15 20:01:41,034 DEBUG [Listener at localhost/43553-EventThread] zookeeper.ZKWatcher(600): regionserver:36625-0x1005992ed530002, quorum=127.0.0.1:49184, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-15 20:01:41,034 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@321c1ca5] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@321c1ca5 2023-02-15 20:01:41,034 ERROR [Listener at localhost/43553-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@5be8f3e7 rejected from java.util.concurrent.ThreadPoolExecutor@664c7679[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-15 20:01:41,134 DEBUG [Listener at localhost/43553-EventThread] zookeeper.ZKWatcher(600): master:35467-0x1005992ed530000, quorum=127.0.0.1:49184, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-15 20:01:41,134 INFO [M:0;jenkins-hbase4:35467] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,35467,1676491293605; zookeeper connection closed. 2023-02-15 20:01:41,134 ERROR [Listener at localhost/43553-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@6c0bdd05 rejected from java.util.concurrent.ThreadPoolExecutor@6834545c[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 55] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-15 20:01:41,135 DEBUG [Listener at localhost/43553-EventThread] zookeeper.ZKWatcher(600): master:35467-0x1005992ed530000, quorum=127.0.0.1:49184, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-15 20:01:41,135 ERROR [Listener at localhost/43553-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@2e80b8eb rejected from java.util.concurrent.ThreadPoolExecutor@6834545c[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 55] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-15 20:01:41,217 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-datanode.properties,hadoop-metrics2.properties 2023-02-15 20:01:41,234 DEBUG [Listener at localhost/43553-EventThread] zookeeper.ZKWatcher(600): regionserver:40517-0x1005992ed530001, quorum=127.0.0.1:49184, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-15 20:01:41,234 INFO [RS:0;jenkins-hbase4:40517] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,40517,1676491293664; zookeeper connection closed. 2023-02-15 20:01:41,235 ERROR [Listener at localhost/43553-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@38def809 rejected from java.util.concurrent.ThreadPoolExecutor@32469618[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-15 20:01:41,235 DEBUG [Listener at localhost/43553-EventThread] zookeeper.ZKWatcher(600): regionserver:40517-0x1005992ed530001, quorum=127.0.0.1:49184, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-15 20:01:41,235 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@6098670c] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@6098670c 2023-02-15 20:01:41,235 ERROR [Listener at localhost/43553-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@408972f0 rejected from java.util.concurrent.ThreadPoolExecutor@32469618[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-15 20:01:41,235 INFO [Listener at localhost/43553] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 2 regionserver(s) complete 2023-02-15 20:01:41,236 WARN [Listener at localhost/43553] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-15 20:01:41,248 INFO [Listener at localhost/43553] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-15 20:01:41,270 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(152): Removing adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-15 20:01:41,356 WARN [BP-1699691870-172.31.14.131-1676491293022 heartbeating to localhost/127.0.0.1:43597] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-15 20:01:41,357 WARN [BP-1699691870-172.31.14.131-1676491293022 heartbeating to localhost/127.0.0.1:43597] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1699691870-172.31.14.131-1676491293022 (Datanode Uuid c8f119a7-b671-44fd-b45a-8761b32a7a92) service to localhost/127.0.0.1:43597 2023-02-15 20:01:41,359 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/63389d22-ebad-6aa5-b3ed-1f47f6072df6/cluster_75e2f904-c355-d1cf-5c64-97d220c683ad/dfs/data/data3/current/BP-1699691870-172.31.14.131-1676491293022] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-15 20:01:41,359 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/63389d22-ebad-6aa5-b3ed-1f47f6072df6/cluster_75e2f904-c355-d1cf-5c64-97d220c683ad/dfs/data/data4/current/BP-1699691870-172.31.14.131-1676491293022] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-15 20:01:41,361 WARN [Listener at localhost/43553] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-15 20:01:41,364 INFO [Listener at localhost/43553] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-15 20:01:41,470 WARN [BP-1699691870-172.31.14.131-1676491293022 heartbeating to localhost/127.0.0.1:43597] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-15 20:01:41,470 WARN [BP-1699691870-172.31.14.131-1676491293022 heartbeating to localhost/127.0.0.1:43597] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1699691870-172.31.14.131-1676491293022 (Datanode Uuid 4389ca41-3fee-42de-bc59-7ff211de1455) service to localhost/127.0.0.1:43597 2023-02-15 20:01:41,470 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/63389d22-ebad-6aa5-b3ed-1f47f6072df6/cluster_75e2f904-c355-d1cf-5c64-97d220c683ad/dfs/data/data1/current/BP-1699691870-172.31.14.131-1676491293022] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-15 20:01:41,471 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/63389d22-ebad-6aa5-b3ed-1f47f6072df6/cluster_75e2f904-c355-d1cf-5c64-97d220c683ad/dfs/data/data2/current/BP-1699691870-172.31.14.131-1676491293022] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-15 20:01:41,480 INFO [Listener at localhost/43553] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-15 20:01:41,600 INFO [Listener at localhost/43553] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-02-15 20:01:41,645 INFO [Listener at localhost/43553] hbase.HBaseTestingUtility(1293): Minicluster is down 2023-02-15 20:01:41,671 INFO [Listener at localhost/43553] hbase.ResourceChecker(175): after: mapred.TestTableSnapshotInputFormat#testWithMockedMapReduceMultiRegion Thread=230 (was 180) Potentially hanging thread: RS-EventLoopGroup-13-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-17-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-17-1 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.selectNow(SelectorImpl.java:105) io.netty.channel.nio.SelectedSelectionKeySetSelector.selectNow(SelectedSelectionKeySetSelector.java:56) io.netty.channel.nio.NioEventLoop.selectNow(NioEventLoop.java:798) io.netty.channel.nio.NioEventLoop$1.get(NioEventLoop.java:72) io.netty.channel.DefaultSelectStrategy.calculateStrategy(DefaultSelectStrategy.java:30) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:441) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/43553.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-11 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase4.apache.org,35467,1676491293605)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/43553.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: Listener at localhost/43553 java.lang.Thread.dumpThreads(Native Method) java.lang.Thread.getAllStackTraces(Thread.java:1615) org.apache.hadoop.hbase.ResourceCheckerJUnitListener$ThreadResourceAnalyzer.getVal(ResourceCheckerJUnitListener.java:49) org.apache.hadoop.hbase.ResourceChecker.fill(ResourceChecker.java:110) org.apache.hadoop.hbase.ResourceChecker.fillEndings(ResourceChecker.java:104) org.apache.hadoop.hbase.ResourceChecker.end(ResourceChecker.java:206) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.end(ResourceCheckerJUnitListener.java:165) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.testFinished(ResourceCheckerJUnitListener.java:185) org.junit.runner.notification.SynchronizedRunListener.testFinished(SynchronizedRunListener.java:87) org.junit.runner.notification.RunNotifier$9.notifyListener(RunNotifier.java:225) org.junit.runner.notification.RunNotifier$SafeNotifier.run(RunNotifier.java:72) org.junit.runner.notification.RunNotifier.fireTestFinished(RunNotifier.java:222) org.junit.internal.runners.model.EachTestNotifier.fireTestFinished(EachTestNotifier.java:38) org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:372) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) org.apache.hadoop.hbase.SystemExitRule$1.evaluate(SystemExitRule.java:39) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/43553.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: IPC Client (1185813668) connection to localhost/127.0.0.1:43597 from jenkins.hfs.6 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-16-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-10 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1185813668) connection to localhost/127.0.0.1:43597 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS-EventLoopGroup-13-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.6@localhost:43597 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-16-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-17-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-14-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/43553.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: Listener at localhost/43553.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: nioEventLoopGroup-16-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.7@localhost:43597 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-12-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins@localhost:43597 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-15-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-15-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-14-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/43553.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: RS-EventLoopGroup-14-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-14-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-12-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/43553.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: nioEventLoopGroup-15-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-13-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1185813668) connection to localhost/127.0.0.1:43597 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: Listener at localhost/43553.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: RS-EventLoopGroup-14-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/43553.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-12 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1185813668) connection to localhost/127.0.0.1:43597 from jenkins.hfs.7 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS-EventLoopGroup-12-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/43553.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: RS-EventLoopGroup-14-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=638 (was 567) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=327 (was 304) - SystemLoadAverage LEAK? -, ProcessCount=166 (was 165) - ProcessCount LEAK? -, AvailableMemoryMB=2639 (was 2737) 2023-02-15 20:01:41,681 INFO [Listener at localhost/43553] hbase.ResourceChecker(147): before: mapred.TestTableSnapshotInputFormat#testWithMockedMapReduceSingleRegion Thread=230, OpenFileDescriptor=638, MaxFileDescriptor=60000, SystemLoadAverage=327, ProcessCount=166, AvailableMemoryMB=2638 2023-02-15 20:01:41,692 INFO [Listener at localhost/43553] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.log.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/63389d22-ebad-6aa5-b3ed-1f47f6072df6/hadoop.log.dir so I do NOT create it in target/test-data/60d35244-9efb-8171-b54c-79ea832c21da 2023-02-15 20:01:41,692 WARN [Listener at localhost/43553] hbase.HBaseTestingUtility(449): hadoop.log.dir property value differs in configuration and system: Configuration=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/../logs while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/63389d22-ebad-6aa5-b3ed-1f47f6072df6/hadoop.log.dir Erasing configuration value by system value. 2023-02-15 20:01:41,692 INFO [Listener at localhost/43553] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.tmp.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/63389d22-ebad-6aa5-b3ed-1f47f6072df6/hadoop.tmp.dir so I do NOT create it in target/test-data/60d35244-9efb-8171-b54c-79ea832c21da 2023-02-15 20:01:41,692 WARN [Listener at localhost/43553] hbase.HBaseTestingUtility(449): hadoop.tmp.dir property value differs in configuration and system: Configuration=/tmp/hadoop-jenkins while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/63389d22-ebad-6aa5-b3ed-1f47f6072df6/hadoop.tmp.dir Erasing configuration value by system value. 2023-02-15 20:01:41,692 DEBUG [Listener at localhost/43553] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/60d35244-9efb-8171-b54c-79ea832c21da 2023-02-15 20:01:41,692 INFO [Listener at localhost/43553] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=2, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=true, createWALDir=false} 2023-02-15 20:01:41,692 INFO [Listener at localhost/43553] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/60d35244-9efb-8171-b54c-79ea832c21da/cluster_2e3ec7f8-62e9-c847-6b18-7328346b74c4, deleteOnExit=true 2023-02-15 20:01:41,692 INFO [Listener at localhost/43553] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-02-15 20:01:41,692 INFO [Listener at localhost/43553] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/60d35244-9efb-8171-b54c-79ea832c21da/test.cache.data in system properties and HBase conf 2023-02-15 20:01:41,692 INFO [Listener at localhost/43553] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/60d35244-9efb-8171-b54c-79ea832c21da/hadoop.tmp.dir in system properties and HBase conf 2023-02-15 20:01:41,692 INFO [Listener at localhost/43553] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/60d35244-9efb-8171-b54c-79ea832c21da/hadoop.log.dir in system properties and HBase conf 2023-02-15 20:01:41,693 INFO [Listener at localhost/43553] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/60d35244-9efb-8171-b54c-79ea832c21da/mapreduce.cluster.local.dir in system properties and HBase conf 2023-02-15 20:01:41,693 INFO [Listener at localhost/43553] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/60d35244-9efb-8171-b54c-79ea832c21da/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-02-15 20:01:41,693 INFO [Listener at localhost/43553] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-02-15 20:01:41,693 DEBUG [Listener at localhost/43553] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-02-15 20:01:41,693 INFO [Listener at localhost/43553] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/60d35244-9efb-8171-b54c-79ea832c21da/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-02-15 20:01:41,693 INFO [Listener at localhost/43553] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/60d35244-9efb-8171-b54c-79ea832c21da/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-02-15 20:01:41,693 INFO [Listener at localhost/43553] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/60d35244-9efb-8171-b54c-79ea832c21da/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-02-15 20:01:41,693 INFO [Listener at localhost/43553] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/60d35244-9efb-8171-b54c-79ea832c21da/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-15 20:01:41,693 INFO [Listener at localhost/43553] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/60d35244-9efb-8171-b54c-79ea832c21da/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-02-15 20:01:41,693 INFO [Listener at localhost/43553] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/60d35244-9efb-8171-b54c-79ea832c21da/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-02-15 20:01:41,694 INFO [Listener at localhost/43553] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/60d35244-9efb-8171-b54c-79ea832c21da/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-15 20:01:41,694 INFO [Listener at localhost/43553] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/60d35244-9efb-8171-b54c-79ea832c21da/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-15 20:01:41,694 INFO [Listener at localhost/43553] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/60d35244-9efb-8171-b54c-79ea832c21da/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-02-15 20:01:41,694 INFO [Listener at localhost/43553] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/60d35244-9efb-8171-b54c-79ea832c21da/nfs.dump.dir in system properties and HBase conf 2023-02-15 20:01:41,694 INFO [Listener at localhost/43553] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/60d35244-9efb-8171-b54c-79ea832c21da/java.io.tmpdir in system properties and HBase conf 2023-02-15 20:01:41,694 INFO [Listener at localhost/43553] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/60d35244-9efb-8171-b54c-79ea832c21da/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-15 20:01:41,694 INFO [Listener at localhost/43553] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/60d35244-9efb-8171-b54c-79ea832c21da/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-02-15 20:01:41,694 INFO [Listener at localhost/43553] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/60d35244-9efb-8171-b54c-79ea832c21da/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-02-15 20:01:41,698 WARN [Listener at localhost/43553] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-15 20:01:41,698 WARN [Listener at localhost/43553] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-15 20:01:41,737 WARN [Listener at localhost/43553] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-15 20:01:41,739 INFO [Listener at localhost/43553] log.Slf4jLog(67): jetty-6.1.26 2023-02-15 20:01:41,748 INFO [Listener at localhost/43553] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/60d35244-9efb-8171-b54c-79ea832c21da/java.io.tmpdir/Jetty_localhost_44281_hdfs____8snp3p/webapp 2023-02-15 20:01:41,855 INFO [Listener at localhost/43553] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:44281 2023-02-15 20:01:41,860 WARN [Listener at localhost/43553] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-15 20:01:41,860 WARN [Listener at localhost/43553] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-15 20:01:41,904 WARN [Listener at localhost/33775] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-15 20:01:41,921 WARN [Listener at localhost/33775] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-15 20:01:41,923 WARN [Listener at localhost/33775] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-15 20:01:41,924 INFO [Listener at localhost/33775] log.Slf4jLog(67): jetty-6.1.26 2023-02-15 20:01:41,930 INFO [Listener at localhost/33775] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/60d35244-9efb-8171-b54c-79ea832c21da/java.io.tmpdir/Jetty_localhost_37769_datanode____ccclz1/webapp 2023-02-15 20:01:42,036 INFO [Listener at localhost/33775] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:37769 2023-02-15 20:01:42,043 WARN [Listener at localhost/34815] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-15 20:01:42,064 WARN [Listener at localhost/34815] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-15 20:01:42,067 WARN [Listener at localhost/34815] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-15 20:01:42,069 INFO [Listener at localhost/34815] log.Slf4jLog(67): jetty-6.1.26 2023-02-15 20:01:42,077 INFO [Listener at localhost/34815] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/60d35244-9efb-8171-b54c-79ea832c21da/java.io.tmpdir/Jetty_localhost_37957_datanode____98puse/webapp 2023-02-15 20:01:42,152 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xca4649eb134c333: Processing first storage report for DS-bbd70589-1056-49a1-b5a3-6c58cfe02501 from datanode c8cdff00-76ee-4871-be6e-5c223c20dee8 2023-02-15 20:01:42,153 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xca4649eb134c333: from storage DS-bbd70589-1056-49a1-b5a3-6c58cfe02501 node DatanodeRegistration(127.0.0.1:45337, datanodeUuid=c8cdff00-76ee-4871-be6e-5c223c20dee8, infoPort=43733, infoSecurePort=0, ipcPort=34815, storageInfo=lv=-57;cid=testClusterID;nsid=982387358;c=1676491301701), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-15 20:01:42,153 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xca4649eb134c333: Processing first storage report for DS-c2f9d72f-d853-4ab7-9e68-3254e8590120 from datanode c8cdff00-76ee-4871-be6e-5c223c20dee8 2023-02-15 20:01:42,153 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xca4649eb134c333: from storage DS-c2f9d72f-d853-4ab7-9e68-3254e8590120 node DatanodeRegistration(127.0.0.1:45337, datanodeUuid=c8cdff00-76ee-4871-be6e-5c223c20dee8, infoPort=43733, infoSecurePort=0, ipcPort=34815, storageInfo=lv=-57;cid=testClusterID;nsid=982387358;c=1676491301701), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-15 20:01:42,194 INFO [Listener at localhost/34815] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:37957 2023-02-15 20:01:42,208 WARN [Listener at localhost/34695] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-15 20:01:42,323 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x25025af996e5a58f: Processing first storage report for DS-8191fa34-3242-4f00-927a-28d310175376 from datanode a1bdfa59-597f-4053-9843-91f85b4a168f 2023-02-15 20:01:42,323 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x25025af996e5a58f: from storage DS-8191fa34-3242-4f00-927a-28d310175376 node DatanodeRegistration(127.0.0.1:43605, datanodeUuid=a1bdfa59-597f-4053-9843-91f85b4a168f, infoPort=45339, infoSecurePort=0, ipcPort=34695, storageInfo=lv=-57;cid=testClusterID;nsid=982387358;c=1676491301701), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-15 20:01:42,323 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x25025af996e5a58f: Processing first storage report for DS-f8ac0115-f3e4-4978-a4a8-42f57e9858b8 from datanode a1bdfa59-597f-4053-9843-91f85b4a168f 2023-02-15 20:01:42,323 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x25025af996e5a58f: from storage DS-f8ac0115-f3e4-4978-a4a8-42f57e9858b8 node DatanodeRegistration(127.0.0.1:43605, datanodeUuid=a1bdfa59-597f-4053-9843-91f85b4a168f, infoPort=45339, infoSecurePort=0, ipcPort=34695, storageInfo=lv=-57;cid=testClusterID;nsid=982387358;c=1676491301701), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-15 20:01:42,418 DEBUG [Listener at localhost/34695] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/60d35244-9efb-8171-b54c-79ea832c21da 2023-02-15 20:01:42,420 INFO [Listener at localhost/34695] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/60d35244-9efb-8171-b54c-79ea832c21da/cluster_2e3ec7f8-62e9-c847-6b18-7328346b74c4/zookeeper_0, clientPort=61407, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/60d35244-9efb-8171-b54c-79ea832c21da/cluster_2e3ec7f8-62e9-c847-6b18-7328346b74c4/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/60d35244-9efb-8171-b54c-79ea832c21da/cluster_2e3ec7f8-62e9-c847-6b18-7328346b74c4/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-02-15 20:01:42,421 INFO [Listener at localhost/34695] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=61407 2023-02-15 20:01:42,421 INFO [Listener at localhost/34695] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-15 20:01:42,423 INFO [Listener at localhost/34695] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-15 20:01:42,435 INFO [Listener at localhost/34695] util.FSUtils(479): Created version file at hdfs://localhost:33775/user/jenkins/test-data/1089ab4b-ae96-4b07-8e73-9617cf0f2504 with version=8 2023-02-15 20:01:42,436 INFO [Listener at localhost/34695] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-15 20:01:42,437 INFO [Listener at localhost/34695] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-15 20:01:42,438 INFO [Listener at localhost/34695] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:33775/user/jenkins/test-data/e1346e9a-ebf6-316f-c458-1c6b009bbc08/hbase-staging 2023-02-15 20:01:42,440 INFO [Listener at localhost/34695] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-02-15 20:01:42,440 INFO [Listener at localhost/34695] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-15 20:01:42,440 INFO [Listener at localhost/34695] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-15 20:01:42,440 INFO [Listener at localhost/34695] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-15 20:01:42,441 INFO [Listener at localhost/34695] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-15 20:01:42,441 INFO [Listener at localhost/34695] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-15 20:01:42,441 INFO [Listener at localhost/34695] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-02-15 20:01:42,442 INFO [Listener at localhost/34695] ipc.NettyRpcServer(120): Bind to /172.31.14.131:45885 2023-02-15 20:01:42,442 INFO [Listener at localhost/34695] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-15 20:01:42,443 INFO [Listener at localhost/34695] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-15 20:01:42,444 INFO [Listener at localhost/34695] zookeeper.RecoverableZooKeeper(93): Process identifier=master:45885 connecting to ZooKeeper ensemble=127.0.0.1:61407 2023-02-15 20:01:42,456 DEBUG [Listener at localhost/34695-EventThread] zookeeper.ZKWatcher(600): master:458850x0, quorum=127.0.0.1:61407, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-15 20:01:42,462 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): master:45885-0x10059930fd80000 connected 2023-02-15 20:01:42,476 DEBUG [Listener at localhost/34695] zookeeper.ZKUtil(164): master:45885-0x10059930fd80000, quorum=127.0.0.1:61407, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-15 20:01:42,476 DEBUG [Listener at localhost/34695] zookeeper.ZKUtil(164): master:45885-0x10059930fd80000, quorum=127.0.0.1:61407, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-15 20:01:42,477 DEBUG [Listener at localhost/34695] zookeeper.ZKUtil(164): master:45885-0x10059930fd80000, quorum=127.0.0.1:61407, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-15 20:01:42,477 DEBUG [Listener at localhost/34695] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=45885 2023-02-15 20:01:42,477 DEBUG [Listener at localhost/34695] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=45885 2023-02-15 20:01:42,478 DEBUG [Listener at localhost/34695] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=45885 2023-02-15 20:01:42,478 DEBUG [Listener at localhost/34695] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=45885 2023-02-15 20:01:42,478 DEBUG [Listener at localhost/34695] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=45885 2023-02-15 20:01:42,478 INFO [Listener at localhost/34695] master.HMaster(444): hbase.rootdir=hdfs://localhost:33775/user/jenkins/test-data/1089ab4b-ae96-4b07-8e73-9617cf0f2504, hbase.cluster.distributed=false 2023-02-15 20:01:42,491 INFO [Listener at localhost/34695] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-15 20:01:42,491 INFO [Listener at localhost/34695] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-15 20:01:42,491 INFO [Listener at localhost/34695] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-15 20:01:42,491 INFO [Listener at localhost/34695] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-15 20:01:42,491 INFO [Listener at localhost/34695] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-15 20:01:42,491 INFO [Listener at localhost/34695] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-15 20:01:42,491 INFO [Listener at localhost/34695] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-15 20:01:42,492 INFO [Listener at localhost/34695] ipc.NettyRpcServer(120): Bind to /172.31.14.131:38321 2023-02-15 20:01:42,492 INFO [Listener at localhost/34695] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-15 20:01:42,495 DEBUG [Listener at localhost/34695] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-15 20:01:42,495 INFO [Listener at localhost/34695] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-15 20:01:42,496 INFO [Listener at localhost/34695] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-15 20:01:42,497 INFO [Listener at localhost/34695] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:38321 connecting to ZooKeeper ensemble=127.0.0.1:61407 2023-02-15 20:01:42,502 DEBUG [Listener at localhost/34695-EventThread] zookeeper.ZKWatcher(600): regionserver:383210x0, quorum=127.0.0.1:61407, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-15 20:01:42,503 DEBUG [Listener at localhost/34695] zookeeper.ZKUtil(164): regionserver:383210x0, quorum=127.0.0.1:61407, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-15 20:01:42,504 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:38321-0x10059930fd80001 connected 2023-02-15 20:01:42,504 DEBUG [Listener at localhost/34695] zookeeper.ZKUtil(164): regionserver:38321-0x10059930fd80001, quorum=127.0.0.1:61407, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-15 20:01:42,505 DEBUG [Listener at localhost/34695] zookeeper.ZKUtil(164): regionserver:38321-0x10059930fd80001, quorum=127.0.0.1:61407, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-15 20:01:42,506 DEBUG [Listener at localhost/34695] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=38321 2023-02-15 20:01:42,507 DEBUG [Listener at localhost/34695] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=38321 2023-02-15 20:01:42,507 DEBUG [Listener at localhost/34695] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=38321 2023-02-15 20:01:42,507 DEBUG [Listener at localhost/34695] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=38321 2023-02-15 20:01:42,507 DEBUG [Listener at localhost/34695] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=38321 2023-02-15 20:01:42,521 INFO [Listener at localhost/34695] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-15 20:01:42,521 INFO [Listener at localhost/34695] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-15 20:01:42,521 INFO [Listener at localhost/34695] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-15 20:01:42,521 INFO [Listener at localhost/34695] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-15 20:01:42,521 INFO [Listener at localhost/34695] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-15 20:01:42,521 INFO [Listener at localhost/34695] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-15 20:01:42,521 INFO [Listener at localhost/34695] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-15 20:01:42,522 INFO [Listener at localhost/34695] ipc.NettyRpcServer(120): Bind to /172.31.14.131:43045 2023-02-15 20:01:42,522 INFO [Listener at localhost/34695] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-15 20:01:42,522 DEBUG [Listener at localhost/34695] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-15 20:01:42,523 INFO [Listener at localhost/34695] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-15 20:01:42,523 INFO [Listener at localhost/34695] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-15 20:01:42,524 INFO [Listener at localhost/34695] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:43045 connecting to ZooKeeper ensemble=127.0.0.1:61407 2023-02-15 20:01:42,528 DEBUG [Listener at localhost/34695-EventThread] zookeeper.ZKWatcher(600): regionserver:430450x0, quorum=127.0.0.1:61407, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-15 20:01:42,529 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:43045-0x10059930fd80002 connected 2023-02-15 20:01:42,529 DEBUG [Listener at localhost/34695] zookeeper.ZKUtil(164): regionserver:43045-0x10059930fd80002, quorum=127.0.0.1:61407, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-15 20:01:42,530 DEBUG [Listener at localhost/34695] zookeeper.ZKUtil(164): regionserver:43045-0x10059930fd80002, quorum=127.0.0.1:61407, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-15 20:01:42,530 DEBUG [Listener at localhost/34695] zookeeper.ZKUtil(164): regionserver:43045-0x10059930fd80002, quorum=127.0.0.1:61407, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-15 20:01:42,531 DEBUG [Listener at localhost/34695] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=43045 2023-02-15 20:01:42,531 DEBUG [Listener at localhost/34695] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=43045 2023-02-15 20:01:42,531 DEBUG [Listener at localhost/34695] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=43045 2023-02-15 20:01:42,531 DEBUG [Listener at localhost/34695] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=43045 2023-02-15 20:01:42,531 DEBUG [Listener at localhost/34695] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=43045 2023-02-15 20:01:42,533 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,45885,1676491302440 2023-02-15 20:01:42,535 DEBUG [Listener at localhost/34695-EventThread] zookeeper.ZKWatcher(600): master:45885-0x10059930fd80000, quorum=127.0.0.1:61407, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-15 20:01:42,535 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:45885-0x10059930fd80000, quorum=127.0.0.1:61407, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,45885,1676491302440 2023-02-15 20:01:42,536 DEBUG [Listener at localhost/34695-EventThread] zookeeper.ZKWatcher(600): regionserver:38321-0x10059930fd80001, quorum=127.0.0.1:61407, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-15 20:01:42,536 DEBUG [Listener at localhost/34695-EventThread] zookeeper.ZKWatcher(600): master:45885-0x10059930fd80000, quorum=127.0.0.1:61407, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-15 20:01:42,537 DEBUG [Listener at localhost/34695-EventThread] zookeeper.ZKWatcher(600): master:45885-0x10059930fd80000, quorum=127.0.0.1:61407, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-15 20:01:42,537 DEBUG [Listener at localhost/34695-EventThread] zookeeper.ZKWatcher(600): regionserver:43045-0x10059930fd80002, quorum=127.0.0.1:61407, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-15 20:01:42,538 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:45885-0x10059930fd80000, quorum=127.0.0.1:61407, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-15 20:01:42,539 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,45885,1676491302440 from backup master directory 2023-02-15 20:01:42,542 DEBUG [Listener at localhost/34695-EventThread] zookeeper.ZKWatcher(600): master:45885-0x10059930fd80000, quorum=127.0.0.1:61407, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,45885,1676491302440 2023-02-15 20:01:42,542 DEBUG [Listener at localhost/34695-EventThread] zookeeper.ZKWatcher(600): master:45885-0x10059930fd80000, quorum=127.0.0.1:61407, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-15 20:01:42,542 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-15 20:01:42,542 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase4.apache.org,45885,1676491302440 2023-02-15 20:01:42,542 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:45885-0x10059930fd80000, quorum=127.0.0.1:61407, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-15 20:01:42,557 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(628): Created cluster ID file at hdfs://localhost:33775/user/jenkins/test-data/1089ab4b-ae96-4b07-8e73-9617cf0f2504/hbase.id with ID: 884cf748-b330-44cd-8fe0-79f84421fe29 2023-02-15 20:01:42,566 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-15 20:01:42,568 DEBUG [Listener at localhost/34695-EventThread] zookeeper.ZKWatcher(600): master:45885-0x10059930fd80000, quorum=127.0.0.1:61407, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-15 20:01:42,977 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x5acfb3be to 127.0.0.1:61407 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-15 20:01:42,982 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7015dd88, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-15 20:01:42,982 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-15 20:01:42,983 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-02-15 20:01:42,983 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-15 20:01:42,984 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7689): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:33775/user/jenkins/test-data/1089ab4b-ae96-4b07-8e73-9617cf0f2504/MasterData/data/master/store-tmp 2023-02-15 20:01:42,994 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 20:01:42,994 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-15 20:01:42,994 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-15 20:01:42,995 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-15 20:01:42,995 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-15 20:01:42,995 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-15 20:01:42,995 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-15 20:01:42,995 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-15 20:01:42,995 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:33775/user/jenkins/test-data/1089ab4b-ae96-4b07-8e73-9617cf0f2504/MasterData/WALs/jenkins-hbase4.apache.org,45885,1676491302440 2023-02-15 20:01:42,998 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C45885%2C1676491302440, suffix=, logDir=hdfs://localhost:33775/user/jenkins/test-data/1089ab4b-ae96-4b07-8e73-9617cf0f2504/MasterData/WALs/jenkins-hbase4.apache.org,45885,1676491302440, archiveDir=hdfs://localhost:33775/user/jenkins/test-data/1089ab4b-ae96-4b07-8e73-9617cf0f2504/MasterData/oldWALs, maxLogs=10 2023-02-15 20:01:43,014 DEBUG [RS-EventLoopGroup-17-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43605,DS-8191fa34-3242-4f00-927a-28d310175376,DISK] 2023-02-15 20:01:43,015 DEBUG [RS-EventLoopGroup-17-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45337,DS-bbd70589-1056-49a1-b5a3-6c58cfe02501,DISK] 2023-02-15 20:01:43,018 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/1089ab4b-ae96-4b07-8e73-9617cf0f2504/MasterData/WALs/jenkins-hbase4.apache.org,45885,1676491302440/jenkins-hbase4.apache.org%2C45885%2C1676491302440.1676491302998 2023-02-15 20:01:43,018 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:43605,DS-8191fa34-3242-4f00-927a-28d310175376,DISK], DatanodeInfoWithStorage[127.0.0.1:45337,DS-bbd70589-1056-49a1-b5a3-6c58cfe02501,DISK]] 2023-02-15 20:01:43,018 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7850): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-02-15 20:01:43,018 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 20:01:43,019 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7890): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-02-15 20:01:43,019 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7893): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-02-15 20:01:43,020 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-02-15 20:01:43,021 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33775/user/jenkins/test-data/1089ab4b-ae96-4b07-8e73-9617cf0f2504/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-02-15 20:01:43,021 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-02-15 20:01:43,022 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 20:01:43,022 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33775/user/jenkins/test-data/1089ab4b-ae96-4b07-8e73-9617cf0f2504/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-15 20:01:43,023 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33775/user/jenkins/test-data/1089ab4b-ae96-4b07-8e73-9617cf0f2504/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-15 20:01:43,025 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1054): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-02-15 20:01:43,027 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33775/user/jenkins/test-data/1089ab4b-ae96-4b07-8e73-9617cf0f2504/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-15 20:01:43,027 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1071): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60563095, jitterRate=-0.09753955900669098}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-15 20:01:43,027 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(964): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-15 20:01:43,027 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-02-15 20:01:43,029 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-02-15 20:01:43,029 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-02-15 20:01:43,029 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-02-15 20:01:43,030 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 0 msec 2023-02-15 20:01:43,030 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 0 msec 2023-02-15 20:01:43,030 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(95): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-02-15 20:01:43,031 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-02-15 20:01:43,031 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-02-15 20:01:43,043 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-02-15 20:01:43,043 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-02-15 20:01:43,043 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:45885-0x10059930fd80000, quorum=127.0.0.1:61407, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-02-15 20:01:43,044 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-02-15 20:01:43,044 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:45885-0x10059930fd80000, quorum=127.0.0.1:61407, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-02-15 20:01:43,046 DEBUG [Listener at localhost/34695-EventThread] zookeeper.ZKWatcher(600): master:45885-0x10059930fd80000, quorum=127.0.0.1:61407, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-15 20:01:43,046 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:45885-0x10059930fd80000, quorum=127.0.0.1:61407, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-02-15 20:01:43,047 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:45885-0x10059930fd80000, quorum=127.0.0.1:61407, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-02-15 20:01:43,048 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:45885-0x10059930fd80000, quorum=127.0.0.1:61407, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-02-15 20:01:43,050 DEBUG [Listener at localhost/34695-EventThread] zookeeper.ZKWatcher(600): regionserver:38321-0x10059930fd80001, quorum=127.0.0.1:61407, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-15 20:01:43,050 DEBUG [Listener at localhost/34695-EventThread] zookeeper.ZKWatcher(600): master:45885-0x10059930fd80000, quorum=127.0.0.1:61407, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-15 20:01:43,050 DEBUG [Listener at localhost/34695-EventThread] zookeeper.ZKWatcher(600): regionserver:43045-0x10059930fd80002, quorum=127.0.0.1:61407, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-15 20:01:43,050 DEBUG [Listener at localhost/34695-EventThread] zookeeper.ZKWatcher(600): master:45885-0x10059930fd80000, quorum=127.0.0.1:61407, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-15 20:01:43,051 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase4.apache.org,45885,1676491302440, sessionid=0x10059930fd80000, setting cluster-up flag (Was=false) 2023-02-15 20:01:43,060 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-02-15 20:01:43,060 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,45885,1676491302440 2023-02-15 20:01:43,063 DEBUG [Listener at localhost/34695-EventThread] zookeeper.ZKWatcher(600): master:45885-0x10059930fd80000, quorum=127.0.0.1:61407, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-15 20:01:43,067 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-02-15 20:01:43,068 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,45885,1676491302440 2023-02-15 20:01:43,069 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:33775/user/jenkins/test-data/1089ab4b-ae96-4b07-8e73-9617cf0f2504/.hbase-snapshot/.tmp 2023-02-15 20:01:43,070 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-02-15 20:01:43,071 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-15 20:01:43,071 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-15 20:01:43,071 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-15 20:01:43,071 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-15 20:01:43,071 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-02-15 20:01:43,071 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 20:01:43,071 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-15 20:01:43,071 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 20:01:43,072 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1676491333072 2023-02-15 20:01:43,072 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-02-15 20:01:43,072 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-02-15 20:01:43,073 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-02-15 20:01:43,073 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-02-15 20:01:43,073 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-02-15 20:01:43,073 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-02-15 20:01:43,076 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-15 20:01:43,076 DEBUG [PEWorker-2] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-02-15 20:01:43,076 INFO [PEWorker-2] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-02-15 20:01:43,076 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-02-15 20:01:43,077 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-02-15 20:01:43,077 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-02-15 20:01:43,077 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-02-15 20:01:43,078 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-02-15 20:01:43,078 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676491303078,5,FailOnTimeoutGroup] 2023-02-15 20:01:43,078 INFO [PEWorker-2] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-15 20:01:43,078 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676491303078,5,FailOnTimeoutGroup] 2023-02-15 20:01:43,078 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-15 20:01:43,078 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-02-15 20:01:43,078 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-02-15 20:01:43,078 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-02-15 20:01:43,095 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:33775/user/jenkins/test-data/1089ab4b-ae96-4b07-8e73-9617cf0f2504/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-15 20:01:43,095 INFO [PEWorker-2] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:33775/user/jenkins/test-data/1089ab4b-ae96-4b07-8e73-9617cf0f2504/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-15 20:01:43,095 INFO [PEWorker-2] regionserver.HRegion(7671): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33775/user/jenkins/test-data/1089ab4b-ae96-4b07-8e73-9617cf0f2504 2023-02-15 20:01:43,104 DEBUG [PEWorker-2] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 20:01:43,105 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-15 20:01:43,106 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33775/user/jenkins/test-data/1089ab4b-ae96-4b07-8e73-9617cf0f2504/data/hbase/meta/1588230740/info 2023-02-15 20:01:43,107 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-15 20:01:43,107 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 20:01:43,107 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-15 20:01:43,108 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33775/user/jenkins/test-data/1089ab4b-ae96-4b07-8e73-9617cf0f2504/data/hbase/meta/1588230740/rep_barrier 2023-02-15 20:01:43,108 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-15 20:01:43,109 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 20:01:43,109 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-15 20:01:43,110 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33775/user/jenkins/test-data/1089ab4b-ae96-4b07-8e73-9617cf0f2504/data/hbase/meta/1588230740/table 2023-02-15 20:01:43,110 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-15 20:01:43,110 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 20:01:43,111 DEBUG [PEWorker-2] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33775/user/jenkins/test-data/1089ab4b-ae96-4b07-8e73-9617cf0f2504/data/hbase/meta/1588230740 2023-02-15 20:01:43,111 DEBUG [PEWorker-2] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33775/user/jenkins/test-data/1089ab4b-ae96-4b07-8e73-9617cf0f2504/data/hbase/meta/1588230740 2023-02-15 20:01:43,113 DEBUG [PEWorker-2] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-15 20:01:43,113 DEBUG [PEWorker-2] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-15 20:01:43,115 DEBUG [PEWorker-2] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33775/user/jenkins/test-data/1089ab4b-ae96-4b07-8e73-9617cf0f2504/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-15 20:01:43,115 INFO [PEWorker-2] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68163548, jitterRate=0.01571601629257202}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-15 20:01:43,115 DEBUG [PEWorker-2] regionserver.HRegion(964): Region open journal for 1588230740: 2023-02-15 20:01:43,115 DEBUG [PEWorker-2] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-15 20:01:43,115 INFO [PEWorker-2] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-15 20:01:43,116 DEBUG [PEWorker-2] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-15 20:01:43,116 DEBUG [PEWorker-2] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-15 20:01:43,116 DEBUG [PEWorker-2] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-15 20:01:43,116 INFO [PEWorker-2] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-15 20:01:43,116 DEBUG [PEWorker-2] regionserver.HRegion(1557): Region close journal for 1588230740: 2023-02-15 20:01:43,117 DEBUG [PEWorker-2] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-02-15 20:01:43,117 INFO [PEWorker-2] procedure.InitMetaProcedure(103): Going to assign meta 2023-02-15 20:01:43,117 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-02-15 20:01:43,119 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-02-15 20:01:43,124 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-02-15 20:01:43,134 INFO [RS:1;jenkins-hbase4:43045] regionserver.HRegionServer(952): ClusterId : 884cf748-b330-44cd-8fe0-79f84421fe29 2023-02-15 20:01:43,134 DEBUG [RS:1;jenkins-hbase4:43045] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-15 20:01:43,134 INFO [RS:0;jenkins-hbase4:38321] regionserver.HRegionServer(952): ClusterId : 884cf748-b330-44cd-8fe0-79f84421fe29 2023-02-15 20:01:43,134 DEBUG [RS:0;jenkins-hbase4:38321] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-15 20:01:43,139 DEBUG [RS:0;jenkins-hbase4:38321] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-15 20:01:43,139 DEBUG [RS:1;jenkins-hbase4:43045] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-15 20:01:43,139 DEBUG [RS:1;jenkins-hbase4:43045] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-15 20:01:43,139 DEBUG [RS:0;jenkins-hbase4:38321] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-15 20:01:43,143 DEBUG [RS:1;jenkins-hbase4:43045] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-15 20:01:43,144 DEBUG [RS:0;jenkins-hbase4:38321] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-15 20:01:43,146 DEBUG [RS:1;jenkins-hbase4:43045] zookeeper.ReadOnlyZKClient(139): Connect 0x691e4f34 to 127.0.0.1:61407 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-15 20:01:43,146 DEBUG [RS:0;jenkins-hbase4:38321] zookeeper.ReadOnlyZKClient(139): Connect 0x5e2bbef1 to 127.0.0.1:61407 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-15 20:01:43,157 DEBUG [RS:1;jenkins-hbase4:43045] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@67d9bc67, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-15 20:01:43,157 DEBUG [RS:0;jenkins-hbase4:38321] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@50ec5b44, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-15 20:01:43,157 DEBUG [RS:1;jenkins-hbase4:43045] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@63e62444, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-15 20:01:43,157 DEBUG [RS:0;jenkins-hbase4:38321] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@54d3d581, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-15 20:01:43,171 DEBUG [RS:1;jenkins-hbase4:43045] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:43045 2023-02-15 20:01:43,171 DEBUG [RS:0;jenkins-hbase4:38321] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:38321 2023-02-15 20:01:43,171 INFO [RS:1;jenkins-hbase4:43045] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-15 20:01:43,171 INFO [RS:1;jenkins-hbase4:43045] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-15 20:01:43,171 INFO [RS:0;jenkins-hbase4:38321] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-15 20:01:43,171 INFO [RS:0;jenkins-hbase4:38321] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-15 20:01:43,171 DEBUG [RS:1;jenkins-hbase4:43045] regionserver.HRegionServer(1023): About to register with Master. 2023-02-15 20:01:43,171 DEBUG [RS:0;jenkins-hbase4:38321] regionserver.HRegionServer(1023): About to register with Master. 2023-02-15 20:01:43,172 INFO [RS:0;jenkins-hbase4:38321] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,45885,1676491302440 with isa=jenkins-hbase4.apache.org/172.31.14.131:38321, startcode=1676491302490 2023-02-15 20:01:43,172 INFO [RS:1;jenkins-hbase4:43045] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,45885,1676491302440 with isa=jenkins-hbase4.apache.org/172.31.14.131:43045, startcode=1676491302520 2023-02-15 20:01:43,172 DEBUG [RS:0;jenkins-hbase4:38321] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-15 20:01:43,172 DEBUG [RS:1;jenkins-hbase4:43045] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-15 20:01:43,174 INFO [RS-EventLoopGroup-15-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51355, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.9 (auth:SIMPLE), service=RegionServerStatusService 2023-02-15 20:01:43,177 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45885] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,43045,1676491302520 2023-02-15 20:01:43,178 INFO [RS-EventLoopGroup-15-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48845, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.8 (auth:SIMPLE), service=RegionServerStatusService 2023-02-15 20:01:43,178 DEBUG [RS:1;jenkins-hbase4:43045] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:33775/user/jenkins/test-data/1089ab4b-ae96-4b07-8e73-9617cf0f2504 2023-02-15 20:01:43,178 DEBUG [RS:1;jenkins-hbase4:43045] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:33775 2023-02-15 20:01:43,178 DEBUG [RS:1;jenkins-hbase4:43045] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-15 20:01:43,178 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45885] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,38321,1676491302490 2023-02-15 20:01:43,178 DEBUG [RS:0;jenkins-hbase4:38321] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:33775/user/jenkins/test-data/1089ab4b-ae96-4b07-8e73-9617cf0f2504 2023-02-15 20:01:43,178 DEBUG [RS:0;jenkins-hbase4:38321] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:33775 2023-02-15 20:01:43,178 DEBUG [RS:0;jenkins-hbase4:38321] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-15 20:01:43,180 DEBUG [Listener at localhost/34695-EventThread] zookeeper.ZKWatcher(600): master:45885-0x10059930fd80000, quorum=127.0.0.1:61407, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-15 20:01:43,183 DEBUG [RS:1;jenkins-hbase4:43045] zookeeper.ZKUtil(162): regionserver:43045-0x10059930fd80002, quorum=127.0.0.1:61407, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,43045,1676491302520 2023-02-15 20:01:43,183 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,38321,1676491302490] 2023-02-15 20:01:43,183 WARN [RS:1;jenkins-hbase4:43045] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-15 20:01:43,183 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,43045,1676491302520] 2023-02-15 20:01:43,183 DEBUG [RS:0;jenkins-hbase4:38321] zookeeper.ZKUtil(162): regionserver:38321-0x10059930fd80001, quorum=127.0.0.1:61407, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,38321,1676491302490 2023-02-15 20:01:43,183 INFO [RS:1;jenkins-hbase4:43045] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-15 20:01:43,183 WARN [RS:0;jenkins-hbase4:38321] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-15 20:01:43,184 DEBUG [RS:1;jenkins-hbase4:43045] regionserver.HRegionServer(1947): logDir=hdfs://localhost:33775/user/jenkins/test-data/1089ab4b-ae96-4b07-8e73-9617cf0f2504/WALs/jenkins-hbase4.apache.org,43045,1676491302520 2023-02-15 20:01:43,184 INFO [RS:0;jenkins-hbase4:38321] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-15 20:01:43,184 DEBUG [RS:0;jenkins-hbase4:38321] regionserver.HRegionServer(1947): logDir=hdfs://localhost:33775/user/jenkins/test-data/1089ab4b-ae96-4b07-8e73-9617cf0f2504/WALs/jenkins-hbase4.apache.org,38321,1676491302490 2023-02-15 20:01:43,192 DEBUG [RS:0;jenkins-hbase4:38321] zookeeper.ZKUtil(162): regionserver:38321-0x10059930fd80001, quorum=127.0.0.1:61407, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,38321,1676491302490 2023-02-15 20:01:43,192 DEBUG [RS:1;jenkins-hbase4:43045] zookeeper.ZKUtil(162): regionserver:43045-0x10059930fd80002, quorum=127.0.0.1:61407, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,38321,1676491302490 2023-02-15 20:01:43,192 DEBUG [RS:0;jenkins-hbase4:38321] zookeeper.ZKUtil(162): regionserver:38321-0x10059930fd80001, quorum=127.0.0.1:61407, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,43045,1676491302520 2023-02-15 20:01:43,193 DEBUG [RS:1;jenkins-hbase4:43045] zookeeper.ZKUtil(162): regionserver:43045-0x10059930fd80002, quorum=127.0.0.1:61407, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,43045,1676491302520 2023-02-15 20:01:43,193 DEBUG [RS:0;jenkins-hbase4:38321] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-15 20:01:43,193 DEBUG [RS:1;jenkins-hbase4:43045] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-15 20:01:43,193 INFO [RS:0;jenkins-hbase4:38321] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-15 20:01:43,194 INFO [RS:1;jenkins-hbase4:43045] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-15 20:01:43,196 INFO [RS:0;jenkins-hbase4:38321] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-15 20:01:43,199 INFO [RS:1;jenkins-hbase4:43045] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-15 20:01:43,200 INFO [RS:0;jenkins-hbase4:38321] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-15 20:01:43,200 INFO [RS:1;jenkins-hbase4:43045] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-15 20:01:43,200 INFO [RS:0;jenkins-hbase4:38321] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-15 20:01:43,200 INFO [RS:1;jenkins-hbase4:43045] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-15 20:01:43,200 INFO [RS:0;jenkins-hbase4:38321] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-15 20:01:43,204 INFO [RS:1;jenkins-hbase4:43045] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-15 20:01:43,206 INFO [RS:1;jenkins-hbase4:43045] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-15 20:01:43,206 DEBUG [RS:1;jenkins-hbase4:43045] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 20:01:43,206 DEBUG [RS:1;jenkins-hbase4:43045] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 20:01:43,207 DEBUG [RS:1;jenkins-hbase4:43045] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 20:01:43,207 DEBUG [RS:1;jenkins-hbase4:43045] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 20:01:43,207 DEBUG [RS:1;jenkins-hbase4:43045] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 20:01:43,207 DEBUG [RS:1;jenkins-hbase4:43045] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-15 20:01:43,207 DEBUG [RS:1;jenkins-hbase4:43045] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 20:01:43,207 DEBUG [RS:1;jenkins-hbase4:43045] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 20:01:43,207 DEBUG [RS:1;jenkins-hbase4:43045] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 20:01:43,207 DEBUG [RS:1;jenkins-hbase4:43045] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 20:01:43,211 INFO [RS:1;jenkins-hbase4:43045] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-15 20:01:43,211 INFO [RS:0;jenkins-hbase4:38321] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-15 20:01:43,211 INFO [RS:1;jenkins-hbase4:43045] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-15 20:01:43,212 DEBUG [RS:0;jenkins-hbase4:38321] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 20:01:43,212 INFO [RS:1;jenkins-hbase4:43045] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-15 20:01:43,212 DEBUG [RS:0;jenkins-hbase4:38321] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 20:01:43,212 DEBUG [RS:0;jenkins-hbase4:38321] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 20:01:43,212 DEBUG [RS:0;jenkins-hbase4:38321] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 20:01:43,212 DEBUG [RS:0;jenkins-hbase4:38321] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 20:01:43,212 DEBUG [RS:0;jenkins-hbase4:38321] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-15 20:01:43,213 DEBUG [RS:0;jenkins-hbase4:38321] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 20:01:43,213 DEBUG [RS:0;jenkins-hbase4:38321] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 20:01:43,213 DEBUG [RS:0;jenkins-hbase4:38321] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 20:01:43,213 DEBUG [RS:0;jenkins-hbase4:38321] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 20:01:43,216 INFO [RS:0;jenkins-hbase4:38321] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-15 20:01:43,217 INFO [RS:0;jenkins-hbase4:38321] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-15 20:01:43,217 INFO [RS:0;jenkins-hbase4:38321] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-15 20:01:43,225 INFO [RS:1;jenkins-hbase4:43045] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-15 20:01:43,226 INFO [RS:1;jenkins-hbase4:43045] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,43045,1676491302520-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-15 20:01:43,230 INFO [RS:0;jenkins-hbase4:38321] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-15 20:01:43,230 INFO [RS:0;jenkins-hbase4:38321] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,38321,1676491302490-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-15 20:01:43,236 INFO [RS:1;jenkins-hbase4:43045] regionserver.Replication(203): jenkins-hbase4.apache.org,43045,1676491302520 started 2023-02-15 20:01:43,236 INFO [RS:1;jenkins-hbase4:43045] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,43045,1676491302520, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:43045, sessionid=0x10059930fd80002 2023-02-15 20:01:43,236 DEBUG [RS:1;jenkins-hbase4:43045] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-15 20:01:43,236 DEBUG [RS:1;jenkins-hbase4:43045] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,43045,1676491302520 2023-02-15 20:01:43,236 DEBUG [RS:1;jenkins-hbase4:43045] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,43045,1676491302520' 2023-02-15 20:01:43,236 DEBUG [RS:1;jenkins-hbase4:43045] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-15 20:01:43,236 DEBUG [RS:1;jenkins-hbase4:43045] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-15 20:01:43,237 DEBUG [RS:1;jenkins-hbase4:43045] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-15 20:01:43,237 DEBUG [RS:1;jenkins-hbase4:43045] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-15 20:01:43,237 DEBUG [RS:1;jenkins-hbase4:43045] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,43045,1676491302520 2023-02-15 20:01:43,237 DEBUG [RS:1;jenkins-hbase4:43045] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,43045,1676491302520' 2023-02-15 20:01:43,237 DEBUG [RS:1;jenkins-hbase4:43045] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-15 20:01:43,237 DEBUG [RS:1;jenkins-hbase4:43045] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-15 20:01:43,237 DEBUG [RS:1;jenkins-hbase4:43045] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-15 20:01:43,237 INFO [RS:1;jenkins-hbase4:43045] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-15 20:01:43,237 INFO [RS:1;jenkins-hbase4:43045] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-15 20:01:43,250 INFO [RS:0;jenkins-hbase4:38321] regionserver.Replication(203): jenkins-hbase4.apache.org,38321,1676491302490 started 2023-02-15 20:01:43,250 INFO [RS:0;jenkins-hbase4:38321] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,38321,1676491302490, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:38321, sessionid=0x10059930fd80001 2023-02-15 20:01:43,250 DEBUG [RS:0;jenkins-hbase4:38321] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-15 20:01:43,250 DEBUG [RS:0;jenkins-hbase4:38321] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,38321,1676491302490 2023-02-15 20:01:43,250 DEBUG [RS:0;jenkins-hbase4:38321] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,38321,1676491302490' 2023-02-15 20:01:43,250 DEBUG [RS:0;jenkins-hbase4:38321] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-15 20:01:43,250 DEBUG [RS:0;jenkins-hbase4:38321] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-15 20:01:43,251 DEBUG [RS:0;jenkins-hbase4:38321] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-15 20:01:43,251 DEBUG [RS:0;jenkins-hbase4:38321] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-15 20:01:43,251 DEBUG [RS:0;jenkins-hbase4:38321] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,38321,1676491302490 2023-02-15 20:01:43,251 DEBUG [RS:0;jenkins-hbase4:38321] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,38321,1676491302490' 2023-02-15 20:01:43,251 DEBUG [RS:0;jenkins-hbase4:38321] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-15 20:01:43,251 DEBUG [RS:0;jenkins-hbase4:38321] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-15 20:01:43,251 DEBUG [RS:0;jenkins-hbase4:38321] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-15 20:01:43,251 INFO [RS:0;jenkins-hbase4:38321] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-15 20:01:43,251 INFO [RS:0;jenkins-hbase4:38321] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-15 20:01:43,275 DEBUG [jenkins-hbase4:45885] assignment.AssignmentManager(2178): Processing assignQueue; systemServersCount=2, allServersCount=2 2023-02-15 20:01:43,275 DEBUG [jenkins-hbase4:45885] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-15 20:01:43,276 DEBUG [jenkins-hbase4:45885] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-15 20:01:43,276 DEBUG [jenkins-hbase4:45885] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-15 20:01:43,276 DEBUG [jenkins-hbase4:45885] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-15 20:01:43,277 INFO [PEWorker-4] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,43045,1676491302520, state=OPENING 2023-02-15 20:01:43,278 DEBUG [PEWorker-4] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-02-15 20:01:43,280 DEBUG [Listener at localhost/34695-EventThread] zookeeper.ZKWatcher(600): master:45885-0x10059930fd80000, quorum=127.0.0.1:61407, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-15 20:01:43,280 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-15 20:01:43,283 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,43045,1676491302520}] 2023-02-15 20:01:43,437 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,43045,1676491302520 2023-02-15 20:01:43,437 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-15 20:01:43,438 INFO [RS-EventLoopGroup-17-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60232, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-15 20:01:43,442 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:meta,,1.1588230740 2023-02-15 20:01:43,442 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-15 20:01:43,443 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C43045%2C1676491302520.meta, suffix=.meta, logDir=hdfs://localhost:33775/user/jenkins/test-data/1089ab4b-ae96-4b07-8e73-9617cf0f2504/WALs/jenkins-hbase4.apache.org,43045,1676491302520, archiveDir=hdfs://localhost:33775/user/jenkins/test-data/1089ab4b-ae96-4b07-8e73-9617cf0f2504/oldWALs, maxLogs=32 2023-02-15 20:01:43,456 DEBUG [RS-EventLoopGroup-17-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43605,DS-8191fa34-3242-4f00-927a-28d310175376,DISK] 2023-02-15 20:01:43,456 DEBUG [RS-EventLoopGroup-17-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45337,DS-bbd70589-1056-49a1-b5a3-6c58cfe02501,DISK] 2023-02-15 20:01:43,458 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/1089ab4b-ae96-4b07-8e73-9617cf0f2504/WALs/jenkins-hbase4.apache.org,43045,1676491302520/jenkins-hbase4.apache.org%2C43045%2C1676491302520.meta.1676491303443.meta 2023-02-15 20:01:43,458 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:43605,DS-8191fa34-3242-4f00-927a-28d310175376,DISK], DatanodeInfoWithStorage[127.0.0.1:45337,DS-bbd70589-1056-49a1-b5a3-6c58cfe02501,DISK]] 2023-02-15 20:01:43,458 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-02-15 20:01:43,458 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-02-15 20:01:43,459 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8546): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-02-15 20:01:43,459 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-02-15 20:01:43,459 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-02-15 20:01:43,459 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 20:01:43,459 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 1588230740 2023-02-15 20:01:43,459 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 1588230740 2023-02-15 20:01:43,460 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-15 20:01:43,461 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33775/user/jenkins/test-data/1089ab4b-ae96-4b07-8e73-9617cf0f2504/data/hbase/meta/1588230740/info 2023-02-15 20:01:43,461 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33775/user/jenkins/test-data/1089ab4b-ae96-4b07-8e73-9617cf0f2504/data/hbase/meta/1588230740/info 2023-02-15 20:01:43,461 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-15 20:01:43,462 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 20:01:43,462 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-15 20:01:43,462 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33775/user/jenkins/test-data/1089ab4b-ae96-4b07-8e73-9617cf0f2504/data/hbase/meta/1588230740/rep_barrier 2023-02-15 20:01:43,463 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33775/user/jenkins/test-data/1089ab4b-ae96-4b07-8e73-9617cf0f2504/data/hbase/meta/1588230740/rep_barrier 2023-02-15 20:01:43,463 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-15 20:01:43,463 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 20:01:43,463 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-15 20:01:43,464 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33775/user/jenkins/test-data/1089ab4b-ae96-4b07-8e73-9617cf0f2504/data/hbase/meta/1588230740/table 2023-02-15 20:01:43,464 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33775/user/jenkins/test-data/1089ab4b-ae96-4b07-8e73-9617cf0f2504/data/hbase/meta/1588230740/table 2023-02-15 20:01:43,464 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-15 20:01:43,465 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 20:01:43,465 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33775/user/jenkins/test-data/1089ab4b-ae96-4b07-8e73-9617cf0f2504/data/hbase/meta/1588230740 2023-02-15 20:01:43,466 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33775/user/jenkins/test-data/1089ab4b-ae96-4b07-8e73-9617cf0f2504/data/hbase/meta/1588230740 2023-02-15 20:01:43,468 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-15 20:01:43,468 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-15 20:01:43,469 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63237081, jitterRate=-0.05769406259059906}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-15 20:01:43,469 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 1588230740: 2023-02-15 20:01:43,470 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1676491303437 2023-02-15 20:01:43,473 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:meta,,1.1588230740 2023-02-15 20:01:43,473 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:meta,,1.1588230740 2023-02-15 20:01:43,474 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,43045,1676491302520, state=OPEN 2023-02-15 20:01:43,475 DEBUG [Listener at localhost/34695-EventThread] zookeeper.ZKWatcher(600): master:45885-0x10059930fd80000, quorum=127.0.0.1:61407, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-02-15 20:01:43,475 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-15 20:01:43,476 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-02-15 20:01:43,476 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,43045,1676491302520 in 195 msec 2023-02-15 20:01:43,477 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-02-15 20:01:43,477 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 359 msec 2023-02-15 20:01:43,479 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 409 msec 2023-02-15 20:01:43,479 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1676491303479, completionTime=-1 2023-02-15 20:01:43,479 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=2; waited=0ms, expected min=2 server(s), max=2 server(s), master is running 2023-02-15 20:01:43,479 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1519): Joining cluster... 2023-02-15 20:01:43,481 DEBUG [hconnection-0xeb99d18-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-15 20:01:43,482 INFO [RS-EventLoopGroup-17-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60244, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-15 20:01:43,484 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1531): Number of RegionServers=2 2023-02-15 20:01:43,484 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1676491363484 2023-02-15 20:01:43,484 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1676491423484 2023-02-15 20:01:43,484 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1538): Joined the cluster in 5 msec 2023-02-15 20:01:43,490 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,45885,1676491302440-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-15 20:01:43,490 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,45885,1676491302440-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-15 20:01:43,490 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,45885,1676491302440-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-15 20:01:43,490 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:45885, period=300000, unit=MILLISECONDS is enabled. 2023-02-15 20:01:43,490 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-02-15 20:01:43,490 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-02-15 20:01:43,490 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-15 20:01:43,491 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-02-15 20:01:43,491 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-02-15 20:01:43,493 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-02-15 20:01:43,493 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-15 20:01:43,495 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33775/user/jenkins/test-data/1089ab4b-ae96-4b07-8e73-9617cf0f2504/.tmp/data/hbase/namespace/e5544c0dfa65805513a9f030b3c1cb32 2023-02-15 20:01:43,495 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:33775/user/jenkins/test-data/1089ab4b-ae96-4b07-8e73-9617cf0f2504/.tmp/data/hbase/namespace/e5544c0dfa65805513a9f030b3c1cb32 empty. 2023-02-15 20:01:43,495 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33775/user/jenkins/test-data/1089ab4b-ae96-4b07-8e73-9617cf0f2504/.tmp/data/hbase/namespace/e5544c0dfa65805513a9f030b3c1cb32 2023-02-15 20:01:43,495 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-02-15 20:01:43,510 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:33775/user/jenkins/test-data/1089ab4b-ae96-4b07-8e73-9617cf0f2504/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-02-15 20:01:43,511 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7671): creating {ENCODED => e5544c0dfa65805513a9f030b3c1cb32, NAME => 'hbase:namespace,,1676491303490.e5544c0dfa65805513a9f030b3c1cb32.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33775/user/jenkins/test-data/1089ab4b-ae96-4b07-8e73-9617cf0f2504/.tmp 2023-02-15 20:01:43,517 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676491303490.e5544c0dfa65805513a9f030b3c1cb32.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 20:01:43,517 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1603): Closing e5544c0dfa65805513a9f030b3c1cb32, disabling compactions & flushes 2023-02-15 20:01:43,517 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676491303490.e5544c0dfa65805513a9f030b3c1cb32. 2023-02-15 20:01:43,517 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676491303490.e5544c0dfa65805513a9f030b3c1cb32. 2023-02-15 20:01:43,518 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676491303490.e5544c0dfa65805513a9f030b3c1cb32. after waiting 0 ms 2023-02-15 20:01:43,518 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676491303490.e5544c0dfa65805513a9f030b3c1cb32. 2023-02-15 20:01:43,518 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676491303490.e5544c0dfa65805513a9f030b3c1cb32. 2023-02-15 20:01:43,518 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1557): Region close journal for e5544c0dfa65805513a9f030b3c1cb32: 2023-02-15 20:01:43,519 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-02-15 20:01:43,520 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1676491303490.e5544c0dfa65805513a9f030b3c1cb32.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676491303520"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676491303520"}]},"ts":"1676491303520"} 2023-02-15 20:01:43,522 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-15 20:01:43,523 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-15 20:01:43,523 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676491303523"}]},"ts":"1676491303523"} 2023-02-15 20:01:43,524 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-02-15 20:01:43,528 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-15 20:01:43,529 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-15 20:01:43,529 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-15 20:01:43,529 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-15 20:01:43,529 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=e5544c0dfa65805513a9f030b3c1cb32, ASSIGN}] 2023-02-15 20:01:43,531 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=e5544c0dfa65805513a9f030b3c1cb32, ASSIGN 2023-02-15 20:01:43,532 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=e5544c0dfa65805513a9f030b3c1cb32, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43045,1676491302520; forceNewPlan=false, retain=false 2023-02-15 20:01:43,682 INFO [jenkins-hbase4:45885] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-15 20:01:43,682 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=e5544c0dfa65805513a9f030b3c1cb32, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43045,1676491302520 2023-02-15 20:01:43,683 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1676491303490.e5544c0dfa65805513a9f030b3c1cb32.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676491303682"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676491303682"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676491303682"}]},"ts":"1676491303682"} 2023-02-15 20:01:43,684 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure e5544c0dfa65805513a9f030b3c1cb32, server=jenkins-hbase4.apache.org,43045,1676491302520}] 2023-02-15 20:01:43,839 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:namespace,,1676491303490.e5544c0dfa65805513a9f030b3c1cb32. 2023-02-15 20:01:43,840 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C43045%2C1676491302520, suffix=, logDir=hdfs://localhost:33775/user/jenkins/test-data/1089ab4b-ae96-4b07-8e73-9617cf0f2504/WALs/jenkins-hbase4.apache.org,43045,1676491302520, archiveDir=hdfs://localhost:33775/user/jenkins/test-data/1089ab4b-ae96-4b07-8e73-9617cf0f2504/oldWALs, maxLogs=32 2023-02-15 20:01:43,859 DEBUG [RS-EventLoopGroup-17-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45337,DS-bbd70589-1056-49a1-b5a3-6c58cfe02501,DISK] 2023-02-15 20:01:43,859 DEBUG [RS-EventLoopGroup-17-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43605,DS-8191fa34-3242-4f00-927a-28d310175376,DISK] 2023-02-15 20:01:43,861 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/1089ab4b-ae96-4b07-8e73-9617cf0f2504/WALs/jenkins-hbase4.apache.org,43045,1676491302520/jenkins-hbase4.apache.org%2C43045%2C1676491302520.1676491303841 2023-02-15 20:01:43,861 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:45337,DS-bbd70589-1056-49a1-b5a3-6c58cfe02501,DISK], DatanodeInfoWithStorage[127.0.0.1:43605,DS-8191fa34-3242-4f00-927a-28d310175376,DISK]] 2023-02-15 20:01:43,861 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => e5544c0dfa65805513a9f030b3c1cb32, NAME => 'hbase:namespace,,1676491303490.e5544c0dfa65805513a9f030b3c1cb32.', STARTKEY => '', ENDKEY => ''} 2023-02-15 20:01:43,861 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace e5544c0dfa65805513a9f030b3c1cb32 2023-02-15 20:01:43,861 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676491303490.e5544c0dfa65805513a9f030b3c1cb32.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 20:01:43,861 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for e5544c0dfa65805513a9f030b3c1cb32 2023-02-15 20:01:43,862 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for e5544c0dfa65805513a9f030b3c1cb32 2023-02-15 20:01:43,863 INFO [StoreOpener-e5544c0dfa65805513a9f030b3c1cb32-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region e5544c0dfa65805513a9f030b3c1cb32 2023-02-15 20:01:43,864 DEBUG [StoreOpener-e5544c0dfa65805513a9f030b3c1cb32-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33775/user/jenkins/test-data/1089ab4b-ae96-4b07-8e73-9617cf0f2504/data/hbase/namespace/e5544c0dfa65805513a9f030b3c1cb32/info 2023-02-15 20:01:43,864 DEBUG [StoreOpener-e5544c0dfa65805513a9f030b3c1cb32-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33775/user/jenkins/test-data/1089ab4b-ae96-4b07-8e73-9617cf0f2504/data/hbase/namespace/e5544c0dfa65805513a9f030b3c1cb32/info 2023-02-15 20:01:43,864 INFO [StoreOpener-e5544c0dfa65805513a9f030b3c1cb32-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e5544c0dfa65805513a9f030b3c1cb32 columnFamilyName info 2023-02-15 20:01:43,864 INFO [StoreOpener-e5544c0dfa65805513a9f030b3c1cb32-1] regionserver.HStore(310): Store=e5544c0dfa65805513a9f030b3c1cb32/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 20:01:43,865 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33775/user/jenkins/test-data/1089ab4b-ae96-4b07-8e73-9617cf0f2504/data/hbase/namespace/e5544c0dfa65805513a9f030b3c1cb32 2023-02-15 20:01:43,865 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33775/user/jenkins/test-data/1089ab4b-ae96-4b07-8e73-9617cf0f2504/data/hbase/namespace/e5544c0dfa65805513a9f030b3c1cb32 2023-02-15 20:01:43,868 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for e5544c0dfa65805513a9f030b3c1cb32 2023-02-15 20:01:43,869 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33775/user/jenkins/test-data/1089ab4b-ae96-4b07-8e73-9617cf0f2504/data/hbase/namespace/e5544c0dfa65805513a9f030b3c1cb32/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-15 20:01:43,869 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened e5544c0dfa65805513a9f030b3c1cb32; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60702675, jitterRate=-0.09545965492725372}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-15 20:01:43,870 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for e5544c0dfa65805513a9f030b3c1cb32: 2023-02-15 20:01:43,870 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:namespace,,1676491303490.e5544c0dfa65805513a9f030b3c1cb32., pid=6, masterSystemTime=1676491303836 2023-02-15 20:01:43,873 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:namespace,,1676491303490.e5544c0dfa65805513a9f030b3c1cb32. 2023-02-15 20:01:43,873 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:namespace,,1676491303490.e5544c0dfa65805513a9f030b3c1cb32. 2023-02-15 20:01:43,873 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=e5544c0dfa65805513a9f030b3c1cb32, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43045,1676491302520 2023-02-15 20:01:43,873 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1676491303490.e5544c0dfa65805513a9f030b3c1cb32.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676491303873"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676491303873"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676491303873"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676491303873"}]},"ts":"1676491303873"} 2023-02-15 20:01:43,875 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-02-15 20:01:43,875 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure e5544c0dfa65805513a9f030b3c1cb32, server=jenkins-hbase4.apache.org,43045,1676491302520 in 190 msec 2023-02-15 20:01:43,877 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-02-15 20:01:43,877 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=e5544c0dfa65805513a9f030b3c1cb32, ASSIGN in 346 msec 2023-02-15 20:01:43,877 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-15 20:01:43,878 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676491303877"}]},"ts":"1676491303877"} 2023-02-15 20:01:43,879 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-02-15 20:01:43,880 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-02-15 20:01:43,881 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 390 msec 2023-02-15 20:01:43,892 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:45885-0x10059930fd80000, quorum=127.0.0.1:61407, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-02-15 20:01:43,893 DEBUG [Listener at localhost/34695-EventThread] zookeeper.ZKWatcher(600): master:45885-0x10059930fd80000, quorum=127.0.0.1:61407, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-02-15 20:01:43,894 DEBUG [Listener at localhost/34695-EventThread] zookeeper.ZKWatcher(600): master:45885-0x10059930fd80000, quorum=127.0.0.1:61407, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-15 20:01:43,897 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-02-15 20:01:43,905 DEBUG [Listener at localhost/34695-EventThread] zookeeper.ZKWatcher(600): master:45885-0x10059930fd80000, quorum=127.0.0.1:61407, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-15 20:01:43,907 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 11 msec 2023-02-15 20:01:43,918 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-02-15 20:01:43,924 DEBUG [Listener at localhost/34695-EventThread] zookeeper.ZKWatcher(600): master:45885-0x10059930fd80000, quorum=127.0.0.1:61407, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-15 20:01:43,926 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 7 msec 2023-02-15 20:01:43,933 DEBUG [Listener at localhost/34695-EventThread] zookeeper.ZKWatcher(600): master:45885-0x10059930fd80000, quorum=127.0.0.1:61407, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-02-15 20:01:43,934 DEBUG [Listener at localhost/34695-EventThread] zookeeper.ZKWatcher(600): master:45885-0x10059930fd80000, quorum=127.0.0.1:61407, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-02-15 20:01:43,934 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 1.392sec 2023-02-15 20:01:43,935 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-02-15 20:01:43,935 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-02-15 20:01:43,935 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-02-15 20:01:43,935 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,45885,1676491302440-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-02-15 20:01:43,935 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,45885,1676491302440-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-02-15 20:01:43,936 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-02-15 20:01:44,035 DEBUG [Listener at localhost/34695] zookeeper.ReadOnlyZKClient(139): Connect 0x14d52e2d to 127.0.0.1:61407 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-15 20:01:44,043 DEBUG [Listener at localhost/34695] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@77683ce7, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-15 20:01:44,044 DEBUG [hconnection-0x43ea7fe8-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-15 20:01:44,046 INFO [RS-EventLoopGroup-17-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60246, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-15 20:01:44,047 INFO [Listener at localhost/34695] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,45885,1676491302440 2023-02-15 20:01:44,048 DEBUG [Listener at localhost/34695] mapreduce.TableSnapshotInputFormatTestBase(193): Ensuring table doesn't exist. 2023-02-15 20:01:44,050 DEBUG [Listener at localhost/34695] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-15 20:01:44,051 INFO [RS-EventLoopGroup-15-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33672, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-15 20:01:44,052 INFO [Listener at localhost/34695] client.HBaseAdmin$15(890): Started disable of testWithMockedMapReduceSingleRegion 2023-02-15 20:01:44,052 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45885] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testWithMockedMapReduceSingleRegion 2023-02-15 20:01:44,052 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45885] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.TableNotFoundException: testWithMockedMapReduceSingleRegion at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.checkTableModifiable(AbstractStateMachineTableProcedure.java:125) at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.preflightChecks(AbstractStateMachineTableProcedure.java:157) at org.apache.hadoop.hbase.master.procedure.DisableTableProcedure.(DisableTableProcedure.java:78) at org.apache.hadoop.hbase.master.HMaster$11.run(HMaster.java:2429) at org.apache.hadoop.hbase.master.procedure.MasterProcedureUtil.submitProcedure(MasterProcedureUtil.java:132) at org.apache.hadoop.hbase.master.HMaster.disableTable(HMaster.java:2413) at org.apache.hadoop.hbase.master.MasterRpcServices.disableTable(MasterRpcServices.java:784) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-02-15 20:01:44,052 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45885] ipc.CallRunner(144): callId: 2 service: MasterService methodName: DisableTable size: 95 connection: 172.31.14.131:33672 deadline: 1676491364052, exception=org.apache.hadoop.hbase.TableNotFoundException: testWithMockedMapReduceSingleRegion 2023-02-15 20:01:44,053 INFO [Listener at localhost/34695] mapreduce.TableSnapshotInputFormatTestBase(199): creating table 'testWithMockedMapReduceSingleRegion' 2023-02-15 20:01:44,055 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45885] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testWithMockedMapReduceSingleRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-15 20:01:44,056 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45885] procedure2.ProcedureExecutor(1029): Stored pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testWithMockedMapReduceSingleRegion 2023-02-15 20:01:44,057 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testWithMockedMapReduceSingleRegion execute state=CREATE_TABLE_PRE_OPERATION 2023-02-15 20:01:44,057 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45885] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testWithMockedMapReduceSingleRegion" procId is: 10 2023-02-15 20:01:44,058 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testWithMockedMapReduceSingleRegion execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-15 20:01:44,058 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45885] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-15 20:01:44,059 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33775/user/jenkins/test-data/1089ab4b-ae96-4b07-8e73-9617cf0f2504/.tmp/data/default/testWithMockedMapReduceSingleRegion/0bde707836750663e729a0a0c206c460 2023-02-15 20:01:44,060 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:33775/user/jenkins/test-data/1089ab4b-ae96-4b07-8e73-9617cf0f2504/.tmp/data/default/testWithMockedMapReduceSingleRegion/0bde707836750663e729a0a0c206c460 empty. 2023-02-15 20:01:44,060 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33775/user/jenkins/test-data/1089ab4b-ae96-4b07-8e73-9617cf0f2504/.tmp/data/default/testWithMockedMapReduceSingleRegion/0bde707836750663e729a0a0c206c460 2023-02-15 20:01:44,060 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testWithMockedMapReduceSingleRegion regions 2023-02-15 20:01:44,068 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:33775/user/jenkins/test-data/1089ab4b-ae96-4b07-8e73-9617cf0f2504/.tmp/data/default/testWithMockedMapReduceSingleRegion/.tabledesc/.tableinfo.0000000001 2023-02-15 20:01:44,069 INFO [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(7671): creating {ENCODED => 0bde707836750663e729a0a0c206c460, NAME => 'testWithMockedMapReduceSingleRegion,,1676491304055.0bde707836750663e729a0a0c206c460.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testWithMockedMapReduceSingleRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33775/user/jenkins/test-data/1089ab4b-ae96-4b07-8e73-9617cf0f2504/.tmp 2023-02-15 20:01:44,075 DEBUG [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceSingleRegion,,1676491304055.0bde707836750663e729a0a0c206c460.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 20:01:44,075 DEBUG [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(1603): Closing 0bde707836750663e729a0a0c206c460, disabling compactions & flushes 2023-02-15 20:01:44,075 INFO [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceSingleRegion,,1676491304055.0bde707836750663e729a0a0c206c460. 2023-02-15 20:01:44,075 DEBUG [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceSingleRegion,,1676491304055.0bde707836750663e729a0a0c206c460. 2023-02-15 20:01:44,075 DEBUG [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceSingleRegion,,1676491304055.0bde707836750663e729a0a0c206c460. after waiting 0 ms 2023-02-15 20:01:44,075 DEBUG [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceSingleRegion,,1676491304055.0bde707836750663e729a0a0c206c460. 2023-02-15 20:01:44,075 INFO [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceSingleRegion,,1676491304055.0bde707836750663e729a0a0c206c460. 2023-02-15 20:01:44,075 DEBUG [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(1557): Region close journal for 0bde707836750663e729a0a0c206c460: 2023-02-15 20:01:44,076 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testWithMockedMapReduceSingleRegion execute state=CREATE_TABLE_ADD_TO_META 2023-02-15 20:01:44,077 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceSingleRegion,,1676491304055.0bde707836750663e729a0a0c206c460.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1676491304077"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676491304077"}]},"ts":"1676491304077"} 2023-02-15 20:01:44,079 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-15 20:01:44,079 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testWithMockedMapReduceSingleRegion execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-15 20:01:44,079 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMockedMapReduceSingleRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676491304079"}]},"ts":"1676491304079"} 2023-02-15 20:01:44,080 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testWithMockedMapReduceSingleRegion, state=ENABLING in hbase:meta 2023-02-15 20:01:44,083 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-15 20:01:44,084 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-15 20:01:44,084 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-15 20:01:44,084 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-15 20:01:44,084 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceSingleRegion, region=0bde707836750663e729a0a0c206c460, ASSIGN}] 2023-02-15 20:01:44,086 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceSingleRegion, region=0bde707836750663e729a0a0c206c460, ASSIGN 2023-02-15 20:01:44,086 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceSingleRegion, region=0bde707836750663e729a0a0c206c460, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,38321,1676491302490; forceNewPlan=false, retain=false 2023-02-15 20:01:44,159 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45885] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-15 20:01:44,236 INFO [jenkins-hbase4:45885] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-15 20:01:44,237 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=0bde707836750663e729a0a0c206c460, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,38321,1676491302490 2023-02-15 20:01:44,237 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceSingleRegion,,1676491304055.0bde707836750663e729a0a0c206c460.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1676491304237"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676491304237"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676491304237"}]},"ts":"1676491304237"} 2023-02-15 20:01:44,239 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=12, ppid=11, state=RUNNABLE; OpenRegionProcedure 0bde707836750663e729a0a0c206c460, server=jenkins-hbase4.apache.org,38321,1676491302490}] 2023-02-15 20:01:44,253 INFO [RS:0;jenkins-hbase4:38321] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C38321%2C1676491302490, suffix=, logDir=hdfs://localhost:33775/user/jenkins/test-data/1089ab4b-ae96-4b07-8e73-9617cf0f2504/WALs/jenkins-hbase4.apache.org,38321,1676491302490, archiveDir=hdfs://localhost:33775/user/jenkins/test-data/1089ab4b-ae96-4b07-8e73-9617cf0f2504/oldWALs, maxLogs=32 2023-02-15 20:01:44,268 DEBUG [RS-EventLoopGroup-17-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45337,DS-bbd70589-1056-49a1-b5a3-6c58cfe02501,DISK] 2023-02-15 20:01:44,268 DEBUG [RS-EventLoopGroup-17-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43605,DS-8191fa34-3242-4f00-927a-28d310175376,DISK] 2023-02-15 20:01:44,270 INFO [RS:0;jenkins-hbase4:38321] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/1089ab4b-ae96-4b07-8e73-9617cf0f2504/WALs/jenkins-hbase4.apache.org,38321,1676491302490/jenkins-hbase4.apache.org%2C38321%2C1676491302490.1676491304253 2023-02-15 20:01:44,272 DEBUG [RS:0;jenkins-hbase4:38321] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:45337,DS-bbd70589-1056-49a1-b5a3-6c58cfe02501,DISK], DatanodeInfoWithStorage[127.0.0.1:43605,DS-8191fa34-3242-4f00-927a-28d310175376,DISK]] 2023-02-15 20:01:44,361 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45885] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-15 20:01:44,391 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,38321,1676491302490 2023-02-15 20:01:44,391 DEBUG [RSProcedureDispatcher-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-15 20:01:44,393 INFO [RS-EventLoopGroup-16-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39274, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-15 20:01:44,396 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceSingleRegion,,1676491304055.0bde707836750663e729a0a0c206c460. 2023-02-15 20:01:44,396 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 0bde707836750663e729a0a0c206c460, NAME => 'testWithMockedMapReduceSingleRegion,,1676491304055.0bde707836750663e729a0a0c206c460.', STARTKEY => '', ENDKEY => ''} 2023-02-15 20:01:44,397 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceSingleRegion 0bde707836750663e729a0a0c206c460 2023-02-15 20:01:44,397 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceSingleRegion,,1676491304055.0bde707836750663e729a0a0c206c460.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 20:01:44,397 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 0bde707836750663e729a0a0c206c460 2023-02-15 20:01:44,397 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 0bde707836750663e729a0a0c206c460 2023-02-15 20:01:44,398 INFO [StoreOpener-0bde707836750663e729a0a0c206c460-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 0bde707836750663e729a0a0c206c460 2023-02-15 20:01:44,399 DEBUG [StoreOpener-0bde707836750663e729a0a0c206c460-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33775/user/jenkins/test-data/1089ab4b-ae96-4b07-8e73-9617cf0f2504/data/default/testWithMockedMapReduceSingleRegion/0bde707836750663e729a0a0c206c460/f1 2023-02-15 20:01:44,399 DEBUG [StoreOpener-0bde707836750663e729a0a0c206c460-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33775/user/jenkins/test-data/1089ab4b-ae96-4b07-8e73-9617cf0f2504/data/default/testWithMockedMapReduceSingleRegion/0bde707836750663e729a0a0c206c460/f1 2023-02-15 20:01:44,399 INFO [StoreOpener-0bde707836750663e729a0a0c206c460-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0bde707836750663e729a0a0c206c460 columnFamilyName f1 2023-02-15 20:01:44,400 INFO [StoreOpener-0bde707836750663e729a0a0c206c460-1] regionserver.HStore(310): Store=0bde707836750663e729a0a0c206c460/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 20:01:44,400 INFO [StoreOpener-0bde707836750663e729a0a0c206c460-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 0bde707836750663e729a0a0c206c460 2023-02-15 20:01:44,401 DEBUG [StoreOpener-0bde707836750663e729a0a0c206c460-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33775/user/jenkins/test-data/1089ab4b-ae96-4b07-8e73-9617cf0f2504/data/default/testWithMockedMapReduceSingleRegion/0bde707836750663e729a0a0c206c460/f2 2023-02-15 20:01:44,401 DEBUG [StoreOpener-0bde707836750663e729a0a0c206c460-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33775/user/jenkins/test-data/1089ab4b-ae96-4b07-8e73-9617cf0f2504/data/default/testWithMockedMapReduceSingleRegion/0bde707836750663e729a0a0c206c460/f2 2023-02-15 20:01:44,401 INFO [StoreOpener-0bde707836750663e729a0a0c206c460-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0bde707836750663e729a0a0c206c460 columnFamilyName f2 2023-02-15 20:01:44,401 INFO [StoreOpener-0bde707836750663e729a0a0c206c460-1] regionserver.HStore(310): Store=0bde707836750663e729a0a0c206c460/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 20:01:44,402 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33775/user/jenkins/test-data/1089ab4b-ae96-4b07-8e73-9617cf0f2504/data/default/testWithMockedMapReduceSingleRegion/0bde707836750663e729a0a0c206c460 2023-02-15 20:01:44,402 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33775/user/jenkins/test-data/1089ab4b-ae96-4b07-8e73-9617cf0f2504/data/default/testWithMockedMapReduceSingleRegion/0bde707836750663e729a0a0c206c460 2023-02-15 20:01:44,404 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceSingleRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-15 20:01:44,405 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 0bde707836750663e729a0a0c206c460 2023-02-15 20:01:44,407 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33775/user/jenkins/test-data/1089ab4b-ae96-4b07-8e73-9617cf0f2504/data/default/testWithMockedMapReduceSingleRegion/0bde707836750663e729a0a0c206c460/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-15 20:01:44,407 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 0bde707836750663e729a0a0c206c460; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67499563, jitterRate=0.0058218687772750854}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-15 20:01:44,407 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 0bde707836750663e729a0a0c206c460: 2023-02-15 20:01:44,408 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceSingleRegion,,1676491304055.0bde707836750663e729a0a0c206c460., pid=12, masterSystemTime=1676491304391 2023-02-15 20:01:44,414 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceSingleRegion,,1676491304055.0bde707836750663e729a0a0c206c460. 2023-02-15 20:01:44,414 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceSingleRegion,,1676491304055.0bde707836750663e729a0a0c206c460. 2023-02-15 20:01:44,415 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=0bde707836750663e729a0a0c206c460, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,38321,1676491302490 2023-02-15 20:01:44,415 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceSingleRegion,,1676491304055.0bde707836750663e729a0a0c206c460.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1676491304415"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676491304415"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676491304415"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676491304415"}]},"ts":"1676491304415"} 2023-02-15 20:01:44,418 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=12, resume processing ppid=11 2023-02-15 20:01:44,418 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=12, ppid=11, state=SUCCESS; OpenRegionProcedure 0bde707836750663e729a0a0c206c460, server=jenkins-hbase4.apache.org,38321,1676491302490 in 177 msec 2023-02-15 20:01:44,419 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-02-15 20:01:44,419 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceSingleRegion, region=0bde707836750663e729a0a0c206c460, ASSIGN in 334 msec 2023-02-15 20:01:44,420 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testWithMockedMapReduceSingleRegion execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-15 20:01:44,420 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMockedMapReduceSingleRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676491304420"}]},"ts":"1676491304420"} 2023-02-15 20:01:44,421 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testWithMockedMapReduceSingleRegion, state=ENABLED in hbase:meta 2023-02-15 20:01:44,423 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testWithMockedMapReduceSingleRegion execute state=CREATE_TABLE_POST_OPERATION 2023-02-15 20:01:44,424 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=10, state=SUCCESS; CreateTableProcedure table=testWithMockedMapReduceSingleRegion in 368 msec 2023-02-15 20:01:44,663 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45885] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-15 20:01:44,663 INFO [Listener at localhost/34695] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testWithMockedMapReduceSingleRegion, procId: 10 completed 2023-02-15 20:01:44,663 DEBUG [Listener at localhost/34695] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testWithMockedMapReduceSingleRegion get assigned. Timeout = 60000ms 2023-02-15 20:01:44,663 INFO [Listener at localhost/34695] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-15 20:01:44,666 INFO [Listener at localhost/34695] hbase.HBaseTestingUtility(3484): All regions for table testWithMockedMapReduceSingleRegion assigned to meta. Checking AM states. 2023-02-15 20:01:44,666 INFO [Listener at localhost/34695] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-15 20:01:44,666 INFO [Listener at localhost/34695] hbase.HBaseTestingUtility(3504): All regions for table testWithMockedMapReduceSingleRegion assigned. 2023-02-15 20:01:44,666 INFO [Listener at localhost/34695] mapreduce.TableSnapshotInputFormatTestBase(207): put some stuff in the table 2023-02-15 20:01:44,682 DEBUG [hconnection-0x43ea7fe8-shared-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-15 20:01:44,694 INFO [RS-EventLoopGroup-16-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39286, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-15 20:01:44,702 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38321] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 17576 Client: jenkins//172.31.14.131 first region in multi=testWithMockedMapReduceSingleRegion,,1676491304055.0bde707836750663e729a0a0c206c460. 2023-02-15 20:01:44,788 INFO [Listener at localhost/34695] mapreduce.TableSnapshotInputFormatTestBase(214): snapshot 2023-02-15 20:01:44,788 INFO [Listener at localhost/34695] snapshot.SnapshotTestingUtils(396): taking snapshot. 2023-02-15 20:01:44,789 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45885] master.MasterRpcServices(1580): Client=jenkins//172.31.14.131 snapshot request for:{ ss=testWithMockedMapReduceSingleRegion table=testWithMockedMapReduceSingleRegion type=FLUSH ttl=0 } 2023-02-15 20:01:44,789 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45885] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1676491304789 (current time:1676491304789). 2023-02-15 20:01:44,789 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45885] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-02-15 20:01:44,790 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45885] zookeeper.ReadOnlyZKClient(139): Connect 0x3132dba8 to 127.0.0.1:61407 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-15 20:01:44,797 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45885] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2609cbfa, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-15 20:01:44,799 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45885] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-15 20:01:44,800 INFO [RS-EventLoopGroup-17-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60252, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-15 20:01:44,801 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45885] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3132dba8 to 127.0.0.1:61407 2023-02-15 20:01:44,801 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45885] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-15 20:01:44,801 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45885] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-02-15 20:01:44,801 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45885] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=testWithMockedMapReduceSingleRegion table=testWithMockedMapReduceSingleRegion type=FLUSH ttl=0 } 2023-02-15 20:01:44,803 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45885] procedure2.ProcedureExecutor(1029): Stored pid=13, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=EXCLUSIVE 2023-02-15 20:01:44,804 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=13, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=EXCLUSIVE 2023-02-15 20:01:44,805 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=13, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=EXCLUSIVE; timeout=600000, timestamp=1676491904805 2023-02-15 20:01:44,805 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45885] snapshot.SnapshotManager(653): Started snapshot: { ss=testWithMockedMapReduceSingleRegion table=testWithMockedMapReduceSingleRegion type=FLUSH ttl=0 } 2023-02-15 20:01:44,805 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot testWithMockedMapReduceSingleRegion C_M_SNAPSHOT_TABLE on table testWithMockedMapReduceSingleRegion 2023-02-15 20:01:44,807 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=13, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=EXCLUSIVE 2023-02-15 20:01:44,807 DEBUG [Listener at localhost/34695] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=testWithMockedMapReduceSingleRegion table=testWithMockedMapReduceSingleRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-02-15 20:01:44,807 DEBUG [Listener at localhost/34695] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-02-15 20:01:44,807 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=14, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=SHARED 2023-02-15 20:01:44,808 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=13, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=EXCLUSIVE in 5 msec 2023-02-15 20:01:44,808 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=14, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=SHARED 2023-02-15 20:01:44,809 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=14, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=SHARED; timeout=600000, timestamp=1676491904809 2023-02-15 20:01:44,816 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure testWithMockedMapReduceSingleRegion 2023-02-15 20:01:44,816 INFO [(jenkins-hbase4.apache.org,45885,1676491302440)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMockedMapReduceSingleRegion' 2023-02-15 20:01:44,816 DEBUG [(jenkins-hbase4.apache.org,45885,1676491302440)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-15 20:01:44,817 DEBUG [(jenkins-hbase4.apache.org,45885,1676491302440)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMockedMapReduceSingleRegion' starting 'acquire' 2023-02-15 20:01:44,817 DEBUG [(jenkins-hbase4.apache.org,45885,1676491302440)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMockedMapReduceSingleRegion', kicking off acquire phase on members. 2023-02-15 20:01:44,817 DEBUG [(jenkins-hbase4.apache.org,45885,1676491302440)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45885-0x10059930fd80000, quorum=127.0.0.1:61407, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-15 20:01:44,817 DEBUG [(jenkins-hbase4.apache.org,45885,1676491302440)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion 2023-02-15 20:01:44,818 DEBUG [(jenkins-hbase4.apache.org,45885,1676491302440)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,38321,1676491302490 2023-02-15 20:01:44,818 DEBUG [Listener at localhost/34695-EventThread] zookeeper.ZKWatcher(600): regionserver:43045-0x10059930fd80002, quorum=127.0.0.1:61407, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-15 20:01:44,818 DEBUG [Listener at localhost/34695-EventThread] zookeeper.ZKWatcher(600): regionserver:38321-0x10059930fd80001, quorum=127.0.0.1:61407, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-15 20:01:44,818 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-15 20:01:44,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-15 20:01:44,818 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-15 20:01:44,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-15 20:01:44,819 DEBUG [(jenkins-hbase4.apache.org,45885,1676491302440)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45885-0x10059930fd80000, quorum=127.0.0.1:61407, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,38321,1676491302490 2023-02-15 20:01:44,819 DEBUG [(jenkins-hbase4.apache.org,45885,1676491302440)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-15 20:01:44,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion 2023-02-15 20:01:44,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion 2023-02-15 20:01:44,819 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43045-0x10059930fd80002, quorum=127.0.0.1:61407, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-15 20:01:44,819 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38321-0x10059930fd80001, quorum=127.0.0.1:61407, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-15 20:01:44,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 91 2023-02-15 20:01:44,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion 2023-02-15 20:01:44,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 91 2023-02-15 20:01:44,819 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMockedMapReduceSingleRegion from table testWithMockedMapReduceSingleRegion type FLUSH 2023-02-15 20:01:44,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion 2023-02-15 20:01:44,820 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMockedMapReduceSingleRegion from table testWithMockedMapReduceSingleRegion type FLUSH 2023-02-15 20:01:44,820 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMockedMapReduceSingleRegion 2023-02-15 20:01:44,820 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMockedMapReduceSingleRegion 2023-02-15 20:01:44,820 DEBUG [member: 'jenkins-hbase4.apache.org,43045,1676491302520' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMockedMapReduceSingleRegion' with timeout 300000ms 2023-02-15 20:01:44,820 DEBUG [member: 'jenkins-hbase4.apache.org,43045,1676491302520' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-15 20:01:44,820 DEBUG [member: 'jenkins-hbase4.apache.org,38321,1676491302490' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMockedMapReduceSingleRegion' with timeout 300000ms 2023-02-15 20:01:44,821 DEBUG [member: 'jenkins-hbase4.apache.org,43045,1676491302520' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMockedMapReduceSingleRegion' starting 'acquire' stage 2023-02-15 20:01:44,821 DEBUG [member: 'jenkins-hbase4.apache.org,43045,1676491302520' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMockedMapReduceSingleRegion' locally acquired 2023-02-15 20:01:44,821 DEBUG [member: 'jenkins-hbase4.apache.org,38321,1676491302490' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-15 20:01:44,821 DEBUG [member: 'jenkins-hbase4.apache.org,43045,1676491302520' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43045,1676491302520' joining acquired barrier for procedure (testWithMockedMapReduceSingleRegion) in zk 2023-02-15 20:01:44,821 DEBUG [member: 'jenkins-hbase4.apache.org,38321,1676491302490' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMockedMapReduceSingleRegion' starting 'acquire' stage 2023-02-15 20:01:44,821 DEBUG [member: 'jenkins-hbase4.apache.org,38321,1676491302490' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMockedMapReduceSingleRegion' locally acquired 2023-02-15 20:01:44,821 DEBUG [member: 'jenkins-hbase4.apache.org,38321,1676491302490' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38321,1676491302490' joining acquired barrier for procedure (testWithMockedMapReduceSingleRegion) in zk 2023-02-15 20:01:44,822 DEBUG [member: 'jenkins-hbase4.apache.org,43045,1676491302520' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-15 20:01:44,825 DEBUG [Listener at localhost/34695-EventThread] zookeeper.ZKWatcher(600): master:45885-0x10059930fd80000, quorum=127.0.0.1:61407, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,38321,1676491302490 2023-02-15 20:01:44,825 DEBUG [member: 'jenkins-hbase4.apache.org,38321,1676491302490' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-15 20:01:44,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,38321,1676491302490 2023-02-15 20:01:44,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-15 20:01:44,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-15 20:01:44,825 DEBUG [member: 'jenkins-hbase4.apache.org,43045,1676491302520' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43045-0x10059930fd80002, quorum=127.0.0.1:61407, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-15 20:01:44,825 DEBUG [member: 'jenkins-hbase4.apache.org,43045,1676491302520' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMockedMapReduceSingleRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-15 20:01:44,825 DEBUG [member: 'jenkins-hbase4.apache.org,38321,1676491302490' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38321-0x10059930fd80001, quorum=127.0.0.1:61407, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-15 20:01:44,825 DEBUG [member: 'jenkins-hbase4.apache.org,38321,1676491302490' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMockedMapReduceSingleRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-15 20:01:44,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-15 20:01:44,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-15 20:01:44,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-15 20:01:44,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38321,1676491302490 2023-02-15 20:01:44,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43045,1676491302520 2023-02-15 20:01:44,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-15 20:01:44,826 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38321,1676491302490' joining acquired barrier for procedure 'testWithMockedMapReduceSingleRegion' on coordinator 2023-02-15 20:01:44,826 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@20c7f60e[Count = 0] remaining members to acquire global barrier 2023-02-15 20:01:44,826 DEBUG [(jenkins-hbase4.apache.org,45885,1676491302440)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMockedMapReduceSingleRegion' starting 'in-barrier' execution. 2023-02-15 20:01:44,826 DEBUG [(jenkins-hbase4.apache.org,45885,1676491302440)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-15 20:01:44,827 DEBUG [Listener at localhost/34695-EventThread] zookeeper.ZKWatcher(600): regionserver:43045-0x10059930fd80002, quorum=127.0.0.1:61407, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-15 20:01:44,827 DEBUG [Listener at localhost/34695-EventThread] zookeeper.ZKWatcher(600): regionserver:38321-0x10059930fd80001, quorum=127.0.0.1:61407, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-15 20:01:44,827 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-15 20:01:44,827 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-15 20:01:44,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-15 20:01:44,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-15 20:01:44,828 DEBUG [member: 'jenkins-hbase4.apache.org,43045,1676491302520' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMockedMapReduceSingleRegion' received 'reached' from coordinator. 2023-02-15 20:01:44,828 DEBUG [member: 'jenkins-hbase4.apache.org,38321,1676491302490' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMockedMapReduceSingleRegion' received 'reached' from coordinator. 2023-02-15 20:01:44,828 DEBUG [member: 'jenkins-hbase4.apache.org,43045,1676491302520' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMockedMapReduceSingleRegion' locally completed 2023-02-15 20:01:44,828 DEBUG [(jenkins-hbase4.apache.org,45885,1676491302440)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45885-0x10059930fd80000, quorum=127.0.0.1:61407, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,38321,1676491302490 2023-02-15 20:01:44,828 DEBUG [(jenkins-hbase4.apache.org,45885,1676491302440)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-15 20:01:44,828 DEBUG [member: 'jenkins-hbase4.apache.org,43045,1676491302520' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMockedMapReduceSingleRegion' completed for member 'jenkins-hbase4.apache.org,43045,1676491302520' in zk 2023-02-15 20:01:44,828 DEBUG [member: 'jenkins-hbase4.apache.org,38321,1676491302490' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-02-15 20:01:44,828 DEBUG [rs(jenkins-hbase4.apache.org,38321,1676491302490)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceSingleRegion,,1676491304055.0bde707836750663e729a0a0c206c460. 2023-02-15 20:01:44,828 DEBUG [member: 'jenkins-hbase4.apache.org,38321,1676491302490' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-15 20:01:44,828 DEBUG [rs(jenkins-hbase4.apache.org,38321,1676491302490)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceSingleRegion,,1676491304055.0bde707836750663e729a0a0c206c460. started... 2023-02-15 20:01:44,828 INFO [rs(jenkins-hbase4.apache.org,38321,1676491302490)-snapshot-pool-0] regionserver.HRegion(2744): Flushing 0bde707836750663e729a0a0c206c460 2/2 column families, dataSize=1.01 MB heapSize=3.49 MB 2023-02-15 20:01:44,829 DEBUG [member: 'jenkins-hbase4.apache.org,43045,1676491302520' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMockedMapReduceSingleRegion' has notified controller of completion 2023-02-15 20:01:44,829 DEBUG [member: 'jenkins-hbase4.apache.org,43045,1676491302520' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-15 20:01:44,829 DEBUG [member: 'jenkins-hbase4.apache.org,43045,1676491302520' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMockedMapReduceSingleRegion' completed. 2023-02-15 20:01:44,844 INFO [rs(jenkins-hbase4.apache.org,38321,1676491302490)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=514.92 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:33775/user/jenkins/test-data/1089ab4b-ae96-4b07-8e73-9617cf0f2504/data/default/testWithMockedMapReduceSingleRegion/0bde707836750663e729a0a0c206c460/.tmp/f1/9084d569ff854e5b90241ef4321c2792 2023-02-15 20:01:44,864 INFO [rs(jenkins-hbase4.apache.org,38321,1676491302490)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=514.92 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:33775/user/jenkins/test-data/1089ab4b-ae96-4b07-8e73-9617cf0f2504/data/default/testWithMockedMapReduceSingleRegion/0bde707836750663e729a0a0c206c460/.tmp/f2/622c41a0ce3d494b85bb7f14221f2a91 2023-02-15 20:01:44,869 DEBUG [rs(jenkins-hbase4.apache.org,38321,1676491302490)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33775/user/jenkins/test-data/1089ab4b-ae96-4b07-8e73-9617cf0f2504/data/default/testWithMockedMapReduceSingleRegion/0bde707836750663e729a0a0c206c460/.tmp/f1/9084d569ff854e5b90241ef4321c2792 as hdfs://localhost:33775/user/jenkins/test-data/1089ab4b-ae96-4b07-8e73-9617cf0f2504/data/default/testWithMockedMapReduceSingleRegion/0bde707836750663e729a0a0c206c460/f1/9084d569ff854e5b90241ef4321c2792 2023-02-15 20:01:44,873 INFO [rs(jenkins-hbase4.apache.org,38321,1676491302490)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33775/user/jenkins/test-data/1089ab4b-ae96-4b07-8e73-9617cf0f2504/data/default/testWithMockedMapReduceSingleRegion/0bde707836750663e729a0a0c206c460/f1/9084d569ff854e5b90241ef4321c2792, entries=17576, sequenceid=5, filesize=537.3 K 2023-02-15 20:01:44,873 DEBUG [rs(jenkins-hbase4.apache.org,38321,1676491302490)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33775/user/jenkins/test-data/1089ab4b-ae96-4b07-8e73-9617cf0f2504/data/default/testWithMockedMapReduceSingleRegion/0bde707836750663e729a0a0c206c460/.tmp/f2/622c41a0ce3d494b85bb7f14221f2a91 as hdfs://localhost:33775/user/jenkins/test-data/1089ab4b-ae96-4b07-8e73-9617cf0f2504/data/default/testWithMockedMapReduceSingleRegion/0bde707836750663e729a0a0c206c460/f2/622c41a0ce3d494b85bb7f14221f2a91 2023-02-15 20:01:44,877 INFO [rs(jenkins-hbase4.apache.org,38321,1676491302490)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33775/user/jenkins/test-data/1089ab4b-ae96-4b07-8e73-9617cf0f2504/data/default/testWithMockedMapReduceSingleRegion/0bde707836750663e729a0a0c206c460/f2/622c41a0ce3d494b85bb7f14221f2a91, entries=17576, sequenceid=5, filesize=537.3 K 2023-02-15 20:01:44,878 INFO [rs(jenkins-hbase4.apache.org,38321,1676491302490)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~1.01 MB/1054560, heapSize ~3.49 MB/3656288, currentSize=0 B/0 for 0bde707836750663e729a0a0c206c460 in 50ms, sequenceid=5, compaction requested=false 2023-02-15 20:01:44,878 DEBUG [rs(jenkins-hbase4.apache.org,38321,1676491302490)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testWithMockedMapReduceSingleRegion' 2023-02-15 20:01:44,878 DEBUG [rs(jenkins-hbase4.apache.org,38321,1676491302490)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 0bde707836750663e729a0a0c206c460: 2023-02-15 20:01:44,878 DEBUG [rs(jenkins-hbase4.apache.org,38321,1676491302490)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceSingleRegion,,1676491304055.0bde707836750663e729a0a0c206c460.' region-info for snapshot=testWithMockedMapReduceSingleRegion 2023-02-15 20:01:44,878 DEBUG [rs(jenkins-hbase4.apache.org,38321,1676491302490)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-15 20:01:44,879 DEBUG [rs(jenkins-hbase4.apache.org,38321,1676491302490)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33775/user/jenkins/test-data/1089ab4b-ae96-4b07-8e73-9617cf0f2504/data/default/testWithMockedMapReduceSingleRegion/0bde707836750663e729a0a0c206c460/f1/9084d569ff854e5b90241ef4321c2792] hfiles 2023-02-15 20:01:44,879 DEBUG [rs(jenkins-hbase4.apache.org,38321,1676491302490)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:33775/user/jenkins/test-data/1089ab4b-ae96-4b07-8e73-9617cf0f2504/data/default/testWithMockedMapReduceSingleRegion/0bde707836750663e729a0a0c206c460/f1/9084d569ff854e5b90241ef4321c2792 for snapshot=testWithMockedMapReduceSingleRegion 2023-02-15 20:01:44,879 DEBUG [rs(jenkins-hbase4.apache.org,38321,1676491302490)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33775/user/jenkins/test-data/1089ab4b-ae96-4b07-8e73-9617cf0f2504/data/default/testWithMockedMapReduceSingleRegion/0bde707836750663e729a0a0c206c460/f2/622c41a0ce3d494b85bb7f14221f2a91] hfiles 2023-02-15 20:01:44,879 DEBUG [rs(jenkins-hbase4.apache.org,38321,1676491302490)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:33775/user/jenkins/test-data/1089ab4b-ae96-4b07-8e73-9617cf0f2504/data/default/testWithMockedMapReduceSingleRegion/0bde707836750663e729a0a0c206c460/f2/622c41a0ce3d494b85bb7f14221f2a91 for snapshot=testWithMockedMapReduceSingleRegion 2023-02-15 20:01:44,885 DEBUG [rs(jenkins-hbase4.apache.org,38321,1676491302490)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceSingleRegion,,1676491304055.0bde707836750663e729a0a0c206c460. completed. 2023-02-15 20:01:44,886 DEBUG [rs(jenkins-hbase4.apache.org,38321,1676491302490)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceSingleRegion,,1676491304055.0bde707836750663e729a0a0c206c460. 2023-02-15 20:01:44,886 DEBUG [member: 'jenkins-hbase4.apache.org,38321,1676491302490' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-02-15 20:01:44,886 DEBUG [member: 'jenkins-hbase4.apache.org,38321,1676491302490' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-02-15 20:01:44,886 DEBUG [member: 'jenkins-hbase4.apache.org,38321,1676491302490' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,38321,1676491302490 2023-02-15 20:01:44,886 DEBUG [member: 'jenkins-hbase4.apache.org,38321,1676491302490' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMockedMapReduceSingleRegion' locally completed 2023-02-15 20:01:44,886 DEBUG [member: 'jenkins-hbase4.apache.org,38321,1676491302490' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMockedMapReduceSingleRegion' completed for member 'jenkins-hbase4.apache.org,38321,1676491302490' in zk 2023-02-15 20:01:44,887 DEBUG [Listener at localhost/34695-EventThread] zookeeper.ZKWatcher(600): master:45885-0x10059930fd80000, quorum=127.0.0.1:61407, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,38321,1676491302490 2023-02-15 20:01:44,887 DEBUG [member: 'jenkins-hbase4.apache.org,38321,1676491302490' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMockedMapReduceSingleRegion' has notified controller of completion 2023-02-15 20:01:44,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,38321,1676491302490 2023-02-15 20:01:44,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-15 20:01:44,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-15 20:01:44,888 DEBUG [member: 'jenkins-hbase4.apache.org,38321,1676491302490' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-15 20:01:44,888 DEBUG [member: 'jenkins-hbase4.apache.org,38321,1676491302490' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMockedMapReduceSingleRegion' completed. 2023-02-15 20:01:44,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-15 20:01:44,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-15 20:01:44,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-15 20:01:44,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38321,1676491302490 2023-02-15 20:01:44,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43045,1676491302520 2023-02-15 20:01:44,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-15 20:01:44,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-15 20:01:44,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38321,1676491302490 2023-02-15 20:01:44,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43045,1676491302520 2023-02-15 20:01:44,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMockedMapReduceSingleRegion' member 'jenkins-hbase4.apache.org,38321,1676491302490': 2023-02-15 20:01:44,890 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38321,1676491302490' released barrier for procedure'testWithMockedMapReduceSingleRegion', counting down latch. Waiting for 0 more 2023-02-15 20:01:44,890 INFO [(jenkins-hbase4.apache.org,45885,1676491302440)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMockedMapReduceSingleRegion' execution completed 2023-02-15 20:01:44,890 DEBUG [(jenkins-hbase4.apache.org,45885,1676491302440)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-15 20:01:44,890 DEBUG [(jenkins-hbase4.apache.org,45885,1676491302440)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-15 20:01:44,890 DEBUG [(jenkins-hbase4.apache.org,45885,1676491302440)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMockedMapReduceSingleRegion 2023-02-15 20:01:44,890 INFO [(jenkins-hbase4.apache.org,45885,1676491302440)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMockedMapReduceSingleRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-02-15 20:01:44,893 DEBUG [Listener at localhost/34695-EventThread] zookeeper.ZKWatcher(600): regionserver:43045-0x10059930fd80002, quorum=127.0.0.1:61407, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-15 20:01:44,893 DEBUG [Listener at localhost/34695-EventThread] zookeeper.ZKWatcher(600): regionserver:38321-0x10059930fd80001, quorum=127.0.0.1:61407, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-15 20:01:44,893 DEBUG [Listener at localhost/34695-EventThread] zookeeper.ZKWatcher(600): master:45885-0x10059930fd80000, quorum=127.0.0.1:61407, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-15 20:01:44,893 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-15 20:01:44,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-15 20:01:44,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-15 20:01:44,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-15 20:01:44,893 DEBUG [Listener at localhost/34695-EventThread] zookeeper.ZKWatcher(600): regionserver:38321-0x10059930fd80001, quorum=127.0.0.1:61407, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-15 20:01:44,893 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-15 20:01:44,893 DEBUG [Listener at localhost/34695-EventThread] zookeeper.ZKWatcher(600): regionserver:43045-0x10059930fd80002, quorum=127.0.0.1:61407, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-15 20:01:44,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-15 20:01:44,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-15 20:01:44,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-15 20:01:44,894 DEBUG [(jenkins-hbase4.apache.org,45885,1676491302440)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45885-0x10059930fd80000, quorum=127.0.0.1:61407, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,38321,1676491302490 2023-02-15 20:01:44,894 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-15 20:01:44,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-15 20:01:44,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-15 20:01:44,894 DEBUG [(jenkins-hbase4.apache.org,45885,1676491302440)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45885-0x10059930fd80000, quorum=127.0.0.1:61407, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,43045,1676491302520 2023-02-15 20:01:44,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-15 20:01:44,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-15 20:01:44,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-15 20:01:44,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38321,1676491302490 2023-02-15 20:01:44,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43045,1676491302520 2023-02-15 20:01:44,895 DEBUG [(jenkins-hbase4.apache.org,45885,1676491302440)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45885-0x10059930fd80000, quorum=127.0.0.1:61407, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,38321,1676491302490 2023-02-15 20:01:44,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-15 20:01:44,896 DEBUG [(jenkins-hbase4.apache.org,45885,1676491302440)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45885-0x10059930fd80000, quorum=127.0.0.1:61407, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,43045,1676491302520 2023-02-15 20:01:44,896 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-15 20:01:44,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-15 20:01:44,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-15 20:01:44,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-15 20:01:44,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38321,1676491302490 2023-02-15 20:01:44,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43045,1676491302520 2023-02-15 20:01:44,901 DEBUG [Listener at localhost/34695-EventThread] zookeeper.ZKWatcher(600): master:45885-0x10059930fd80000, quorum=127.0.0.1:61407, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,43045,1676491302520 2023-02-15 20:01:44,901 DEBUG [Listener at localhost/34695-EventThread] zookeeper.ZKWatcher(600): master:45885-0x10059930fd80000, quorum=127.0.0.1:61407, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion 2023-02-15 20:01:44,901 DEBUG [Listener at localhost/34695-EventThread] zookeeper.ZKWatcher(600): regionserver:38321-0x10059930fd80001, quorum=127.0.0.1:61407, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-15 20:01:44,901 DEBUG [Listener at localhost/34695-EventThread] zookeeper.ZKWatcher(600): master:45885-0x10059930fd80000, quorum=127.0.0.1:61407, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,38321,1676491302490 2023-02-15 20:01:44,901 DEBUG [(jenkins-hbase4.apache.org,45885,1676491302440)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-15 20:01:44,901 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-15 20:01:44,901 DEBUG [Listener at localhost/34695-EventThread] zookeeper.ZKWatcher(600): master:45885-0x10059930fd80000, quorum=127.0.0.1:61407, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion 2023-02-15 20:01:44,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-15 20:01:44,901 DEBUG [Listener at localhost/34695-EventThread] zookeeper.ZKWatcher(600): master:45885-0x10059930fd80000, quorum=127.0.0.1:61407, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,43045,1676491302520 2023-02-15 20:01:44,901 DEBUG [Listener at localhost/34695-EventThread] zookeeper.ZKWatcher(600): master:45885-0x10059930fd80000, quorum=127.0.0.1:61407, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-15 20:01:44,901 DEBUG [Listener at localhost/34695-EventThread] zookeeper.ZKWatcher(600): regionserver:43045-0x10059930fd80002, quorum=127.0.0.1:61407, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-15 20:01:44,901 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for testWithMockedMapReduceSingleRegion 2023-02-15 20:01:44,901 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-15 20:01:44,901 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for testWithMockedMapReduceSingleRegion 2023-02-15 20:01:44,901 DEBUG [Listener at localhost/34695-EventThread] zookeeper.ZKWatcher(600): regionserver:43045-0x10059930fd80002, quorum=127.0.0.1:61407, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-15 20:01:44,901 DEBUG [Listener at localhost/34695-EventThread] zookeeper.ZKWatcher(600): master:45885-0x10059930fd80000, quorum=127.0.0.1:61407, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,38321,1676491302490 2023-02-15 20:01:44,901 DEBUG [Listener at localhost/34695-EventThread] zookeeper.ZKWatcher(600): regionserver:38321-0x10059930fd80001, quorum=127.0.0.1:61407, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-15 20:01:44,901 DEBUG [Listener at localhost/34695-EventThread] zookeeper.ZKWatcher(600): master:45885-0x10059930fd80000, quorum=127.0.0.1:61407, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-15 20:01:44,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-15 20:01:44,901 DEBUG [Listener at localhost/34695-EventThread] zookeeper.ZKWatcher(600): master:45885-0x10059930fd80000, quorum=127.0.0.1:61407, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-15 20:01:44,901 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-15 20:01:44,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-15 20:01:44,902 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:33775/user/jenkins/test-data/1089ab4b-ae96-4b07-8e73-9617cf0f2504/.hbase-snapshot/.tmp/testWithMockedMapReduceSingleRegion 2023-02-15 20:01:44,902 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-15 20:01:44,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-15 20:01:44,907 DEBUG [Listener at localhost/34695] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-15 20:01:44,908 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45885] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMockedMapReduceSingleRegion table=testWithMockedMapReduceSingleRegion type=FLUSH ttl=0 } is done 2023-02-15 20:01:44,908 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45885] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMockedMapReduceSingleRegion table=testWithMockedMapReduceSingleRegion type=FLUSH ttl=0 }' is still in progress! 2023-02-15 20:01:44,909 DEBUG [Listener at localhost/34695] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-02-15 20:01:44,919 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:33775/user/jenkins/test-data/1089ab4b-ae96-4b07-8e73-9617cf0f2504/.hbase-snapshot/.tmp/testWithMockedMapReduceSingleRegion to hdfs://localhost:33775/user/jenkins/test-data/1089ab4b-ae96-4b07-8e73-9617cf0f2504/.hbase-snapshot/testWithMockedMapReduceSingleRegion 2023-02-15 20:01:44,936 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot testWithMockedMapReduceSingleRegion of table testWithMockedMapReduceSingleRegion completed 2023-02-15 20:01:44,936 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:33775/user/jenkins/test-data/1089ab4b-ae96-4b07-8e73-9617cf0f2504/.hbase-snapshot/.tmp/testWithMockedMapReduceSingleRegion 2023-02-15 20:01:44,936 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:33775/user/jenkins/test-data/1089ab4b-ae96-4b07-8e73-9617cf0f2504/.hbase-snapshot/.tmp/testWithMockedMapReduceSingleRegion 2023-02-15 20:01:44,936 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot testWithMockedMapReduceSingleRegion C_M_SNAPSHOT_TABLE on table testWithMockedMapReduceSingleRegion at 1676491304805Consolidate snapshot: testWithMockedMapReduceSingleRegion at 1676491304901 (+96 ms)Loading Region manifests for testWithMockedMapReduceSingleRegion at 1676491304901Writing data manifest for testWithMockedMapReduceSingleRegion at 1676491304905 (+4 ms)Verifying snapshot: testWithMockedMapReduceSingleRegion at 1676491304914 (+9 ms)Snapshot testWithMockedMapReduceSingleRegion of table testWithMockedMapReduceSingleRegion completed at 1676491304936 (+22 ms) 2023-02-15 20:01:44,938 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=14, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=SHARED 2023-02-15 20:01:44,939 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=14, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=SHARED in 132 msec 2023-02-15 20:01:45,109 DEBUG [Listener at localhost/34695] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-15 20:01:45,110 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45885] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMockedMapReduceSingleRegion table=testWithMockedMapReduceSingleRegion type=FLUSH ttl=0 } is done 2023-02-15 20:01:45,110 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45885] snapshot.SnapshotManager(401): Snapshot '{ ss=testWithMockedMapReduceSingleRegion table=testWithMockedMapReduceSingleRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-02-15 20:01:45,110 INFO [Listener at localhost/34695] snapshot.SnapshotTestingUtils(399): Confirming snapshot exists. 2023-02-15 20:01:45,115 INFO [Listener at localhost/34695] snapshot.SnapshotTestingUtils(406): validating snapshot. 2023-02-15 20:01:45,120 INFO [Listener at localhost/34695] mapreduce.TableSnapshotInputFormatTestBase(218): load different values 2023-02-15 20:01:45,158 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38321] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 17576 Client: jenkins//172.31.14.131 first region in multi=testWithMockedMapReduceSingleRegion,,1676491304055.0bde707836750663e729a0a0c206c460. 2023-02-15 20:01:45,242 INFO [Listener at localhost/34695] mapreduce.TableSnapshotInputFormatTestBase(222): cause flush to create new files in the region 2023-02-15 20:01:45,248 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45885] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-15 20:01:45,249 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45885] procedure.ProcedureCoordinator(165): Submitting procedure testWithMockedMapReduceSingleRegion 2023-02-15 20:01:45,250 INFO [(jenkins-hbase4.apache.org,45885,1676491302440)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMockedMapReduceSingleRegion' 2023-02-15 20:01:45,250 DEBUG [(jenkins-hbase4.apache.org,45885,1676491302440)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-15 20:01:45,251 DEBUG [(jenkins-hbase4.apache.org,45885,1676491302440)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMockedMapReduceSingleRegion' starting 'acquire' 2023-02-15 20:01:45,251 DEBUG [(jenkins-hbase4.apache.org,45885,1676491302440)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMockedMapReduceSingleRegion', kicking off acquire phase on members. 2023-02-15 20:01:45,251 DEBUG [(jenkins-hbase4.apache.org,45885,1676491302440)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45885-0x10059930fd80000, quorum=127.0.0.1:61407, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-15 20:01:45,251 DEBUG [(jenkins-hbase4.apache.org,45885,1676491302440)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion 2023-02-15 20:01:45,254 DEBUG [Listener at localhost/34695-EventThread] zookeeper.ZKWatcher(600): regionserver:43045-0x10059930fd80002, quorum=127.0.0.1:61407, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-15 20:01:45,254 DEBUG [Listener at localhost/34695-EventThread] zookeeper.ZKWatcher(600): regionserver:38321-0x10059930fd80001, quorum=127.0.0.1:61407, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-15 20:01:45,254 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-15 20:01:45,254 DEBUG [(jenkins-hbase4.apache.org,45885,1676491302440)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,38321,1676491302490 2023-02-15 20:01:45,254 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-15 20:01:45,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-15 20:01:45,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-15 20:01:45,254 DEBUG [(jenkins-hbase4.apache.org,45885,1676491302440)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45885-0x10059930fd80000, quorum=127.0.0.1:61407, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,38321,1676491302490 2023-02-15 20:01:45,254 DEBUG [(jenkins-hbase4.apache.org,45885,1676491302440)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-15 20:01:45,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion 2023-02-15 20:01:45,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion 2023-02-15 20:01:45,255 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38321-0x10059930fd80001, quorum=127.0.0.1:61407, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-15 20:01:45,255 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43045-0x10059930fd80002, quorum=127.0.0.1:61407, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-15 20:01:45,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-15 20:01:45,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-15 20:01:45,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion 2023-02-15 20:01:45,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion 2023-02-15 20:01:45,255 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMockedMapReduceSingleRegion 2023-02-15 20:01:45,255 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMockedMapReduceSingleRegion 2023-02-15 20:01:45,256 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMockedMapReduceSingleRegion 2023-02-15 20:01:45,256 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMockedMapReduceSingleRegion 2023-02-15 20:01:45,256 DEBUG [member: 'jenkins-hbase4.apache.org,38321,1676491302490' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMockedMapReduceSingleRegion' with timeout 60000ms 2023-02-15 20:01:45,256 DEBUG [member: 'jenkins-hbase4.apache.org,38321,1676491302490' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-15 20:01:45,256 DEBUG [member: 'jenkins-hbase4.apache.org,43045,1676491302520' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMockedMapReduceSingleRegion' with timeout 60000ms 2023-02-15 20:01:45,257 DEBUG [member: 'jenkins-hbase4.apache.org,43045,1676491302520' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-15 20:01:45,257 DEBUG [member: 'jenkins-hbase4.apache.org,38321,1676491302490' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMockedMapReduceSingleRegion' starting 'acquire' stage 2023-02-15 20:01:45,258 DEBUG [member: 'jenkins-hbase4.apache.org,43045,1676491302520' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMockedMapReduceSingleRegion' starting 'acquire' stage 2023-02-15 20:01:45,258 DEBUG [member: 'jenkins-hbase4.apache.org,43045,1676491302520' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMockedMapReduceSingleRegion' locally acquired 2023-02-15 20:01:45,258 DEBUG [member: 'jenkins-hbase4.apache.org,43045,1676491302520' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43045,1676491302520' joining acquired barrier for procedure (testWithMockedMapReduceSingleRegion) in zk 2023-02-15 20:01:45,260 DEBUG [member: 'jenkins-hbase4.apache.org,43045,1676491302520' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-15 20:01:45,260 DEBUG [member: 'jenkins-hbase4.apache.org,38321,1676491302490' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-15 20:01:45,260 DEBUG [member: 'jenkins-hbase4.apache.org,38321,1676491302490' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-15 20:01:45,260 DEBUG [member: 'jenkins-hbase4.apache.org,43045,1676491302520' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43045-0x10059930fd80002, quorum=127.0.0.1:61407, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-15 20:01:45,260 DEBUG [member: 'jenkins-hbase4.apache.org,43045,1676491302520' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMockedMapReduceSingleRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-15 20:01:45,260 DEBUG [rs(jenkins-hbase4.apache.org,38321,1676491302490)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceSingleRegion,,1676491304055.0bde707836750663e729a0a0c206c460. 2023-02-15 20:01:45,260 DEBUG [rs(jenkins-hbase4.apache.org,38321,1676491302490)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceSingleRegion,,1676491304055.0bde707836750663e729a0a0c206c460. started... 2023-02-15 20:01:45,260 INFO [rs(jenkins-hbase4.apache.org,38321,1676491302490)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 0bde707836750663e729a0a0c206c460 2/2 column families, dataSize=1.58 MB heapSize=4.02 MB 2023-02-15 20:01:45,286 INFO [rs(jenkins-hbase4.apache.org,38321,1676491302490)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=806.71 KB at sequenceid=9 (bloomFilter=false), to=hdfs://localhost:33775/user/jenkins/test-data/1089ab4b-ae96-4b07-8e73-9617cf0f2504/data/default/testWithMockedMapReduceSingleRegion/0bde707836750663e729a0a0c206c460/.tmp/f1/0eb89e0b7d2b4279840443eac0aa5eef 2023-02-15 20:01:45,310 INFO [rs(jenkins-hbase4.apache.org,38321,1676491302490)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=806.71 KB at sequenceid=9 (bloomFilter=false), to=hdfs://localhost:33775/user/jenkins/test-data/1089ab4b-ae96-4b07-8e73-9617cf0f2504/data/default/testWithMockedMapReduceSingleRegion/0bde707836750663e729a0a0c206c460/.tmp/f2/f39ee4b8073d42a4ba555b42861a0bde 2023-02-15 20:01:45,316 DEBUG [rs(jenkins-hbase4.apache.org,38321,1676491302490)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33775/user/jenkins/test-data/1089ab4b-ae96-4b07-8e73-9617cf0f2504/data/default/testWithMockedMapReduceSingleRegion/0bde707836750663e729a0a0c206c460/.tmp/f1/0eb89e0b7d2b4279840443eac0aa5eef as hdfs://localhost:33775/user/jenkins/test-data/1089ab4b-ae96-4b07-8e73-9617cf0f2504/data/default/testWithMockedMapReduceSingleRegion/0bde707836750663e729a0a0c206c460/f1/0eb89e0b7d2b4279840443eac0aa5eef 2023-02-15 20:01:45,320 INFO [rs(jenkins-hbase4.apache.org,38321,1676491302490)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33775/user/jenkins/test-data/1089ab4b-ae96-4b07-8e73-9617cf0f2504/data/default/testWithMockedMapReduceSingleRegion/0bde707836750663e729a0a0c206c460/f1/0eb89e0b7d2b4279840443eac0aa5eef, entries=17576, sequenceid=9, filesize=829.4 K 2023-02-15 20:01:45,321 DEBUG [rs(jenkins-hbase4.apache.org,38321,1676491302490)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33775/user/jenkins/test-data/1089ab4b-ae96-4b07-8e73-9617cf0f2504/data/default/testWithMockedMapReduceSingleRegion/0bde707836750663e729a0a0c206c460/.tmp/f2/f39ee4b8073d42a4ba555b42861a0bde as hdfs://localhost:33775/user/jenkins/test-data/1089ab4b-ae96-4b07-8e73-9617cf0f2504/data/default/testWithMockedMapReduceSingleRegion/0bde707836750663e729a0a0c206c460/f2/f39ee4b8073d42a4ba555b42861a0bde 2023-02-15 20:01:45,333 INFO [rs(jenkins-hbase4.apache.org,38321,1676491302490)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33775/user/jenkins/test-data/1089ab4b-ae96-4b07-8e73-9617cf0f2504/data/default/testWithMockedMapReduceSingleRegion/0bde707836750663e729a0a0c206c460/f2/f39ee4b8073d42a4ba555b42861a0bde, entries=17576, sequenceid=9, filesize=829.4 K 2023-02-15 20:01:45,334 INFO [rs(jenkins-hbase4.apache.org,38321,1676491302490)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~1.58 MB/1652144, heapSize ~4.02 MB/4218720, currentSize=0 B/0 for 0bde707836750663e729a0a0c206c460 in 74ms, sequenceid=9, compaction requested=false 2023-02-15 20:01:45,335 DEBUG [rs(jenkins-hbase4.apache.org,38321,1676491302490)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 0bde707836750663e729a0a0c206c460: 2023-02-15 20:01:45,335 DEBUG [rs(jenkins-hbase4.apache.org,38321,1676491302490)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceSingleRegion,,1676491304055.0bde707836750663e729a0a0c206c460. 2023-02-15 20:01:45,336 DEBUG [member: 'jenkins-hbase4.apache.org,38321,1676491302490' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-15 20:01:45,336 DEBUG [member: 'jenkins-hbase4.apache.org,38321,1676491302490' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-15 20:01:45,336 DEBUG [member: 'jenkins-hbase4.apache.org,38321,1676491302490' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,38321,1676491302490 2023-02-15 20:01:45,336 DEBUG [member: 'jenkins-hbase4.apache.org,38321,1676491302490' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMockedMapReduceSingleRegion' locally acquired 2023-02-15 20:01:45,336 DEBUG [member: 'jenkins-hbase4.apache.org,38321,1676491302490' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38321,1676491302490' joining acquired barrier for procedure (testWithMockedMapReduceSingleRegion) in zk 2023-02-15 20:01:45,337 DEBUG [Listener at localhost/34695-EventThread] zookeeper.ZKWatcher(600): master:45885-0x10059930fd80000, quorum=127.0.0.1:61407, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,38321,1676491302490 2023-02-15 20:01:45,338 DEBUG [member: 'jenkins-hbase4.apache.org,38321,1676491302490' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-15 20:01:45,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,38321,1676491302490 2023-02-15 20:01:45,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-15 20:01:45,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-15 20:01:45,338 DEBUG [member: 'jenkins-hbase4.apache.org,38321,1676491302490' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38321-0x10059930fd80001, quorum=127.0.0.1:61407, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-15 20:01:45,338 DEBUG [member: 'jenkins-hbase4.apache.org,38321,1676491302490' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMockedMapReduceSingleRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-15 20:01:45,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-15 20:01:45,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-15 20:01:45,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-15 20:01:45,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38321,1676491302490 2023-02-15 20:01:45,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43045,1676491302520 2023-02-15 20:01:45,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-15 20:01:45,340 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38321,1676491302490' joining acquired barrier for procedure 'testWithMockedMapReduceSingleRegion' on coordinator 2023-02-15 20:01:45,340 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@24f866ce[Count = 0] remaining members to acquire global barrier 2023-02-15 20:01:45,340 DEBUG [(jenkins-hbase4.apache.org,45885,1676491302440)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMockedMapReduceSingleRegion' starting 'in-barrier' execution. 2023-02-15 20:01:45,340 DEBUG [(jenkins-hbase4.apache.org,45885,1676491302440)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-15 20:01:45,347 DEBUG [Listener at localhost/34695-EventThread] zookeeper.ZKWatcher(600): regionserver:38321-0x10059930fd80001, quorum=127.0.0.1:61407, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-15 20:01:45,347 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-15 20:01:45,347 DEBUG [Listener at localhost/34695-EventThread] zookeeper.ZKWatcher(600): regionserver:43045-0x10059930fd80002, quorum=127.0.0.1:61407, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-15 20:01:45,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-15 20:01:45,347 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-15 20:01:45,347 DEBUG [member: 'jenkins-hbase4.apache.org,38321,1676491302490' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMockedMapReduceSingleRegion' received 'reached' from coordinator. 2023-02-15 20:01:45,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-15 20:01:45,347 DEBUG [member: 'jenkins-hbase4.apache.org,38321,1676491302490' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMockedMapReduceSingleRegion' locally completed 2023-02-15 20:01:45,347 DEBUG [member: 'jenkins-hbase4.apache.org,43045,1676491302520' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMockedMapReduceSingleRegion' received 'reached' from coordinator. 2023-02-15 20:01:45,347 DEBUG [member: 'jenkins-hbase4.apache.org,38321,1676491302490' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMockedMapReduceSingleRegion' completed for member 'jenkins-hbase4.apache.org,38321,1676491302490' in zk 2023-02-15 20:01:45,347 DEBUG [member: 'jenkins-hbase4.apache.org,43045,1676491302520' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMockedMapReduceSingleRegion' locally completed 2023-02-15 20:01:45,347 DEBUG [member: 'jenkins-hbase4.apache.org,43045,1676491302520' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMockedMapReduceSingleRegion' completed for member 'jenkins-hbase4.apache.org,43045,1676491302520' in zk 2023-02-15 20:01:45,348 DEBUG [(jenkins-hbase4.apache.org,45885,1676491302440)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45885-0x10059930fd80000, quorum=127.0.0.1:61407, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,38321,1676491302490 2023-02-15 20:01:45,348 DEBUG [(jenkins-hbase4.apache.org,45885,1676491302440)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-15 20:01:45,350 DEBUG [Listener at localhost/34695-EventThread] zookeeper.ZKWatcher(600): master:45885-0x10059930fd80000, quorum=127.0.0.1:61407, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,38321,1676491302490 2023-02-15 20:01:45,350 DEBUG [member: 'jenkins-hbase4.apache.org,38321,1676491302490' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMockedMapReduceSingleRegion' has notified controller of completion 2023-02-15 20:01:45,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,38321,1676491302490 2023-02-15 20:01:45,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-15 20:01:45,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-15 20:01:45,350 DEBUG [member: 'jenkins-hbase4.apache.org,38321,1676491302490' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-15 20:01:45,351 DEBUG [member: 'jenkins-hbase4.apache.org,38321,1676491302490' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMockedMapReduceSingleRegion' completed. 2023-02-15 20:01:45,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-15 20:01:45,351 DEBUG [member: 'jenkins-hbase4.apache.org,43045,1676491302520' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMockedMapReduceSingleRegion' has notified controller of completion 2023-02-15 20:01:45,351 DEBUG [member: 'jenkins-hbase4.apache.org,43045,1676491302520' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-15 20:01:45,351 DEBUG [member: 'jenkins-hbase4.apache.org,43045,1676491302520' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMockedMapReduceSingleRegion' completed. 2023-02-15 20:01:45,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-15 20:01:45,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-15 20:01:45,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38321,1676491302490 2023-02-15 20:01:45,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43045,1676491302520 2023-02-15 20:01:45,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-15 20:01:45,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-15 20:01:45,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38321,1676491302490 2023-02-15 20:01:45,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43045,1676491302520 2023-02-15 20:01:45,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMockedMapReduceSingleRegion' member 'jenkins-hbase4.apache.org,38321,1676491302490': 2023-02-15 20:01:45,354 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38321,1676491302490' released barrier for procedure'testWithMockedMapReduceSingleRegion', counting down latch. Waiting for 0 more 2023-02-15 20:01:45,354 INFO [(jenkins-hbase4.apache.org,45885,1676491302440)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMockedMapReduceSingleRegion' execution completed 2023-02-15 20:01:45,354 DEBUG [(jenkins-hbase4.apache.org,45885,1676491302440)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-15 20:01:45,354 DEBUG [(jenkins-hbase4.apache.org,45885,1676491302440)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-15 20:01:45,354 DEBUG [(jenkins-hbase4.apache.org,45885,1676491302440)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMockedMapReduceSingleRegion 2023-02-15 20:01:45,354 INFO [(jenkins-hbase4.apache.org,45885,1676491302440)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMockedMapReduceSingleRegionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-15 20:01:45,356 DEBUG [Listener at localhost/34695-EventThread] zookeeper.ZKWatcher(600): regionserver:43045-0x10059930fd80002, quorum=127.0.0.1:61407, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-15 20:01:45,356 DEBUG [Listener at localhost/34695-EventThread] zookeeper.ZKWatcher(600): master:45885-0x10059930fd80000, quorum=127.0.0.1:61407, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-15 20:01:45,356 DEBUG [Listener at localhost/34695-EventThread] zookeeper.ZKWatcher(600): regionserver:38321-0x10059930fd80001, quorum=127.0.0.1:61407, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-15 20:01:45,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-15 20:01:45,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-15 20:01:45,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-15 20:01:45,356 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-15 20:01:45,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-15 20:01:45,356 DEBUG [Listener at localhost/34695-EventThread] zookeeper.ZKWatcher(600): regionserver:43045-0x10059930fd80002, quorum=127.0.0.1:61407, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-15 20:01:45,356 DEBUG [Listener at localhost/34695-EventThread] zookeeper.ZKWatcher(600): regionserver:38321-0x10059930fd80001, quorum=127.0.0.1:61407, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-15 20:01:45,356 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-15 20:01:45,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-15 20:01:45,357 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-15 20:01:45,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-15 20:01:45,357 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-15 20:01:45,357 DEBUG [(jenkins-hbase4.apache.org,45885,1676491302440)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45885-0x10059930fd80000, quorum=127.0.0.1:61407, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,38321,1676491302490 2023-02-15 20:01:45,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-15 20:01:45,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-15 20:01:45,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-15 20:01:45,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-15 20:01:45,357 DEBUG [(jenkins-hbase4.apache.org,45885,1676491302440)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45885-0x10059930fd80000, quorum=127.0.0.1:61407, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,43045,1676491302520 2023-02-15 20:01:45,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-15 20:01:45,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-15 20:01:45,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-15 20:01:45,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38321,1676491302490 2023-02-15 20:01:45,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43045,1676491302520 2023-02-15 20:01:45,359 DEBUG [(jenkins-hbase4.apache.org,45885,1676491302440)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45885-0x10059930fd80000, quorum=127.0.0.1:61407, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,38321,1676491302490 2023-02-15 20:01:45,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-15 20:01:45,359 DEBUG [(jenkins-hbase4.apache.org,45885,1676491302440)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45885-0x10059930fd80000, quorum=127.0.0.1:61407, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,43045,1676491302520 2023-02-15 20:01:45,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-15 20:01:45,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38321,1676491302490 2023-02-15 20:01:45,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43045,1676491302520 2023-02-15 20:01:45,362 DEBUG [Listener at localhost/34695-EventThread] zookeeper.ZKWatcher(600): regionserver:38321-0x10059930fd80001, quorum=127.0.0.1:61407, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-15 20:01:45,362 DEBUG [Listener at localhost/34695-EventThread] zookeeper.ZKWatcher(600): master:45885-0x10059930fd80000, quorum=127.0.0.1:61407, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,43045,1676491302520 2023-02-15 20:01:45,362 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-15 20:01:45,362 DEBUG [Listener at localhost/34695-EventThread] zookeeper.ZKWatcher(600): master:45885-0x10059930fd80000, quorum=127.0.0.1:61407, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion 2023-02-15 20:01:45,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-15 20:01:45,362 DEBUG [(jenkins-hbase4.apache.org,45885,1676491302440)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-15 20:01:45,362 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45885] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testWithMockedMapReduceSingleRegion' 2023-02-15 20:01:45,362 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45885] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-15 20:01:45,362 DEBUG [Listener at localhost/34695-EventThread] zookeeper.ZKWatcher(600): regionserver:38321-0x10059930fd80001, quorum=127.0.0.1:61407, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-15 20:01:45,362 DEBUG [Listener at localhost/34695-EventThread] zookeeper.ZKWatcher(600): regionserver:43045-0x10059930fd80002, quorum=127.0.0.1:61407, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-15 20:01:45,363 DEBUG [Listener at localhost/34695-EventThread] zookeeper.ZKWatcher(600): regionserver:43045-0x10059930fd80002, quorum=127.0.0.1:61407, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-15 20:01:45,363 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-15 20:01:45,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-15 20:01:45,362 DEBUG [Listener at localhost/34695-EventThread] zookeeper.ZKWatcher(600): master:45885-0x10059930fd80000, quorum=127.0.0.1:61407, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,38321,1676491302490 2023-02-15 20:01:45,363 DEBUG [Listener at localhost/34695-EventThread] zookeeper.ZKWatcher(600): master:45885-0x10059930fd80000, quorum=127.0.0.1:61407, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion 2023-02-15 20:01:45,363 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-15 20:01:45,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-15 20:01:45,363 DEBUG [Listener at localhost/34695-EventThread] zookeeper.ZKWatcher(600): master:45885-0x10059930fd80000, quorum=127.0.0.1:61407, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,43045,1676491302520 2023-02-15 20:01:45,363 DEBUG [Listener at localhost/34695-EventThread] zookeeper.ZKWatcher(600): master:45885-0x10059930fd80000, quorum=127.0.0.1:61407, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-15 20:01:45,363 DEBUG [Listener at localhost/34695] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testWithMockedMapReduceSingleRegion'' to complete. (max 20000 ms per retry) 2023-02-15 20:01:45,363 DEBUG [Listener at localhost/34695] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-15 20:01:45,363 DEBUG [Listener at localhost/34695-EventThread] zookeeper.ZKWatcher(600): master:45885-0x10059930fd80000, quorum=127.0.0.1:61407, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,38321,1676491302490 2023-02-15 20:01:45,363 DEBUG [Listener at localhost/34695-EventThread] zookeeper.ZKWatcher(600): master:45885-0x10059930fd80000, quorum=127.0.0.1:61407, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-15 20:01:45,363 DEBUG [Listener at localhost/34695-EventThread] zookeeper.ZKWatcher(600): master:45885-0x10059930fd80000, quorum=127.0.0.1:61407, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-15 20:01:45,363 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-15 20:01:45,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-15 20:01:45,463 DEBUG [Listener at localhost/34695] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-15 20:01:45,465 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45885] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-15 20:01:45,469 INFO [Listener at localhost/34695] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "testWithMockedMapReduceSingleRegion" table: "testWithMockedMapReduceSingleRegion" creation_time: 1676491304789 type: FLUSH version: 2 ttl: 0 2023-02-15 20:01:45,469 DEBUG [Listener at localhost/34695] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost:33775/user/jenkins/test-data/e1346e9a-ebf6-316f-c458-1c6b009bbc08/testWithMockedMapReduceSingleRegion/f3b44fec-16d2-4175-922c-a2f459c64483/data/default/testWithMockedMapReduceSingleRegion 2023-02-15 20:01:45,470 INFO [Listener at localhost/34695] snapshot.RestoreSnapshotHelper(239): region to add: 0bde707836750663e729a0a0c206c460 2023-02-15 20:01:45,470 INFO [Listener at localhost/34695] snapshot.RestoreSnapshotHelper(585): clone region=0bde707836750663e729a0a0c206c460 as 0bde707836750663e729a0a0c206c460 in snapshot testWithMockedMapReduceSingleRegion 2023-02-15 20:01:45,470 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(7671): creating {ENCODED => 0bde707836750663e729a0a0c206c460, NAME => 'testWithMockedMapReduceSingleRegion,,1676491304055.0bde707836750663e729a0a0c206c460.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testWithMockedMapReduceSingleRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33775/user/jenkins/test-data/e1346e9a-ebf6-316f-c458-1c6b009bbc08/testWithMockedMapReduceSingleRegion/f3b44fec-16d2-4175-922c-a2f459c64483 2023-02-15 20:01:45,476 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceSingleRegion,,1676491304055.0bde707836750663e729a0a0c206c460.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 20:01:45,476 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 9084d569ff854e5b90241ef4321c2792 from cloned region in snapshot testWithMockedMapReduceSingleRegion to table=testWithMockedMapReduceSingleRegion 2023-02-15 20:01:45,478 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 622c41a0ce3d494b85bb7f14221f2a91 from cloned region in snapshot testWithMockedMapReduceSingleRegion to table=testWithMockedMapReduceSingleRegion 2023-02-15 20:01:45,480 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1603): Closing 0bde707836750663e729a0a0c206c460, disabling compactions & flushes 2023-02-15 20:01:45,480 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceSingleRegion,,1676491304055.0bde707836750663e729a0a0c206c460. 2023-02-15 20:01:45,480 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceSingleRegion,,1676491304055.0bde707836750663e729a0a0c206c460. 2023-02-15 20:01:45,480 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceSingleRegion,,1676491304055.0bde707836750663e729a0a0c206c460. after waiting 0 ms 2023-02-15 20:01:45,480 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceSingleRegion,,1676491304055.0bde707836750663e729a0a0c206c460. 2023-02-15 20:01:45,480 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceSingleRegion,,1676491304055.0bde707836750663e729a0a0c206c460. 2023-02-15 20:01:45,480 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1557): Region close journal for 0bde707836750663e729a0a0c206c460: 2023-02-15 20:01:45,481 INFO [Listener at localhost/34695] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "testWithMockedMapReduceSingleRegion" table: "testWithMockedMapReduceSingleRegion" creation_time: 1676491304789 type: FLUSH version: 2 ttl: 0 2023-02-15 20:01:45,481 DEBUG [Listener at localhost/34695] snapshot.RestoreSnapshotHelper(832): Restored table dir:hdfs://localhost:33775/user/jenkins/test-data/e1346e9a-ebf6-316f-c458-1c6b009bbc08/testWithMockedMapReduceSingleRegion/f3b44fec-16d2-4175-922c-a2f459c64483 2023-02-15 20:01:45,481 DEBUG [Listener at localhost/34695] util.CommonFSUtils(682): File system contents for path hdfs://localhost:33775/user/jenkins/test-data/e1346e9a-ebf6-316f-c458-1c6b009bbc08/testWithMockedMapReduceSingleRegion/f3b44fec-16d2-4175-922c-a2f459c64483 2023-02-15 20:01:45,481 DEBUG [Listener at localhost/34695] util.CommonFSUtils(699): |-data/ 2023-02-15 20:01:45,481 DEBUG [Listener at localhost/34695] util.CommonFSUtils(699): |----default/ 2023-02-15 20:01:45,482 DEBUG [Listener at localhost/34695] util.CommonFSUtils(699): |-------testWithMockedMapReduceSingleRegion/ 2023-02-15 20:01:45,482 DEBUG [Listener at localhost/34695] util.CommonFSUtils(699): |----------0bde707836750663e729a0a0c206c460/ 2023-02-15 20:01:45,482 DEBUG [Listener at localhost/34695] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-15 20:01:45,482 DEBUG [Listener at localhost/34695] util.CommonFSUtils(699): |-------------f1/ 2023-02-15 20:01:45,483 DEBUG [Listener at localhost/34695] util.CommonFSUtils(702): |----------------testWithMockedMapReduceSingleRegion=0bde707836750663e729a0a0c206c460-9084d569ff854e5b90241ef4321c2792 2023-02-15 20:01:45,483 DEBUG [Listener at localhost/34695] util.CommonFSUtils(699): |-------------f2/ 2023-02-15 20:01:45,483 DEBUG [Listener at localhost/34695] util.CommonFSUtils(702): |----------------testWithMockedMapReduceSingleRegion=0bde707836750663e729a0a0c206c460-622c41a0ce3d494b85bb7f14221f2a91 2023-02-15 20:01:45,486 INFO [Listener at localhost/34695] mapreduce.TableSnapshotInputFormatImpl(392): Provided Scan has DEFAULT ReadType, updating STREAM for Snapshot-based InputFormat 2023-02-15 20:01:45,490 DEBUG [Listener at localhost/34695] regionserver.HRegion(865): Instantiated testWithMockedMapReduceSingleRegion,,1676491304055.0bde707836750663e729a0a0c206c460.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 20:01:45,490 INFO [Listener at localhost/34695] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-15 20:01:45,490 DEBUG [Listener at localhost/34695] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-15 20:01:45,492 INFO [StoreOpener-0bde707836750663e729a0a0c206c460-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 0bde707836750663e729a0a0c206c460 2023-02-15 20:01:45,493 DEBUG [StoreOpener-0bde707836750663e729a0a0c206c460-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33775/user/jenkins/test-data/e1346e9a-ebf6-316f-c458-1c6b009bbc08/testWithMockedMapReduceSingleRegion/f3b44fec-16d2-4175-922c-a2f459c64483/data/default/testWithMockedMapReduceSingleRegion/0bde707836750663e729a0a0c206c460/f1 2023-02-15 20:01:45,493 INFO [StoreOpener-0bde707836750663e729a0a0c206c460-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0bde707836750663e729a0a0c206c460 columnFamilyName f1 2023-02-15 20:01:45,496 DEBUG [StoreOpener-0bde707836750663e729a0a0c206c460-1] regionserver.HStore(539): loaded hdfs://localhost:33775/user/jenkins/test-data/e1346e9a-ebf6-316f-c458-1c6b009bbc08/testWithMockedMapReduceSingleRegion/f3b44fec-16d2-4175-922c-a2f459c64483/data/default/testWithMockedMapReduceSingleRegion/0bde707836750663e729a0a0c206c460/f1/testWithMockedMapReduceSingleRegion=0bde707836750663e729a0a0c206c460-9084d569ff854e5b90241ef4321c2792 2023-02-15 20:01:45,497 INFO [StoreOpener-0bde707836750663e729a0a0c206c460-1] regionserver.HStore(310): Store=0bde707836750663e729a0a0c206c460/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 20:01:45,497 INFO [StoreOpener-0bde707836750663e729a0a0c206c460-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 0bde707836750663e729a0a0c206c460 2023-02-15 20:01:45,497 DEBUG [StoreOpener-0bde707836750663e729a0a0c206c460-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33775/user/jenkins/test-data/e1346e9a-ebf6-316f-c458-1c6b009bbc08/testWithMockedMapReduceSingleRegion/f3b44fec-16d2-4175-922c-a2f459c64483/data/default/testWithMockedMapReduceSingleRegion/0bde707836750663e729a0a0c206c460/f2 2023-02-15 20:01:45,498 INFO [StoreOpener-0bde707836750663e729a0a0c206c460-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0bde707836750663e729a0a0c206c460 columnFamilyName f2 2023-02-15 20:01:45,501 DEBUG [StoreOpener-0bde707836750663e729a0a0c206c460-1] regionserver.HStore(539): loaded hdfs://localhost:33775/user/jenkins/test-data/e1346e9a-ebf6-316f-c458-1c6b009bbc08/testWithMockedMapReduceSingleRegion/f3b44fec-16d2-4175-922c-a2f459c64483/data/default/testWithMockedMapReduceSingleRegion/0bde707836750663e729a0a0c206c460/f2/testWithMockedMapReduceSingleRegion=0bde707836750663e729a0a0c206c460-622c41a0ce3d494b85bb7f14221f2a91 2023-02-15 20:01:45,501 INFO [StoreOpener-0bde707836750663e729a0a0c206c460-1] regionserver.HStore(310): Store=0bde707836750663e729a0a0c206c460/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 20:01:45,502 DEBUG [Listener at localhost/34695] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceSingleRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-15 20:01:45,502 INFO [Listener at localhost/34695] regionserver.HRegion(1071): Opened 0bde707836750663e729a0a0c206c460; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69159786, jitterRate=0.030561119318008423}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-15 20:01:45,502 DEBUG [Listener at localhost/34695] regionserver.HRegion(964): Region open journal for 0bde707836750663e729a0a0c206c460: 2023-02-15 20:01:45,553 DEBUG [Listener at localhost/34695] regionserver.HRegion(1603): Closing 0bde707836750663e729a0a0c206c460, disabling compactions & flushes 2023-02-15 20:01:45,554 INFO [Listener at localhost/34695] regionserver.HRegion(1625): Closing region testWithMockedMapReduceSingleRegion,,1676491304055.0bde707836750663e729a0a0c206c460. 2023-02-15 20:01:45,554 DEBUG [Listener at localhost/34695] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceSingleRegion,,1676491304055.0bde707836750663e729a0a0c206c460. 2023-02-15 20:01:45,554 DEBUG [Listener at localhost/34695] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceSingleRegion,,1676491304055.0bde707836750663e729a0a0c206c460. after waiting 0 ms 2023-02-15 20:01:45,554 DEBUG [Listener at localhost/34695] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceSingleRegion,,1676491304055.0bde707836750663e729a0a0c206c460. 2023-02-15 20:01:45,555 INFO [Listener at localhost/34695] regionserver.HRegion(1837): Closed testWithMockedMapReduceSingleRegion,,1676491304055.0bde707836750663e729a0a0c206c460. 2023-02-15 20:01:45,555 DEBUG [Listener at localhost/34695] regionserver.HRegion(1557): Region close journal for 0bde707836750663e729a0a0c206c460: 2023-02-15 20:01:45,560 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45885] master.MasterRpcServices(748): Client=jenkins//172.31.14.131 delete name: "testWithMockedMapReduceSingleRegion" 2023-02-15 20:01:45,562 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45885] snapshot.SnapshotManager(333): Deleting snapshot: testWithMockedMapReduceSingleRegion 2023-02-15 20:01:45,564 INFO [Listener at localhost/34695] client.HBaseAdmin$15(890): Started disable of testWithMockedMapReduceSingleRegion 2023-02-15 20:01:45,564 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45885] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testWithMockedMapReduceSingleRegion 2023-02-15 20:01:45,565 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45885] procedure2.ProcedureExecutor(1029): Stored pid=15, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testWithMockedMapReduceSingleRegion 2023-02-15 20:01:45,568 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMockedMapReduceSingleRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676491305568"}]},"ts":"1676491305568"} 2023-02-15 20:01:45,568 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45885] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-15 20:01:45,569 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testWithMockedMapReduceSingleRegion, state=DISABLING in hbase:meta 2023-02-15 20:01:45,572 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testWithMockedMapReduceSingleRegion to state=DISABLING 2023-02-15 20:01:45,572 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceSingleRegion, region=0bde707836750663e729a0a0c206c460, UNASSIGN}] 2023-02-15 20:01:45,574 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceSingleRegion, region=0bde707836750663e729a0a0c206c460, UNASSIGN 2023-02-15 20:01:45,574 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=0bde707836750663e729a0a0c206c460, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,38321,1676491302490 2023-02-15 20:01:45,574 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceSingleRegion,,1676491304055.0bde707836750663e729a0a0c206c460.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1676491305574"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676491305574"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676491305574"}]},"ts":"1676491305574"} 2023-02-15 20:01:45,576 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=17, ppid=16, state=RUNNABLE; CloseRegionProcedure 0bde707836750663e729a0a0c206c460, server=jenkins-hbase4.apache.org,38321,1676491302490}] 2023-02-15 20:01:45,669 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45885] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-15 20:01:45,728 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 0bde707836750663e729a0a0c206c460 2023-02-15 20:01:45,728 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 0bde707836750663e729a0a0c206c460, disabling compactions & flushes 2023-02-15 20:01:45,728 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceSingleRegion,,1676491304055.0bde707836750663e729a0a0c206c460. 2023-02-15 20:01:45,728 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceSingleRegion,,1676491304055.0bde707836750663e729a0a0c206c460. 2023-02-15 20:01:45,728 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceSingleRegion,,1676491304055.0bde707836750663e729a0a0c206c460. after waiting 0 ms 2023-02-15 20:01:45,728 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceSingleRegion,,1676491304055.0bde707836750663e729a0a0c206c460. 2023-02-15 20:01:45,731 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33775/user/jenkins/test-data/1089ab4b-ae96-4b07-8e73-9617cf0f2504/data/default/testWithMockedMapReduceSingleRegion/0bde707836750663e729a0a0c206c460/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-15 20:01:45,732 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceSingleRegion,,1676491304055.0bde707836750663e729a0a0c206c460. 2023-02-15 20:01:45,732 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 0bde707836750663e729a0a0c206c460: 2023-02-15 20:01:45,734 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 0bde707836750663e729a0a0c206c460 2023-02-15 20:01:45,734 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=0bde707836750663e729a0a0c206c460, regionState=CLOSED 2023-02-15 20:01:45,734 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceSingleRegion,,1676491304055.0bde707836750663e729a0a0c206c460.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1676491305734"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676491305734"}]},"ts":"1676491305734"} 2023-02-15 20:01:45,736 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=17, resume processing ppid=16 2023-02-15 20:01:45,736 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=16, state=SUCCESS; CloseRegionProcedure 0bde707836750663e729a0a0c206c460, server=jenkins-hbase4.apache.org,38321,1676491302490 in 160 msec 2023-02-15 20:01:45,738 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=16, resume processing ppid=15 2023-02-15 20:01:45,738 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=15, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceSingleRegion, region=0bde707836750663e729a0a0c206c460, UNASSIGN in 164 msec 2023-02-15 20:01:45,738 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMockedMapReduceSingleRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676491305738"}]},"ts":"1676491305738"} 2023-02-15 20:01:45,739 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testWithMockedMapReduceSingleRegion, state=DISABLED in hbase:meta 2023-02-15 20:01:45,741 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testWithMockedMapReduceSingleRegion to state=DISABLED 2023-02-15 20:01:45,743 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=15, state=SUCCESS; DisableTableProcedure table=testWithMockedMapReduceSingleRegion in 178 msec 2023-02-15 20:01:45,871 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45885] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-15 20:01:45,871 INFO [Listener at localhost/34695] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testWithMockedMapReduceSingleRegion, procId: 15 completed 2023-02-15 20:01:45,872 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45885] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testWithMockedMapReduceSingleRegion 2023-02-15 20:01:45,872 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45885] procedure2.ProcedureExecutor(1029): Stored pid=18, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testWithMockedMapReduceSingleRegion 2023-02-15 20:01:45,874 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=18, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testWithMockedMapReduceSingleRegion 2023-02-15 20:01:45,875 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=18, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testWithMockedMapReduceSingleRegion 2023-02-15 20:01:45,875 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45885] master.MasterRpcServices(1227): Checking to see if procedure is done pid=18 2023-02-15 20:01:45,878 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33775/user/jenkins/test-data/1089ab4b-ae96-4b07-8e73-9617cf0f2504/.tmp/data/default/testWithMockedMapReduceSingleRegion/0bde707836750663e729a0a0c206c460 2023-02-15 20:01:45,880 DEBUG [HFileArchiver-2] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33775/user/jenkins/test-data/1089ab4b-ae96-4b07-8e73-9617cf0f2504/.tmp/data/default/testWithMockedMapReduceSingleRegion/0bde707836750663e729a0a0c206c460/f1, FileablePath, hdfs://localhost:33775/user/jenkins/test-data/1089ab4b-ae96-4b07-8e73-9617cf0f2504/.tmp/data/default/testWithMockedMapReduceSingleRegion/0bde707836750663e729a0a0c206c460/f2, FileablePath, hdfs://localhost:33775/user/jenkins/test-data/1089ab4b-ae96-4b07-8e73-9617cf0f2504/.tmp/data/default/testWithMockedMapReduceSingleRegion/0bde707836750663e729a0a0c206c460/recovered.edits] 2023-02-15 20:01:45,883 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33775/user/jenkins/test-data/1089ab4b-ae96-4b07-8e73-9617cf0f2504/.tmp/data/default/testWithMockedMapReduceSingleRegion/0bde707836750663e729a0a0c206c460/f1/0eb89e0b7d2b4279840443eac0aa5eef to hdfs://localhost:33775/user/jenkins/test-data/1089ab4b-ae96-4b07-8e73-9617cf0f2504/archive/data/default/testWithMockedMapReduceSingleRegion/0bde707836750663e729a0a0c206c460/f1/0eb89e0b7d2b4279840443eac0aa5eef 2023-02-15 20:01:45,885 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33775/user/jenkins/test-data/1089ab4b-ae96-4b07-8e73-9617cf0f2504/.tmp/data/default/testWithMockedMapReduceSingleRegion/0bde707836750663e729a0a0c206c460/f1/9084d569ff854e5b90241ef4321c2792 to hdfs://localhost:33775/user/jenkins/test-data/1089ab4b-ae96-4b07-8e73-9617cf0f2504/archive/data/default/testWithMockedMapReduceSingleRegion/0bde707836750663e729a0a0c206c460/f1/9084d569ff854e5b90241ef4321c2792 2023-02-15 20:01:45,887 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33775/user/jenkins/test-data/1089ab4b-ae96-4b07-8e73-9617cf0f2504/.tmp/data/default/testWithMockedMapReduceSingleRegion/0bde707836750663e729a0a0c206c460/f2/622c41a0ce3d494b85bb7f14221f2a91 to hdfs://localhost:33775/user/jenkins/test-data/1089ab4b-ae96-4b07-8e73-9617cf0f2504/archive/data/default/testWithMockedMapReduceSingleRegion/0bde707836750663e729a0a0c206c460/f2/622c41a0ce3d494b85bb7f14221f2a91 2023-02-15 20:01:45,888 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33775/user/jenkins/test-data/1089ab4b-ae96-4b07-8e73-9617cf0f2504/.tmp/data/default/testWithMockedMapReduceSingleRegion/0bde707836750663e729a0a0c206c460/f2/f39ee4b8073d42a4ba555b42861a0bde to hdfs://localhost:33775/user/jenkins/test-data/1089ab4b-ae96-4b07-8e73-9617cf0f2504/archive/data/default/testWithMockedMapReduceSingleRegion/0bde707836750663e729a0a0c206c460/f2/f39ee4b8073d42a4ba555b42861a0bde 2023-02-15 20:01:45,891 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33775/user/jenkins/test-data/1089ab4b-ae96-4b07-8e73-9617cf0f2504/.tmp/data/default/testWithMockedMapReduceSingleRegion/0bde707836750663e729a0a0c206c460/recovered.edits/12.seqid to hdfs://localhost:33775/user/jenkins/test-data/1089ab4b-ae96-4b07-8e73-9617cf0f2504/archive/data/default/testWithMockedMapReduceSingleRegion/0bde707836750663e729a0a0c206c460/recovered.edits/12.seqid 2023-02-15 20:01:45,892 DEBUG [HFileArchiver-2] backup.HFileArchiver(596): Deleted hdfs://localhost:33775/user/jenkins/test-data/1089ab4b-ae96-4b07-8e73-9617cf0f2504/.tmp/data/default/testWithMockedMapReduceSingleRegion/0bde707836750663e729a0a0c206c460 2023-02-15 20:01:45,892 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testWithMockedMapReduceSingleRegion regions 2023-02-15 20:01:45,894 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=18, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testWithMockedMapReduceSingleRegion 2023-02-15 20:01:45,895 WARN [PEWorker-1] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testWithMockedMapReduceSingleRegion from hbase:meta 2023-02-15 20:01:45,902 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(421): Removing 'testWithMockedMapReduceSingleRegion' descriptor. 2023-02-15 20:01:45,902 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=18, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testWithMockedMapReduceSingleRegion 2023-02-15 20:01:45,903 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(411): Removing 'testWithMockedMapReduceSingleRegion' from region states. 2023-02-15 20:01:45,903 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceSingleRegion,,1676491304055.0bde707836750663e729a0a0c206c460.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676491305903"}]},"ts":"9223372036854775807"} 2023-02-15 20:01:45,904 INFO [PEWorker-1] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-02-15 20:01:45,904 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 0bde707836750663e729a0a0c206c460, NAME => 'testWithMockedMapReduceSingleRegion,,1676491304055.0bde707836750663e729a0a0c206c460.', STARTKEY => '', ENDKEY => ''}] 2023-02-15 20:01:45,904 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(415): Marking 'testWithMockedMapReduceSingleRegion' as deleted. 2023-02-15 20:01:45,904 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceSingleRegion","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1676491305904"}]},"ts":"9223372036854775807"} 2023-02-15 20:01:45,905 INFO [PEWorker-1] hbase.MetaTableAccessor(1658): Deleted table testWithMockedMapReduceSingleRegion state from META 2023-02-15 20:01:45,907 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(130): Finished pid=18, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testWithMockedMapReduceSingleRegion 2023-02-15 20:01:45,908 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=18, state=SUCCESS; DeleteTableProcedure table=testWithMockedMapReduceSingleRegion in 35 msec 2023-02-15 20:01:45,977 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45885] master.MasterRpcServices(1227): Checking to see if procedure is done pid=18 2023-02-15 20:01:45,977 INFO [Listener at localhost/34695] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testWithMockedMapReduceSingleRegion, procId: 18 completed 2023-02-15 20:01:45,977 INFO [Listener at localhost/34695] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-02-15 20:01:45,977 INFO [Listener at localhost/34695] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-15 20:01:45,978 DEBUG [Listener at localhost/34695] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x14d52e2d to 127.0.0.1:61407 2023-02-15 20:01:45,978 DEBUG [Listener at localhost/34695] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-15 20:01:45,978 DEBUG [Listener at localhost/34695] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-02-15 20:01:45,978 DEBUG [Listener at localhost/34695] util.JVMClusterUtil(257): Found active master hash=1010115468, stopped=false 2023-02-15 20:01:45,978 INFO [Listener at localhost/34695] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,45885,1676491302440 2023-02-15 20:01:45,981 DEBUG [Listener at localhost/34695-EventThread] zookeeper.ZKWatcher(600): regionserver:38321-0x10059930fd80001, quorum=127.0.0.1:61407, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-15 20:01:45,981 DEBUG [Listener at localhost/34695-EventThread] zookeeper.ZKWatcher(600): regionserver:43045-0x10059930fd80002, quorum=127.0.0.1:61407, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-15 20:01:45,981 INFO [Listener at localhost/34695] procedure2.ProcedureExecutor(629): Stopping 2023-02-15 20:01:45,981 DEBUG [Listener at localhost/34695-EventThread] zookeeper.ZKWatcher(600): master:45885-0x10059930fd80000, quorum=127.0.0.1:61407, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-15 20:01:45,981 DEBUG [Listener at localhost/34695-EventThread] zookeeper.ZKWatcher(600): master:45885-0x10059930fd80000, quorum=127.0.0.1:61407, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-15 20:01:45,984 DEBUG [Listener at localhost/34695] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5acfb3be to 127.0.0.1:61407 2023-02-15 20:01:45,984 DEBUG [Listener at localhost/34695] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-15 20:01:45,984 INFO [Listener at localhost/34695] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,38321,1676491302490' ***** 2023-02-15 20:01:45,984 INFO [Listener at localhost/34695] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-15 20:01:45,984 INFO [Listener at localhost/34695] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,43045,1676491302520' ***** 2023-02-15 20:01:45,984 INFO [Listener at localhost/34695] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-15 20:01:45,984 INFO [RS:0;jenkins-hbase4:38321] regionserver.HeapMemoryManager(220): Stopping 2023-02-15 20:01:45,984 INFO [RS:0;jenkins-hbase4:38321] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-15 20:01:45,984 INFO [RS:0;jenkins-hbase4:38321] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-15 20:01:45,984 INFO [RS:1;jenkins-hbase4:43045] regionserver.HeapMemoryManager(220): Stopping 2023-02-15 20:01:45,985 INFO [RS:1;jenkins-hbase4:43045] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-15 20:01:45,985 INFO [RS:0;jenkins-hbase4:38321] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,38321,1676491302490 2023-02-15 20:01:45,985 INFO [RS:1;jenkins-hbase4:43045] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-15 20:01:45,985 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-15 20:01:45,985 INFO [RS:1;jenkins-hbase4:43045] regionserver.HRegionServer(3304): Received CLOSE for e5544c0dfa65805513a9f030b3c1cb32 2023-02-15 20:01:45,985 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-15 20:01:45,985 DEBUG [RS:0;jenkins-hbase4:38321] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5e2bbef1 to 127.0.0.1:61407 2023-02-15 20:01:45,986 DEBUG [RS:0;jenkins-hbase4:38321] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-15 20:01:45,986 INFO [RS:0;jenkins-hbase4:38321] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,38321,1676491302490; all regions closed. 2023-02-15 20:01:45,986 INFO [RS:1;jenkins-hbase4:43045] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,43045,1676491302520 2023-02-15 20:01:45,987 DEBUG [RS:1;jenkins-hbase4:43045] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x691e4f34 to 127.0.0.1:61407 2023-02-15 20:01:45,987 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing e5544c0dfa65805513a9f030b3c1cb32, disabling compactions & flushes 2023-02-15 20:01:45,987 DEBUG [RS:1;jenkins-hbase4:43045] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-15 20:01:45,987 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676491303490.e5544c0dfa65805513a9f030b3c1cb32. 2023-02-15 20:01:45,987 INFO [RS:1;jenkins-hbase4:43045] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-15 20:01:45,987 INFO [RS:1;jenkins-hbase4:43045] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-15 20:01:45,987 INFO [RS:1;jenkins-hbase4:43045] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-15 20:01:45,987 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676491303490.e5544c0dfa65805513a9f030b3c1cb32. 2023-02-15 20:01:45,987 INFO [RS:1;jenkins-hbase4:43045] regionserver.HRegionServer(3304): Received CLOSE for 1588230740 2023-02-15 20:01:45,987 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676491303490.e5544c0dfa65805513a9f030b3c1cb32. after waiting 0 ms 2023-02-15 20:01:45,987 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676491303490.e5544c0dfa65805513a9f030b3c1cb32. 2023-02-15 20:01:45,987 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing e5544c0dfa65805513a9f030b3c1cb32 1/1 column families, dataSize=78 B heapSize=488 B 2023-02-15 20:01:45,987 INFO [RS:1;jenkins-hbase4:43045] regionserver.HRegionServer(1475): Waiting on 2 regions to close 2023-02-15 20:01:45,987 DEBUG [RS:1;jenkins-hbase4:43045] regionserver.HRegionServer(1479): Online Regions={1588230740=hbase:meta,,1.1588230740, e5544c0dfa65805513a9f030b3c1cb32=hbase:namespace,,1676491303490.e5544c0dfa65805513a9f030b3c1cb32.} 2023-02-15 20:01:45,988 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-15 20:01:45,988 DEBUG [RS:1;jenkins-hbase4:43045] regionserver.HRegionServer(1505): Waiting on 1588230740, e5544c0dfa65805513a9f030b3c1cb32 2023-02-15 20:01:45,988 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-15 20:01:45,988 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-15 20:01:45,988 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-15 20:01:45,988 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-15 20:01:45,988 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 1588230740 3/3 column families, dataSize=4.21 KB heapSize=7.63 KB 2023-02-15 20:01:45,992 DEBUG [RS:0;jenkins-hbase4:38321] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/1089ab4b-ae96-4b07-8e73-9617cf0f2504/oldWALs 2023-02-15 20:01:45,993 INFO [RS:0;jenkins-hbase4:38321] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C38321%2C1676491302490:(num 1676491304253) 2023-02-15 20:01:45,993 DEBUG [RS:0;jenkins-hbase4:38321] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-15 20:01:45,993 INFO [RS:0;jenkins-hbase4:38321] regionserver.LeaseManager(133): Closed leases 2023-02-15 20:01:45,993 INFO [RS:0;jenkins-hbase4:38321] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-02-15 20:01:45,993 INFO [RS:0;jenkins-hbase4:38321] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-15 20:01:45,993 INFO [RS:0;jenkins-hbase4:38321] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-15 20:01:45,993 INFO [RS:0;jenkins-hbase4:38321] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-15 20:01:45,993 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-15 20:01:45,994 INFO [RS:0;jenkins-hbase4:38321] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:38321 2023-02-15 20:01:46,002 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:33775/user/jenkins/test-data/1089ab4b-ae96-4b07-8e73-9617cf0f2504/data/hbase/namespace/e5544c0dfa65805513a9f030b3c1cb32/.tmp/info/5dfb90c2e86a4cca855e659c9954b4c0 2023-02-15 20:01:46,003 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.57 KB at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:33775/user/jenkins/test-data/1089ab4b-ae96-4b07-8e73-9617cf0f2504/data/hbase/meta/1588230740/.tmp/info/47ec2ab11bdf444d95e30bd53deb647b 2023-02-15 20:01:46,008 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 47ec2ab11bdf444d95e30bd53deb647b 2023-02-15 20:01:46,014 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33775/user/jenkins/test-data/1089ab4b-ae96-4b07-8e73-9617cf0f2504/data/hbase/namespace/e5544c0dfa65805513a9f030b3c1cb32/.tmp/info/5dfb90c2e86a4cca855e659c9954b4c0 as hdfs://localhost:33775/user/jenkins/test-data/1089ab4b-ae96-4b07-8e73-9617cf0f2504/data/hbase/namespace/e5544c0dfa65805513a9f030b3c1cb32/info/5dfb90c2e86a4cca855e659c9954b4c0 2023-02-15 20:01:46,016 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-15 20:01:46,019 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-15 20:01:46,020 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:33775/user/jenkins/test-data/1089ab4b-ae96-4b07-8e73-9617cf0f2504/data/hbase/namespace/e5544c0dfa65805513a9f030b3c1cb32/info/5dfb90c2e86a4cca855e659c9954b4c0, entries=2, sequenceid=6, filesize=4.8 K 2023-02-15 20:01:46,028 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for e5544c0dfa65805513a9f030b3c1cb32 in 41ms, sequenceid=6, compaction requested=false 2023-02-15 20:01:46,052 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=115 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:33775/user/jenkins/test-data/1089ab4b-ae96-4b07-8e73-9617cf0f2504/data/hbase/meta/1588230740/.tmp/rep_barrier/bae9dcba11a844fa858660e1c90b71d2 2023-02-15 20:01:46,058 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33775/user/jenkins/test-data/1089ab4b-ae96-4b07-8e73-9617cf0f2504/data/hbase/namespace/e5544c0dfa65805513a9f030b3c1cb32/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-02-15 20:01:46,058 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676491303490.e5544c0dfa65805513a9f030b3c1cb32. 2023-02-15 20:01:46,058 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for e5544c0dfa65805513a9f030b3c1cb32: 2023-02-15 20:01:46,059 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1676491303490.e5544c0dfa65805513a9f030b3c1cb32. 2023-02-15 20:01:46,060 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for bae9dcba11a844fa858660e1c90b71d2 2023-02-15 20:01:46,078 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=536 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:33775/user/jenkins/test-data/1089ab4b-ae96-4b07-8e73-9617cf0f2504/data/hbase/meta/1588230740/.tmp/table/82cfc74ec20641ec8b4602b7c05cd242 2023-02-15 20:01:46,082 DEBUG [Listener at localhost/34695-EventThread] zookeeper.ZKWatcher(600): regionserver:38321-0x10059930fd80001, quorum=127.0.0.1:61407, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,38321,1676491302490 2023-02-15 20:01:46,082 ERROR [Listener at localhost/34695-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@2c127b57 rejected from java.util.concurrent.ThreadPoolExecutor@282dfa0d[Shutting down, pool size = 1, active threads = 1, queued tasks = 0, completed tasks = 15] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-15 20:01:46,082 DEBUG [Listener at localhost/34695-EventThread] zookeeper.ZKWatcher(600): regionserver:43045-0x10059930fd80002, quorum=127.0.0.1:61407, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,38321,1676491302490 2023-02-15 20:01:46,082 DEBUG [Listener at localhost/34695-EventThread] zookeeper.ZKWatcher(600): regionserver:43045-0x10059930fd80002, quorum=127.0.0.1:61407, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-15 20:01:46,082 DEBUG [Listener at localhost/34695-EventThread] zookeeper.ZKWatcher(600): master:45885-0x10059930fd80000, quorum=127.0.0.1:61407, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-15 20:01:46,082 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:45885-0x10059930fd80000, quorum=127.0.0.1:61407, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-15 20:01:46,082 DEBUG [Listener at localhost/34695-EventThread] zookeeper.ZKWatcher(600): regionserver:38321-0x10059930fd80001, quorum=127.0.0.1:61407, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-15 20:01:46,082 ERROR [Listener at localhost/34695-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@637f5bcd rejected from java.util.concurrent.ThreadPoolExecutor@282dfa0d[Shutting down, pool size = 1, active threads = 1, queued tasks = 0, completed tasks = 15] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-15 20:01:46,082 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43045-0x10059930fd80002, quorum=127.0.0.1:61407, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-15 20:01:46,082 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38321-0x10059930fd80001, quorum=127.0.0.1:61407, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-15 20:01:46,083 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 82cfc74ec20641ec8b4602b7c05cd242 2023-02-15 20:01:46,084 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33775/user/jenkins/test-data/1089ab4b-ae96-4b07-8e73-9617cf0f2504/data/hbase/meta/1588230740/.tmp/info/47ec2ab11bdf444d95e30bd53deb647b as hdfs://localhost:33775/user/jenkins/test-data/1089ab4b-ae96-4b07-8e73-9617cf0f2504/data/hbase/meta/1588230740/info/47ec2ab11bdf444d95e30bd53deb647b 2023-02-15 20:01:46,088 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 47ec2ab11bdf444d95e30bd53deb647b 2023-02-15 20:01:46,088 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:33775/user/jenkins/test-data/1089ab4b-ae96-4b07-8e73-9617cf0f2504/data/hbase/meta/1588230740/info/47ec2ab11bdf444d95e30bd53deb647b, entries=12, sequenceid=21, filesize=6.3 K 2023-02-15 20:01:46,089 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33775/user/jenkins/test-data/1089ab4b-ae96-4b07-8e73-9617cf0f2504/data/hbase/meta/1588230740/.tmp/rep_barrier/bae9dcba11a844fa858660e1c90b71d2 as hdfs://localhost:33775/user/jenkins/test-data/1089ab4b-ae96-4b07-8e73-9617cf0f2504/data/hbase/meta/1588230740/rep_barrier/bae9dcba11a844fa858660e1c90b71d2 2023-02-15 20:01:46,093 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for bae9dcba11a844fa858660e1c90b71d2 2023-02-15 20:01:46,093 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:33775/user/jenkins/test-data/1089ab4b-ae96-4b07-8e73-9617cf0f2504/data/hbase/meta/1588230740/rep_barrier/bae9dcba11a844fa858660e1c90b71d2, entries=1, sequenceid=21, filesize=5.0 K 2023-02-15 20:01:46,094 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33775/user/jenkins/test-data/1089ab4b-ae96-4b07-8e73-9617cf0f2504/data/hbase/meta/1588230740/.tmp/table/82cfc74ec20641ec8b4602b7c05cd242 as hdfs://localhost:33775/user/jenkins/test-data/1089ab4b-ae96-4b07-8e73-9617cf0f2504/data/hbase/meta/1588230740/table/82cfc74ec20641ec8b4602b7c05cd242 2023-02-15 20:01:46,104 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 82cfc74ec20641ec8b4602b7c05cd242 2023-02-15 20:01:46,104 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:33775/user/jenkins/test-data/1089ab4b-ae96-4b07-8e73-9617cf0f2504/data/hbase/meta/1588230740/table/82cfc74ec20641ec8b4602b7c05cd242, entries=4, sequenceid=21, filesize=5.1 K 2023-02-15 20:01:46,107 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~4.21 KB/4311, heapSize ~7.58 KB/7760, currentSize=0 B/0 for 1588230740 in 119ms, sequenceid=21, compaction requested=false 2023-02-15 20:01:46,126 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33775/user/jenkins/test-data/1089ab4b-ae96-4b07-8e73-9617cf0f2504/data/hbase/meta/1588230740/recovered.edits/24.seqid, newMaxSeqId=24, maxSeqId=1 2023-02-15 20:01:46,126 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-15 20:01:46,126 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-15 20:01:46,126 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 1588230740: 2023-02-15 20:01:46,126 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-02-15 20:01:46,185 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,38321,1676491302490] 2023-02-15 20:01:46,185 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,38321,1676491302490; numProcessing=1 2023-02-15 20:01:46,187 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-datanode.properties,hadoop-metrics2.properties 2023-02-15 20:01:46,187 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,38321,1676491302490 already deleted, retry=false 2023-02-15 20:01:46,187 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,38321,1676491302490 expired; onlineServers=1 2023-02-15 20:01:46,188 INFO [RS:1;jenkins-hbase4:43045] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,43045,1676491302520; all regions closed. 2023-02-15 20:01:46,194 DEBUG [RS:1;jenkins-hbase4:43045] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/1089ab4b-ae96-4b07-8e73-9617cf0f2504/oldWALs 2023-02-15 20:01:46,194 INFO [RS:1;jenkins-hbase4:43045] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C43045%2C1676491302520.meta:.meta(num 1676491303443) 2023-02-15 20:01:46,196 WARN [Close-WAL-Writer-0] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(641): complete file /user/jenkins/test-data/1089ab4b-ae96-4b07-8e73-9617cf0f2504/WALs/jenkins-hbase4.apache.org,43045,1676491302520/jenkins-hbase4.apache.org%2C43045%2C1676491302520.1676491303841 not finished, retry = 0 2023-02-15 20:01:46,216 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-02-15 20:01:46,216 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-02-15 20:01:46,298 DEBUG [RS:1;jenkins-hbase4:43045] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/1089ab4b-ae96-4b07-8e73-9617cf0f2504/oldWALs 2023-02-15 20:01:46,298 INFO [RS:1;jenkins-hbase4:43045] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C43045%2C1676491302520:(num 1676491303841) 2023-02-15 20:01:46,298 DEBUG [RS:1;jenkins-hbase4:43045] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-15 20:01:46,299 INFO [RS:1;jenkins-hbase4:43045] regionserver.LeaseManager(133): Closed leases 2023-02-15 20:01:46,299 INFO [RS:1;jenkins-hbase4:43045] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-02-15 20:01:46,299 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-15 20:01:46,300 INFO [RS:1;jenkins-hbase4:43045] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:43045 2023-02-15 20:01:46,302 DEBUG [Listener at localhost/34695-EventThread] zookeeper.ZKWatcher(600): regionserver:43045-0x10059930fd80002, quorum=127.0.0.1:61407, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,43045,1676491302520 2023-02-15 20:01:46,302 DEBUG [Listener at localhost/34695-EventThread] zookeeper.ZKWatcher(600): master:45885-0x10059930fd80000, quorum=127.0.0.1:61407, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-15 20:01:46,303 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,43045,1676491302520] 2023-02-15 20:01:46,303 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,43045,1676491302520; numProcessing=2 2023-02-15 20:01:46,304 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,43045,1676491302520 already deleted, retry=false 2023-02-15 20:01:46,304 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,43045,1676491302520 expired; onlineServers=0 2023-02-15 20:01:46,305 INFO [RegionServerTracker-0] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,45885,1676491302440' ***** 2023-02-15 20:01:46,305 INFO [RegionServerTracker-0] regionserver.HRegionServer(2310): STOPPED: Cluster shutdown set; onlineServer=0 2023-02-15 20:01:46,306 DEBUG [M:0;jenkins-hbase4:45885] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@380ab0d2, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-15 20:01:46,306 INFO [M:0;jenkins-hbase4:45885] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,45885,1676491302440 2023-02-15 20:01:46,306 INFO [M:0;jenkins-hbase4:45885] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,45885,1676491302440; all regions closed. 2023-02-15 20:01:46,306 DEBUG [M:0;jenkins-hbase4:45885] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-15 20:01:46,306 DEBUG [M:0;jenkins-hbase4:45885] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-02-15 20:01:46,306 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-02-15 20:01:46,306 DEBUG [M:0;jenkins-hbase4:45885] cleaner.HFileCleaner(317): Stopping file delete threads 2023-02-15 20:01:46,306 INFO [M:0;jenkins-hbase4:45885] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-02-15 20:01:46,306 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676491303078] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676491303078,5,FailOnTimeoutGroup] 2023-02-15 20:01:46,306 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676491303078] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676491303078,5,FailOnTimeoutGroup] 2023-02-15 20:01:46,306 INFO [M:0;jenkins-hbase4:45885] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-02-15 20:01:46,307 INFO [M:0;jenkins-hbase4:45885] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-02-15 20:01:46,307 DEBUG [M:0;jenkins-hbase4:45885] master.HMaster(1512): Stopping service threads 2023-02-15 20:01:46,307 INFO [M:0;jenkins-hbase4:45885] procedure2.RemoteProcedureDispatcher(118): Stopping procedure remote dispatcher 2023-02-15 20:01:46,307 ERROR [M:0;jenkins-hbase4:45885] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-02-15 20:01:46,308 INFO [M:0;jenkins-hbase4:45885] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-02-15 20:01:46,308 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-02-15 20:01:46,310 DEBUG [Listener at localhost/34695-EventThread] zookeeper.ZKWatcher(600): master:45885-0x10059930fd80000, quorum=127.0.0.1:61407, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-02-15 20:01:46,310 DEBUG [Listener at localhost/34695-EventThread] zookeeper.ZKWatcher(600): master:45885-0x10059930fd80000, quorum=127.0.0.1:61407, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-15 20:01:46,310 DEBUG [M:0;jenkins-hbase4:45885] zookeeper.ZKUtil(398): master:45885-0x10059930fd80000, quorum=127.0.0.1:61407, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-02-15 20:01:46,311 WARN [M:0;jenkins-hbase4:45885] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-02-15 20:01:46,311 INFO [M:0;jenkins-hbase4:45885] assignment.AssignmentManager(315): Stopping assignment manager 2023-02-15 20:01:46,311 INFO [M:0;jenkins-hbase4:45885] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-02-15 20:01:46,312 DEBUG [M:0;jenkins-hbase4:45885] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-15 20:01:46,312 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:45885-0x10059930fd80000, quorum=127.0.0.1:61407, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-15 20:01:46,312 INFO [M:0;jenkins-hbase4:45885] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-15 20:01:46,312 DEBUG [M:0;jenkins-hbase4:45885] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-15 20:01:46,312 DEBUG [M:0;jenkins-hbase4:45885] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-15 20:01:46,312 DEBUG [M:0;jenkins-hbase4:45885] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-15 20:01:46,312 INFO [M:0;jenkins-hbase4:45885] regionserver.HRegion(2744): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=56.12 KB heapSize=67.06 KB 2023-02-15 20:01:46,337 INFO [M:0;jenkins-hbase4:45885] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=56.12 KB at sequenceid=132 (bloomFilter=true), to=hdfs://localhost:33775/user/jenkins/test-data/1089ab4b-ae96-4b07-8e73-9617cf0f2504/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/b344daf1e465489881d3c78dc8279f9d 2023-02-15 20:01:46,343 DEBUG [M:0;jenkins-hbase4:45885] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33775/user/jenkins/test-data/1089ab4b-ae96-4b07-8e73-9617cf0f2504/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/b344daf1e465489881d3c78dc8279f9d as hdfs://localhost:33775/user/jenkins/test-data/1089ab4b-ae96-4b07-8e73-9617cf0f2504/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/b344daf1e465489881d3c78dc8279f9d 2023-02-15 20:01:46,347 INFO [M:0;jenkins-hbase4:45885] regionserver.HStore(1080): Added hdfs://localhost:33775/user/jenkins/test-data/1089ab4b-ae96-4b07-8e73-9617cf0f2504/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/b344daf1e465489881d3c78dc8279f9d, entries=17, sequenceid=132, filesize=8.7 K 2023-02-15 20:01:46,348 INFO [M:0;jenkins-hbase4:45885] regionserver.HRegion(2947): Finished flush of dataSize ~56.12 KB/57463, heapSize ~67.05 KB/68656, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 36ms, sequenceid=132, compaction requested=false 2023-02-15 20:01:46,352 INFO [M:0;jenkins-hbase4:45885] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-15 20:01:46,352 DEBUG [M:0;jenkins-hbase4:45885] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-15 20:01:46,355 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-15 20:01:46,356 INFO [M:0;jenkins-hbase4:45885] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-02-15 20:01:46,357 INFO [M:0;jenkins-hbase4:45885] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:45885 2023-02-15 20:01:46,359 DEBUG [M:0;jenkins-hbase4:45885] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,45885,1676491302440 already deleted, retry=false 2023-02-15 20:01:46,382 DEBUG [Listener at localhost/34695-EventThread] zookeeper.ZKWatcher(600): regionserver:38321-0x10059930fd80001, quorum=127.0.0.1:61407, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-15 20:01:46,382 INFO [RS:0;jenkins-hbase4:38321] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,38321,1676491302490; zookeeper connection closed. 2023-02-15 20:01:46,383 ERROR [Listener at localhost/34695-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@1bb22828 rejected from java.util.concurrent.ThreadPoolExecutor@282dfa0d[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-15 20:01:46,383 DEBUG [Listener at localhost/34695-EventThread] zookeeper.ZKWatcher(600): regionserver:38321-0x10059930fd80001, quorum=127.0.0.1:61407, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-15 20:01:46,383 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@7cbf78c7] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@7cbf78c7 2023-02-15 20:01:46,383 ERROR [Listener at localhost/34695-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@14380d7d rejected from java.util.concurrent.ThreadPoolExecutor@282dfa0d[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-15 20:01:46,483 DEBUG [Listener at localhost/34695-EventThread] zookeeper.ZKWatcher(600): master:45885-0x10059930fd80000, quorum=127.0.0.1:61407, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-15 20:01:46,483 ERROR [Listener at localhost/34695-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@40e6ac32 rejected from java.util.concurrent.ThreadPoolExecutor@44d920f6[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 50] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-15 20:01:46,483 INFO [M:0;jenkins-hbase4:45885] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,45885,1676491302440; zookeeper connection closed. 2023-02-15 20:01:46,483 DEBUG [Listener at localhost/34695-EventThread] zookeeper.ZKWatcher(600): master:45885-0x10059930fd80000, quorum=127.0.0.1:61407, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-15 20:01:46,484 ERROR [Listener at localhost/34695-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@4562a0cf rejected from java.util.concurrent.ThreadPoolExecutor@44d920f6[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 50] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-15 20:01:46,583 DEBUG [Listener at localhost/34695-EventThread] zookeeper.ZKWatcher(600): regionserver:43045-0x10059930fd80002, quorum=127.0.0.1:61407, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-15 20:01:46,583 INFO [RS:1;jenkins-hbase4:43045] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,43045,1676491302520; zookeeper connection closed. 2023-02-15 20:01:46,583 ERROR [Listener at localhost/34695-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@2ee2fb52 rejected from java.util.concurrent.ThreadPoolExecutor@2add7a56[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 19] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-15 20:01:46,583 DEBUG [Listener at localhost/34695-EventThread] zookeeper.ZKWatcher(600): regionserver:43045-0x10059930fd80002, quorum=127.0.0.1:61407, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-15 20:01:46,583 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@3e0299e1] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@3e0299e1 2023-02-15 20:01:46,583 ERROR [Listener at localhost/34695-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@67fb7195 rejected from java.util.concurrent.ThreadPoolExecutor@2add7a56[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 19] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-15 20:01:46,584 INFO [Listener at localhost/34695] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 2 regionserver(s) complete 2023-02-15 20:01:46,585 WARN [Listener at localhost/34695] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-15 20:01:46,589 INFO [Listener at localhost/34695] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-15 20:01:46,698 WARN [BP-2111606029-172.31.14.131-1676491301701 heartbeating to localhost/127.0.0.1:33775] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-15 20:01:46,699 WARN [BP-2111606029-172.31.14.131-1676491301701 heartbeating to localhost/127.0.0.1:33775] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-2111606029-172.31.14.131-1676491301701 (Datanode Uuid a1bdfa59-597f-4053-9843-91f85b4a168f) service to localhost/127.0.0.1:33775 2023-02-15 20:01:46,701 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/60d35244-9efb-8171-b54c-79ea832c21da/cluster_2e3ec7f8-62e9-c847-6b18-7328346b74c4/dfs/data/data3/current/BP-2111606029-172.31.14.131-1676491301701] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-15 20:01:46,701 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/60d35244-9efb-8171-b54c-79ea832c21da/cluster_2e3ec7f8-62e9-c847-6b18-7328346b74c4/dfs/data/data4/current/BP-2111606029-172.31.14.131-1676491301701] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-15 20:01:46,703 WARN [Listener at localhost/34695] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-15 20:01:46,725 INFO [Listener at localhost/34695] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-15 20:01:46,729 WARN [BP-2111606029-172.31.14.131-1676491301701 heartbeating to localhost/127.0.0.1:33775] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-15 20:01:46,729 WARN [BP-2111606029-172.31.14.131-1676491301701 heartbeating to localhost/127.0.0.1:33775] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-2111606029-172.31.14.131-1676491301701 (Datanode Uuid c8cdff00-76ee-4871-be6e-5c223c20dee8) service to localhost/127.0.0.1:33775 2023-02-15 20:01:46,729 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/60d35244-9efb-8171-b54c-79ea832c21da/cluster_2e3ec7f8-62e9-c847-6b18-7328346b74c4/dfs/data/data1/current/BP-2111606029-172.31.14.131-1676491301701] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-15 20:01:46,730 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/60d35244-9efb-8171-b54c-79ea832c21da/cluster_2e3ec7f8-62e9-c847-6b18-7328346b74c4/dfs/data/data2/current/BP-2111606029-172.31.14.131-1676491301701] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-15 20:01:46,743 INFO [Listener at localhost/34695] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-15 20:01:46,759 INFO [Listener at localhost/34695] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-02-15 20:01:46,783 INFO [Listener at localhost/34695] hbase.HBaseTestingUtility(1293): Minicluster is down 2023-02-15 20:01:46,797 INFO [Listener at localhost/34695] hbase.ResourceChecker(175): after: mapred.TestTableSnapshotInputFormat#testWithMockedMapReduceSingleRegion Thread=254 (was 230) Potentially hanging thread: nioEventLoopGroup-20-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-18-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-15-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/34695 java.lang.Thread.dumpThreads(Native Method) java.lang.Thread.getAllStackTraces(Thread.java:1615) org.apache.hadoop.hbase.ResourceCheckerJUnitListener$ThreadResourceAnalyzer.getVal(ResourceCheckerJUnitListener.java:49) org.apache.hadoop.hbase.ResourceChecker.fill(ResourceChecker.java:110) org.apache.hadoop.hbase.ResourceChecker.fillEndings(ResourceChecker.java:104) org.apache.hadoop.hbase.ResourceChecker.end(ResourceChecker.java:206) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.end(ResourceCheckerJUnitListener.java:165) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.testFinished(ResourceCheckerJUnitListener.java:185) org.junit.runner.notification.SynchronizedRunListener.testFinished(SynchronizedRunListener.java:87) org.junit.runner.notification.RunNotifier$9.notifyListener(RunNotifier.java:225) org.junit.runner.notification.RunNotifier$SafeNotifier.run(RunNotifier.java:72) org.junit.runner.notification.RunNotifier.fireTestFinished(RunNotifier.java:222) org.junit.internal.runners.model.EachTestNotifier.fireTestFinished(EachTestNotifier.java:38) org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:372) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) org.apache.hadoop.hbase.SystemExitRule$1.evaluate(SystemExitRule.java:39) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-17-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-21-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-19-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-19-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-17-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-15-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.9@localhost:33775 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1185813668) connection to localhost/127.0.0.1:33775 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS-EventLoopGroup-16-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-18-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-15 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins@localhost:33775 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/34695.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: RS-EventLoopGroup-15-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-20-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.8@localhost:33775 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-13 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-20-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-21-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-16-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1185813668) connection to localhost/127.0.0.1:33775 from jenkins.hfs.9 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: (jenkins-hbase4.apache.org,45885,1676491302440)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-14 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1185813668) connection to localhost/127.0.0.1:33775 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: IPC Client (1185813668) connection to localhost/127.0.0.1:33775 from jenkins.hfs.8 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-21-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-17-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-19-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-18-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-16-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=656 (was 638) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=317 (was 327), ProcessCount=166 (was 166), AvailableMemoryMB=2606 (was 2638) 2023-02-15 20:01:46,810 INFO [Listener at localhost/34695] hbase.ResourceChecker(147): before: mapred.TestTableSnapshotInputFormat#testRestoreSnapshotDoesNotCreateBackRefLinks Thread=254, OpenFileDescriptor=656, MaxFileDescriptor=60000, SystemLoadAverage=317, ProcessCount=166, AvailableMemoryMB=2605 2023-02-15 20:01:46,821 INFO [Listener at localhost/34695] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.log.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/60d35244-9efb-8171-b54c-79ea832c21da/hadoop.log.dir so I do NOT create it in target/test-data/ac5c756a-6485-ac70-7138-b3e6db6d6010 2023-02-15 20:01:46,821 WARN [Listener at localhost/34695] hbase.HBaseTestingUtility(449): hadoop.log.dir property value differs in configuration and system: Configuration=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/../logs while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/60d35244-9efb-8171-b54c-79ea832c21da/hadoop.log.dir Erasing configuration value by system value. 2023-02-15 20:01:46,821 INFO [Listener at localhost/34695] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.tmp.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/60d35244-9efb-8171-b54c-79ea832c21da/hadoop.tmp.dir so I do NOT create it in target/test-data/ac5c756a-6485-ac70-7138-b3e6db6d6010 2023-02-15 20:01:46,821 WARN [Listener at localhost/34695] hbase.HBaseTestingUtility(449): hadoop.tmp.dir property value differs in configuration and system: Configuration=/tmp/hadoop-jenkins while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/60d35244-9efb-8171-b54c-79ea832c21da/hadoop.tmp.dir Erasing configuration value by system value. 2023-02-15 20:01:46,821 DEBUG [Listener at localhost/34695] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ac5c756a-6485-ac70-7138-b3e6db6d6010 2023-02-15 20:01:46,821 INFO [Listener at localhost/34695] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=2, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=true, createWALDir=false} 2023-02-15 20:01:46,821 INFO [Listener at localhost/34695] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ac5c756a-6485-ac70-7138-b3e6db6d6010/cluster_9f2cb9c2-f4e9-5557-56de-ad895dec4706, deleteOnExit=true 2023-02-15 20:01:46,822 INFO [Listener at localhost/34695] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-02-15 20:01:46,822 INFO [Listener at localhost/34695] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ac5c756a-6485-ac70-7138-b3e6db6d6010/test.cache.data in system properties and HBase conf 2023-02-15 20:01:46,822 INFO [Listener at localhost/34695] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ac5c756a-6485-ac70-7138-b3e6db6d6010/hadoop.tmp.dir in system properties and HBase conf 2023-02-15 20:01:46,822 INFO [Listener at localhost/34695] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ac5c756a-6485-ac70-7138-b3e6db6d6010/hadoop.log.dir in system properties and HBase conf 2023-02-15 20:01:46,822 INFO [Listener at localhost/34695] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ac5c756a-6485-ac70-7138-b3e6db6d6010/mapreduce.cluster.local.dir in system properties and HBase conf 2023-02-15 20:01:46,822 INFO [Listener at localhost/34695] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ac5c756a-6485-ac70-7138-b3e6db6d6010/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-02-15 20:01:46,822 INFO [Listener at localhost/34695] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-02-15 20:01:46,822 DEBUG [Listener at localhost/34695] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-02-15 20:01:46,822 INFO [Listener at localhost/34695] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ac5c756a-6485-ac70-7138-b3e6db6d6010/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-02-15 20:01:46,823 INFO [Listener at localhost/34695] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ac5c756a-6485-ac70-7138-b3e6db6d6010/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-02-15 20:01:46,823 INFO [Listener at localhost/34695] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ac5c756a-6485-ac70-7138-b3e6db6d6010/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-02-15 20:01:46,823 INFO [Listener at localhost/34695] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ac5c756a-6485-ac70-7138-b3e6db6d6010/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-15 20:01:46,823 INFO [Listener at localhost/34695] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ac5c756a-6485-ac70-7138-b3e6db6d6010/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-02-15 20:01:46,823 INFO [Listener at localhost/34695] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ac5c756a-6485-ac70-7138-b3e6db6d6010/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-02-15 20:01:46,823 INFO [Listener at localhost/34695] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ac5c756a-6485-ac70-7138-b3e6db6d6010/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-15 20:01:46,823 INFO [Listener at localhost/34695] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ac5c756a-6485-ac70-7138-b3e6db6d6010/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-15 20:01:46,823 INFO [Listener at localhost/34695] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ac5c756a-6485-ac70-7138-b3e6db6d6010/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-02-15 20:01:46,823 INFO [Listener at localhost/34695] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ac5c756a-6485-ac70-7138-b3e6db6d6010/nfs.dump.dir in system properties and HBase conf 2023-02-15 20:01:46,824 INFO [Listener at localhost/34695] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ac5c756a-6485-ac70-7138-b3e6db6d6010/java.io.tmpdir in system properties and HBase conf 2023-02-15 20:01:46,824 INFO [Listener at localhost/34695] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ac5c756a-6485-ac70-7138-b3e6db6d6010/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-15 20:01:46,824 INFO [Listener at localhost/34695] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ac5c756a-6485-ac70-7138-b3e6db6d6010/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-02-15 20:01:46,824 INFO [Listener at localhost/34695] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ac5c756a-6485-ac70-7138-b3e6db6d6010/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-02-15 20:01:46,828 WARN [Listener at localhost/34695] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-15 20:01:46,828 WARN [Listener at localhost/34695] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-15 20:01:46,873 WARN [Listener at localhost/34695] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-15 20:01:46,876 INFO [Listener at localhost/34695] log.Slf4jLog(67): jetty-6.1.26 2023-02-15 20:01:46,884 INFO [Listener at localhost/34695] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ac5c756a-6485-ac70-7138-b3e6db6d6010/java.io.tmpdir/Jetty_localhost_41541_hdfs____.2qd5z5/webapp 2023-02-15 20:01:46,996 INFO [Listener at localhost/34695] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:41541 2023-02-15 20:01:47,001 WARN [Listener at localhost/34695] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-15 20:01:47,001 WARN [Listener at localhost/34695] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-15 20:01:47,048 WARN [Listener at localhost/43713] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-15 20:01:47,062 WARN [Listener at localhost/43713] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-15 20:01:47,064 WARN [Listener at localhost/43713] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-15 20:01:47,065 INFO [Listener at localhost/43713] log.Slf4jLog(67): jetty-6.1.26 2023-02-15 20:01:47,071 INFO [Listener at localhost/43713] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ac5c756a-6485-ac70-7138-b3e6db6d6010/java.io.tmpdir/Jetty_localhost_35813_datanode____.gzb59d/webapp 2023-02-15 20:01:47,183 INFO [Listener at localhost/43713] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:35813 2023-02-15 20:01:47,194 WARN [Listener at localhost/33937] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-15 20:01:47,213 WARN [Listener at localhost/33937] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-15 20:01:47,215 WARN [Listener at localhost/33937] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-15 20:01:47,217 INFO [Listener at localhost/33937] log.Slf4jLog(67): jetty-6.1.26 2023-02-15 20:01:47,222 INFO [Listener at localhost/33937] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ac5c756a-6485-ac70-7138-b3e6db6d6010/java.io.tmpdir/Jetty_localhost_39409_datanode____.t69dhe/webapp 2023-02-15 20:01:47,296 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x6f3fdfd7ec16bef8: Processing first storage report for DS-969de9b0-feaa-4639-9b72-f9305b55a4cf from datanode b8b7ea5b-b871-4246-b0a7-cc26748effcd 2023-02-15 20:01:47,296 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x6f3fdfd7ec16bef8: from storage DS-969de9b0-feaa-4639-9b72-f9305b55a4cf node DatanodeRegistration(127.0.0.1:45539, datanodeUuid=b8b7ea5b-b871-4246-b0a7-cc26748effcd, infoPort=35827, infoSecurePort=0, ipcPort=33937, storageInfo=lv=-57;cid=testClusterID;nsid=1161440635;c=1676491306831), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-15 20:01:47,296 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x6f3fdfd7ec16bef8: Processing first storage report for DS-798f9e30-f55e-4fb8-bb06-4d9d653dfc5e from datanode b8b7ea5b-b871-4246-b0a7-cc26748effcd 2023-02-15 20:01:47,296 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x6f3fdfd7ec16bef8: from storage DS-798f9e30-f55e-4fb8-bb06-4d9d653dfc5e node DatanodeRegistration(127.0.0.1:45539, datanodeUuid=b8b7ea5b-b871-4246-b0a7-cc26748effcd, infoPort=35827, infoSecurePort=0, ipcPort=33937, storageInfo=lv=-57;cid=testClusterID;nsid=1161440635;c=1676491306831), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-15 20:01:47,338 INFO [Listener at localhost/33937] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:39409 2023-02-15 20:01:47,347 WARN [Listener at localhost/44509] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-15 20:01:47,439 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x6212f677e4a44d52: Processing first storage report for DS-30c649f1-6553-4fdd-ac66-fdd811b65af4 from datanode 9d641c39-b67d-4dbf-a4f6-9cfe76e13e3b 2023-02-15 20:01:47,440 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x6212f677e4a44d52: from storage DS-30c649f1-6553-4fdd-ac66-fdd811b65af4 node DatanodeRegistration(127.0.0.1:45543, datanodeUuid=9d641c39-b67d-4dbf-a4f6-9cfe76e13e3b, infoPort=33503, infoSecurePort=0, ipcPort=44509, storageInfo=lv=-57;cid=testClusterID;nsid=1161440635;c=1676491306831), blocks: 0, hasStaleStorage: true, processing time: 1 msecs, invalidatedBlocks: 0 2023-02-15 20:01:47,440 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x6212f677e4a44d52: Processing first storage report for DS-5b1c17b6-19a3-4c13-ab25-38945ea65e6e from datanode 9d641c39-b67d-4dbf-a4f6-9cfe76e13e3b 2023-02-15 20:01:47,440 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x6212f677e4a44d52: from storage DS-5b1c17b6-19a3-4c13-ab25-38945ea65e6e node DatanodeRegistration(127.0.0.1:45543, datanodeUuid=9d641c39-b67d-4dbf-a4f6-9cfe76e13e3b, infoPort=33503, infoSecurePort=0, ipcPort=44509, storageInfo=lv=-57;cid=testClusterID;nsid=1161440635;c=1676491306831), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-15 20:01:47,455 DEBUG [Listener at localhost/44509] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ac5c756a-6485-ac70-7138-b3e6db6d6010 2023-02-15 20:01:47,458 INFO [Listener at localhost/44509] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ac5c756a-6485-ac70-7138-b3e6db6d6010/cluster_9f2cb9c2-f4e9-5557-56de-ad895dec4706/zookeeper_0, clientPort=53662, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ac5c756a-6485-ac70-7138-b3e6db6d6010/cluster_9f2cb9c2-f4e9-5557-56de-ad895dec4706/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ac5c756a-6485-ac70-7138-b3e6db6d6010/cluster_9f2cb9c2-f4e9-5557-56de-ad895dec4706/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-02-15 20:01:47,459 INFO [Listener at localhost/44509] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=53662 2023-02-15 20:01:47,459 INFO [Listener at localhost/44509] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-15 20:01:47,459 INFO [Listener at localhost/44509] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-15 20:01:47,473 INFO [Listener at localhost/44509] util.FSUtils(479): Created version file at hdfs://localhost:43713/user/jenkins/test-data/c7dde7f7-f3cd-e2c2-c03f-38aeb64416ed with version=8 2023-02-15 20:01:47,473 INFO [Listener at localhost/44509] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-15 20:01:47,474 INFO [Listener at localhost/44509] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-15 20:01:47,475 INFO [Listener at localhost/44509] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:43713/user/jenkins/test-data/7fe6e493-30c4-7f54-e50e-dcd4f9f9a780/hbase-staging 2023-02-15 20:01:47,477 INFO [Listener at localhost/44509] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-02-15 20:01:47,477 INFO [Listener at localhost/44509] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-15 20:01:47,477 INFO [Listener at localhost/44509] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-15 20:01:47,477 INFO [Listener at localhost/44509] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-15 20:01:47,477 INFO [Listener at localhost/44509] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-15 20:01:47,477 INFO [Listener at localhost/44509] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-15 20:01:47,477 INFO [Listener at localhost/44509] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-02-15 20:01:47,478 INFO [Listener at localhost/44509] ipc.NettyRpcServer(120): Bind to /172.31.14.131:43791 2023-02-15 20:01:47,479 INFO [Listener at localhost/44509] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-15 20:01:47,480 INFO [Listener at localhost/44509] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-15 20:01:47,481 INFO [Listener at localhost/44509] zookeeper.RecoverableZooKeeper(93): Process identifier=master:43791 connecting to ZooKeeper ensemble=127.0.0.1:53662 2023-02-15 20:01:47,492 DEBUG [Listener at localhost/44509-EventThread] zookeeper.ZKWatcher(600): master:437910x0, quorum=127.0.0.1:53662, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-15 20:01:47,493 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): master:43791-0x100599323860000 connected 2023-02-15 20:01:47,514 DEBUG [Listener at localhost/44509] zookeeper.ZKUtil(164): master:43791-0x100599323860000, quorum=127.0.0.1:53662, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-15 20:01:47,514 DEBUG [Listener at localhost/44509] zookeeper.ZKUtil(164): master:43791-0x100599323860000, quorum=127.0.0.1:53662, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-15 20:01:47,515 DEBUG [Listener at localhost/44509] zookeeper.ZKUtil(164): master:43791-0x100599323860000, quorum=127.0.0.1:53662, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-15 20:01:47,515 DEBUG [Listener at localhost/44509] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=43791 2023-02-15 20:01:47,515 DEBUG [Listener at localhost/44509] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=43791 2023-02-15 20:01:47,516 DEBUG [Listener at localhost/44509] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=43791 2023-02-15 20:01:47,520 DEBUG [Listener at localhost/44509] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=43791 2023-02-15 20:01:47,520 DEBUG [Listener at localhost/44509] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=43791 2023-02-15 20:01:47,520 INFO [Listener at localhost/44509] master.HMaster(444): hbase.rootdir=hdfs://localhost:43713/user/jenkins/test-data/c7dde7f7-f3cd-e2c2-c03f-38aeb64416ed, hbase.cluster.distributed=false 2023-02-15 20:01:47,532 INFO [Listener at localhost/44509] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-15 20:01:47,532 INFO [Listener at localhost/44509] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-15 20:01:47,533 INFO [Listener at localhost/44509] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-15 20:01:47,533 INFO [Listener at localhost/44509] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-15 20:01:47,533 INFO [Listener at localhost/44509] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-15 20:01:47,533 INFO [Listener at localhost/44509] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-15 20:01:47,533 INFO [Listener at localhost/44509] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-15 20:01:47,534 INFO [Listener at localhost/44509] ipc.NettyRpcServer(120): Bind to /172.31.14.131:44675 2023-02-15 20:01:47,534 INFO [Listener at localhost/44509] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-15 20:01:47,534 DEBUG [Listener at localhost/44509] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-15 20:01:47,535 INFO [Listener at localhost/44509] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-15 20:01:47,536 INFO [Listener at localhost/44509] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-15 20:01:47,536 INFO [Listener at localhost/44509] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:44675 connecting to ZooKeeper ensemble=127.0.0.1:53662 2023-02-15 20:01:47,538 DEBUG [Listener at localhost/44509-EventThread] zookeeper.ZKWatcher(600): regionserver:446750x0, quorum=127.0.0.1:53662, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-15 20:01:47,539 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:44675-0x100599323860001 connected 2023-02-15 20:01:47,539 DEBUG [Listener at localhost/44509] zookeeper.ZKUtil(164): regionserver:44675-0x100599323860001, quorum=127.0.0.1:53662, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-15 20:01:47,540 DEBUG [Listener at localhost/44509] zookeeper.ZKUtil(164): regionserver:44675-0x100599323860001, quorum=127.0.0.1:53662, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-15 20:01:47,541 DEBUG [Listener at localhost/44509] zookeeper.ZKUtil(164): regionserver:44675-0x100599323860001, quorum=127.0.0.1:53662, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-15 20:01:47,541 DEBUG [Listener at localhost/44509] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=44675 2023-02-15 20:01:47,544 DEBUG [Listener at localhost/44509] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=44675 2023-02-15 20:01:47,544 DEBUG [Listener at localhost/44509] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=44675 2023-02-15 20:01:47,548 DEBUG [Listener at localhost/44509] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=44675 2023-02-15 20:01:47,548 DEBUG [Listener at localhost/44509] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=44675 2023-02-15 20:01:47,559 INFO [Listener at localhost/44509] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-15 20:01:47,559 INFO [Listener at localhost/44509] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-15 20:01:47,559 INFO [Listener at localhost/44509] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-15 20:01:47,559 INFO [Listener at localhost/44509] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-15 20:01:47,559 INFO [Listener at localhost/44509] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-15 20:01:47,559 INFO [Listener at localhost/44509] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-15 20:01:47,559 INFO [Listener at localhost/44509] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-15 20:01:47,560 INFO [Listener at localhost/44509] ipc.NettyRpcServer(120): Bind to /172.31.14.131:41047 2023-02-15 20:01:47,560 INFO [Listener at localhost/44509] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-15 20:01:47,560 DEBUG [Listener at localhost/44509] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-15 20:01:47,561 INFO [Listener at localhost/44509] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-15 20:01:47,562 INFO [Listener at localhost/44509] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-15 20:01:47,562 INFO [Listener at localhost/44509] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:41047 connecting to ZooKeeper ensemble=127.0.0.1:53662 2023-02-15 20:01:47,564 DEBUG [Listener at localhost/44509-EventThread] zookeeper.ZKWatcher(600): regionserver:410470x0, quorum=127.0.0.1:53662, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-15 20:01:47,565 DEBUG [Listener at localhost/44509] zookeeper.ZKUtil(164): regionserver:410470x0, quorum=127.0.0.1:53662, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-15 20:01:47,565 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:41047-0x100599323860002 connected 2023-02-15 20:01:47,566 DEBUG [Listener at localhost/44509] zookeeper.ZKUtil(164): regionserver:41047-0x100599323860002, quorum=127.0.0.1:53662, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-15 20:01:47,566 DEBUG [Listener at localhost/44509] zookeeper.ZKUtil(164): regionserver:41047-0x100599323860002, quorum=127.0.0.1:53662, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-15 20:01:47,566 DEBUG [Listener at localhost/44509] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=41047 2023-02-15 20:01:47,567 DEBUG [Listener at localhost/44509] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=41047 2023-02-15 20:01:47,568 DEBUG [Listener at localhost/44509] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=41047 2023-02-15 20:01:47,570 DEBUG [Listener at localhost/44509] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=41047 2023-02-15 20:01:47,571 DEBUG [Listener at localhost/44509] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=41047 2023-02-15 20:01:47,572 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,43791,1676491307476 2023-02-15 20:01:47,573 DEBUG [Listener at localhost/44509-EventThread] zookeeper.ZKWatcher(600): master:43791-0x100599323860000, quorum=127.0.0.1:53662, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-15 20:01:47,574 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:43791-0x100599323860000, quorum=127.0.0.1:53662, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,43791,1676491307476 2023-02-15 20:01:47,580 DEBUG [Listener at localhost/44509-EventThread] zookeeper.ZKWatcher(600): master:43791-0x100599323860000, quorum=127.0.0.1:53662, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-15 20:01:47,580 DEBUG [Listener at localhost/44509-EventThread] zookeeper.ZKWatcher(600): regionserver:41047-0x100599323860002, quorum=127.0.0.1:53662, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-15 20:01:47,580 DEBUG [Listener at localhost/44509-EventThread] zookeeper.ZKWatcher(600): regionserver:44675-0x100599323860001, quorum=127.0.0.1:53662, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-15 20:01:47,580 DEBUG [Listener at localhost/44509-EventThread] zookeeper.ZKWatcher(600): master:43791-0x100599323860000, quorum=127.0.0.1:53662, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-15 20:01:47,582 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:43791-0x100599323860000, quorum=127.0.0.1:53662, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-15 20:01:47,584 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,43791,1676491307476 from backup master directory 2023-02-15 20:01:47,585 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:43791-0x100599323860000, quorum=127.0.0.1:53662, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-15 20:01:47,585 DEBUG [Listener at localhost/44509-EventThread] zookeeper.ZKWatcher(600): master:43791-0x100599323860000, quorum=127.0.0.1:53662, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,43791,1676491307476 2023-02-15 20:01:47,585 DEBUG [Listener at localhost/44509-EventThread] zookeeper.ZKWatcher(600): master:43791-0x100599323860000, quorum=127.0.0.1:53662, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-15 20:01:47,585 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-15 20:01:47,585 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase4.apache.org,43791,1676491307476 2023-02-15 20:01:47,599 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(628): Created cluster ID file at hdfs://localhost:43713/user/jenkins/test-data/c7dde7f7-f3cd-e2c2-c03f-38aeb64416ed/hbase.id with ID: a949ad81-a02a-4394-a3e3-c9335cc955ce 2023-02-15 20:01:47,608 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-15 20:01:47,610 DEBUG [Listener at localhost/44509-EventThread] zookeeper.ZKWatcher(600): master:43791-0x100599323860000, quorum=127.0.0.1:53662, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-15 20:01:47,621 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x617e5eae to 127.0.0.1:53662 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-15 20:01:47,624 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3b16a1f5, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-15 20:01:47,624 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-15 20:01:47,625 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-02-15 20:01:47,625 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-15 20:01:47,626 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7689): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:43713/user/jenkins/test-data/c7dde7f7-f3cd-e2c2-c03f-38aeb64416ed/MasterData/data/master/store-tmp 2023-02-15 20:01:47,632 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 20:01:47,632 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-15 20:01:47,632 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-15 20:01:47,632 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-15 20:01:47,632 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-15 20:01:47,632 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-15 20:01:47,632 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-15 20:01:47,632 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-15 20:01:47,633 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:43713/user/jenkins/test-data/c7dde7f7-f3cd-e2c2-c03f-38aeb64416ed/MasterData/WALs/jenkins-hbase4.apache.org,43791,1676491307476 2023-02-15 20:01:47,635 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C43791%2C1676491307476, suffix=, logDir=hdfs://localhost:43713/user/jenkins/test-data/c7dde7f7-f3cd-e2c2-c03f-38aeb64416ed/MasterData/WALs/jenkins-hbase4.apache.org,43791,1676491307476, archiveDir=hdfs://localhost:43713/user/jenkins/test-data/c7dde7f7-f3cd-e2c2-c03f-38aeb64416ed/MasterData/oldWALs, maxLogs=10 2023-02-15 20:01:47,647 DEBUG [RS-EventLoopGroup-20-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45543,DS-30c649f1-6553-4fdd-ac66-fdd811b65af4,DISK] 2023-02-15 20:01:47,647 DEBUG [RS-EventLoopGroup-20-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45539,DS-969de9b0-feaa-4639-9b72-f9305b55a4cf,DISK] 2023-02-15 20:01:47,649 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/c7dde7f7-f3cd-e2c2-c03f-38aeb64416ed/MasterData/WALs/jenkins-hbase4.apache.org,43791,1676491307476/jenkins-hbase4.apache.org%2C43791%2C1676491307476.1676491307635 2023-02-15 20:01:47,652 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:45543,DS-30c649f1-6553-4fdd-ac66-fdd811b65af4,DISK], DatanodeInfoWithStorage[127.0.0.1:45539,DS-969de9b0-feaa-4639-9b72-f9305b55a4cf,DISK]] 2023-02-15 20:01:47,652 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7850): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-02-15 20:01:47,652 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 20:01:47,652 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7890): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-02-15 20:01:47,652 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7893): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-02-15 20:01:47,656 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-02-15 20:01:47,657 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43713/user/jenkins/test-data/c7dde7f7-f3cd-e2c2-c03f-38aeb64416ed/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-02-15 20:01:47,658 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-02-15 20:01:47,659 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 20:01:47,659 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43713/user/jenkins/test-data/c7dde7f7-f3cd-e2c2-c03f-38aeb64416ed/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-15 20:01:47,659 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43713/user/jenkins/test-data/c7dde7f7-f3cd-e2c2-c03f-38aeb64416ed/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-15 20:01:47,661 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1054): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-02-15 20:01:47,664 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43713/user/jenkins/test-data/c7dde7f7-f3cd-e2c2-c03f-38aeb64416ed/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-15 20:01:47,665 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1071): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71114110, jitterRate=0.05968281626701355}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-15 20:01:47,665 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(964): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-15 20:01:47,665 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-02-15 20:01:47,666 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-02-15 20:01:47,666 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-02-15 20:01:47,666 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-02-15 20:01:47,666 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 0 msec 2023-02-15 20:01:47,667 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 0 msec 2023-02-15 20:01:47,667 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(95): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-02-15 20:01:47,667 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-02-15 20:01:47,668 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-02-15 20:01:47,678 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-02-15 20:01:47,678 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-02-15 20:01:47,678 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:43791-0x100599323860000, quorum=127.0.0.1:53662, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-02-15 20:01:47,678 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-02-15 20:01:47,679 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:43791-0x100599323860000, quorum=127.0.0.1:53662, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-02-15 20:01:47,681 DEBUG [Listener at localhost/44509-EventThread] zookeeper.ZKWatcher(600): master:43791-0x100599323860000, quorum=127.0.0.1:53662, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-15 20:01:47,682 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:43791-0x100599323860000, quorum=127.0.0.1:53662, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-02-15 20:01:47,682 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:43791-0x100599323860000, quorum=127.0.0.1:53662, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-02-15 20:01:47,683 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:43791-0x100599323860000, quorum=127.0.0.1:53662, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-02-15 20:01:47,684 DEBUG [Listener at localhost/44509-EventThread] zookeeper.ZKWatcher(600): master:43791-0x100599323860000, quorum=127.0.0.1:53662, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-15 20:01:47,684 DEBUG [Listener at localhost/44509-EventThread] zookeeper.ZKWatcher(600): regionserver:41047-0x100599323860002, quorum=127.0.0.1:53662, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-15 20:01:47,684 DEBUG [Listener at localhost/44509-EventThread] zookeeper.ZKWatcher(600): regionserver:44675-0x100599323860001, quorum=127.0.0.1:53662, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-15 20:01:47,684 DEBUG [Listener at localhost/44509-EventThread] zookeeper.ZKWatcher(600): master:43791-0x100599323860000, quorum=127.0.0.1:53662, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-15 20:01:47,684 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase4.apache.org,43791,1676491307476, sessionid=0x100599323860000, setting cluster-up flag (Was=false) 2023-02-15 20:01:47,690 DEBUG [Listener at localhost/44509-EventThread] zookeeper.ZKWatcher(600): master:43791-0x100599323860000, quorum=127.0.0.1:53662, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-15 20:01:47,694 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-02-15 20:01:47,695 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,43791,1676491307476 2023-02-15 20:01:47,698 DEBUG [Listener at localhost/44509-EventThread] zookeeper.ZKWatcher(600): master:43791-0x100599323860000, quorum=127.0.0.1:53662, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-15 20:01:47,701 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-02-15 20:01:47,702 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,43791,1676491307476 2023-02-15 20:01:47,703 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:43713/user/jenkins/test-data/c7dde7f7-f3cd-e2c2-c03f-38aeb64416ed/.hbase-snapshot/.tmp 2023-02-15 20:01:47,704 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-02-15 20:01:47,704 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-15 20:01:47,704 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-15 20:01:47,704 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-15 20:01:47,704 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-15 20:01:47,704 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-02-15 20:01:47,704 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 20:01:47,704 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-15 20:01:47,704 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 20:01:47,710 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1676491337709 2023-02-15 20:01:47,710 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-02-15 20:01:47,710 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-02-15 20:01:47,710 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-02-15 20:01:47,710 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-02-15 20:01:47,710 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-02-15 20:01:47,710 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-02-15 20:01:47,710 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-02-15 20:01:47,710 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-02-15 20:01:47,710 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-15 20:01:47,710 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-02-15 20:01:47,710 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-02-15 20:01:47,710 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-02-15 20:01:47,711 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-02-15 20:01:47,711 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-02-15 20:01:47,711 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676491307711,5,FailOnTimeoutGroup] 2023-02-15 20:01:47,712 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-15 20:01:47,712 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676491307712,5,FailOnTimeoutGroup] 2023-02-15 20:01:47,712 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-15 20:01:47,712 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-02-15 20:01:47,712 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-02-15 20:01:47,712 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-02-15 20:01:47,723 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:43713/user/jenkins/test-data/c7dde7f7-f3cd-e2c2-c03f-38aeb64416ed/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-15 20:01:47,724 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:43713/user/jenkins/test-data/c7dde7f7-f3cd-e2c2-c03f-38aeb64416ed/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-15 20:01:47,724 INFO [PEWorker-1] regionserver.HRegion(7671): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43713/user/jenkins/test-data/c7dde7f7-f3cd-e2c2-c03f-38aeb64416ed 2023-02-15 20:01:47,733 DEBUG [PEWorker-1] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 20:01:47,734 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-15 20:01:47,735 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43713/user/jenkins/test-data/c7dde7f7-f3cd-e2c2-c03f-38aeb64416ed/data/hbase/meta/1588230740/info 2023-02-15 20:01:47,735 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-15 20:01:47,736 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 20:01:47,736 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-15 20:01:47,737 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43713/user/jenkins/test-data/c7dde7f7-f3cd-e2c2-c03f-38aeb64416ed/data/hbase/meta/1588230740/rep_barrier 2023-02-15 20:01:47,737 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-15 20:01:47,737 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 20:01:47,737 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-15 20:01:47,738 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43713/user/jenkins/test-data/c7dde7f7-f3cd-e2c2-c03f-38aeb64416ed/data/hbase/meta/1588230740/table 2023-02-15 20:01:47,738 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-15 20:01:47,739 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 20:01:47,739 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43713/user/jenkins/test-data/c7dde7f7-f3cd-e2c2-c03f-38aeb64416ed/data/hbase/meta/1588230740 2023-02-15 20:01:47,739 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43713/user/jenkins/test-data/c7dde7f7-f3cd-e2c2-c03f-38aeb64416ed/data/hbase/meta/1588230740 2023-02-15 20:01:47,741 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-15 20:01:47,742 DEBUG [PEWorker-1] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-15 20:01:47,743 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43713/user/jenkins/test-data/c7dde7f7-f3cd-e2c2-c03f-38aeb64416ed/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-15 20:01:47,743 INFO [PEWorker-1] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=58800294, jitterRate=-0.12380734086036682}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-15 20:01:47,743 DEBUG [PEWorker-1] regionserver.HRegion(964): Region open journal for 1588230740: 2023-02-15 20:01:47,743 DEBUG [PEWorker-1] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-15 20:01:47,743 INFO [PEWorker-1] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-15 20:01:47,743 DEBUG [PEWorker-1] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-15 20:01:47,743 DEBUG [PEWorker-1] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-15 20:01:47,743 DEBUG [PEWorker-1] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-15 20:01:47,744 INFO [PEWorker-1] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-15 20:01:47,744 DEBUG [PEWorker-1] regionserver.HRegion(1557): Region close journal for 1588230740: 2023-02-15 20:01:47,744 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-02-15 20:01:47,744 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-02-15 20:01:47,744 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-02-15 20:01:47,746 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-02-15 20:01:47,747 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-02-15 20:01:47,773 INFO [RS:0;jenkins-hbase4:44675] regionserver.HRegionServer(952): ClusterId : a949ad81-a02a-4394-a3e3-c9335cc955ce 2023-02-15 20:01:47,773 DEBUG [RS:0;jenkins-hbase4:44675] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-15 20:01:47,773 INFO [RS:1;jenkins-hbase4:41047] regionserver.HRegionServer(952): ClusterId : a949ad81-a02a-4394-a3e3-c9335cc955ce 2023-02-15 20:01:47,773 DEBUG [RS:1;jenkins-hbase4:41047] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-15 20:01:47,776 DEBUG [RS:0;jenkins-hbase4:44675] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-15 20:01:47,776 DEBUG [RS:0;jenkins-hbase4:44675] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-15 20:01:47,777 DEBUG [RS:1;jenkins-hbase4:41047] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-15 20:01:47,777 DEBUG [RS:1;jenkins-hbase4:41047] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-15 20:01:47,778 DEBUG [RS:0;jenkins-hbase4:44675] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-15 20:01:47,779 DEBUG [RS:0;jenkins-hbase4:44675] zookeeper.ReadOnlyZKClient(139): Connect 0x43cf695a to 127.0.0.1:53662 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-15 20:01:47,779 DEBUG [RS:1;jenkins-hbase4:41047] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-15 20:01:47,780 DEBUG [RS:1;jenkins-hbase4:41047] zookeeper.ReadOnlyZKClient(139): Connect 0x19e95656 to 127.0.0.1:53662 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-15 20:01:47,784 DEBUG [RS:0;jenkins-hbase4:44675] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4d088f53, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-15 20:01:47,784 DEBUG [RS:1;jenkins-hbase4:41047] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@172ebb1b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-15 20:01:47,784 DEBUG [RS:0;jenkins-hbase4:44675] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4937022a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-15 20:01:47,784 DEBUG [RS:1;jenkins-hbase4:41047] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@13113d26, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-15 20:01:47,793 DEBUG [RS:1;jenkins-hbase4:41047] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:41047 2023-02-15 20:01:47,793 INFO [RS:1;jenkins-hbase4:41047] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-15 20:01:47,793 INFO [RS:1;jenkins-hbase4:41047] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-15 20:01:47,793 DEBUG [RS:1;jenkins-hbase4:41047] regionserver.HRegionServer(1023): About to register with Master. 2023-02-15 20:01:47,794 INFO [RS:1;jenkins-hbase4:41047] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,43791,1676491307476 with isa=jenkins-hbase4.apache.org/172.31.14.131:41047, startcode=1676491307558 2023-02-15 20:01:47,794 DEBUG [RS:1;jenkins-hbase4:41047] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-15 20:01:47,795 INFO [RS-EventLoopGroup-18-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46915, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.11 (auth:SIMPLE), service=RegionServerStatusService 2023-02-15 20:01:47,797 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43791] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,41047,1676491307558 2023-02-15 20:01:47,797 DEBUG [RS:1;jenkins-hbase4:41047] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:43713/user/jenkins/test-data/c7dde7f7-f3cd-e2c2-c03f-38aeb64416ed 2023-02-15 20:01:47,797 DEBUG [RS:1;jenkins-hbase4:41047] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:43713 2023-02-15 20:01:47,797 DEBUG [RS:1;jenkins-hbase4:41047] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-15 20:01:47,799 DEBUG [Listener at localhost/44509-EventThread] zookeeper.ZKWatcher(600): master:43791-0x100599323860000, quorum=127.0.0.1:53662, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-15 20:01:47,799 DEBUG [RS:1;jenkins-hbase4:41047] zookeeper.ZKUtil(162): regionserver:41047-0x100599323860002, quorum=127.0.0.1:53662, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,41047,1676491307558 2023-02-15 20:01:47,799 WARN [RS:1;jenkins-hbase4:41047] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-15 20:01:47,800 INFO [RS:1;jenkins-hbase4:41047] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-15 20:01:47,800 DEBUG [RS:1;jenkins-hbase4:41047] regionserver.HRegionServer(1947): logDir=hdfs://localhost:43713/user/jenkins/test-data/c7dde7f7-f3cd-e2c2-c03f-38aeb64416ed/WALs/jenkins-hbase4.apache.org,41047,1676491307558 2023-02-15 20:01:47,800 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,41047,1676491307558] 2023-02-15 20:01:47,800 DEBUG [RS:0;jenkins-hbase4:44675] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:44675 2023-02-15 20:01:47,800 INFO [RS:0;jenkins-hbase4:44675] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-15 20:01:47,800 INFO [RS:0;jenkins-hbase4:44675] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-15 20:01:47,800 DEBUG [RS:0;jenkins-hbase4:44675] regionserver.HRegionServer(1023): About to register with Master. 2023-02-15 20:01:47,801 INFO [RS:0;jenkins-hbase4:44675] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,43791,1676491307476 with isa=jenkins-hbase4.apache.org/172.31.14.131:44675, startcode=1676491307532 2023-02-15 20:01:47,802 DEBUG [RS:0;jenkins-hbase4:44675] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-15 20:01:47,803 DEBUG [RS:1;jenkins-hbase4:41047] zookeeper.ZKUtil(162): regionserver:41047-0x100599323860002, quorum=127.0.0.1:53662, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,41047,1676491307558 2023-02-15 20:01:47,804 INFO [RS-EventLoopGroup-18-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60395, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.10 (auth:SIMPLE), service=RegionServerStatusService 2023-02-15 20:01:47,804 DEBUG [RS:1;jenkins-hbase4:41047] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-15 20:01:47,805 INFO [RS:1;jenkins-hbase4:41047] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-15 20:01:47,805 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43791] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,44675,1676491307532 2023-02-15 20:01:47,805 DEBUG [RS:0;jenkins-hbase4:44675] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:43713/user/jenkins/test-data/c7dde7f7-f3cd-e2c2-c03f-38aeb64416ed 2023-02-15 20:01:47,805 DEBUG [RS:0;jenkins-hbase4:44675] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:43713 2023-02-15 20:01:47,805 DEBUG [RS:0;jenkins-hbase4:44675] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-15 20:01:47,808 INFO [RS:1;jenkins-hbase4:41047] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-15 20:01:47,808 INFO [RS:1;jenkins-hbase4:41047] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-15 20:01:47,808 INFO [RS:1;jenkins-hbase4:41047] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-15 20:01:47,809 INFO [RS:1;jenkins-hbase4:41047] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-15 20:01:47,810 INFO [RS:1;jenkins-hbase4:41047] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-15 20:01:47,810 DEBUG [Listener at localhost/44509-EventThread] zookeeper.ZKWatcher(600): master:43791-0x100599323860000, quorum=127.0.0.1:53662, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-15 20:01:47,810 DEBUG [Listener at localhost/44509-EventThread] zookeeper.ZKWatcher(600): regionserver:41047-0x100599323860002, quorum=127.0.0.1:53662, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-15 20:01:47,810 DEBUG [RS:1;jenkins-hbase4:41047] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 20:01:47,810 DEBUG [RS:1;jenkins-hbase4:41047] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 20:01:47,811 DEBUG [RS:1;jenkins-hbase4:41047] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 20:01:47,811 DEBUG [RS:1;jenkins-hbase4:41047] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 20:01:47,811 DEBUG [RS:1;jenkins-hbase4:41047] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 20:01:47,811 DEBUG [RS:0;jenkins-hbase4:44675] zookeeper.ZKUtil(162): regionserver:44675-0x100599323860001, quorum=127.0.0.1:53662, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,44675,1676491307532 2023-02-15 20:01:47,811 DEBUG [RS:1;jenkins-hbase4:41047] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-15 20:01:47,811 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,44675,1676491307532] 2023-02-15 20:01:47,811 DEBUG [RS:1;jenkins-hbase4:41047] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 20:01:47,811 WARN [RS:0;jenkins-hbase4:44675] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-15 20:01:47,811 DEBUG [RS:1;jenkins-hbase4:41047] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 20:01:47,811 INFO [RS:0;jenkins-hbase4:44675] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-15 20:01:47,811 DEBUG [RS:1;jenkins-hbase4:41047] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 20:01:47,811 DEBUG [RS:0;jenkins-hbase4:44675] regionserver.HRegionServer(1947): logDir=hdfs://localhost:43713/user/jenkins/test-data/c7dde7f7-f3cd-e2c2-c03f-38aeb64416ed/WALs/jenkins-hbase4.apache.org,44675,1676491307532 2023-02-15 20:01:47,811 DEBUG [RS:1;jenkins-hbase4:41047] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 20:01:47,811 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): regionserver:41047-0x100599323860002, quorum=127.0.0.1:53662, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,41047,1676491307558 2023-02-15 20:01:47,811 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): regionserver:41047-0x100599323860002, quorum=127.0.0.1:53662, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,44675,1676491307532 2023-02-15 20:01:47,816 INFO [RS:1;jenkins-hbase4:41047] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-15 20:01:47,816 INFO [RS:1;jenkins-hbase4:41047] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-15 20:01:47,816 INFO [RS:1;jenkins-hbase4:41047] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-15 20:01:47,819 DEBUG [RS:0;jenkins-hbase4:44675] zookeeper.ZKUtil(162): regionserver:44675-0x100599323860001, quorum=127.0.0.1:53662, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,41047,1676491307558 2023-02-15 20:01:47,819 DEBUG [RS:0;jenkins-hbase4:44675] zookeeper.ZKUtil(162): regionserver:44675-0x100599323860001, quorum=127.0.0.1:53662, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,44675,1676491307532 2023-02-15 20:01:47,820 DEBUG [RS:0;jenkins-hbase4:44675] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-15 20:01:47,820 INFO [RS:0;jenkins-hbase4:44675] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-15 20:01:47,826 INFO [RS:0;jenkins-hbase4:44675] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-15 20:01:47,826 INFO [RS:0;jenkins-hbase4:44675] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-15 20:01:47,827 INFO [RS:0;jenkins-hbase4:44675] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-15 20:01:47,827 INFO [RS:0;jenkins-hbase4:44675] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-15 20:01:47,828 INFO [RS:0;jenkins-hbase4:44675] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-15 20:01:47,829 DEBUG [RS:0;jenkins-hbase4:44675] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 20:01:47,829 DEBUG [RS:0;jenkins-hbase4:44675] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 20:01:47,829 DEBUG [RS:0;jenkins-hbase4:44675] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 20:01:47,829 DEBUG [RS:0;jenkins-hbase4:44675] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 20:01:47,829 DEBUG [RS:0;jenkins-hbase4:44675] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 20:01:47,829 DEBUG [RS:0;jenkins-hbase4:44675] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-15 20:01:47,829 DEBUG [RS:0;jenkins-hbase4:44675] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 20:01:47,829 DEBUG [RS:0;jenkins-hbase4:44675] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 20:01:47,829 DEBUG [RS:0;jenkins-hbase4:44675] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 20:01:47,829 DEBUG [RS:0;jenkins-hbase4:44675] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 20:01:47,830 INFO [RS:0;jenkins-hbase4:44675] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-15 20:01:47,830 INFO [RS:0;jenkins-hbase4:44675] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-15 20:01:47,830 INFO [RS:0;jenkins-hbase4:44675] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-15 20:01:47,834 INFO [RS:1;jenkins-hbase4:41047] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-15 20:01:47,834 INFO [RS:1;jenkins-hbase4:41047] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,41047,1676491307558-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-15 20:01:47,842 INFO [RS:0;jenkins-hbase4:44675] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-15 20:01:47,842 INFO [RS:0;jenkins-hbase4:44675] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,44675,1676491307532-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-15 20:01:47,844 INFO [RS:1;jenkins-hbase4:41047] regionserver.Replication(203): jenkins-hbase4.apache.org,41047,1676491307558 started 2023-02-15 20:01:47,844 INFO [RS:1;jenkins-hbase4:41047] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,41047,1676491307558, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:41047, sessionid=0x100599323860002 2023-02-15 20:01:47,844 DEBUG [RS:1;jenkins-hbase4:41047] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-15 20:01:47,845 DEBUG [RS:1;jenkins-hbase4:41047] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,41047,1676491307558 2023-02-15 20:01:47,845 DEBUG [RS:1;jenkins-hbase4:41047] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,41047,1676491307558' 2023-02-15 20:01:47,845 DEBUG [RS:1;jenkins-hbase4:41047] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-15 20:01:47,845 DEBUG [RS:1;jenkins-hbase4:41047] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-15 20:01:47,845 DEBUG [RS:1;jenkins-hbase4:41047] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-15 20:01:47,845 DEBUG [RS:1;jenkins-hbase4:41047] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-15 20:01:47,845 DEBUG [RS:1;jenkins-hbase4:41047] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,41047,1676491307558 2023-02-15 20:01:47,845 DEBUG [RS:1;jenkins-hbase4:41047] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,41047,1676491307558' 2023-02-15 20:01:47,845 DEBUG [RS:1;jenkins-hbase4:41047] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-15 20:01:47,846 DEBUG [RS:1;jenkins-hbase4:41047] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-15 20:01:47,846 DEBUG [RS:1;jenkins-hbase4:41047] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-15 20:01:47,846 INFO [RS:1;jenkins-hbase4:41047] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-15 20:01:47,846 INFO [RS:1;jenkins-hbase4:41047] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-15 20:01:47,852 INFO [RS:0;jenkins-hbase4:44675] regionserver.Replication(203): jenkins-hbase4.apache.org,44675,1676491307532 started 2023-02-15 20:01:47,852 INFO [RS:0;jenkins-hbase4:44675] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,44675,1676491307532, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:44675, sessionid=0x100599323860001 2023-02-15 20:01:47,852 DEBUG [RS:0;jenkins-hbase4:44675] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-15 20:01:47,852 DEBUG [RS:0;jenkins-hbase4:44675] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,44675,1676491307532 2023-02-15 20:01:47,852 DEBUG [RS:0;jenkins-hbase4:44675] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,44675,1676491307532' 2023-02-15 20:01:47,852 DEBUG [RS:0;jenkins-hbase4:44675] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-15 20:01:47,853 DEBUG [RS:0;jenkins-hbase4:44675] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-15 20:01:47,853 DEBUG [RS:0;jenkins-hbase4:44675] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-15 20:01:47,853 DEBUG [RS:0;jenkins-hbase4:44675] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-15 20:01:47,853 DEBUG [RS:0;jenkins-hbase4:44675] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,44675,1676491307532 2023-02-15 20:01:47,853 DEBUG [RS:0;jenkins-hbase4:44675] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,44675,1676491307532' 2023-02-15 20:01:47,853 DEBUG [RS:0;jenkins-hbase4:44675] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-15 20:01:47,853 DEBUG [RS:0;jenkins-hbase4:44675] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-15 20:01:47,854 DEBUG [RS:0;jenkins-hbase4:44675] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-15 20:01:47,854 INFO [RS:0;jenkins-hbase4:44675] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-15 20:01:47,854 INFO [RS:0;jenkins-hbase4:44675] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-15 20:01:47,897 DEBUG [jenkins-hbase4:43791] assignment.AssignmentManager(2178): Processing assignQueue; systemServersCount=2, allServersCount=2 2023-02-15 20:01:47,898 DEBUG [jenkins-hbase4:43791] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-15 20:01:47,899 DEBUG [jenkins-hbase4:43791] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-15 20:01:47,899 DEBUG [jenkins-hbase4:43791] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-15 20:01:47,899 DEBUG [jenkins-hbase4:43791] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-15 20:01:47,899 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,44675,1676491307532, state=OPENING 2023-02-15 20:01:47,900 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-02-15 20:01:47,901 DEBUG [Listener at localhost/44509-EventThread] zookeeper.ZKWatcher(600): master:43791-0x100599323860000, quorum=127.0.0.1:53662, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-15 20:01:47,902 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-15 20:01:47,902 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,44675,1676491307532}] 2023-02-15 20:01:48,057 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,44675,1676491307532 2023-02-15 20:01:48,057 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-15 20:01:48,058 INFO [RS-EventLoopGroup-19-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48682, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-15 20:01:48,062 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:meta,,1.1588230740 2023-02-15 20:01:48,062 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-15 20:01:48,063 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C44675%2C1676491307532.meta, suffix=.meta, logDir=hdfs://localhost:43713/user/jenkins/test-data/c7dde7f7-f3cd-e2c2-c03f-38aeb64416ed/WALs/jenkins-hbase4.apache.org,44675,1676491307532, archiveDir=hdfs://localhost:43713/user/jenkins/test-data/c7dde7f7-f3cd-e2c2-c03f-38aeb64416ed/oldWALs, maxLogs=32 2023-02-15 20:01:48,076 DEBUG [RS-EventLoopGroup-20-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45543,DS-30c649f1-6553-4fdd-ac66-fdd811b65af4,DISK] 2023-02-15 20:01:48,077 DEBUG [RS-EventLoopGroup-20-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45539,DS-969de9b0-feaa-4639-9b72-f9305b55a4cf,DISK] 2023-02-15 20:01:48,078 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/c7dde7f7-f3cd-e2c2-c03f-38aeb64416ed/WALs/jenkins-hbase4.apache.org,44675,1676491307532/jenkins-hbase4.apache.org%2C44675%2C1676491307532.meta.1676491308063.meta 2023-02-15 20:01:48,078 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:45543,DS-30c649f1-6553-4fdd-ac66-fdd811b65af4,DISK], DatanodeInfoWithStorage[127.0.0.1:45539,DS-969de9b0-feaa-4639-9b72-f9305b55a4cf,DISK]] 2023-02-15 20:01:48,078 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-02-15 20:01:48,079 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-02-15 20:01:48,079 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8546): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-02-15 20:01:48,079 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-02-15 20:01:48,079 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-02-15 20:01:48,079 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 20:01:48,079 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 1588230740 2023-02-15 20:01:48,079 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 1588230740 2023-02-15 20:01:48,080 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-15 20:01:48,081 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43713/user/jenkins/test-data/c7dde7f7-f3cd-e2c2-c03f-38aeb64416ed/data/hbase/meta/1588230740/info 2023-02-15 20:01:48,081 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43713/user/jenkins/test-data/c7dde7f7-f3cd-e2c2-c03f-38aeb64416ed/data/hbase/meta/1588230740/info 2023-02-15 20:01:48,081 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-15 20:01:48,082 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 20:01:48,082 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-15 20:01:48,082 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43713/user/jenkins/test-data/c7dde7f7-f3cd-e2c2-c03f-38aeb64416ed/data/hbase/meta/1588230740/rep_barrier 2023-02-15 20:01:48,083 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43713/user/jenkins/test-data/c7dde7f7-f3cd-e2c2-c03f-38aeb64416ed/data/hbase/meta/1588230740/rep_barrier 2023-02-15 20:01:48,083 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-15 20:01:48,083 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 20:01:48,083 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-15 20:01:48,084 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43713/user/jenkins/test-data/c7dde7f7-f3cd-e2c2-c03f-38aeb64416ed/data/hbase/meta/1588230740/table 2023-02-15 20:01:48,084 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43713/user/jenkins/test-data/c7dde7f7-f3cd-e2c2-c03f-38aeb64416ed/data/hbase/meta/1588230740/table 2023-02-15 20:01:48,084 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-15 20:01:48,084 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 20:01:48,085 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43713/user/jenkins/test-data/c7dde7f7-f3cd-e2c2-c03f-38aeb64416ed/data/hbase/meta/1588230740 2023-02-15 20:01:48,086 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43713/user/jenkins/test-data/c7dde7f7-f3cd-e2c2-c03f-38aeb64416ed/data/hbase/meta/1588230740 2023-02-15 20:01:48,087 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-15 20:01:48,088 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-15 20:01:48,088 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63966769, jitterRate=-0.04682086408138275}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-15 20:01:48,088 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 1588230740: 2023-02-15 20:01:48,089 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1676491308056 2023-02-15 20:01:48,093 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:meta,,1.1588230740 2023-02-15 20:01:48,093 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:meta,,1.1588230740 2023-02-15 20:01:48,094 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,44675,1676491307532, state=OPEN 2023-02-15 20:01:48,095 DEBUG [Listener at localhost/44509-EventThread] zookeeper.ZKWatcher(600): master:43791-0x100599323860000, quorum=127.0.0.1:53662, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-02-15 20:01:48,095 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-15 20:01:48,096 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-02-15 20:01:48,096 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,44675,1676491307532 in 193 msec 2023-02-15 20:01:48,097 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-02-15 20:01:48,097 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 352 msec 2023-02-15 20:01:48,098 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 395 msec 2023-02-15 20:01:48,098 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1676491308098, completionTime=-1 2023-02-15 20:01:48,098 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=2; waited=0ms, expected min=2 server(s), max=2 server(s), master is running 2023-02-15 20:01:48,098 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1519): Joining cluster... 2023-02-15 20:01:48,101 DEBUG [hconnection-0x26cfee3b-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-15 20:01:48,102 INFO [RS-EventLoopGroup-19-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48698, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-15 20:01:48,103 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1531): Number of RegionServers=2 2023-02-15 20:01:48,104 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1676491368104 2023-02-15 20:01:48,104 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1676491428104 2023-02-15 20:01:48,104 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1538): Joined the cluster in 5 msec 2023-02-15 20:01:48,112 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,43791,1676491307476-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-15 20:01:48,112 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,43791,1676491307476-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-15 20:01:48,112 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,43791,1676491307476-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-15 20:01:48,112 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:43791, period=300000, unit=MILLISECONDS is enabled. 2023-02-15 20:01:48,112 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-02-15 20:01:48,112 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-02-15 20:01:48,112 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-15 20:01:48,113 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-02-15 20:01:48,114 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-02-15 20:01:48,114 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-02-15 20:01:48,115 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-15 20:01:48,116 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43713/user/jenkins/test-data/c7dde7f7-f3cd-e2c2-c03f-38aeb64416ed/.tmp/data/hbase/namespace/005556a0868445ebc467cfbf458c1db5 2023-02-15 20:01:48,117 DEBUG [HFileArchiver-6] backup.HFileArchiver(153): Directory hdfs://localhost:43713/user/jenkins/test-data/c7dde7f7-f3cd-e2c2-c03f-38aeb64416ed/.tmp/data/hbase/namespace/005556a0868445ebc467cfbf458c1db5 empty. 2023-02-15 20:01:48,117 DEBUG [HFileArchiver-6] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43713/user/jenkins/test-data/c7dde7f7-f3cd-e2c2-c03f-38aeb64416ed/.tmp/data/hbase/namespace/005556a0868445ebc467cfbf458c1db5 2023-02-15 20:01:48,117 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-02-15 20:01:48,126 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:43713/user/jenkins/test-data/c7dde7f7-f3cd-e2c2-c03f-38aeb64416ed/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-02-15 20:01:48,127 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7671): creating {ENCODED => 005556a0868445ebc467cfbf458c1db5, NAME => 'hbase:namespace,,1676491308112.005556a0868445ebc467cfbf458c1db5.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43713/user/jenkins/test-data/c7dde7f7-f3cd-e2c2-c03f-38aeb64416ed/.tmp 2023-02-15 20:01:48,134 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676491308112.005556a0868445ebc467cfbf458c1db5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 20:01:48,134 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1603): Closing 005556a0868445ebc467cfbf458c1db5, disabling compactions & flushes 2023-02-15 20:01:48,134 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676491308112.005556a0868445ebc467cfbf458c1db5. 2023-02-15 20:01:48,134 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676491308112.005556a0868445ebc467cfbf458c1db5. 2023-02-15 20:01:48,134 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676491308112.005556a0868445ebc467cfbf458c1db5. after waiting 0 ms 2023-02-15 20:01:48,134 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676491308112.005556a0868445ebc467cfbf458c1db5. 2023-02-15 20:01:48,134 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676491308112.005556a0868445ebc467cfbf458c1db5. 2023-02-15 20:01:48,134 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1557): Region close journal for 005556a0868445ebc467cfbf458c1db5: 2023-02-15 20:01:48,136 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-02-15 20:01:48,136 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1676491308112.005556a0868445ebc467cfbf458c1db5.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676491308136"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676491308136"}]},"ts":"1676491308136"} 2023-02-15 20:01:48,138 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-15 20:01:48,138 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-15 20:01:48,138 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676491308138"}]},"ts":"1676491308138"} 2023-02-15 20:01:48,139 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-02-15 20:01:48,143 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-15 20:01:48,144 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-15 20:01:48,144 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-15 20:01:48,144 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-15 20:01:48,144 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=005556a0868445ebc467cfbf458c1db5, ASSIGN}] 2023-02-15 20:01:48,146 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=005556a0868445ebc467cfbf458c1db5, ASSIGN 2023-02-15 20:01:48,147 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=005556a0868445ebc467cfbf458c1db5, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,41047,1676491307558; forceNewPlan=false, retain=false 2023-02-15 20:01:48,297 INFO [jenkins-hbase4:43791] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-15 20:01:48,297 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=005556a0868445ebc467cfbf458c1db5, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41047,1676491307558 2023-02-15 20:01:48,298 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1676491308112.005556a0868445ebc467cfbf458c1db5.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676491308297"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676491308297"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676491308297"}]},"ts":"1676491308297"} 2023-02-15 20:01:48,299 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 005556a0868445ebc467cfbf458c1db5, server=jenkins-hbase4.apache.org,41047,1676491307558}] 2023-02-15 20:01:48,452 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,41047,1676491307558 2023-02-15 20:01:48,452 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-15 20:01:48,454 INFO [RS-EventLoopGroup-20-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59248, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-15 20:01:48,457 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:namespace,,1676491308112.005556a0868445ebc467cfbf458c1db5. 2023-02-15 20:01:48,459 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C41047%2C1676491307558, suffix=, logDir=hdfs://localhost:43713/user/jenkins/test-data/c7dde7f7-f3cd-e2c2-c03f-38aeb64416ed/WALs/jenkins-hbase4.apache.org,41047,1676491307558, archiveDir=hdfs://localhost:43713/user/jenkins/test-data/c7dde7f7-f3cd-e2c2-c03f-38aeb64416ed/oldWALs, maxLogs=32 2023-02-15 20:01:48,473 DEBUG [RS-EventLoopGroup-20-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45539,DS-969de9b0-feaa-4639-9b72-f9305b55a4cf,DISK] 2023-02-15 20:01:48,473 DEBUG [RS-EventLoopGroup-20-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45543,DS-30c649f1-6553-4fdd-ac66-fdd811b65af4,DISK] 2023-02-15 20:01:48,474 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/c7dde7f7-f3cd-e2c2-c03f-38aeb64416ed/WALs/jenkins-hbase4.apache.org,41047,1676491307558/jenkins-hbase4.apache.org%2C41047%2C1676491307558.1676491308459 2023-02-15 20:01:48,474 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:45539,DS-969de9b0-feaa-4639-9b72-f9305b55a4cf,DISK], DatanodeInfoWithStorage[127.0.0.1:45543,DS-30c649f1-6553-4fdd-ac66-fdd811b65af4,DISK]] 2023-02-15 20:01:48,475 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 005556a0868445ebc467cfbf458c1db5, NAME => 'hbase:namespace,,1676491308112.005556a0868445ebc467cfbf458c1db5.', STARTKEY => '', ENDKEY => ''} 2023-02-15 20:01:48,475 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 005556a0868445ebc467cfbf458c1db5 2023-02-15 20:01:48,475 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676491308112.005556a0868445ebc467cfbf458c1db5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 20:01:48,475 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 005556a0868445ebc467cfbf458c1db5 2023-02-15 20:01:48,475 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 005556a0868445ebc467cfbf458c1db5 2023-02-15 20:01:48,476 INFO [StoreOpener-005556a0868445ebc467cfbf458c1db5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 005556a0868445ebc467cfbf458c1db5 2023-02-15 20:01:48,477 DEBUG [StoreOpener-005556a0868445ebc467cfbf458c1db5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43713/user/jenkins/test-data/c7dde7f7-f3cd-e2c2-c03f-38aeb64416ed/data/hbase/namespace/005556a0868445ebc467cfbf458c1db5/info 2023-02-15 20:01:48,477 DEBUG [StoreOpener-005556a0868445ebc467cfbf458c1db5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43713/user/jenkins/test-data/c7dde7f7-f3cd-e2c2-c03f-38aeb64416ed/data/hbase/namespace/005556a0868445ebc467cfbf458c1db5/info 2023-02-15 20:01:48,477 INFO [StoreOpener-005556a0868445ebc467cfbf458c1db5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 005556a0868445ebc467cfbf458c1db5 columnFamilyName info 2023-02-15 20:01:48,478 INFO [StoreOpener-005556a0868445ebc467cfbf458c1db5-1] regionserver.HStore(310): Store=005556a0868445ebc467cfbf458c1db5/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 20:01:48,478 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43713/user/jenkins/test-data/c7dde7f7-f3cd-e2c2-c03f-38aeb64416ed/data/hbase/namespace/005556a0868445ebc467cfbf458c1db5 2023-02-15 20:01:48,478 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43713/user/jenkins/test-data/c7dde7f7-f3cd-e2c2-c03f-38aeb64416ed/data/hbase/namespace/005556a0868445ebc467cfbf458c1db5 2023-02-15 20:01:48,481 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 005556a0868445ebc467cfbf458c1db5 2023-02-15 20:01:48,483 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43713/user/jenkins/test-data/c7dde7f7-f3cd-e2c2-c03f-38aeb64416ed/data/hbase/namespace/005556a0868445ebc467cfbf458c1db5/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-15 20:01:48,483 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 005556a0868445ebc467cfbf458c1db5; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60280981, jitterRate=-0.10174338519573212}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-15 20:01:48,483 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 005556a0868445ebc467cfbf458c1db5: 2023-02-15 20:01:48,484 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:namespace,,1676491308112.005556a0868445ebc467cfbf458c1db5., pid=6, masterSystemTime=1676491308452 2023-02-15 20:01:48,487 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:namespace,,1676491308112.005556a0868445ebc467cfbf458c1db5. 2023-02-15 20:01:48,487 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:namespace,,1676491308112.005556a0868445ebc467cfbf458c1db5. 2023-02-15 20:01:48,488 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=005556a0868445ebc467cfbf458c1db5, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,41047,1676491307558 2023-02-15 20:01:48,488 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1676491308112.005556a0868445ebc467cfbf458c1db5.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676491308488"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676491308488"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676491308488"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676491308488"}]},"ts":"1676491308488"} 2023-02-15 20:01:48,490 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-02-15 20:01:48,490 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 005556a0868445ebc467cfbf458c1db5, server=jenkins-hbase4.apache.org,41047,1676491307558 in 190 msec 2023-02-15 20:01:48,492 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-02-15 20:01:48,492 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=005556a0868445ebc467cfbf458c1db5, ASSIGN in 346 msec 2023-02-15 20:01:48,492 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-15 20:01:48,493 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676491308493"}]},"ts":"1676491308493"} 2023-02-15 20:01:48,494 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-02-15 20:01:48,496 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-02-15 20:01:48,497 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 383 msec 2023-02-15 20:01:48,514 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:43791-0x100599323860000, quorum=127.0.0.1:53662, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-02-15 20:01:48,515 DEBUG [Listener at localhost/44509-EventThread] zookeeper.ZKWatcher(600): master:43791-0x100599323860000, quorum=127.0.0.1:53662, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-02-15 20:01:48,515 DEBUG [Listener at localhost/44509-EventThread] zookeeper.ZKWatcher(600): master:43791-0x100599323860000, quorum=127.0.0.1:53662, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-15 20:01:48,517 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-15 20:01:48,518 INFO [RS-EventLoopGroup-20-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59254, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-15 20:01:48,519 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-02-15 20:01:48,526 DEBUG [Listener at localhost/44509-EventThread] zookeeper.ZKWatcher(600): master:43791-0x100599323860000, quorum=127.0.0.1:53662, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-15 20:01:48,529 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 9 msec 2023-02-15 20:01:48,530 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-02-15 20:01:48,536 DEBUG [Listener at localhost/44509-EventThread] zookeeper.ZKWatcher(600): master:43791-0x100599323860000, quorum=127.0.0.1:53662, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-15 20:01:48,538 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 7 msec 2023-02-15 20:01:48,545 DEBUG [Listener at localhost/44509-EventThread] zookeeper.ZKWatcher(600): master:43791-0x100599323860000, quorum=127.0.0.1:53662, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-02-15 20:01:48,546 DEBUG [Listener at localhost/44509-EventThread] zookeeper.ZKWatcher(600): master:43791-0x100599323860000, quorum=127.0.0.1:53662, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-02-15 20:01:48,546 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 0.960sec 2023-02-15 20:01:48,547 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-02-15 20:01:48,547 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-02-15 20:01:48,547 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-02-15 20:01:48,547 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,43791,1676491307476-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-02-15 20:01:48,547 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,43791,1676491307476-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-02-15 20:01:48,548 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-02-15 20:01:48,573 DEBUG [Listener at localhost/44509] zookeeper.ReadOnlyZKClient(139): Connect 0x520cf990 to 127.0.0.1:53662 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-15 20:01:48,577 DEBUG [Listener at localhost/44509] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3d631461, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-15 20:01:48,578 DEBUG [hconnection-0x339d3d14-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-15 20:01:48,580 INFO [RS-EventLoopGroup-19-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48708, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-15 20:01:48,581 INFO [Listener at localhost/44509] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,43791,1676491307476 2023-02-15 20:01:48,582 DEBUG [Listener at localhost/44509] mapreduce.TableSnapshotInputFormatTestBase(193): Ensuring table doesn't exist. 2023-02-15 20:01:48,584 DEBUG [Listener at localhost/44509] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-15 20:01:48,585 INFO [RS-EventLoopGroup-18-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34584, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-15 20:01:48,585 INFO [Listener at localhost/44509] client.HBaseAdmin$15(890): Started disable of testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-15 20:01:48,585 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43791] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-15 20:01:48,586 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43791] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.TableNotFoundException: testRestoreSnapshotDoesNotCreateBackRefLinks at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.checkTableModifiable(AbstractStateMachineTableProcedure.java:125) at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.preflightChecks(AbstractStateMachineTableProcedure.java:157) at org.apache.hadoop.hbase.master.procedure.DisableTableProcedure.(DisableTableProcedure.java:78) at org.apache.hadoop.hbase.master.HMaster$11.run(HMaster.java:2429) at org.apache.hadoop.hbase.master.procedure.MasterProcedureUtil.submitProcedure(MasterProcedureUtil.java:132) at org.apache.hadoop.hbase.master.HMaster.disableTable(HMaster.java:2413) at org.apache.hadoop.hbase.master.MasterRpcServices.disableTable(MasterRpcServices.java:784) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-02-15 20:01:48,586 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43791] ipc.CallRunner(144): callId: 2 service: MasterService methodName: DisableTable size: 103 connection: 172.31.14.131:34584 deadline: 1676491368585, exception=org.apache.hadoop.hbase.TableNotFoundException: testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-15 20:01:48,586 INFO [Listener at localhost/44509] mapreduce.TableSnapshotInputFormatTestBase(199): creating table 'testRestoreSnapshotDoesNotCreateBackRefLinks' 2023-02-15 20:01:48,588 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43791] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testRestoreSnapshotDoesNotCreateBackRefLinks', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-15 20:01:48,589 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43791] procedure2.ProcedureExecutor(1029): Stored pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-15 20:01:48,590 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks execute state=CREATE_TABLE_PRE_OPERATION 2023-02-15 20:01:48,590 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43791] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testRestoreSnapshotDoesNotCreateBackRefLinks" procId is: 10 2023-02-15 20:01:48,590 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-15 20:01:48,591 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43791] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-15 20:01:48,592 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43713/user/jenkins/test-data/c7dde7f7-f3cd-e2c2-c03f-38aeb64416ed/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/ecd7e50d99200460879f7ddfe78b8166 2023-02-15 20:01:48,592 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:43713/user/jenkins/test-data/c7dde7f7-f3cd-e2c2-c03f-38aeb64416ed/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/ecd7e50d99200460879f7ddfe78b8166 empty. 2023-02-15 20:01:48,592 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43713/user/jenkins/test-data/c7dde7f7-f3cd-e2c2-c03f-38aeb64416ed/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/ecd7e50d99200460879f7ddfe78b8166 2023-02-15 20:01:48,592 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testRestoreSnapshotDoesNotCreateBackRefLinks regions 2023-02-15 20:01:48,600 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:43713/user/jenkins/test-data/c7dde7f7-f3cd-e2c2-c03f-38aeb64416ed/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/.tabledesc/.tableinfo.0000000001 2023-02-15 20:01:48,601 INFO [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(7671): creating {ENCODED => ecd7e50d99200460879f7ddfe78b8166, NAME => 'testRestoreSnapshotDoesNotCreateBackRefLinks,,1676491308588.ecd7e50d99200460879f7ddfe78b8166.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testRestoreSnapshotDoesNotCreateBackRefLinks', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43713/user/jenkins/test-data/c7dde7f7-f3cd-e2c2-c03f-38aeb64416ed/.tmp 2023-02-15 20:01:48,609 DEBUG [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(865): Instantiated testRestoreSnapshotDoesNotCreateBackRefLinks,,1676491308588.ecd7e50d99200460879f7ddfe78b8166.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 20:01:48,609 DEBUG [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(1603): Closing ecd7e50d99200460879f7ddfe78b8166, disabling compactions & flushes 2023-02-15 20:01:48,609 INFO [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(1625): Closing region testRestoreSnapshotDoesNotCreateBackRefLinks,,1676491308588.ecd7e50d99200460879f7ddfe78b8166. 2023-02-15 20:01:48,609 DEBUG [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testRestoreSnapshotDoesNotCreateBackRefLinks,,1676491308588.ecd7e50d99200460879f7ddfe78b8166. 2023-02-15 20:01:48,609 DEBUG [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(1713): Acquired close lock on testRestoreSnapshotDoesNotCreateBackRefLinks,,1676491308588.ecd7e50d99200460879f7ddfe78b8166. after waiting 0 ms 2023-02-15 20:01:48,609 DEBUG [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(1723): Updates disabled for region testRestoreSnapshotDoesNotCreateBackRefLinks,,1676491308588.ecd7e50d99200460879f7ddfe78b8166. 2023-02-15 20:01:48,609 INFO [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(1837): Closed testRestoreSnapshotDoesNotCreateBackRefLinks,,1676491308588.ecd7e50d99200460879f7ddfe78b8166. 2023-02-15 20:01:48,609 DEBUG [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(1557): Region close journal for ecd7e50d99200460879f7ddfe78b8166: 2023-02-15 20:01:48,611 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks execute state=CREATE_TABLE_ADD_TO_META 2023-02-15 20:01:48,611 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks,,1676491308588.ecd7e50d99200460879f7ddfe78b8166.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1676491308611"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676491308611"}]},"ts":"1676491308611"} 2023-02-15 20:01:48,613 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-15 20:01:48,613 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-15 20:01:48,613 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676491308613"}]},"ts":"1676491308613"} 2023-02-15 20:01:48,614 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, state=ENABLING in hbase:meta 2023-02-15 20:01:48,617 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-15 20:01:48,617 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-15 20:01:48,618 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-15 20:01:48,618 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-15 20:01:48,618 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks, region=ecd7e50d99200460879f7ddfe78b8166, ASSIGN}] 2023-02-15 20:01:48,619 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks, region=ecd7e50d99200460879f7ddfe78b8166, ASSIGN 2023-02-15 20:01:48,620 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks, region=ecd7e50d99200460879f7ddfe78b8166, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,41047,1676491307558; forceNewPlan=false, retain=false 2023-02-15 20:01:48,692 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43791] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-15 20:01:48,770 INFO [jenkins-hbase4:43791] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-15 20:01:48,770 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=ecd7e50d99200460879f7ddfe78b8166, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41047,1676491307558 2023-02-15 20:01:48,771 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks,,1676491308588.ecd7e50d99200460879f7ddfe78b8166.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1676491308770"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676491308770"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676491308770"}]},"ts":"1676491308770"} 2023-02-15 20:01:48,772 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=12, ppid=11, state=RUNNABLE; OpenRegionProcedure ecd7e50d99200460879f7ddfe78b8166, server=jenkins-hbase4.apache.org,41047,1676491307558}] 2023-02-15 20:01:48,855 INFO [RS:0;jenkins-hbase4:44675] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C44675%2C1676491307532, suffix=, logDir=hdfs://localhost:43713/user/jenkins/test-data/c7dde7f7-f3cd-e2c2-c03f-38aeb64416ed/WALs/jenkins-hbase4.apache.org,44675,1676491307532, archiveDir=hdfs://localhost:43713/user/jenkins/test-data/c7dde7f7-f3cd-e2c2-c03f-38aeb64416ed/oldWALs, maxLogs=32 2023-02-15 20:01:48,870 DEBUG [RS-EventLoopGroup-20-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45543,DS-30c649f1-6553-4fdd-ac66-fdd811b65af4,DISK] 2023-02-15 20:01:48,870 DEBUG [RS-EventLoopGroup-20-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45539,DS-969de9b0-feaa-4639-9b72-f9305b55a4cf,DISK] 2023-02-15 20:01:48,876 INFO [RS:0;jenkins-hbase4:44675] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/c7dde7f7-f3cd-e2c2-c03f-38aeb64416ed/WALs/jenkins-hbase4.apache.org,44675,1676491307532/jenkins-hbase4.apache.org%2C44675%2C1676491307532.1676491308855 2023-02-15 20:01:48,876 DEBUG [RS:0;jenkins-hbase4:44675] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:45543,DS-30c649f1-6553-4fdd-ac66-fdd811b65af4,DISK], DatanodeInfoWithStorage[127.0.0.1:45539,DS-969de9b0-feaa-4639-9b72-f9305b55a4cf,DISK]] 2023-02-15 20:01:48,893 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43791] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-15 20:01:48,927 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testRestoreSnapshotDoesNotCreateBackRefLinks,,1676491308588.ecd7e50d99200460879f7ddfe78b8166. 2023-02-15 20:01:48,927 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => ecd7e50d99200460879f7ddfe78b8166, NAME => 'testRestoreSnapshotDoesNotCreateBackRefLinks,,1676491308588.ecd7e50d99200460879f7ddfe78b8166.', STARTKEY => '', ENDKEY => ''} 2023-02-15 20:01:48,927 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testRestoreSnapshotDoesNotCreateBackRefLinks ecd7e50d99200460879f7ddfe78b8166 2023-02-15 20:01:48,927 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testRestoreSnapshotDoesNotCreateBackRefLinks,,1676491308588.ecd7e50d99200460879f7ddfe78b8166.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 20:01:48,927 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for ecd7e50d99200460879f7ddfe78b8166 2023-02-15 20:01:48,927 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for ecd7e50d99200460879f7ddfe78b8166 2023-02-15 20:01:48,928 INFO [StoreOpener-ecd7e50d99200460879f7ddfe78b8166-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region ecd7e50d99200460879f7ddfe78b8166 2023-02-15 20:01:48,929 DEBUG [StoreOpener-ecd7e50d99200460879f7ddfe78b8166-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43713/user/jenkins/test-data/c7dde7f7-f3cd-e2c2-c03f-38aeb64416ed/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/ecd7e50d99200460879f7ddfe78b8166/f1 2023-02-15 20:01:48,929 DEBUG [StoreOpener-ecd7e50d99200460879f7ddfe78b8166-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43713/user/jenkins/test-data/c7dde7f7-f3cd-e2c2-c03f-38aeb64416ed/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/ecd7e50d99200460879f7ddfe78b8166/f1 2023-02-15 20:01:48,930 INFO [StoreOpener-ecd7e50d99200460879f7ddfe78b8166-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ecd7e50d99200460879f7ddfe78b8166 columnFamilyName f1 2023-02-15 20:01:48,930 INFO [StoreOpener-ecd7e50d99200460879f7ddfe78b8166-1] regionserver.HStore(310): Store=ecd7e50d99200460879f7ddfe78b8166/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 20:01:48,930 INFO [StoreOpener-ecd7e50d99200460879f7ddfe78b8166-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region ecd7e50d99200460879f7ddfe78b8166 2023-02-15 20:01:48,931 DEBUG [StoreOpener-ecd7e50d99200460879f7ddfe78b8166-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43713/user/jenkins/test-data/c7dde7f7-f3cd-e2c2-c03f-38aeb64416ed/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/ecd7e50d99200460879f7ddfe78b8166/f2 2023-02-15 20:01:48,931 DEBUG [StoreOpener-ecd7e50d99200460879f7ddfe78b8166-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43713/user/jenkins/test-data/c7dde7f7-f3cd-e2c2-c03f-38aeb64416ed/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/ecd7e50d99200460879f7ddfe78b8166/f2 2023-02-15 20:01:48,931 INFO [StoreOpener-ecd7e50d99200460879f7ddfe78b8166-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ecd7e50d99200460879f7ddfe78b8166 columnFamilyName f2 2023-02-15 20:01:48,932 INFO [StoreOpener-ecd7e50d99200460879f7ddfe78b8166-1] regionserver.HStore(310): Store=ecd7e50d99200460879f7ddfe78b8166/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 20:01:48,932 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43713/user/jenkins/test-data/c7dde7f7-f3cd-e2c2-c03f-38aeb64416ed/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/ecd7e50d99200460879f7ddfe78b8166 2023-02-15 20:01:48,933 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43713/user/jenkins/test-data/c7dde7f7-f3cd-e2c2-c03f-38aeb64416ed/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/ecd7e50d99200460879f7ddfe78b8166 2023-02-15 20:01:48,934 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testRestoreSnapshotDoesNotCreateBackRefLinks descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-15 20:01:48,935 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for ecd7e50d99200460879f7ddfe78b8166 2023-02-15 20:01:48,936 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43713/user/jenkins/test-data/c7dde7f7-f3cd-e2c2-c03f-38aeb64416ed/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/ecd7e50d99200460879f7ddfe78b8166/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-15 20:01:48,937 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened ecd7e50d99200460879f7ddfe78b8166; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61568468, jitterRate=-0.08255833387374878}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-15 20:01:48,937 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for ecd7e50d99200460879f7ddfe78b8166: 2023-02-15 20:01:48,937 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testRestoreSnapshotDoesNotCreateBackRefLinks,,1676491308588.ecd7e50d99200460879f7ddfe78b8166., pid=12, masterSystemTime=1676491308924 2023-02-15 20:01:48,938 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testRestoreSnapshotDoesNotCreateBackRefLinks,,1676491308588.ecd7e50d99200460879f7ddfe78b8166. 2023-02-15 20:01:48,938 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testRestoreSnapshotDoesNotCreateBackRefLinks,,1676491308588.ecd7e50d99200460879f7ddfe78b8166. 2023-02-15 20:01:48,939 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=ecd7e50d99200460879f7ddfe78b8166, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,41047,1676491307558 2023-02-15 20:01:48,939 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks,,1676491308588.ecd7e50d99200460879f7ddfe78b8166.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1676491308939"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676491308939"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676491308939"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676491308939"}]},"ts":"1676491308939"} 2023-02-15 20:01:48,941 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=12, resume processing ppid=11 2023-02-15 20:01:48,941 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=12, ppid=11, state=SUCCESS; OpenRegionProcedure ecd7e50d99200460879f7ddfe78b8166, server=jenkins-hbase4.apache.org,41047,1676491307558 in 168 msec 2023-02-15 20:01:48,942 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-02-15 20:01:48,943 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks, region=ecd7e50d99200460879f7ddfe78b8166, ASSIGN in 323 msec 2023-02-15 20:01:48,943 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-15 20:01:48,943 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676491308943"}]},"ts":"1676491308943"} 2023-02-15 20:01:48,944 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, state=ENABLED in hbase:meta 2023-02-15 20:01:48,946 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks execute state=CREATE_TABLE_POST_OPERATION 2023-02-15 20:01:48,947 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=10, state=SUCCESS; CreateTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks in 358 msec 2023-02-15 20:01:49,195 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43791] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-15 20:01:49,195 INFO [Listener at localhost/44509] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testRestoreSnapshotDoesNotCreateBackRefLinks, procId: 10 completed 2023-02-15 20:01:49,195 DEBUG [Listener at localhost/44509] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testRestoreSnapshotDoesNotCreateBackRefLinks get assigned. Timeout = 60000ms 2023-02-15 20:01:49,195 INFO [Listener at localhost/44509] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-15 20:01:49,197 INFO [Listener at localhost/44509] hbase.HBaseTestingUtility(3484): All regions for table testRestoreSnapshotDoesNotCreateBackRefLinks assigned to meta. Checking AM states. 2023-02-15 20:01:49,197 INFO [Listener at localhost/44509] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-15 20:01:49,197 INFO [Listener at localhost/44509] hbase.HBaseTestingUtility(3504): All regions for table testRestoreSnapshotDoesNotCreateBackRefLinks assigned. 2023-02-15 20:01:49,197 INFO [Listener at localhost/44509] mapreduce.TableSnapshotInputFormatTestBase(207): put some stuff in the table 2023-02-15 20:01:49,209 DEBUG [hconnection-0x339d3d14-shared-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-15 20:01:49,219 INFO [RS-EventLoopGroup-20-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59266, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-15 20:01:49,227 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41047] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 17576 Client: jenkins//172.31.14.131 first region in multi=testRestoreSnapshotDoesNotCreateBackRefLinks,,1676491308588.ecd7e50d99200460879f7ddfe78b8166. 2023-02-15 20:01:49,318 INFO [Listener at localhost/44509] mapreduce.TableSnapshotInputFormatTestBase(214): snapshot 2023-02-15 20:01:49,318 INFO [Listener at localhost/44509] snapshot.SnapshotTestingUtils(396): taking snapshot. 2023-02-15 20:01:49,319 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43791] master.MasterRpcServices(1580): Client=jenkins//172.31.14.131 snapshot request for:{ ss=foo table=testRestoreSnapshotDoesNotCreateBackRefLinks type=FLUSH ttl=0 } 2023-02-15 20:01:49,319 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43791] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1676491309319 (current time:1676491309319). 2023-02-15 20:01:49,319 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43791] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-02-15 20:01:49,320 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43791] zookeeper.ReadOnlyZKClient(139): Connect 0x0d26c983 to 127.0.0.1:53662 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-15 20:01:49,323 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43791] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@66818f75, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-15 20:01:49,324 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43791] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-15 20:01:49,325 INFO [RS-EventLoopGroup-19-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48716, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-15 20:01:49,326 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43791] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0d26c983 to 127.0.0.1:53662 2023-02-15 20:01:49,326 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43791] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-15 20:01:49,327 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43791] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-02-15 20:01:49,327 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43791] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=foo table=testRestoreSnapshotDoesNotCreateBackRefLinks type=FLUSH ttl=0 } 2023-02-15 20:01:49,328 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43791] procedure2.ProcedureExecutor(1029): Stored pid=13, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=EXCLUSIVE 2023-02-15 20:01:49,330 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=13, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=EXCLUSIVE 2023-02-15 20:01:49,330 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=13, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=EXCLUSIVE; timeout=600000, timestamp=1676491909330 2023-02-15 20:01:49,330 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43791] snapshot.SnapshotManager(653): Started snapshot: { ss=foo table=testRestoreSnapshotDoesNotCreateBackRefLinks type=FLUSH ttl=0 } 2023-02-15 20:01:49,330 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot foo C_M_SNAPSHOT_TABLE on table testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-15 20:01:49,332 DEBUG [Listener at localhost/44509] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=foo table=testRestoreSnapshotDoesNotCreateBackRefLinks type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-02-15 20:01:49,332 DEBUG [Listener at localhost/44509] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-02-15 20:01:49,333 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=13, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=EXCLUSIVE 2023-02-15 20:01:49,333 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=14, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=SHARED 2023-02-15 20:01:49,333 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=13, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=EXCLUSIVE in 5 msec 2023-02-15 20:01:49,334 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=14, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=SHARED 2023-02-15 20:01:49,334 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=14, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=SHARED; timeout=600000, timestamp=1676491909334 2023-02-15 20:01:49,341 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure foo 2023-02-15 20:01:49,342 INFO [(jenkins-hbase4.apache.org,43791,1676491307476)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'foo' 2023-02-15 20:01:49,342 DEBUG [(jenkins-hbase4.apache.org,43791,1676491307476)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-15 20:01:49,342 DEBUG [(jenkins-hbase4.apache.org,43791,1676491307476)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'foo' starting 'acquire' 2023-02-15 20:01:49,342 DEBUG [(jenkins-hbase4.apache.org,43791,1676491307476)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'foo', kicking off acquire phase on members. 2023-02-15 20:01:49,343 DEBUG [(jenkins-hbase4.apache.org,43791,1676491307476)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43791-0x100599323860000, quorum=127.0.0.1:53662, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/foo 2023-02-15 20:01:49,343 DEBUG [(jenkins-hbase4.apache.org,43791,1676491307476)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/foo 2023-02-15 20:01:49,344 DEBUG [Listener at localhost/44509-EventThread] zookeeper.ZKWatcher(600): regionserver:44675-0x100599323860001, quorum=127.0.0.1:53662, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-15 20:01:49,344 DEBUG [Listener at localhost/44509-EventThread] zookeeper.ZKWatcher(600): regionserver:41047-0x100599323860002, quorum=127.0.0.1:53662, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-15 20:01:49,344 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-15 20:01:49,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-15 20:01:49,344 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-15 20:01:49,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-15 20:01:49,344 DEBUG [(jenkins-hbase4.apache.org,43791,1676491307476)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,41047,1676491307558 2023-02-15 20:01:49,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/foo 2023-02-15 20:01:49,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/foo 2023-02-15 20:01:49,344 DEBUG [(jenkins-hbase4.apache.org,43791,1676491307476)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43791-0x100599323860000, quorum=127.0.0.1:53662, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,41047,1676491307558 2023-02-15 20:01:49,345 DEBUG [(jenkins-hbase4.apache.org,43791,1676491307476)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-15 20:01:49,345 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44675-0x100599323860001, quorum=127.0.0.1:53662, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/foo 2023-02-15 20:01:49,345 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41047-0x100599323860002, quorum=127.0.0.1:53662, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/foo 2023-02-15 20:01:49,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 68 2023-02-15 20:01:49,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/foo 2023-02-15 20:01:49,345 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot foo from table testRestoreSnapshotDoesNotCreateBackRefLinks type FLUSH 2023-02-15 20:01:49,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 68 2023-02-15 20:01:49,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/foo 2023-02-15 20:01:49,345 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot foo from table testRestoreSnapshotDoesNotCreateBackRefLinks type FLUSH 2023-02-15 20:01:49,345 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:foo 2023-02-15 20:01:49,345 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:foo 2023-02-15 20:01:49,345 DEBUG [member: 'jenkins-hbase4.apache.org,44675,1676491307532' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'foo' with timeout 300000ms 2023-02-15 20:01:49,345 DEBUG [member: 'jenkins-hbase4.apache.org,44675,1676491307532' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-15 20:01:49,346 DEBUG [member: 'jenkins-hbase4.apache.org,44675,1676491307532' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'foo' starting 'acquire' stage 2023-02-15 20:01:49,346 DEBUG [member: 'jenkins-hbase4.apache.org,41047,1676491307558' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'foo' with timeout 300000ms 2023-02-15 20:01:49,346 DEBUG [member: 'jenkins-hbase4.apache.org,41047,1676491307558' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-15 20:01:49,346 DEBUG [member: 'jenkins-hbase4.apache.org,44675,1676491307532' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'foo' locally acquired 2023-02-15 20:01:49,346 DEBUG [member: 'jenkins-hbase4.apache.org,44675,1676491307532' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44675,1676491307532' joining acquired barrier for procedure (foo) in zk 2023-02-15 20:01:49,347 DEBUG [member: 'jenkins-hbase4.apache.org,41047,1676491307558' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'foo' starting 'acquire' stage 2023-02-15 20:01:49,347 DEBUG [member: 'jenkins-hbase4.apache.org,41047,1676491307558' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'foo' locally acquired 2023-02-15 20:01:49,347 DEBUG [member: 'jenkins-hbase4.apache.org,41047,1676491307558' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41047,1676491307558' joining acquired barrier for procedure (foo) in zk 2023-02-15 20:01:49,348 DEBUG [member: 'jenkins-hbase4.apache.org,44675,1676491307532' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/foo 2023-02-15 20:01:49,350 DEBUG [Listener at localhost/44509-EventThread] zookeeper.ZKWatcher(600): master:43791-0x100599323860000, quorum=127.0.0.1:53662, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,41047,1676491307558 2023-02-15 20:01:49,350 DEBUG [member: 'jenkins-hbase4.apache.org,44675,1676491307532' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44675-0x100599323860001, quorum=127.0.0.1:53662, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/foo 2023-02-15 20:01:49,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,41047,1676491307558 2023-02-15 20:01:49,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-15 20:01:49,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-15 20:01:49,350 DEBUG [member: 'jenkins-hbase4.apache.org,41047,1676491307558' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/foo 2023-02-15 20:01:49,350 DEBUG [member: 'jenkins-hbase4.apache.org,44675,1676491307532' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'foo' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-15 20:01:49,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-15 20:01:49,350 DEBUG [member: 'jenkins-hbase4.apache.org,41047,1676491307558' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41047-0x100599323860002, quorum=127.0.0.1:53662, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/foo 2023-02-15 20:01:49,350 DEBUG [member: 'jenkins-hbase4.apache.org,41047,1676491307558' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'foo' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-15 20:01:49,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-15 20:01:49,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-15 20:01:49,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41047,1676491307558 2023-02-15 20:01:49,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44675,1676491307532 2023-02-15 20:01:49,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-15 20:01:49,352 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41047,1676491307558' joining acquired barrier for procedure 'foo' on coordinator 2023-02-15 20:01:49,352 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@67622354[Count = 0] remaining members to acquire global barrier 2023-02-15 20:01:49,352 DEBUG [(jenkins-hbase4.apache.org,43791,1676491307476)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'foo' starting 'in-barrier' execution. 2023-02-15 20:01:49,352 DEBUG [(jenkins-hbase4.apache.org,43791,1676491307476)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/foo 2023-02-15 20:01:49,353 DEBUG [Listener at localhost/44509-EventThread] zookeeper.ZKWatcher(600): regionserver:41047-0x100599323860002, quorum=127.0.0.1:53662, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/foo 2023-02-15 20:01:49,353 DEBUG [Listener at localhost/44509-EventThread] zookeeper.ZKWatcher(600): regionserver:44675-0x100599323860001, quorum=127.0.0.1:53662, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/foo 2023-02-15 20:01:49,353 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/foo 2023-02-15 20:01:49,353 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/foo 2023-02-15 20:01:49,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/foo 2023-02-15 20:01:49,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/foo 2023-02-15 20:01:49,353 DEBUG [member: 'jenkins-hbase4.apache.org,44675,1676491307532' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'foo' received 'reached' from coordinator. 2023-02-15 20:01:49,353 DEBUG [member: 'jenkins-hbase4.apache.org,41047,1676491307558' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'foo' received 'reached' from coordinator. 2023-02-15 20:01:49,353 DEBUG [member: 'jenkins-hbase4.apache.org,44675,1676491307532' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'foo' locally completed 2023-02-15 20:01:49,353 DEBUG [(jenkins-hbase4.apache.org,43791,1676491307476)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43791-0x100599323860000, quorum=127.0.0.1:53662, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,41047,1676491307558 2023-02-15 20:01:49,353 DEBUG [(jenkins-hbase4.apache.org,43791,1676491307476)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-15 20:01:49,353 DEBUG [member: 'jenkins-hbase4.apache.org,44675,1676491307532' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'foo' completed for member 'jenkins-hbase4.apache.org,44675,1676491307532' in zk 2023-02-15 20:01:49,353 DEBUG [member: 'jenkins-hbase4.apache.org,41047,1676491307558' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-02-15 20:01:49,353 DEBUG [member: 'jenkins-hbase4.apache.org,41047,1676491307558' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-15 20:01:49,353 DEBUG [rs(jenkins-hbase4.apache.org,41047,1676491307558)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testRestoreSnapshotDoesNotCreateBackRefLinks,,1676491308588.ecd7e50d99200460879f7ddfe78b8166. 2023-02-15 20:01:49,353 DEBUG [rs(jenkins-hbase4.apache.org,41047,1676491307558)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testRestoreSnapshotDoesNotCreateBackRefLinks,,1676491308588.ecd7e50d99200460879f7ddfe78b8166. started... 2023-02-15 20:01:49,354 INFO [rs(jenkins-hbase4.apache.org,41047,1676491307558)-snapshot-pool-0] regionserver.HRegion(2744): Flushing ecd7e50d99200460879f7ddfe78b8166 2/2 column families, dataSize=1.01 MB heapSize=3.49 MB 2023-02-15 20:01:49,355 DEBUG [member: 'jenkins-hbase4.apache.org,44675,1676491307532' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'foo' has notified controller of completion 2023-02-15 20:01:49,355 DEBUG [member: 'jenkins-hbase4.apache.org,44675,1676491307532' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-15 20:01:49,355 DEBUG [member: 'jenkins-hbase4.apache.org,44675,1676491307532' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'foo' completed. 2023-02-15 20:01:49,367 INFO [rs(jenkins-hbase4.apache.org,41047,1676491307558)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=514.92 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:43713/user/jenkins/test-data/c7dde7f7-f3cd-e2c2-c03f-38aeb64416ed/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/ecd7e50d99200460879f7ddfe78b8166/.tmp/f1/a6b55ed0642e42b2a7484090e008abd1 2023-02-15 20:01:49,384 INFO [rs(jenkins-hbase4.apache.org,41047,1676491307558)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=514.92 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:43713/user/jenkins/test-data/c7dde7f7-f3cd-e2c2-c03f-38aeb64416ed/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/ecd7e50d99200460879f7ddfe78b8166/.tmp/f2/a3959b2c6a93458a8c4eb5b62eb55cd4 2023-02-15 20:01:49,388 DEBUG [rs(jenkins-hbase4.apache.org,41047,1676491307558)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43713/user/jenkins/test-data/c7dde7f7-f3cd-e2c2-c03f-38aeb64416ed/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/ecd7e50d99200460879f7ddfe78b8166/.tmp/f1/a6b55ed0642e42b2a7484090e008abd1 as hdfs://localhost:43713/user/jenkins/test-data/c7dde7f7-f3cd-e2c2-c03f-38aeb64416ed/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/ecd7e50d99200460879f7ddfe78b8166/f1/a6b55ed0642e42b2a7484090e008abd1 2023-02-15 20:01:49,391 INFO [rs(jenkins-hbase4.apache.org,41047,1676491307558)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43713/user/jenkins/test-data/c7dde7f7-f3cd-e2c2-c03f-38aeb64416ed/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/ecd7e50d99200460879f7ddfe78b8166/f1/a6b55ed0642e42b2a7484090e008abd1, entries=17576, sequenceid=5, filesize=537.3 K 2023-02-15 20:01:49,392 DEBUG [rs(jenkins-hbase4.apache.org,41047,1676491307558)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43713/user/jenkins/test-data/c7dde7f7-f3cd-e2c2-c03f-38aeb64416ed/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/ecd7e50d99200460879f7ddfe78b8166/.tmp/f2/a3959b2c6a93458a8c4eb5b62eb55cd4 as hdfs://localhost:43713/user/jenkins/test-data/c7dde7f7-f3cd-e2c2-c03f-38aeb64416ed/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/ecd7e50d99200460879f7ddfe78b8166/f2/a3959b2c6a93458a8c4eb5b62eb55cd4 2023-02-15 20:01:49,396 INFO [rs(jenkins-hbase4.apache.org,41047,1676491307558)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43713/user/jenkins/test-data/c7dde7f7-f3cd-e2c2-c03f-38aeb64416ed/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/ecd7e50d99200460879f7ddfe78b8166/f2/a3959b2c6a93458a8c4eb5b62eb55cd4, entries=17576, sequenceid=5, filesize=537.3 K 2023-02-15 20:01:49,396 INFO [rs(jenkins-hbase4.apache.org,41047,1676491307558)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~1.01 MB/1054560, heapSize ~3.49 MB/3656288, currentSize=0 B/0 for ecd7e50d99200460879f7ddfe78b8166 in 42ms, sequenceid=5, compaction requested=false 2023-02-15 20:01:49,396 DEBUG [rs(jenkins-hbase4.apache.org,41047,1676491307558)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testRestoreSnapshotDoesNotCreateBackRefLinks' 2023-02-15 20:01:49,397 DEBUG [rs(jenkins-hbase4.apache.org,41047,1676491307558)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for ecd7e50d99200460879f7ddfe78b8166: 2023-02-15 20:01:49,397 DEBUG [rs(jenkins-hbase4.apache.org,41047,1676491307558)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testRestoreSnapshotDoesNotCreateBackRefLinks,,1676491308588.ecd7e50d99200460879f7ddfe78b8166.' region-info for snapshot=foo 2023-02-15 20:01:49,397 DEBUG [rs(jenkins-hbase4.apache.org,41047,1676491307558)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-15 20:01:49,397 DEBUG [rs(jenkins-hbase4.apache.org,41047,1676491307558)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43713/user/jenkins/test-data/c7dde7f7-f3cd-e2c2-c03f-38aeb64416ed/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/ecd7e50d99200460879f7ddfe78b8166/f1/a6b55ed0642e42b2a7484090e008abd1] hfiles 2023-02-15 20:01:49,397 DEBUG [rs(jenkins-hbase4.apache.org,41047,1676491307558)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:43713/user/jenkins/test-data/c7dde7f7-f3cd-e2c2-c03f-38aeb64416ed/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/ecd7e50d99200460879f7ddfe78b8166/f1/a6b55ed0642e42b2a7484090e008abd1 for snapshot=foo 2023-02-15 20:01:49,397 DEBUG [rs(jenkins-hbase4.apache.org,41047,1676491307558)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43713/user/jenkins/test-data/c7dde7f7-f3cd-e2c2-c03f-38aeb64416ed/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/ecd7e50d99200460879f7ddfe78b8166/f2/a3959b2c6a93458a8c4eb5b62eb55cd4] hfiles 2023-02-15 20:01:49,397 DEBUG [rs(jenkins-hbase4.apache.org,41047,1676491307558)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:43713/user/jenkins/test-data/c7dde7f7-f3cd-e2c2-c03f-38aeb64416ed/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/ecd7e50d99200460879f7ddfe78b8166/f2/a3959b2c6a93458a8c4eb5b62eb55cd4 for snapshot=foo 2023-02-15 20:01:49,403 DEBUG [rs(jenkins-hbase4.apache.org,41047,1676491307558)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testRestoreSnapshotDoesNotCreateBackRefLinks,,1676491308588.ecd7e50d99200460879f7ddfe78b8166. completed. 2023-02-15 20:01:49,403 DEBUG [rs(jenkins-hbase4.apache.org,41047,1676491307558)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testRestoreSnapshotDoesNotCreateBackRefLinks,,1676491308588.ecd7e50d99200460879f7ddfe78b8166. 2023-02-15 20:01:49,403 DEBUG [member: 'jenkins-hbase4.apache.org,41047,1676491307558' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-02-15 20:01:49,403 DEBUG [member: 'jenkins-hbase4.apache.org,41047,1676491307558' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-02-15 20:01:49,403 DEBUG [member: 'jenkins-hbase4.apache.org,41047,1676491307558' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,41047,1676491307558 2023-02-15 20:01:49,403 DEBUG [member: 'jenkins-hbase4.apache.org,41047,1676491307558' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'foo' locally completed 2023-02-15 20:01:49,403 DEBUG [member: 'jenkins-hbase4.apache.org,41047,1676491307558' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'foo' completed for member 'jenkins-hbase4.apache.org,41047,1676491307558' in zk 2023-02-15 20:01:49,404 DEBUG [Listener at localhost/44509-EventThread] zookeeper.ZKWatcher(600): master:43791-0x100599323860000, quorum=127.0.0.1:53662, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,41047,1676491307558 2023-02-15 20:01:49,404 DEBUG [member: 'jenkins-hbase4.apache.org,41047,1676491307558' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'foo' has notified controller of completion 2023-02-15 20:01:49,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,41047,1676491307558 2023-02-15 20:01:49,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-15 20:01:49,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-15 20:01:49,405 DEBUG [member: 'jenkins-hbase4.apache.org,41047,1676491307558' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-15 20:01:49,405 DEBUG [member: 'jenkins-hbase4.apache.org,41047,1676491307558' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'foo' completed. 2023-02-15 20:01:49,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-15 20:01:49,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-15 20:01:49,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-15 20:01:49,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41047,1676491307558 2023-02-15 20:01:49,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44675,1676491307532 2023-02-15 20:01:49,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-15 20:01:49,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-15 20:01:49,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41047,1676491307558 2023-02-15 20:01:49,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44675,1676491307532 2023-02-15 20:01:49,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'foo' member 'jenkins-hbase4.apache.org,41047,1676491307558': 2023-02-15 20:01:49,408 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41047,1676491307558' released barrier for procedure'foo', counting down latch. Waiting for 0 more 2023-02-15 20:01:49,408 INFO [(jenkins-hbase4.apache.org,43791,1676491307476)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'foo' execution completed 2023-02-15 20:01:49,408 DEBUG [(jenkins-hbase4.apache.org,43791,1676491307476)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-15 20:01:49,408 DEBUG [(jenkins-hbase4.apache.org,43791,1676491307476)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-15 20:01:49,408 DEBUG [(jenkins-hbase4.apache.org,43791,1676491307476)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:foo 2023-02-15 20:01:49,408 INFO [(jenkins-hbase4.apache.org,43791,1676491307476)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure fooincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-02-15 20:01:49,411 DEBUG [Listener at localhost/44509-EventThread] zookeeper.ZKWatcher(600): regionserver:41047-0x100599323860002, quorum=127.0.0.1:53662, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/foo 2023-02-15 20:01:49,411 DEBUG [Listener at localhost/44509-EventThread] zookeeper.ZKWatcher(600): regionserver:44675-0x100599323860001, quorum=127.0.0.1:53662, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/foo 2023-02-15 20:01:49,411 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/foo 2023-02-15 20:01:49,411 DEBUG [Listener at localhost/44509-EventThread] zookeeper.ZKWatcher(600): master:43791-0x100599323860000, quorum=127.0.0.1:53662, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/foo 2023-02-15 20:01:49,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/foo 2023-02-15 20:01:49,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/foo 2023-02-15 20:01:49,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-15 20:01:49,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-15 20:01:49,411 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/foo 2023-02-15 20:01:49,411 DEBUG [Listener at localhost/44509-EventThread] zookeeper.ZKWatcher(600): regionserver:44675-0x100599323860001, quorum=127.0.0.1:53662, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-15 20:01:49,411 DEBUG [Listener at localhost/44509-EventThread] zookeeper.ZKWatcher(600): regionserver:41047-0x100599323860002, quorum=127.0.0.1:53662, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-15 20:01:49,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/foo 2023-02-15 20:01:49,411 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-15 20:01:49,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-15 20:01:49,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-15 20:01:49,411 DEBUG [(jenkins-hbase4.apache.org,43791,1676491307476)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43791-0x100599323860000, quorum=127.0.0.1:53662, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,41047,1676491307558 2023-02-15 20:01:49,411 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-15 20:01:49,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-15 20:01:49,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/foo 2023-02-15 20:01:49,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-15 20:01:49,412 DEBUG [(jenkins-hbase4.apache.org,43791,1676491307476)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43791-0x100599323860000, quorum=127.0.0.1:53662, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,44675,1676491307532 2023-02-15 20:01:49,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/foo 2023-02-15 20:01:49,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-15 20:01:49,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-15 20:01:49,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41047,1676491307558 2023-02-15 20:01:49,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44675,1676491307532 2023-02-15 20:01:49,414 DEBUG [(jenkins-hbase4.apache.org,43791,1676491307476)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43791-0x100599323860000, quorum=127.0.0.1:53662, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,41047,1676491307558 2023-02-15 20:01:49,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-15 20:01:49,414 DEBUG [(jenkins-hbase4.apache.org,43791,1676491307476)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43791-0x100599323860000, quorum=127.0.0.1:53662, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,44675,1676491307532 2023-02-15 20:01:49,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-15 20:01:49,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41047,1676491307558 2023-02-15 20:01:49,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44675,1676491307532 2023-02-15 20:01:49,419 DEBUG [Listener at localhost/44509-EventThread] zookeeper.ZKWatcher(600): master:43791-0x100599323860000, quorum=127.0.0.1:53662, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,44675,1676491307532 2023-02-15 20:01:49,419 DEBUG [Listener at localhost/44509-EventThread] zookeeper.ZKWatcher(600): master:43791-0x100599323860000, quorum=127.0.0.1:53662, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo 2023-02-15 20:01:49,419 DEBUG [Listener at localhost/44509-EventThread] zookeeper.ZKWatcher(600): regionserver:41047-0x100599323860002, quorum=127.0.0.1:53662, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-15 20:01:49,419 DEBUG [Listener at localhost/44509-EventThread] zookeeper.ZKWatcher(600): master:43791-0x100599323860000, quorum=127.0.0.1:53662, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,41047,1676491307558 2023-02-15 20:01:49,419 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-15 20:01:49,419 DEBUG [Listener at localhost/44509-EventThread] zookeeper.ZKWatcher(600): regionserver:41047-0x100599323860002, quorum=127.0.0.1:53662, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-15 20:01:49,419 DEBUG [(jenkins-hbase4.apache.org,43791,1676491307476)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-15 20:01:49,419 DEBUG [Listener at localhost/44509-EventThread] zookeeper.ZKWatcher(600): regionserver:44675-0x100599323860001, quorum=127.0.0.1:53662, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-15 20:01:49,419 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for foo 2023-02-15 20:01:49,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-15 20:01:49,420 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for foo 2023-02-15 20:01:49,419 DEBUG [Listener at localhost/44509-EventThread] zookeeper.ZKWatcher(600): master:43791-0x100599323860000, quorum=127.0.0.1:53662, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo 2023-02-15 20:01:49,420 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-15 20:01:49,419 DEBUG [Listener at localhost/44509-EventThread] zookeeper.ZKWatcher(600): regionserver:44675-0x100599323860001, quorum=127.0.0.1:53662, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-15 20:01:49,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-15 20:01:49,420 DEBUG [Listener at localhost/44509-EventThread] zookeeper.ZKWatcher(600): master:43791-0x100599323860000, quorum=127.0.0.1:53662, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,44675,1676491307532 2023-02-15 20:01:49,420 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-15 20:01:49,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-15 20:01:49,420 DEBUG [Listener at localhost/44509-EventThread] zookeeper.ZKWatcher(600): master:43791-0x100599323860000, quorum=127.0.0.1:53662, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/foo 2023-02-15 20:01:49,420 DEBUG [Listener at localhost/44509-EventThread] zookeeper.ZKWatcher(600): master:43791-0x100599323860000, quorum=127.0.0.1:53662, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,41047,1676491307558 2023-02-15 20:01:49,420 DEBUG [Listener at localhost/44509-EventThread] zookeeper.ZKWatcher(600): master:43791-0x100599323860000, quorum=127.0.0.1:53662, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/foo 2023-02-15 20:01:49,420 DEBUG [Listener at localhost/44509-EventThread] zookeeper.ZKWatcher(600): master:43791-0x100599323860000, quorum=127.0.0.1:53662, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/foo 2023-02-15 20:01:49,420 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:43713/user/jenkins/test-data/c7dde7f7-f3cd-e2c2-c03f-38aeb64416ed/.hbase-snapshot/.tmp/foo 2023-02-15 20:01:49,420 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-15 20:01:49,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-15 20:01:49,433 DEBUG [Listener at localhost/44509] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-15 20:01:49,434 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43791] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=foo table=testRestoreSnapshotDoesNotCreateBackRefLinks type=FLUSH ttl=0 } is done 2023-02-15 20:01:49,434 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43791] snapshot.SnapshotManager(404): Snapshoting '{ ss=foo table=testRestoreSnapshotDoesNotCreateBackRefLinks type=FLUSH ttl=0 }' is still in progress! 2023-02-15 20:01:49,434 DEBUG [Listener at localhost/44509] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-02-15 20:01:49,439 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:43713/user/jenkins/test-data/c7dde7f7-f3cd-e2c2-c03f-38aeb64416ed/.hbase-snapshot/.tmp/foo to hdfs://localhost:43713/user/jenkins/test-data/c7dde7f7-f3cd-e2c2-c03f-38aeb64416ed/.hbase-snapshot/foo 2023-02-15 20:01:49,457 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot foo of table testRestoreSnapshotDoesNotCreateBackRefLinks completed 2023-02-15 20:01:49,457 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:43713/user/jenkins/test-data/c7dde7f7-f3cd-e2c2-c03f-38aeb64416ed/.hbase-snapshot/.tmp/foo 2023-02-15 20:01:49,458 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:43713/user/jenkins/test-data/c7dde7f7-f3cd-e2c2-c03f-38aeb64416ed/.hbase-snapshot/.tmp/foo 2023-02-15 20:01:49,458 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot foo C_M_SNAPSHOT_TABLE on table testRestoreSnapshotDoesNotCreateBackRefLinks at 1676491309330Consolidate snapshot: foo at 1676491309420 (+90 ms)Loading Region manifests for foo at 1676491309420Writing data manifest for foo at 1676491309425 (+5 ms)Verifying snapshot: foo at 1676491309433 (+8 ms)Snapshot foo of table testRestoreSnapshotDoesNotCreateBackRefLinks completed at 1676491309457 (+24 ms) 2023-02-15 20:01:49,460 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=14, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=SHARED 2023-02-15 20:01:49,461 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=14, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=SHARED in 129 msec 2023-02-15 20:01:49,634 DEBUG [Listener at localhost/44509] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-15 20:01:49,635 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43791] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=foo table=testRestoreSnapshotDoesNotCreateBackRefLinks type=FLUSH ttl=0 } is done 2023-02-15 20:01:49,636 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43791] snapshot.SnapshotManager(401): Snapshot '{ ss=foo table=testRestoreSnapshotDoesNotCreateBackRefLinks type=FLUSH ttl=0 }' has completed, notifying client. 2023-02-15 20:01:49,636 INFO [Listener at localhost/44509] snapshot.SnapshotTestingUtils(399): Confirming snapshot exists. 2023-02-15 20:01:49,639 INFO [Listener at localhost/44509] snapshot.SnapshotTestingUtils(406): validating snapshot. 2023-02-15 20:01:49,644 INFO [Listener at localhost/44509] mapreduce.TableSnapshotInputFormatTestBase(218): load different values 2023-02-15 20:01:49,671 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41047] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 17576 Client: jenkins//172.31.14.131 first region in multi=testRestoreSnapshotDoesNotCreateBackRefLinks,,1676491308588.ecd7e50d99200460879f7ddfe78b8166. 2023-02-15 20:01:49,755 INFO [Listener at localhost/44509] mapreduce.TableSnapshotInputFormatTestBase(222): cause flush to create new files in the region 2023-02-15 20:01:49,760 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43791] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-15 20:01:49,761 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43791] procedure.ProcedureCoordinator(165): Submitting procedure testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-15 20:01:49,762 INFO [(jenkins-hbase4.apache.org,43791,1676491307476)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' 2023-02-15 20:01:49,762 DEBUG [(jenkins-hbase4.apache.org,43791,1676491307476)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-15 20:01:49,763 DEBUG [(jenkins-hbase4.apache.org,43791,1676491307476)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' starting 'acquire' 2023-02-15 20:01:49,763 DEBUG [(jenkins-hbase4.apache.org,43791,1676491307476)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks', kicking off acquire phase on members. 2023-02-15 20:01:49,763 DEBUG [(jenkins-hbase4.apache.org,43791,1676491307476)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43791-0x100599323860000, quorum=127.0.0.1:53662, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-15 20:01:49,763 DEBUG [(jenkins-hbase4.apache.org,43791,1676491307476)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-15 20:01:49,764 DEBUG [Listener at localhost/44509-EventThread] zookeeper.ZKWatcher(600): regionserver:44675-0x100599323860001, quorum=127.0.0.1:53662, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-15 20:01:49,764 DEBUG [Listener at localhost/44509-EventThread] zookeeper.ZKWatcher(600): regionserver:41047-0x100599323860002, quorum=127.0.0.1:53662, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-15 20:01:49,764 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-15 20:01:49,764 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-15 20:01:49,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-15 20:01:49,764 DEBUG [(jenkins-hbase4.apache.org,43791,1676491307476)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,41047,1676491307558 2023-02-15 20:01:49,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-15 20:01:49,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-15 20:01:49,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-15 20:01:49,765 DEBUG [(jenkins-hbase4.apache.org,43791,1676491307476)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43791-0x100599323860000, quorum=127.0.0.1:53662, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,41047,1676491307558 2023-02-15 20:01:49,765 DEBUG [(jenkins-hbase4.apache.org,43791,1676491307476)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-15 20:01:49,765 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41047-0x100599323860002, quorum=127.0.0.1:53662, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-15 20:01:49,765 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44675-0x100599323860001, quorum=127.0.0.1:53662, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-15 20:01:49,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-15 20:01:49,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-15 20:01:49,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-15 20:01:49,766 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-15 20:01:49,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-15 20:01:49,766 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-15 20:01:49,766 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-15 20:01:49,766 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-15 20:01:49,766 DEBUG [member: 'jenkins-hbase4.apache.org,41047,1676491307558' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' with timeout 60000ms 2023-02-15 20:01:49,766 DEBUG [member: 'jenkins-hbase4.apache.org,41047,1676491307558' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-15 20:01:49,766 DEBUG [member: 'jenkins-hbase4.apache.org,44675,1676491307532' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' with timeout 60000ms 2023-02-15 20:01:49,767 DEBUG [member: 'jenkins-hbase4.apache.org,41047,1676491307558' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' starting 'acquire' stage 2023-02-15 20:01:49,767 DEBUG [member: 'jenkins-hbase4.apache.org,44675,1676491307532' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-15 20:01:49,768 DEBUG [member: 'jenkins-hbase4.apache.org,41047,1676491307558' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-15 20:01:49,768 DEBUG [member: 'jenkins-hbase4.apache.org,44675,1676491307532' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' starting 'acquire' stage 2023-02-15 20:01:49,768 DEBUG [rs(jenkins-hbase4.apache.org,41047,1676491307558)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testRestoreSnapshotDoesNotCreateBackRefLinks,,1676491308588.ecd7e50d99200460879f7ddfe78b8166. 2023-02-15 20:01:49,768 DEBUG [rs(jenkins-hbase4.apache.org,41047,1676491307558)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testRestoreSnapshotDoesNotCreateBackRefLinks,,1676491308588.ecd7e50d99200460879f7ddfe78b8166. started... 2023-02-15 20:01:49,768 DEBUG [member: 'jenkins-hbase4.apache.org,41047,1676491307558' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-15 20:01:49,768 DEBUG [member: 'jenkins-hbase4.apache.org,44675,1676491307532' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' locally acquired 2023-02-15 20:01:49,769 INFO [rs(jenkins-hbase4.apache.org,41047,1676491307558)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing ecd7e50d99200460879f7ddfe78b8166 2/2 column families, dataSize=1.58 MB heapSize=4.02 MB 2023-02-15 20:01:49,769 DEBUG [member: 'jenkins-hbase4.apache.org,44675,1676491307532' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44675,1676491307532' joining acquired barrier for procedure (testRestoreSnapshotDoesNotCreateBackRefLinks) in zk 2023-02-15 20:01:49,770 DEBUG [member: 'jenkins-hbase4.apache.org,44675,1676491307532' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-15 20:01:49,770 DEBUG [member: 'jenkins-hbase4.apache.org,44675,1676491307532' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44675-0x100599323860001, quorum=127.0.0.1:53662, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-15 20:01:49,770 DEBUG [member: 'jenkins-hbase4.apache.org,44675,1676491307532' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-15 20:01:49,783 INFO [rs(jenkins-hbase4.apache.org,41047,1676491307558)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=806.71 KB at sequenceid=9 (bloomFilter=false), to=hdfs://localhost:43713/user/jenkins/test-data/c7dde7f7-f3cd-e2c2-c03f-38aeb64416ed/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/ecd7e50d99200460879f7ddfe78b8166/.tmp/f1/5ecd8c50d4534d6cbd5608a1b4e2efbb 2023-02-15 20:01:49,801 INFO [rs(jenkins-hbase4.apache.org,41047,1676491307558)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=806.71 KB at sequenceid=9 (bloomFilter=false), to=hdfs://localhost:43713/user/jenkins/test-data/c7dde7f7-f3cd-e2c2-c03f-38aeb64416ed/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/ecd7e50d99200460879f7ddfe78b8166/.tmp/f2/5d27ce38352840b0863e5c5db9de2d3e 2023-02-15 20:01:49,805 DEBUG [rs(jenkins-hbase4.apache.org,41047,1676491307558)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43713/user/jenkins/test-data/c7dde7f7-f3cd-e2c2-c03f-38aeb64416ed/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/ecd7e50d99200460879f7ddfe78b8166/.tmp/f1/5ecd8c50d4534d6cbd5608a1b4e2efbb as hdfs://localhost:43713/user/jenkins/test-data/c7dde7f7-f3cd-e2c2-c03f-38aeb64416ed/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/ecd7e50d99200460879f7ddfe78b8166/f1/5ecd8c50d4534d6cbd5608a1b4e2efbb 2023-02-15 20:01:49,809 INFO [rs(jenkins-hbase4.apache.org,41047,1676491307558)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43713/user/jenkins/test-data/c7dde7f7-f3cd-e2c2-c03f-38aeb64416ed/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/ecd7e50d99200460879f7ddfe78b8166/f1/5ecd8c50d4534d6cbd5608a1b4e2efbb, entries=17576, sequenceid=9, filesize=829.4 K 2023-02-15 20:01:49,809 DEBUG [rs(jenkins-hbase4.apache.org,41047,1676491307558)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43713/user/jenkins/test-data/c7dde7f7-f3cd-e2c2-c03f-38aeb64416ed/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/ecd7e50d99200460879f7ddfe78b8166/.tmp/f2/5d27ce38352840b0863e5c5db9de2d3e as hdfs://localhost:43713/user/jenkins/test-data/c7dde7f7-f3cd-e2c2-c03f-38aeb64416ed/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/ecd7e50d99200460879f7ddfe78b8166/f2/5d27ce38352840b0863e5c5db9de2d3e 2023-02-15 20:01:49,813 INFO [rs(jenkins-hbase4.apache.org,41047,1676491307558)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43713/user/jenkins/test-data/c7dde7f7-f3cd-e2c2-c03f-38aeb64416ed/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/ecd7e50d99200460879f7ddfe78b8166/f2/5d27ce38352840b0863e5c5db9de2d3e, entries=17576, sequenceid=9, filesize=829.4 K 2023-02-15 20:01:49,814 INFO [rs(jenkins-hbase4.apache.org,41047,1676491307558)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~1.58 MB/1652144, heapSize ~4.02 MB/4218720, currentSize=0 B/0 for ecd7e50d99200460879f7ddfe78b8166 in 46ms, sequenceid=9, compaction requested=false 2023-02-15 20:01:49,816 DEBUG [rs(jenkins-hbase4.apache.org,41047,1676491307558)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for ecd7e50d99200460879f7ddfe78b8166: 2023-02-15 20:01:49,816 DEBUG [rs(jenkins-hbase4.apache.org,41047,1676491307558)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testRestoreSnapshotDoesNotCreateBackRefLinks,,1676491308588.ecd7e50d99200460879f7ddfe78b8166. 2023-02-15 20:01:49,816 DEBUG [member: 'jenkins-hbase4.apache.org,41047,1676491307558' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-15 20:01:49,816 DEBUG [member: 'jenkins-hbase4.apache.org,41047,1676491307558' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-15 20:01:49,816 DEBUG [member: 'jenkins-hbase4.apache.org,41047,1676491307558' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41047,1676491307558 2023-02-15 20:01:49,816 DEBUG [member: 'jenkins-hbase4.apache.org,41047,1676491307558' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' locally acquired 2023-02-15 20:01:49,816 DEBUG [member: 'jenkins-hbase4.apache.org,41047,1676491307558' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41047,1676491307558' joining acquired barrier for procedure (testRestoreSnapshotDoesNotCreateBackRefLinks) in zk 2023-02-15 20:01:49,818 DEBUG [member: 'jenkins-hbase4.apache.org,41047,1676491307558' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-15 20:01:49,818 DEBUG [Listener at localhost/44509-EventThread] zookeeper.ZKWatcher(600): master:43791-0x100599323860000, quorum=127.0.0.1:53662, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,41047,1676491307558 2023-02-15 20:01:49,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,41047,1676491307558 2023-02-15 20:01:49,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-15 20:01:49,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-15 20:01:49,818 DEBUG [member: 'jenkins-hbase4.apache.org,41047,1676491307558' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41047-0x100599323860002, quorum=127.0.0.1:53662, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-15 20:01:49,818 DEBUG [member: 'jenkins-hbase4.apache.org,41047,1676491307558' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-15 20:01:49,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-15 20:01:49,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-15 20:01:49,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-15 20:01:49,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41047,1676491307558 2023-02-15 20:01:49,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44675,1676491307532 2023-02-15 20:01:49,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-15 20:01:49,820 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41047,1676491307558' joining acquired barrier for procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' on coordinator 2023-02-15 20:01:49,820 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@635dab60[Count = 0] remaining members to acquire global barrier 2023-02-15 20:01:49,820 DEBUG [(jenkins-hbase4.apache.org,43791,1676491307476)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' starting 'in-barrier' execution. 2023-02-15 20:01:49,820 DEBUG [(jenkins-hbase4.apache.org,43791,1676491307476)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-15 20:01:49,821 DEBUG [Listener at localhost/44509-EventThread] zookeeper.ZKWatcher(600): regionserver:41047-0x100599323860002, quorum=127.0.0.1:53662, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-15 20:01:49,821 DEBUG [Listener at localhost/44509-EventThread] zookeeper.ZKWatcher(600): regionserver:44675-0x100599323860001, quorum=127.0.0.1:53662, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-15 20:01:49,821 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-15 20:01:49,821 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-15 20:01:49,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-15 20:01:49,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-15 20:01:49,822 DEBUG [member: 'jenkins-hbase4.apache.org,44675,1676491307532' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' received 'reached' from coordinator. 2023-02-15 20:01:49,822 DEBUG [member: 'jenkins-hbase4.apache.org,41047,1676491307558' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' received 'reached' from coordinator. 2023-02-15 20:01:49,822 DEBUG [member: 'jenkins-hbase4.apache.org,41047,1676491307558' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' locally completed 2023-02-15 20:01:49,822 DEBUG [(jenkins-hbase4.apache.org,43791,1676491307476)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43791-0x100599323860000, quorum=127.0.0.1:53662, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,41047,1676491307558 2023-02-15 20:01:49,822 DEBUG [(jenkins-hbase4.apache.org,43791,1676491307476)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-15 20:01:49,822 DEBUG [member: 'jenkins-hbase4.apache.org,44675,1676491307532' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' locally completed 2023-02-15 20:01:49,822 DEBUG [member: 'jenkins-hbase4.apache.org,44675,1676491307532' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' completed for member 'jenkins-hbase4.apache.org,44675,1676491307532' in zk 2023-02-15 20:01:49,822 DEBUG [member: 'jenkins-hbase4.apache.org,41047,1676491307558' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' completed for member 'jenkins-hbase4.apache.org,41047,1676491307558' in zk 2023-02-15 20:01:49,823 DEBUG [member: 'jenkins-hbase4.apache.org,41047,1676491307558' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' has notified controller of completion 2023-02-15 20:01:49,823 DEBUG [Listener at localhost/44509-EventThread] zookeeper.ZKWatcher(600): master:43791-0x100599323860000, quorum=127.0.0.1:53662, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,41047,1676491307558 2023-02-15 20:01:49,823 DEBUG [member: 'jenkins-hbase4.apache.org,44675,1676491307532' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' has notified controller of completion 2023-02-15 20:01:49,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,41047,1676491307558 2023-02-15 20:01:49,823 DEBUG [member: 'jenkins-hbase4.apache.org,44675,1676491307532' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-15 20:01:49,823 DEBUG [member: 'jenkins-hbase4.apache.org,41047,1676491307558' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-15 20:01:49,823 DEBUG [member: 'jenkins-hbase4.apache.org,44675,1676491307532' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' completed. 2023-02-15 20:01:49,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-15 20:01:49,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-15 20:01:49,823 DEBUG [member: 'jenkins-hbase4.apache.org,41047,1676491307558' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' completed. 2023-02-15 20:01:49,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-15 20:01:49,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-15 20:01:49,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-15 20:01:49,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41047,1676491307558 2023-02-15 20:01:49,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44675,1676491307532 2023-02-15 20:01:49,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-15 20:01:49,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-15 20:01:49,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41047,1676491307558 2023-02-15 20:01:49,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44675,1676491307532 2023-02-15 20:01:49,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' member 'jenkins-hbase4.apache.org,41047,1676491307558': 2023-02-15 20:01:49,826 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41047,1676491307558' released barrier for procedure'testRestoreSnapshotDoesNotCreateBackRefLinks', counting down latch. Waiting for 0 more 2023-02-15 20:01:49,826 INFO [(jenkins-hbase4.apache.org,43791,1676491307476)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' execution completed 2023-02-15 20:01:49,827 DEBUG [(jenkins-hbase4.apache.org,43791,1676491307476)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-15 20:01:49,827 DEBUG [(jenkins-hbase4.apache.org,43791,1676491307476)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-15 20:01:49,827 DEBUG [(jenkins-hbase4.apache.org,43791,1676491307476)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-15 20:01:49,827 INFO [(jenkins-hbase4.apache.org,43791,1676491307476)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testRestoreSnapshotDoesNotCreateBackRefLinksincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-15 20:01:49,828 DEBUG [Listener at localhost/44509-EventThread] zookeeper.ZKWatcher(600): regionserver:44675-0x100599323860001, quorum=127.0.0.1:53662, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-15 20:01:49,828 DEBUG [Listener at localhost/44509-EventThread] zookeeper.ZKWatcher(600): master:43791-0x100599323860000, quorum=127.0.0.1:53662, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-15 20:01:49,828 DEBUG [Listener at localhost/44509-EventThread] zookeeper.ZKWatcher(600): regionserver:41047-0x100599323860002, quorum=127.0.0.1:53662, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-15 20:01:49,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-15 20:01:49,828 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-15 20:01:49,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-15 20:01:49,828 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-15 20:01:49,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-15 20:01:49,828 DEBUG [Listener at localhost/44509-EventThread] zookeeper.ZKWatcher(600): regionserver:44675-0x100599323860001, quorum=127.0.0.1:53662, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-15 20:01:49,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-15 20:01:49,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-15 20:01:49,828 DEBUG [Listener at localhost/44509-EventThread] zookeeper.ZKWatcher(600): regionserver:41047-0x100599323860002, quorum=127.0.0.1:53662, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-15 20:01:49,829 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-15 20:01:49,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-15 20:01:49,829 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-15 20:01:49,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-15 20:01:49,829 DEBUG [(jenkins-hbase4.apache.org,43791,1676491307476)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43791-0x100599323860000, quorum=127.0.0.1:53662, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,41047,1676491307558 2023-02-15 20:01:49,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-15 20:01:49,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-15 20:01:49,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-15 20:01:49,829 DEBUG [(jenkins-hbase4.apache.org,43791,1676491307476)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43791-0x100599323860000, quorum=127.0.0.1:53662, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,44675,1676491307532 2023-02-15 20:01:49,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-15 20:01:49,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-15 20:01:49,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-15 20:01:49,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41047,1676491307558 2023-02-15 20:01:49,831 DEBUG [(jenkins-hbase4.apache.org,43791,1676491307476)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43791-0x100599323860000, quorum=127.0.0.1:53662, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,41047,1676491307558 2023-02-15 20:01:49,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44675,1676491307532 2023-02-15 20:01:49,831 DEBUG [(jenkins-hbase4.apache.org,43791,1676491307476)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43791-0x100599323860000, quorum=127.0.0.1:53662, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,44675,1676491307532 2023-02-15 20:01:49,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-15 20:01:49,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-15 20:01:49,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41047,1676491307558 2023-02-15 20:01:49,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44675,1676491307532 2023-02-15 20:01:49,838 DEBUG [Listener at localhost/44509-EventThread] zookeeper.ZKWatcher(600): master:43791-0x100599323860000, quorum=127.0.0.1:53662, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,44675,1676491307532 2023-02-15 20:01:49,838 DEBUG [Listener at localhost/44509-EventThread] zookeeper.ZKWatcher(600): master:43791-0x100599323860000, quorum=127.0.0.1:53662, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-15 20:01:49,838 DEBUG [Listener at localhost/44509-EventThread] zookeeper.ZKWatcher(600): regionserver:44675-0x100599323860001, quorum=127.0.0.1:53662, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-15 20:01:49,838 DEBUG [Listener at localhost/44509-EventThread] zookeeper.ZKWatcher(600): regionserver:41047-0x100599323860002, quorum=127.0.0.1:53662, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-15 20:01:49,838 DEBUG [Listener at localhost/44509-EventThread] zookeeper.ZKWatcher(600): master:43791-0x100599323860000, quorum=127.0.0.1:53662, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,41047,1676491307558 2023-02-15 20:01:49,838 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-15 20:01:49,838 DEBUG [(jenkins-hbase4.apache.org,43791,1676491307476)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-15 20:01:49,838 DEBUG [Listener at localhost/44509-EventThread] zookeeper.ZKWatcher(600): regionserver:41047-0x100599323860002, quorum=127.0.0.1:53662, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-15 20:01:49,838 DEBUG [Listener at localhost/44509-EventThread] zookeeper.ZKWatcher(600): regionserver:44675-0x100599323860001, quorum=127.0.0.1:53662, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-15 20:01:49,838 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-15 20:01:49,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-15 20:01:49,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-15 20:01:49,838 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43791] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testRestoreSnapshotDoesNotCreateBackRefLinks' 2023-02-15 20:01:49,839 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43791] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-15 20:01:49,838 DEBUG [Listener at localhost/44509-EventThread] zookeeper.ZKWatcher(600): master:43791-0x100599323860000, quorum=127.0.0.1:53662, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-15 20:01:49,839 DEBUG [Listener at localhost/44509-EventThread] zookeeper.ZKWatcher(600): master:43791-0x100599323860000, quorum=127.0.0.1:53662, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,44675,1676491307532 2023-02-15 20:01:49,839 DEBUG [Listener at localhost/44509-EventThread] zookeeper.ZKWatcher(600): master:43791-0x100599323860000, quorum=127.0.0.1:53662, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-15 20:01:49,839 DEBUG [Listener at localhost/44509-EventThread] zookeeper.ZKWatcher(600): master:43791-0x100599323860000, quorum=127.0.0.1:53662, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,41047,1676491307558 2023-02-15 20:01:49,839 DEBUG [Listener at localhost/44509-EventThread] zookeeper.ZKWatcher(600): master:43791-0x100599323860000, quorum=127.0.0.1:53662, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-15 20:01:49,839 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-15 20:01:49,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-15 20:01:49,839 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-15 20:01:49,839 DEBUG [Listener at localhost/44509-EventThread] zookeeper.ZKWatcher(600): master:43791-0x100599323860000, quorum=127.0.0.1:53662, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-15 20:01:49,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-15 20:01:49,839 DEBUG [Listener at localhost/44509] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testRestoreSnapshotDoesNotCreateBackRefLinks'' to complete. (max 20000 ms per retry) 2023-02-15 20:01:49,839 DEBUG [Listener at localhost/44509] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-15 20:01:49,939 DEBUG [Listener at localhost/44509] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-15 20:01:49,940 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43791] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-15 20:01:49,946 INFO [Listener at localhost/44509] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "foo" table: "testRestoreSnapshotDoesNotCreateBackRefLinks" creation_time: 1676491309319 type: FLUSH version: 2 ttl: 0 2023-02-15 20:01:49,946 DEBUG [Listener at localhost/44509] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost:43713/user/jenkins/test-data/7fe6e493-30c4-7f54-e50e-dcd4f9f9a780/foo/8e26c228-6e96-4b09-9f06-f1b6a57a2188/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-15 20:01:49,946 INFO [Listener at localhost/44509] snapshot.RestoreSnapshotHelper(239): region to add: ecd7e50d99200460879f7ddfe78b8166 2023-02-15 20:01:49,947 INFO [Listener at localhost/44509] snapshot.RestoreSnapshotHelper(585): clone region=ecd7e50d99200460879f7ddfe78b8166 as ecd7e50d99200460879f7ddfe78b8166 in snapshot foo 2023-02-15 20:01:49,950 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(7671): creating {ENCODED => ecd7e50d99200460879f7ddfe78b8166, NAME => 'testRestoreSnapshotDoesNotCreateBackRefLinks,,1676491308588.ecd7e50d99200460879f7ddfe78b8166.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testRestoreSnapshotDoesNotCreateBackRefLinks', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43713/user/jenkins/test-data/7fe6e493-30c4-7f54-e50e-dcd4f9f9a780/foo/8e26c228-6e96-4b09-9f06-f1b6a57a2188 2023-02-15 20:01:49,966 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(865): Instantiated testRestoreSnapshotDoesNotCreateBackRefLinks,,1676491308588.ecd7e50d99200460879f7ddfe78b8166.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 20:01:49,966 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink a6b55ed0642e42b2a7484090e008abd1 from cloned region in snapshot foo to table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-15 20:01:49,968 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink a3959b2c6a93458a8c4eb5b62eb55cd4 from cloned region in snapshot foo to table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-15 20:01:49,970 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1603): Closing ecd7e50d99200460879f7ddfe78b8166, disabling compactions & flushes 2023-02-15 20:01:49,970 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1625): Closing region testRestoreSnapshotDoesNotCreateBackRefLinks,,1676491308588.ecd7e50d99200460879f7ddfe78b8166. 2023-02-15 20:01:49,970 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testRestoreSnapshotDoesNotCreateBackRefLinks,,1676491308588.ecd7e50d99200460879f7ddfe78b8166. 2023-02-15 20:01:49,970 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1713): Acquired close lock on testRestoreSnapshotDoesNotCreateBackRefLinks,,1676491308588.ecd7e50d99200460879f7ddfe78b8166. after waiting 0 ms 2023-02-15 20:01:49,970 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1723): Updates disabled for region testRestoreSnapshotDoesNotCreateBackRefLinks,,1676491308588.ecd7e50d99200460879f7ddfe78b8166. 2023-02-15 20:01:49,970 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1837): Closed testRestoreSnapshotDoesNotCreateBackRefLinks,,1676491308588.ecd7e50d99200460879f7ddfe78b8166. 2023-02-15 20:01:49,970 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1557): Region close journal for ecd7e50d99200460879f7ddfe78b8166: 2023-02-15 20:01:49,973 INFO [Listener at localhost/44509] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "foo" table: "testRestoreSnapshotDoesNotCreateBackRefLinks" creation_time: 1676491309319 type: FLUSH version: 2 ttl: 0 2023-02-15 20:01:49,973 DEBUG [Listener at localhost/44509] snapshot.RestoreSnapshotHelper(832): Restored table dir:hdfs://localhost:43713/user/jenkins/test-data/7fe6e493-30c4-7f54-e50e-dcd4f9f9a780/foo/8e26c228-6e96-4b09-9f06-f1b6a57a2188 2023-02-15 20:01:49,973 DEBUG [Listener at localhost/44509] util.CommonFSUtils(682): File system contents for path hdfs://localhost:43713/user/jenkins/test-data/7fe6e493-30c4-7f54-e50e-dcd4f9f9a780/foo/8e26c228-6e96-4b09-9f06-f1b6a57a2188 2023-02-15 20:01:49,973 DEBUG [Listener at localhost/44509] util.CommonFSUtils(699): |-data/ 2023-02-15 20:01:49,974 DEBUG [Listener at localhost/44509] util.CommonFSUtils(699): |----default/ 2023-02-15 20:01:49,974 DEBUG [Listener at localhost/44509] util.CommonFSUtils(699): |-------testRestoreSnapshotDoesNotCreateBackRefLinks/ 2023-02-15 20:01:49,975 DEBUG [Listener at localhost/44509] util.CommonFSUtils(699): |----------ecd7e50d99200460879f7ddfe78b8166/ 2023-02-15 20:01:49,975 DEBUG [Listener at localhost/44509] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-15 20:01:49,975 DEBUG [Listener at localhost/44509] util.CommonFSUtils(699): |-------------f1/ 2023-02-15 20:01:49,976 DEBUG [Listener at localhost/44509] util.CommonFSUtils(702): |----------------testRestoreSnapshotDoesNotCreateBackRefLinks=ecd7e50d99200460879f7ddfe78b8166-a6b55ed0642e42b2a7484090e008abd1 2023-02-15 20:01:49,976 DEBUG [Listener at localhost/44509] util.CommonFSUtils(699): |-------------f2/ 2023-02-15 20:01:49,976 DEBUG [Listener at localhost/44509] util.CommonFSUtils(702): |----------------testRestoreSnapshotDoesNotCreateBackRefLinks=ecd7e50d99200460879f7ddfe78b8166-a3959b2c6a93458a8c4eb5b62eb55cd4 hdfs://localhost:43713/user/jenkins/test-data/c7dde7f7-f3cd-e2c2-c03f-38aeb64416ed/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/ecd7e50d99200460879f7ddfe78b8166/f1/5ecd8c50d4534d6cbd5608a1b4e2efbb hdfs://localhost:43713/user/jenkins/test-data/c7dde7f7-f3cd-e2c2-c03f-38aeb64416ed/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/ecd7e50d99200460879f7ddfe78b8166/f1/a6b55ed0642e42b2a7484090e008abd1 hdfs://localhost:43713/user/jenkins/test-data/c7dde7f7-f3cd-e2c2-c03f-38aeb64416ed/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/ecd7e50d99200460879f7ddfe78b8166/f2/5d27ce38352840b0863e5c5db9de2d3e hdfs://localhost:43713/user/jenkins/test-data/c7dde7f7-f3cd-e2c2-c03f-38aeb64416ed/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/ecd7e50d99200460879f7ddfe78b8166/f2/a3959b2c6a93458a8c4eb5b62eb55cd4 2023-02-15 20:01:49,983 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43791] master.MasterRpcServices(748): Client=jenkins//172.31.14.131 delete name: "foo" 2023-02-15 20:01:49,985 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43791] snapshot.SnapshotManager(333): Deleting snapshot: foo 2023-02-15 20:01:49,986 INFO [Listener at localhost/44509] client.HBaseAdmin$15(890): Started disable of testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-15 20:01:49,987 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43791] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-15 20:01:49,987 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43791] procedure2.ProcedureExecutor(1029): Stored pid=15, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-15 20:01:49,990 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676491309990"}]},"ts":"1676491309990"} 2023-02-15 20:01:49,990 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43791] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-15 20:01:49,991 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, state=DISABLING in hbase:meta 2023-02-15 20:01:49,993 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testRestoreSnapshotDoesNotCreateBackRefLinks to state=DISABLING 2023-02-15 20:01:49,993 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks, region=ecd7e50d99200460879f7ddfe78b8166, UNASSIGN}] 2023-02-15 20:01:49,996 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks, region=ecd7e50d99200460879f7ddfe78b8166, UNASSIGN 2023-02-15 20:01:49,997 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=ecd7e50d99200460879f7ddfe78b8166, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,41047,1676491307558 2023-02-15 20:01:49,997 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks,,1676491308588.ecd7e50d99200460879f7ddfe78b8166.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1676491309997"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676491309997"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676491309997"}]},"ts":"1676491309997"} 2023-02-15 20:01:49,998 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=17, ppid=16, state=RUNNABLE; CloseRegionProcedure ecd7e50d99200460879f7ddfe78b8166, server=jenkins-hbase4.apache.org,41047,1676491307558}] 2023-02-15 20:01:50,092 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43791] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-15 20:01:50,150 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close ecd7e50d99200460879f7ddfe78b8166 2023-02-15 20:01:50,150 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing ecd7e50d99200460879f7ddfe78b8166, disabling compactions & flushes 2023-02-15 20:01:50,150 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testRestoreSnapshotDoesNotCreateBackRefLinks,,1676491308588.ecd7e50d99200460879f7ddfe78b8166. 2023-02-15 20:01:50,150 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testRestoreSnapshotDoesNotCreateBackRefLinks,,1676491308588.ecd7e50d99200460879f7ddfe78b8166. 2023-02-15 20:01:50,150 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testRestoreSnapshotDoesNotCreateBackRefLinks,,1676491308588.ecd7e50d99200460879f7ddfe78b8166. after waiting 0 ms 2023-02-15 20:01:50,150 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testRestoreSnapshotDoesNotCreateBackRefLinks,,1676491308588.ecd7e50d99200460879f7ddfe78b8166. 2023-02-15 20:01:50,153 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43713/user/jenkins/test-data/c7dde7f7-f3cd-e2c2-c03f-38aeb64416ed/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/ecd7e50d99200460879f7ddfe78b8166/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-15 20:01:50,154 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testRestoreSnapshotDoesNotCreateBackRefLinks,,1676491308588.ecd7e50d99200460879f7ddfe78b8166. 2023-02-15 20:01:50,154 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for ecd7e50d99200460879f7ddfe78b8166: 2023-02-15 20:01:50,155 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed ecd7e50d99200460879f7ddfe78b8166 2023-02-15 20:01:50,156 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=ecd7e50d99200460879f7ddfe78b8166, regionState=CLOSED 2023-02-15 20:01:50,156 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks,,1676491308588.ecd7e50d99200460879f7ddfe78b8166.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1676491310155"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676491310155"}]},"ts":"1676491310155"} 2023-02-15 20:01:50,158 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=17, resume processing ppid=16 2023-02-15 20:01:50,158 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=16, state=SUCCESS; CloseRegionProcedure ecd7e50d99200460879f7ddfe78b8166, server=jenkins-hbase4.apache.org,41047,1676491307558 in 159 msec 2023-02-15 20:01:50,159 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=16, resume processing ppid=15 2023-02-15 20:01:50,159 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=15, state=SUCCESS; TransitRegionStateProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks, region=ecd7e50d99200460879f7ddfe78b8166, UNASSIGN in 165 msec 2023-02-15 20:01:50,160 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676491310160"}]},"ts":"1676491310160"} 2023-02-15 20:01:50,161 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, state=DISABLED in hbase:meta 2023-02-15 20:01:50,162 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testRestoreSnapshotDoesNotCreateBackRefLinks to state=DISABLED 2023-02-15 20:01:50,163 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=15, state=SUCCESS; DisableTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks in 176 msec 2023-02-15 20:01:50,293 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43791] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-15 20:01:50,294 INFO [Listener at localhost/44509] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testRestoreSnapshotDoesNotCreateBackRefLinks, procId: 15 completed 2023-02-15 20:01:50,295 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43791] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-15 20:01:50,298 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43791] procedure2.ProcedureExecutor(1029): Stored pid=18, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-15 20:01:50,299 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=18, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-15 20:01:50,300 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=18, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-15 20:01:50,301 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43791] master.MasterRpcServices(1227): Checking to see if procedure is done pid=18 2023-02-15 20:01:50,303 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43713/user/jenkins/test-data/c7dde7f7-f3cd-e2c2-c03f-38aeb64416ed/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/ecd7e50d99200460879f7ddfe78b8166 2023-02-15 20:01:50,305 DEBUG [HFileArchiver-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:43713/user/jenkins/test-data/c7dde7f7-f3cd-e2c2-c03f-38aeb64416ed/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/ecd7e50d99200460879f7ddfe78b8166/f1, FileablePath, hdfs://localhost:43713/user/jenkins/test-data/c7dde7f7-f3cd-e2c2-c03f-38aeb64416ed/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/ecd7e50d99200460879f7ddfe78b8166/f2, FileablePath, hdfs://localhost:43713/user/jenkins/test-data/c7dde7f7-f3cd-e2c2-c03f-38aeb64416ed/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/ecd7e50d99200460879f7ddfe78b8166/recovered.edits] 2023-02-15 20:01:50,308 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43713/user/jenkins/test-data/c7dde7f7-f3cd-e2c2-c03f-38aeb64416ed/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/ecd7e50d99200460879f7ddfe78b8166/f1/5ecd8c50d4534d6cbd5608a1b4e2efbb to hdfs://localhost:43713/user/jenkins/test-data/c7dde7f7-f3cd-e2c2-c03f-38aeb64416ed/archive/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/ecd7e50d99200460879f7ddfe78b8166/f1/5ecd8c50d4534d6cbd5608a1b4e2efbb 2023-02-15 20:01:50,309 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43713/user/jenkins/test-data/c7dde7f7-f3cd-e2c2-c03f-38aeb64416ed/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/ecd7e50d99200460879f7ddfe78b8166/f1/a6b55ed0642e42b2a7484090e008abd1 to hdfs://localhost:43713/user/jenkins/test-data/c7dde7f7-f3cd-e2c2-c03f-38aeb64416ed/archive/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/ecd7e50d99200460879f7ddfe78b8166/f1/a6b55ed0642e42b2a7484090e008abd1 2023-02-15 20:01:50,312 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43713/user/jenkins/test-data/c7dde7f7-f3cd-e2c2-c03f-38aeb64416ed/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/ecd7e50d99200460879f7ddfe78b8166/f2/5d27ce38352840b0863e5c5db9de2d3e to hdfs://localhost:43713/user/jenkins/test-data/c7dde7f7-f3cd-e2c2-c03f-38aeb64416ed/archive/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/ecd7e50d99200460879f7ddfe78b8166/f2/5d27ce38352840b0863e5c5db9de2d3e 2023-02-15 20:01:50,313 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43713/user/jenkins/test-data/c7dde7f7-f3cd-e2c2-c03f-38aeb64416ed/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/ecd7e50d99200460879f7ddfe78b8166/f2/a3959b2c6a93458a8c4eb5b62eb55cd4 to hdfs://localhost:43713/user/jenkins/test-data/c7dde7f7-f3cd-e2c2-c03f-38aeb64416ed/archive/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/ecd7e50d99200460879f7ddfe78b8166/f2/a3959b2c6a93458a8c4eb5b62eb55cd4 2023-02-15 20:01:50,315 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43713/user/jenkins/test-data/c7dde7f7-f3cd-e2c2-c03f-38aeb64416ed/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/ecd7e50d99200460879f7ddfe78b8166/recovered.edits/12.seqid to hdfs://localhost:43713/user/jenkins/test-data/c7dde7f7-f3cd-e2c2-c03f-38aeb64416ed/archive/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/ecd7e50d99200460879f7ddfe78b8166/recovered.edits/12.seqid 2023-02-15 20:01:50,315 DEBUG [HFileArchiver-5] backup.HFileArchiver(596): Deleted hdfs://localhost:43713/user/jenkins/test-data/c7dde7f7-f3cd-e2c2-c03f-38aeb64416ed/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/ecd7e50d99200460879f7ddfe78b8166 2023-02-15 20:01:50,315 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testRestoreSnapshotDoesNotCreateBackRefLinks regions 2023-02-15 20:01:50,317 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=18, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-15 20:01:50,318 WARN [PEWorker-1] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testRestoreSnapshotDoesNotCreateBackRefLinks from hbase:meta 2023-02-15 20:01:50,320 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(421): Removing 'testRestoreSnapshotDoesNotCreateBackRefLinks' descriptor. 2023-02-15 20:01:50,323 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=18, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-15 20:01:50,323 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(411): Removing 'testRestoreSnapshotDoesNotCreateBackRefLinks' from region states. 2023-02-15 20:01:50,323 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks,,1676491308588.ecd7e50d99200460879f7ddfe78b8166.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676491310323"}]},"ts":"9223372036854775807"} 2023-02-15 20:01:50,324 INFO [PEWorker-1] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-02-15 20:01:50,324 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => ecd7e50d99200460879f7ddfe78b8166, NAME => 'testRestoreSnapshotDoesNotCreateBackRefLinks,,1676491308588.ecd7e50d99200460879f7ddfe78b8166.', STARTKEY => '', ENDKEY => ''}] 2023-02-15 20:01:50,324 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(415): Marking 'testRestoreSnapshotDoesNotCreateBackRefLinks' as deleted. 2023-02-15 20:01:50,324 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1676491310324"}]},"ts":"9223372036854775807"} 2023-02-15 20:01:50,325 INFO [PEWorker-1] hbase.MetaTableAccessor(1658): Deleted table testRestoreSnapshotDoesNotCreateBackRefLinks state from META 2023-02-15 20:01:50,327 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(130): Finished pid=18, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-15 20:01:50,328 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=18, state=SUCCESS; DeleteTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks in 32 msec 2023-02-15 20:01:50,403 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43791] master.MasterRpcServices(1227): Checking to see if procedure is done pid=18 2023-02-15 20:01:50,403 INFO [Listener at localhost/44509] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testRestoreSnapshotDoesNotCreateBackRefLinks, procId: 18 completed 2023-02-15 20:01:50,403 INFO [Listener at localhost/44509] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-02-15 20:01:50,403 INFO [Listener at localhost/44509] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-15 20:01:50,403 DEBUG [Listener at localhost/44509] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x520cf990 to 127.0.0.1:53662 2023-02-15 20:01:50,404 DEBUG [Listener at localhost/44509] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-15 20:01:50,404 DEBUG [Listener at localhost/44509] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-02-15 20:01:50,404 DEBUG [Listener at localhost/44509] util.JVMClusterUtil(257): Found active master hash=1539615999, stopped=false 2023-02-15 20:01:50,404 INFO [Listener at localhost/44509] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,43791,1676491307476 2023-02-15 20:01:50,406 DEBUG [Listener at localhost/44509-EventThread] zookeeper.ZKWatcher(600): regionserver:41047-0x100599323860002, quorum=127.0.0.1:53662, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-15 20:01:50,406 DEBUG [Listener at localhost/44509-EventThread] zookeeper.ZKWatcher(600): master:43791-0x100599323860000, quorum=127.0.0.1:53662, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-15 20:01:50,406 INFO [Listener at localhost/44509] procedure2.ProcedureExecutor(629): Stopping 2023-02-15 20:01:50,406 DEBUG [Listener at localhost/44509-EventThread] zookeeper.ZKWatcher(600): regionserver:44675-0x100599323860001, quorum=127.0.0.1:53662, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-15 20:01:50,406 DEBUG [Listener at localhost/44509-EventThread] zookeeper.ZKWatcher(600): master:43791-0x100599323860000, quorum=127.0.0.1:53662, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-15 20:01:50,408 DEBUG [Listener at localhost/44509] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x617e5eae to 127.0.0.1:53662 2023-02-15 20:01:50,408 DEBUG [Listener at localhost/44509] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-15 20:01:50,408 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44675-0x100599323860001, quorum=127.0.0.1:53662, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-15 20:01:50,408 INFO [Listener at localhost/44509] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,44675,1676491307532' ***** 2023-02-15 20:01:50,409 INFO [Listener at localhost/44509] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-15 20:01:50,408 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41047-0x100599323860002, quorum=127.0.0.1:53662, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-15 20:01:50,409 INFO [RS:0;jenkins-hbase4:44675] regionserver.HeapMemoryManager(220): Stopping 2023-02-15 20:01:50,409 INFO [Listener at localhost/44509] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,41047,1676491307558' ***** 2023-02-15 20:01:50,409 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:43791-0x100599323860000, quorum=127.0.0.1:53662, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-15 20:01:50,409 INFO [Listener at localhost/44509] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-15 20:01:50,409 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-15 20:01:50,409 INFO [RS:0;jenkins-hbase4:44675] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-15 20:01:50,410 INFO [RS:1;jenkins-hbase4:41047] regionserver.HeapMemoryManager(220): Stopping 2023-02-15 20:01:50,410 INFO [RS:0;jenkins-hbase4:44675] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-15 20:01:50,410 INFO [RS:1;jenkins-hbase4:41047] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-15 20:01:50,410 INFO [RS:0;jenkins-hbase4:44675] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,44675,1676491307532 2023-02-15 20:01:50,410 DEBUG [RS:0;jenkins-hbase4:44675] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x43cf695a to 127.0.0.1:53662 2023-02-15 20:01:50,411 DEBUG [RS:0;jenkins-hbase4:44675] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-15 20:01:50,410 INFO [RS:1;jenkins-hbase4:41047] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-15 20:01:50,411 INFO [RS:0;jenkins-hbase4:44675] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-15 20:01:50,411 INFO [RS:1;jenkins-hbase4:41047] regionserver.HRegionServer(3304): Received CLOSE for 005556a0868445ebc467cfbf458c1db5 2023-02-15 20:01:50,410 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-15 20:01:50,411 INFO [RS:1;jenkins-hbase4:41047] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,41047,1676491307558 2023-02-15 20:01:50,411 INFO [RS:0;jenkins-hbase4:44675] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-15 20:01:50,412 INFO [RS:0;jenkins-hbase4:44675] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-15 20:01:50,412 DEBUG [RS:1;jenkins-hbase4:41047] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x19e95656 to 127.0.0.1:53662 2023-02-15 20:01:50,412 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 005556a0868445ebc467cfbf458c1db5, disabling compactions & flushes 2023-02-15 20:01:50,412 DEBUG [RS:1;jenkins-hbase4:41047] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-15 20:01:50,412 INFO [RS:0;jenkins-hbase4:44675] regionserver.HRegionServer(3304): Received CLOSE for 1588230740 2023-02-15 20:01:50,412 INFO [RS:1;jenkins-hbase4:41047] regionserver.HRegionServer(1475): Waiting on 1 regions to close 2023-02-15 20:01:50,412 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676491308112.005556a0868445ebc467cfbf458c1db5. 2023-02-15 20:01:50,412 DEBUG [RS:1;jenkins-hbase4:41047] regionserver.HRegionServer(1479): Online Regions={005556a0868445ebc467cfbf458c1db5=hbase:namespace,,1676491308112.005556a0868445ebc467cfbf458c1db5.} 2023-02-15 20:01:50,412 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676491308112.005556a0868445ebc467cfbf458c1db5. 2023-02-15 20:01:50,412 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676491308112.005556a0868445ebc467cfbf458c1db5. after waiting 0 ms 2023-02-15 20:01:50,412 DEBUG [RS:1;jenkins-hbase4:41047] regionserver.HRegionServer(1505): Waiting on 005556a0868445ebc467cfbf458c1db5 2023-02-15 20:01:50,412 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676491308112.005556a0868445ebc467cfbf458c1db5. 2023-02-15 20:01:50,412 INFO [RS:0;jenkins-hbase4:44675] regionserver.HRegionServer(1475): Waiting on 1 regions to close 2023-02-15 20:01:50,412 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 005556a0868445ebc467cfbf458c1db5 1/1 column families, dataSize=78 B heapSize=488 B 2023-02-15 20:01:50,412 DEBUG [RS:0;jenkins-hbase4:44675] regionserver.HRegionServer(1479): Online Regions={1588230740=hbase:meta,,1.1588230740} 2023-02-15 20:01:50,412 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-15 20:01:50,412 DEBUG [RS:0;jenkins-hbase4:44675] regionserver.HRegionServer(1505): Waiting on 1588230740 2023-02-15 20:01:50,412 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-15 20:01:50,412 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-15 20:01:50,412 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-15 20:01:50,412 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-15 20:01:50,412 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 1588230740 3/3 column families, dataSize=4.46 KB heapSize=7.87 KB 2023-02-15 20:01:50,419 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-15 20:01:50,424 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:43713/user/jenkins/test-data/c7dde7f7-f3cd-e2c2-c03f-38aeb64416ed/data/hbase/namespace/005556a0868445ebc467cfbf458c1db5/.tmp/info/9a0d345f1cde4c58a9eef4604cded02c 2023-02-15 20:01:50,426 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.77 KB at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:43713/user/jenkins/test-data/c7dde7f7-f3cd-e2c2-c03f-38aeb64416ed/data/hbase/meta/1588230740/.tmp/info/d8e91a550bfa468886b6c175197f7c03 2023-02-15 20:01:50,428 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43713/user/jenkins/test-data/c7dde7f7-f3cd-e2c2-c03f-38aeb64416ed/data/hbase/namespace/005556a0868445ebc467cfbf458c1db5/.tmp/info/9a0d345f1cde4c58a9eef4604cded02c as hdfs://localhost:43713/user/jenkins/test-data/c7dde7f7-f3cd-e2c2-c03f-38aeb64416ed/data/hbase/namespace/005556a0868445ebc467cfbf458c1db5/info/9a0d345f1cde4c58a9eef4604cded02c 2023-02-15 20:01:50,429 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d8e91a550bfa468886b6c175197f7c03 2023-02-15 20:01:50,433 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:43713/user/jenkins/test-data/c7dde7f7-f3cd-e2c2-c03f-38aeb64416ed/data/hbase/namespace/005556a0868445ebc467cfbf458c1db5/info/9a0d345f1cde4c58a9eef4604cded02c, entries=2, sequenceid=6, filesize=4.8 K 2023-02-15 20:01:50,433 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 005556a0868445ebc467cfbf458c1db5 in 21ms, sequenceid=6, compaction requested=false 2023-02-15 20:01:50,433 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-15 20:01:50,437 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43713/user/jenkins/test-data/c7dde7f7-f3cd-e2c2-c03f-38aeb64416ed/data/hbase/namespace/005556a0868445ebc467cfbf458c1db5/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-02-15 20:01:50,438 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676491308112.005556a0868445ebc467cfbf458c1db5. 2023-02-15 20:01:50,438 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 005556a0868445ebc467cfbf458c1db5: 2023-02-15 20:01:50,438 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1676491308112.005556a0868445ebc467cfbf458c1db5. 2023-02-15 20:01:50,439 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:43713/user/jenkins/test-data/c7dde7f7-f3cd-e2c2-c03f-38aeb64416ed/data/hbase/meta/1588230740/.tmp/rep_barrier/604f064142444d7dad8ce10782ca3c09 2023-02-15 20:01:50,445 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 604f064142444d7dad8ce10782ca3c09 2023-02-15 20:01:50,462 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=590 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:43713/user/jenkins/test-data/c7dde7f7-f3cd-e2c2-c03f-38aeb64416ed/data/hbase/meta/1588230740/.tmp/table/234509fab2ce4e929745ffaf2fc5e953 2023-02-15 20:01:50,465 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 234509fab2ce4e929745ffaf2fc5e953 2023-02-15 20:01:50,466 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43713/user/jenkins/test-data/c7dde7f7-f3cd-e2c2-c03f-38aeb64416ed/data/hbase/meta/1588230740/.tmp/info/d8e91a550bfa468886b6c175197f7c03 as hdfs://localhost:43713/user/jenkins/test-data/c7dde7f7-f3cd-e2c2-c03f-38aeb64416ed/data/hbase/meta/1588230740/info/d8e91a550bfa468886b6c175197f7c03 2023-02-15 20:01:50,470 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d8e91a550bfa468886b6c175197f7c03 2023-02-15 20:01:50,470 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:43713/user/jenkins/test-data/c7dde7f7-f3cd-e2c2-c03f-38aeb64416ed/data/hbase/meta/1588230740/info/d8e91a550bfa468886b6c175197f7c03, entries=12, sequenceid=21, filesize=6.3 K 2023-02-15 20:01:50,473 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43713/user/jenkins/test-data/c7dde7f7-f3cd-e2c2-c03f-38aeb64416ed/data/hbase/meta/1588230740/.tmp/rep_barrier/604f064142444d7dad8ce10782ca3c09 as hdfs://localhost:43713/user/jenkins/test-data/c7dde7f7-f3cd-e2c2-c03f-38aeb64416ed/data/hbase/meta/1588230740/rep_barrier/604f064142444d7dad8ce10782ca3c09 2023-02-15 20:01:50,477 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 604f064142444d7dad8ce10782ca3c09 2023-02-15 20:01:50,478 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:43713/user/jenkins/test-data/c7dde7f7-f3cd-e2c2-c03f-38aeb64416ed/data/hbase/meta/1588230740/rep_barrier/604f064142444d7dad8ce10782ca3c09, entries=1, sequenceid=21, filesize=5.1 K 2023-02-15 20:01:50,478 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43713/user/jenkins/test-data/c7dde7f7-f3cd-e2c2-c03f-38aeb64416ed/data/hbase/meta/1588230740/.tmp/table/234509fab2ce4e929745ffaf2fc5e953 as hdfs://localhost:43713/user/jenkins/test-data/c7dde7f7-f3cd-e2c2-c03f-38aeb64416ed/data/hbase/meta/1588230740/table/234509fab2ce4e929745ffaf2fc5e953 2023-02-15 20:01:50,482 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 234509fab2ce4e929745ffaf2fc5e953 2023-02-15 20:01:50,482 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:43713/user/jenkins/test-data/c7dde7f7-f3cd-e2c2-c03f-38aeb64416ed/data/hbase/meta/1588230740/table/234509fab2ce4e929745ffaf2fc5e953, entries=4, sequenceid=21, filesize=5.1 K 2023-02-15 20:01:50,483 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~4.46 KB/4572, heapSize ~7.82 KB/8008, currentSize=0 B/0 for 1588230740 in 71ms, sequenceid=21, compaction requested=false 2023-02-15 20:01:50,490 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43713/user/jenkins/test-data/c7dde7f7-f3cd-e2c2-c03f-38aeb64416ed/data/hbase/meta/1588230740/recovered.edits/24.seqid, newMaxSeqId=24, maxSeqId=1 2023-02-15 20:01:50,491 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-15 20:01:50,491 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-15 20:01:50,491 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 1588230740: 2023-02-15 20:01:50,491 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-02-15 20:01:50,612 INFO [RS:1;jenkins-hbase4:41047] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,41047,1676491307558; all regions closed. 2023-02-15 20:01:50,612 INFO [RS:0;jenkins-hbase4:44675] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,44675,1676491307532; all regions closed. 2023-02-15 20:01:50,615 WARN [Close-WAL-Writer-0] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(641): complete file /user/jenkins/test-data/c7dde7f7-f3cd-e2c2-c03f-38aeb64416ed/WALs/jenkins-hbase4.apache.org,41047,1676491307558/jenkins-hbase4.apache.org%2C41047%2C1676491307558.1676491308459 not finished, retry = 0 2023-02-15 20:01:50,617 DEBUG [RS:0;jenkins-hbase4:44675] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/c7dde7f7-f3cd-e2c2-c03f-38aeb64416ed/oldWALs 2023-02-15 20:01:50,617 INFO [RS:0;jenkins-hbase4:44675] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C44675%2C1676491307532.meta:.meta(num 1676491308063) 2023-02-15 20:01:50,628 DEBUG [RS:0;jenkins-hbase4:44675] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/c7dde7f7-f3cd-e2c2-c03f-38aeb64416ed/oldWALs 2023-02-15 20:01:50,628 INFO [RS:0;jenkins-hbase4:44675] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C44675%2C1676491307532:(num 1676491308855) 2023-02-15 20:01:50,628 DEBUG [RS:0;jenkins-hbase4:44675] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-15 20:01:50,628 INFO [RS:0;jenkins-hbase4:44675] regionserver.LeaseManager(133): Closed leases 2023-02-15 20:01:50,628 INFO [RS:0;jenkins-hbase4:44675] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-02-15 20:01:50,628 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-15 20:01:50,629 INFO [RS:0;jenkins-hbase4:44675] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:44675 2023-02-15 20:01:50,631 DEBUG [Listener at localhost/44509-EventThread] zookeeper.ZKWatcher(600): regionserver:44675-0x100599323860001, quorum=127.0.0.1:53662, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,44675,1676491307532 2023-02-15 20:01:50,631 DEBUG [Listener at localhost/44509-EventThread] zookeeper.ZKWatcher(600): regionserver:41047-0x100599323860002, quorum=127.0.0.1:53662, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,44675,1676491307532 2023-02-15 20:01:50,631 ERROR [Listener at localhost/44509-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@b7a2e96 rejected from java.util.concurrent.ThreadPoolExecutor@f45bb21[Shutting down, pool size = 1, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-15 20:01:50,631 DEBUG [Listener at localhost/44509-EventThread] zookeeper.ZKWatcher(600): regionserver:41047-0x100599323860002, quorum=127.0.0.1:53662, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-15 20:01:50,631 DEBUG [Listener at localhost/44509-EventThread] zookeeper.ZKWatcher(600): regionserver:44675-0x100599323860001, quorum=127.0.0.1:53662, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-15 20:01:50,631 DEBUG [Listener at localhost/44509-EventThread] zookeeper.ZKWatcher(600): master:43791-0x100599323860000, quorum=127.0.0.1:53662, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-15 20:01:50,631 ERROR [Listener at localhost/44509-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@21935aec rejected from java.util.concurrent.ThreadPoolExecutor@f45bb21[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-15 20:01:50,632 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,44675,1676491307532] 2023-02-15 20:01:50,632 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,44675,1676491307532; numProcessing=1 2023-02-15 20:01:50,633 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,44675,1676491307532 already deleted, retry=false 2023-02-15 20:01:50,633 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,44675,1676491307532 expired; onlineServers=1 2023-02-15 20:01:50,717 DEBUG [RS:1;jenkins-hbase4:41047] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/c7dde7f7-f3cd-e2c2-c03f-38aeb64416ed/oldWALs 2023-02-15 20:01:50,717 INFO [RS:1;jenkins-hbase4:41047] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C41047%2C1676491307558:(num 1676491308459) 2023-02-15 20:01:50,717 DEBUG [RS:1;jenkins-hbase4:41047] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-15 20:01:50,717 INFO [RS:1;jenkins-hbase4:41047] regionserver.LeaseManager(133): Closed leases 2023-02-15 20:01:50,718 INFO [RS:1;jenkins-hbase4:41047] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-02-15 20:01:50,718 INFO [RS:1;jenkins-hbase4:41047] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-15 20:01:50,718 INFO [RS:1;jenkins-hbase4:41047] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-15 20:01:50,718 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-15 20:01:50,718 INFO [RS:1;jenkins-hbase4:41047] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-15 20:01:50,719 INFO [RS:1;jenkins-hbase4:41047] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:41047 2023-02-15 20:01:50,721 DEBUG [Listener at localhost/44509-EventThread] zookeeper.ZKWatcher(600): regionserver:41047-0x100599323860002, quorum=127.0.0.1:53662, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,41047,1676491307558 2023-02-15 20:01:50,721 DEBUG [Listener at localhost/44509-EventThread] zookeeper.ZKWatcher(600): master:43791-0x100599323860000, quorum=127.0.0.1:53662, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-15 20:01:50,722 ERROR [Listener at localhost/44509-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@7bba9d65 rejected from java.util.concurrent.ThreadPoolExecutor@7f8516ca[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 19] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-15 20:01:50,722 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,41047,1676491307558] 2023-02-15 20:01:50,723 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,41047,1676491307558; numProcessing=2 2023-02-15 20:01:50,723 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,41047,1676491307558 already deleted, retry=false 2023-02-15 20:01:50,724 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,41047,1676491307558 expired; onlineServers=0 2023-02-15 20:01:50,724 INFO [RegionServerTracker-0] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,43791,1676491307476' ***** 2023-02-15 20:01:50,724 INFO [RegionServerTracker-0] regionserver.HRegionServer(2310): STOPPED: Cluster shutdown set; onlineServer=0 2023-02-15 20:01:50,724 DEBUG [M:0;jenkins-hbase4:43791] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5ffb235f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-15 20:01:50,724 INFO [M:0;jenkins-hbase4:43791] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,43791,1676491307476 2023-02-15 20:01:50,725 INFO [M:0;jenkins-hbase4:43791] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,43791,1676491307476; all regions closed. 2023-02-15 20:01:50,725 DEBUG [M:0;jenkins-hbase4:43791] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-15 20:01:50,725 DEBUG [M:0;jenkins-hbase4:43791] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-02-15 20:01:50,725 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-02-15 20:01:50,725 DEBUG [M:0;jenkins-hbase4:43791] cleaner.HFileCleaner(317): Stopping file delete threads 2023-02-15 20:01:50,725 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676491307712] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676491307712,5,FailOnTimeoutGroup] 2023-02-15 20:01:50,725 INFO [M:0;jenkins-hbase4:43791] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-02-15 20:01:50,725 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676491307711] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676491307711,5,FailOnTimeoutGroup] 2023-02-15 20:01:50,725 INFO [M:0;jenkins-hbase4:43791] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-02-15 20:01:50,726 INFO [M:0;jenkins-hbase4:43791] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-02-15 20:01:50,726 DEBUG [M:0;jenkins-hbase4:43791] master.HMaster(1512): Stopping service threads 2023-02-15 20:01:50,726 INFO [M:0;jenkins-hbase4:43791] procedure2.RemoteProcedureDispatcher(118): Stopping procedure remote dispatcher 2023-02-15 20:01:50,727 DEBUG [Listener at localhost/44509-EventThread] zookeeper.ZKWatcher(600): master:43791-0x100599323860000, quorum=127.0.0.1:53662, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-02-15 20:01:50,727 ERROR [M:0;jenkins-hbase4:43791] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-02-15 20:01:50,727 DEBUG [Listener at localhost/44509-EventThread] zookeeper.ZKWatcher(600): master:43791-0x100599323860000, quorum=127.0.0.1:53662, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-15 20:01:50,727 INFO [M:0;jenkins-hbase4:43791] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-02-15 20:01:50,727 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-02-15 20:01:50,728 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:43791-0x100599323860000, quorum=127.0.0.1:53662, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-15 20:01:50,728 DEBUG [M:0;jenkins-hbase4:43791] zookeeper.ZKUtil(398): master:43791-0x100599323860000, quorum=127.0.0.1:53662, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-02-15 20:01:50,728 WARN [M:0;jenkins-hbase4:43791] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-02-15 20:01:50,728 INFO [M:0;jenkins-hbase4:43791] assignment.AssignmentManager(315): Stopping assignment manager 2023-02-15 20:01:50,728 INFO [M:0;jenkins-hbase4:43791] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-02-15 20:01:50,728 DEBUG [M:0;jenkins-hbase4:43791] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-15 20:01:50,729 INFO [M:0;jenkins-hbase4:43791] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-15 20:01:50,729 DEBUG [M:0;jenkins-hbase4:43791] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-15 20:01:50,729 DEBUG [M:0;jenkins-hbase4:43791] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-15 20:01:50,729 DEBUG [M:0;jenkins-hbase4:43791] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-15 20:01:50,729 INFO [M:0;jenkins-hbase4:43791] regionserver.HRegion(2744): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=56.65 KB heapSize=67.61 KB 2023-02-15 20:01:50,738 INFO [M:0;jenkins-hbase4:43791] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=56.65 KB at sequenceid=132 (bloomFilter=true), to=hdfs://localhost:43713/user/jenkins/test-data/c7dde7f7-f3cd-e2c2-c03f-38aeb64416ed/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/92327e6f3c234d339193c44a65e05288 2023-02-15 20:01:50,742 DEBUG [M:0;jenkins-hbase4:43791] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43713/user/jenkins/test-data/c7dde7f7-f3cd-e2c2-c03f-38aeb64416ed/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/92327e6f3c234d339193c44a65e05288 as hdfs://localhost:43713/user/jenkins/test-data/c7dde7f7-f3cd-e2c2-c03f-38aeb64416ed/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/92327e6f3c234d339193c44a65e05288 2023-02-15 20:01:50,745 INFO [M:0;jenkins-hbase4:43791] regionserver.HStore(1080): Added hdfs://localhost:43713/user/jenkins/test-data/c7dde7f7-f3cd-e2c2-c03f-38aeb64416ed/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/92327e6f3c234d339193c44a65e05288, entries=17, sequenceid=132, filesize=8.7 K 2023-02-15 20:01:50,746 INFO [M:0;jenkins-hbase4:43791] regionserver.HRegion(2947): Finished flush of dataSize ~56.65 KB/58009, heapSize ~67.59 KB/69216, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 17ms, sequenceid=132, compaction requested=false 2023-02-15 20:01:50,746 INFO [M:0;jenkins-hbase4:43791] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-15 20:01:50,746 DEBUG [M:0;jenkins-hbase4:43791] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-15 20:01:50,748 INFO [M:0;jenkins-hbase4:43791] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-02-15 20:01:50,748 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-15 20:01:50,749 INFO [M:0;jenkins-hbase4:43791] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:43791 2023-02-15 20:01:50,751 DEBUG [M:0;jenkins-hbase4:43791] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,43791,1676491307476 already deleted, retry=false 2023-02-15 20:01:50,909 DEBUG [Listener at localhost/44509-EventThread] zookeeper.ZKWatcher(600): master:43791-0x100599323860000, quorum=127.0.0.1:53662, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-15 20:01:50,909 INFO [M:0;jenkins-hbase4:43791] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,43791,1676491307476; zookeeper connection closed. 2023-02-15 20:01:50,909 ERROR [Listener at localhost/44509-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@182cc2be rejected from java.util.concurrent.ThreadPoolExecutor@1c134563[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 52] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-15 20:01:50,910 DEBUG [Listener at localhost/44509-EventThread] zookeeper.ZKWatcher(600): master:43791-0x100599323860000, quorum=127.0.0.1:53662, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-15 20:01:50,910 ERROR [Listener at localhost/44509-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@1645ee02 rejected from java.util.concurrent.ThreadPoolExecutor@1c134563[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 52] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-15 20:01:51,009 DEBUG [Listener at localhost/44509-EventThread] zookeeper.ZKWatcher(600): regionserver:41047-0x100599323860002, quorum=127.0.0.1:53662, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-15 20:01:51,009 INFO [RS:1;jenkins-hbase4:41047] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,41047,1676491307558; zookeeper connection closed. 2023-02-15 20:01:51,010 ERROR [Listener at localhost/44509-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@2409ad19 rejected from java.util.concurrent.ThreadPoolExecutor@7f8516ca[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 19] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-15 20:01:51,010 DEBUG [Listener at localhost/44509-EventThread] zookeeper.ZKWatcher(600): regionserver:41047-0x100599323860002, quorum=127.0.0.1:53662, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-15 20:01:51,010 ERROR [Listener at localhost/44509-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@5c9329ba rejected from java.util.concurrent.ThreadPoolExecutor@7f8516ca[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 19] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-15 20:01:51,010 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@5d84b2f3] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@5d84b2f3 2023-02-15 20:01:51,110 DEBUG [Listener at localhost/44509-EventThread] zookeeper.ZKWatcher(600): regionserver:44675-0x100599323860001, quorum=127.0.0.1:53662, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-15 20:01:51,110 INFO [RS:0;jenkins-hbase4:44675] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,44675,1676491307532; zookeeper connection closed. 2023-02-15 20:01:51,110 ERROR [Listener at localhost/44509-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@59f9ee3c rejected from java.util.concurrent.ThreadPoolExecutor@f45bb21[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-15 20:01:51,110 DEBUG [Listener at localhost/44509-EventThread] zookeeper.ZKWatcher(600): regionserver:44675-0x100599323860001, quorum=127.0.0.1:53662, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-15 20:01:51,110 ERROR [Listener at localhost/44509-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@1197a079 rejected from java.util.concurrent.ThreadPoolExecutor@f45bb21[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-15 20:01:51,110 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@666bd66] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@666bd66 2023-02-15 20:01:51,110 INFO [Listener at localhost/44509] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 2 regionserver(s) complete 2023-02-15 20:01:51,111 WARN [Listener at localhost/44509] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-15 20:01:51,114 INFO [Listener at localhost/44509] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-15 20:01:51,224 WARN [BP-1528970134-172.31.14.131-1676491306831 heartbeating to localhost/127.0.0.1:43713] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-15 20:01:51,224 WARN [BP-1528970134-172.31.14.131-1676491306831 heartbeating to localhost/127.0.0.1:43713] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1528970134-172.31.14.131-1676491306831 (Datanode Uuid 9d641c39-b67d-4dbf-a4f6-9cfe76e13e3b) service to localhost/127.0.0.1:43713 2023-02-15 20:01:51,225 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ac5c756a-6485-ac70-7138-b3e6db6d6010/cluster_9f2cb9c2-f4e9-5557-56de-ad895dec4706/dfs/data/data3/current/BP-1528970134-172.31.14.131-1676491306831] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-15 20:01:51,226 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ac5c756a-6485-ac70-7138-b3e6db6d6010/cluster_9f2cb9c2-f4e9-5557-56de-ad895dec4706/dfs/data/data4/current/BP-1528970134-172.31.14.131-1676491306831] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-15 20:01:51,228 WARN [Listener at localhost/44509] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-15 20:01:51,235 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-datanode.properties,hadoop-metrics2.properties 2023-02-15 20:01:51,284 INFO [Listener at localhost/44509] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-15 20:01:51,439 WARN [BP-1528970134-172.31.14.131-1676491306831 heartbeating to localhost/127.0.0.1:43713] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-15 20:01:51,439 WARN [BP-1528970134-172.31.14.131-1676491306831 heartbeating to localhost/127.0.0.1:43713] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1528970134-172.31.14.131-1676491306831 (Datanode Uuid b8b7ea5b-b871-4246-b0a7-cc26748effcd) service to localhost/127.0.0.1:43713 2023-02-15 20:01:51,440 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ac5c756a-6485-ac70-7138-b3e6db6d6010/cluster_9f2cb9c2-f4e9-5557-56de-ad895dec4706/dfs/data/data1/current/BP-1528970134-172.31.14.131-1676491306831] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-15 20:01:51,440 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ac5c756a-6485-ac70-7138-b3e6db6d6010/cluster_9f2cb9c2-f4e9-5557-56de-ad895dec4706/dfs/data/data2/current/BP-1528970134-172.31.14.131-1676491306831] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-15 20:01:51,450 INFO [Listener at localhost/44509] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-15 20:01:51,464 INFO [Listener at localhost/44509] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-02-15 20:01:51,484 INFO [Listener at localhost/44509] hbase.HBaseTestingUtility(1293): Minicluster is down 2023-02-15 20:01:51,499 INFO [Listener at localhost/44509] hbase.ResourceChecker(175): after: mapred.TestTableSnapshotInputFormat#testRestoreSnapshotDoesNotCreateBackRefLinks Thread=275 (was 254) Potentially hanging thread: IPC Client (1185813668) connection to localhost/127.0.0.1:43713 from jenkins.hfs.11 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: IPC Client (1185813668) connection to localhost/127.0.0.1:43713 from jenkins.hfs.10 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-16 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-22-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-22-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/44509 java.lang.Thread.dumpThreads(Native Method) java.lang.Thread.getAllStackTraces(Thread.java:1615) org.apache.hadoop.hbase.ResourceCheckerJUnitListener$ThreadResourceAnalyzer.getVal(ResourceCheckerJUnitListener.java:49) org.apache.hadoop.hbase.ResourceChecker.fill(ResourceChecker.java:110) org.apache.hadoop.hbase.ResourceChecker.fillEndings(ResourceChecker.java:104) org.apache.hadoop.hbase.ResourceChecker.end(ResourceChecker.java:206) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.end(ResourceCheckerJUnitListener.java:165) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.testFinished(ResourceCheckerJUnitListener.java:185) org.junit.runner.notification.SynchronizedRunListener.testFinished(SynchronizedRunListener.java:87) org.junit.runner.notification.RunNotifier$9.notifyListener(RunNotifier.java:225) org.junit.runner.notification.RunNotifier$SafeNotifier.run(RunNotifier.java:72) org.junit.runner.notification.RunNotifier.fireTestFinished(RunNotifier.java:222) org.junit.internal.runners.model.EachTestNotifier.fireTestFinished(EachTestNotifier.java:38) org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:372) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) org.apache.hadoop.hbase.SystemExitRule$1.evaluate(SystemExitRule.java:39) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-24-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-19-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins@localhost:43713 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase4.apache.org,43791,1676491307476)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-24-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-25-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-24-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-25-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-22-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-18-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-18-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-25-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-20-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-18-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-23-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-20-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-19-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.10@localhost:43713 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-19-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1185813668) connection to localhost/127.0.0.1:43713 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-23-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ForkJoinPool-2-worker-7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.ForkJoinPool.awaitWork(ForkJoinPool.java:1824) java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1693) java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175) Potentially hanging thread: nioEventLoopGroup-23-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1185813668) connection to localhost/127.0.0.1:43713 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS-EventLoopGroup-20-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.11@localhost:43713 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=571 (was 656), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=300 (was 317), ProcessCount=170 (was 166) - ProcessCount LEAK? -, AvailableMemoryMB=2419 (was 2605) 2023-02-15 20:01:51,511 INFO [Listener at localhost/44509] hbase.ResourceChecker(147): before: mapred.TestTableSnapshotInputFormat#testWithMapReduceSingleRegion Thread=275, OpenFileDescriptor=571, MaxFileDescriptor=60000, SystemLoadAverage=300, ProcessCount=170, AvailableMemoryMB=2416 2023-02-15 20:01:51,522 INFO [Listener at localhost/44509] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.log.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ac5c756a-6485-ac70-7138-b3e6db6d6010/hadoop.log.dir so I do NOT create it in target/test-data/eacd1d03-335e-c6d1-b724-7feaec7840ae 2023-02-15 20:01:51,522 WARN [Listener at localhost/44509] hbase.HBaseTestingUtility(449): hadoop.log.dir property value differs in configuration and system: Configuration=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/../logs while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ac5c756a-6485-ac70-7138-b3e6db6d6010/hadoop.log.dir Erasing configuration value by system value. 2023-02-15 20:01:51,522 INFO [Listener at localhost/44509] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.tmp.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ac5c756a-6485-ac70-7138-b3e6db6d6010/hadoop.tmp.dir so I do NOT create it in target/test-data/eacd1d03-335e-c6d1-b724-7feaec7840ae 2023-02-15 20:01:51,522 WARN [Listener at localhost/44509] hbase.HBaseTestingUtility(449): hadoop.tmp.dir property value differs in configuration and system: Configuration=/tmp/hadoop-jenkins while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ac5c756a-6485-ac70-7138-b3e6db6d6010/hadoop.tmp.dir Erasing configuration value by system value. 2023-02-15 20:01:51,522 DEBUG [Listener at localhost/44509] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/eacd1d03-335e-c6d1-b724-7feaec7840ae 2023-02-15 20:01:51,522 INFO [Listener at localhost/44509] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=2, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=true, createWALDir=false} 2023-02-15 20:01:51,522 INFO [Listener at localhost/44509] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/eacd1d03-335e-c6d1-b724-7feaec7840ae/cluster_54d5b536-8ea4-6746-fe69-68a96ea4ed03, deleteOnExit=true 2023-02-15 20:01:51,522 INFO [Listener at localhost/44509] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-02-15 20:01:51,523 INFO [Listener at localhost/44509] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/eacd1d03-335e-c6d1-b724-7feaec7840ae/test.cache.data in system properties and HBase conf 2023-02-15 20:01:51,523 INFO [Listener at localhost/44509] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/eacd1d03-335e-c6d1-b724-7feaec7840ae/hadoop.tmp.dir in system properties and HBase conf 2023-02-15 20:01:51,523 INFO [Listener at localhost/44509] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/eacd1d03-335e-c6d1-b724-7feaec7840ae/hadoop.log.dir in system properties and HBase conf 2023-02-15 20:01:51,523 INFO [Listener at localhost/44509] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/eacd1d03-335e-c6d1-b724-7feaec7840ae/mapreduce.cluster.local.dir in system properties and HBase conf 2023-02-15 20:01:51,523 INFO [Listener at localhost/44509] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/eacd1d03-335e-c6d1-b724-7feaec7840ae/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-02-15 20:01:51,523 INFO [Listener at localhost/44509] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-02-15 20:01:51,523 DEBUG [Listener at localhost/44509] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-02-15 20:01:51,524 INFO [Listener at localhost/44509] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/eacd1d03-335e-c6d1-b724-7feaec7840ae/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-02-15 20:01:51,524 INFO [Listener at localhost/44509] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/eacd1d03-335e-c6d1-b724-7feaec7840ae/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-02-15 20:01:51,524 INFO [Listener at localhost/44509] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/eacd1d03-335e-c6d1-b724-7feaec7840ae/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-02-15 20:01:51,524 INFO [Listener at localhost/44509] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/eacd1d03-335e-c6d1-b724-7feaec7840ae/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-15 20:01:51,525 INFO [Listener at localhost/44509] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/eacd1d03-335e-c6d1-b724-7feaec7840ae/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-02-15 20:01:51,525 INFO [Listener at localhost/44509] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/eacd1d03-335e-c6d1-b724-7feaec7840ae/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-02-15 20:01:51,525 INFO [Listener at localhost/44509] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/eacd1d03-335e-c6d1-b724-7feaec7840ae/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-15 20:01:51,525 INFO [Listener at localhost/44509] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/eacd1d03-335e-c6d1-b724-7feaec7840ae/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-15 20:01:51,525 INFO [Listener at localhost/44509] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/eacd1d03-335e-c6d1-b724-7feaec7840ae/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-02-15 20:01:51,525 INFO [Listener at localhost/44509] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/eacd1d03-335e-c6d1-b724-7feaec7840ae/nfs.dump.dir in system properties and HBase conf 2023-02-15 20:01:51,525 INFO [Listener at localhost/44509] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/eacd1d03-335e-c6d1-b724-7feaec7840ae/java.io.tmpdir in system properties and HBase conf 2023-02-15 20:01:51,526 INFO [Listener at localhost/44509] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/eacd1d03-335e-c6d1-b724-7feaec7840ae/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-15 20:01:51,526 INFO [Listener at localhost/44509] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/eacd1d03-335e-c6d1-b724-7feaec7840ae/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-02-15 20:01:51,526 INFO [Listener at localhost/44509] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/eacd1d03-335e-c6d1-b724-7feaec7840ae/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-02-15 20:01:51,530 WARN [Listener at localhost/44509] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-15 20:01:51,530 WARN [Listener at localhost/44509] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-15 20:01:51,580 WARN [Listener at localhost/44509] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-15 20:01:51,582 INFO [Listener at localhost/44509] log.Slf4jLog(67): jetty-6.1.26 2023-02-15 20:01:51,591 INFO [Listener at localhost/44509] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/eacd1d03-335e-c6d1-b724-7feaec7840ae/java.io.tmpdir/Jetty_localhost_46307_hdfs____.rxy466/webapp 2023-02-15 20:01:51,716 INFO [Listener at localhost/44509] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:46307 2023-02-15 20:01:51,721 WARN [Listener at localhost/44509] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-15 20:01:51,721 WARN [Listener at localhost/44509] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-15 20:01:51,771 WARN [Listener at localhost/42419] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-15 20:01:51,792 WARN [Listener at localhost/42419] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-15 20:01:51,793 WARN [Listener at localhost/42419] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-15 20:01:51,795 INFO [Listener at localhost/42419] log.Slf4jLog(67): jetty-6.1.26 2023-02-15 20:01:51,802 INFO [Listener at localhost/42419] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/eacd1d03-335e-c6d1-b724-7feaec7840ae/java.io.tmpdir/Jetty_localhost_45601_datanode____.qebzpf/webapp 2023-02-15 20:01:51,936 INFO [Listener at localhost/42419] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:45601 2023-02-15 20:01:51,972 WARN [Listener at localhost/36833] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-15 20:01:52,027 WARN [Listener at localhost/36833] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-15 20:01:52,030 WARN [Listener at localhost/36833] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-15 20:01:52,035 INFO [Listener at localhost/36833] log.Slf4jLog(67): jetty-6.1.26 2023-02-15 20:01:52,043 INFO [Listener at localhost/36833] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/eacd1d03-335e-c6d1-b724-7feaec7840ae/java.io.tmpdir/Jetty_localhost_43315_datanode____tzehzz/webapp 2023-02-15 20:01:52,131 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x6c74d91167bc70b2: Processing first storage report for DS-24343e8f-c02b-4fbb-92f7-734fd573caf7 from datanode e0715e09-6935-41cc-a3e9-fa1113839e21 2023-02-15 20:01:52,131 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x6c74d91167bc70b2: from storage DS-24343e8f-c02b-4fbb-92f7-734fd573caf7 node DatanodeRegistration(127.0.0.1:36915, datanodeUuid=e0715e09-6935-41cc-a3e9-fa1113839e21, infoPort=38897, infoSecurePort=0, ipcPort=36833, storageInfo=lv=-57;cid=testClusterID;nsid=1787233019;c=1676491311533), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-15 20:01:52,131 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x6c74d91167bc70b2: Processing first storage report for DS-85de6948-2e61-47db-9662-88d21a014d9a from datanode e0715e09-6935-41cc-a3e9-fa1113839e21 2023-02-15 20:01:52,131 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x6c74d91167bc70b2: from storage DS-85de6948-2e61-47db-9662-88d21a014d9a node DatanodeRegistration(127.0.0.1:36915, datanodeUuid=e0715e09-6935-41cc-a3e9-fa1113839e21, infoPort=38897, infoSecurePort=0, ipcPort=36833, storageInfo=lv=-57;cid=testClusterID;nsid=1787233019;c=1676491311533), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-15 20:01:52,189 INFO [Listener at localhost/36833] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:43315 2023-02-15 20:01:52,202 WARN [Listener at localhost/45643] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-15 20:01:52,309 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x8fa21953328d110f: Processing first storage report for DS-2886dbf0-3611-4529-a5cf-c8371ef19ae8 from datanode 3f04f731-c739-4cb9-abe5-fe196937c4b5 2023-02-15 20:01:52,309 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x8fa21953328d110f: from storage DS-2886dbf0-3611-4529-a5cf-c8371ef19ae8 node DatanodeRegistration(127.0.0.1:35243, datanodeUuid=3f04f731-c739-4cb9-abe5-fe196937c4b5, infoPort=37443, infoSecurePort=0, ipcPort=45643, storageInfo=lv=-57;cid=testClusterID;nsid=1787233019;c=1676491311533), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-15 20:01:52,310 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x8fa21953328d110f: Processing first storage report for DS-790c7226-1b01-40d9-aeb5-0b79bb80a7dd from datanode 3f04f731-c739-4cb9-abe5-fe196937c4b5 2023-02-15 20:01:52,310 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x8fa21953328d110f: from storage DS-790c7226-1b01-40d9-aeb5-0b79bb80a7dd node DatanodeRegistration(127.0.0.1:35243, datanodeUuid=3f04f731-c739-4cb9-abe5-fe196937c4b5, infoPort=37443, infoSecurePort=0, ipcPort=45643, storageInfo=lv=-57;cid=testClusterID;nsid=1787233019;c=1676491311533), blocks: 0, hasStaleStorage: false, processing time: 1 msecs, invalidatedBlocks: 0 2023-02-15 20:01:52,331 DEBUG [Listener at localhost/45643] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/eacd1d03-335e-c6d1-b724-7feaec7840ae 2023-02-15 20:01:52,333 INFO [Listener at localhost/45643] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/eacd1d03-335e-c6d1-b724-7feaec7840ae/cluster_54d5b536-8ea4-6746-fe69-68a96ea4ed03/zookeeper_0, clientPort=51396, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/eacd1d03-335e-c6d1-b724-7feaec7840ae/cluster_54d5b536-8ea4-6746-fe69-68a96ea4ed03/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/eacd1d03-335e-c6d1-b724-7feaec7840ae/cluster_54d5b536-8ea4-6746-fe69-68a96ea4ed03/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-02-15 20:01:52,334 INFO [Listener at localhost/45643] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=51396 2023-02-15 20:01:52,334 INFO [Listener at localhost/45643] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-15 20:01:52,335 INFO [Listener at localhost/45643] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-15 20:01:52,351 INFO [Listener at localhost/45643] util.FSUtils(479): Created version file at hdfs://localhost:42419/user/jenkins/test-data/6193eb18-18c5-1507-512e-fcc3d8d85808 with version=8 2023-02-15 20:01:52,352 INFO [Listener at localhost/45643] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-15 20:01:52,352 INFO [Listener at localhost/45643] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-15 20:01:52,353 INFO [Listener at localhost/45643] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:42419/user/jenkins/test-data/73d2f27f-d0dd-241a-d274-9ec62cc68209/hbase-staging 2023-02-15 20:01:52,355 INFO [Listener at localhost/45643] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-02-15 20:01:52,355 INFO [Listener at localhost/45643] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-15 20:01:52,355 INFO [Listener at localhost/45643] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-15 20:01:52,355 INFO [Listener at localhost/45643] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-15 20:01:52,355 INFO [Listener at localhost/45643] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-15 20:01:52,356 INFO [Listener at localhost/45643] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-15 20:01:52,356 INFO [Listener at localhost/45643] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-02-15 20:01:52,356 INFO [Listener at localhost/45643] ipc.NettyRpcServer(120): Bind to /172.31.14.131:45745 2023-02-15 20:01:52,357 INFO [Listener at localhost/45643] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-15 20:01:52,357 INFO [Listener at localhost/45643] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-15 20:01:52,358 INFO [Listener at localhost/45643] zookeeper.RecoverableZooKeeper(93): Process identifier=master:45745 connecting to ZooKeeper ensemble=127.0.0.1:51396 2023-02-15 20:01:52,364 DEBUG [Listener at localhost/45643-EventThread] zookeeper.ZKWatcher(600): master:457450x0, quorum=127.0.0.1:51396, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-15 20:01:52,365 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): master:45745-0x100599336920000 connected 2023-02-15 20:01:52,387 DEBUG [Listener at localhost/45643] zookeeper.ZKUtil(164): master:45745-0x100599336920000, quorum=127.0.0.1:51396, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-15 20:01:52,388 DEBUG [Listener at localhost/45643] zookeeper.ZKUtil(164): master:45745-0x100599336920000, quorum=127.0.0.1:51396, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-15 20:01:52,388 DEBUG [Listener at localhost/45643] zookeeper.ZKUtil(164): master:45745-0x100599336920000, quorum=127.0.0.1:51396, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-15 20:01:52,394 DEBUG [Listener at localhost/45643] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=45745 2023-02-15 20:01:52,394 DEBUG [Listener at localhost/45643] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=45745 2023-02-15 20:01:52,395 DEBUG [Listener at localhost/45643] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=45745 2023-02-15 20:01:52,403 DEBUG [Listener at localhost/45643] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=45745 2023-02-15 20:01:52,403 DEBUG [Listener at localhost/45643] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=45745 2023-02-15 20:01:52,403 INFO [Listener at localhost/45643] master.HMaster(444): hbase.rootdir=hdfs://localhost:42419/user/jenkins/test-data/6193eb18-18c5-1507-512e-fcc3d8d85808, hbase.cluster.distributed=false 2023-02-15 20:01:52,416 INFO [Listener at localhost/45643] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-15 20:01:52,416 INFO [Listener at localhost/45643] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-15 20:01:52,416 INFO [Listener at localhost/45643] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-15 20:01:52,416 INFO [Listener at localhost/45643] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-15 20:01:52,416 INFO [Listener at localhost/45643] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-15 20:01:52,417 INFO [Listener at localhost/45643] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-15 20:01:52,417 INFO [Listener at localhost/45643] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-15 20:01:52,418 INFO [Listener at localhost/45643] ipc.NettyRpcServer(120): Bind to /172.31.14.131:46217 2023-02-15 20:01:52,419 INFO [Listener at localhost/45643] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-15 20:01:52,420 DEBUG [Listener at localhost/45643] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-15 20:01:52,420 INFO [Listener at localhost/45643] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-15 20:01:52,421 INFO [Listener at localhost/45643] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-15 20:01:52,422 INFO [Listener at localhost/45643] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:46217 connecting to ZooKeeper ensemble=127.0.0.1:51396 2023-02-15 20:01:52,424 DEBUG [Listener at localhost/45643-EventThread] zookeeper.ZKWatcher(600): regionserver:462170x0, quorum=127.0.0.1:51396, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-15 20:01:52,426 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:46217-0x100599336920001 connected 2023-02-15 20:01:52,427 DEBUG [Listener at localhost/45643] zookeeper.ZKUtil(164): regionserver:46217-0x100599336920001, quorum=127.0.0.1:51396, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-15 20:01:52,428 DEBUG [Listener at localhost/45643] zookeeper.ZKUtil(164): regionserver:46217-0x100599336920001, quorum=127.0.0.1:51396, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-15 20:01:52,428 DEBUG [Listener at localhost/45643] zookeeper.ZKUtil(164): regionserver:46217-0x100599336920001, quorum=127.0.0.1:51396, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-15 20:01:52,433 DEBUG [Listener at localhost/45643] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=46217 2023-02-15 20:01:52,433 DEBUG [Listener at localhost/45643] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=46217 2023-02-15 20:01:52,438 DEBUG [Listener at localhost/45643] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=46217 2023-02-15 20:01:52,443 DEBUG [Listener at localhost/45643] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=46217 2023-02-15 20:01:52,443 DEBUG [Listener at localhost/45643] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=46217 2023-02-15 20:01:52,456 INFO [Listener at localhost/45643] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-15 20:01:52,456 INFO [Listener at localhost/45643] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-15 20:01:52,456 INFO [Listener at localhost/45643] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-15 20:01:52,456 INFO [Listener at localhost/45643] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-15 20:01:52,456 INFO [Listener at localhost/45643] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-15 20:01:52,457 INFO [Listener at localhost/45643] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-15 20:01:52,457 INFO [Listener at localhost/45643] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-15 20:01:52,457 INFO [Listener at localhost/45643] ipc.NettyRpcServer(120): Bind to /172.31.14.131:35725 2023-02-15 20:01:52,458 INFO [Listener at localhost/45643] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-15 20:01:52,458 DEBUG [Listener at localhost/45643] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-15 20:01:52,458 INFO [Listener at localhost/45643] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-15 20:01:52,459 INFO [Listener at localhost/45643] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-15 20:01:52,460 INFO [Listener at localhost/45643] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:35725 connecting to ZooKeeper ensemble=127.0.0.1:51396 2023-02-15 20:01:52,464 DEBUG [Listener at localhost/45643-EventThread] zookeeper.ZKWatcher(600): regionserver:357250x0, quorum=127.0.0.1:51396, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-15 20:01:52,465 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:35725-0x100599336920002 connected 2023-02-15 20:01:52,465 DEBUG [Listener at localhost/45643] zookeeper.ZKUtil(164): regionserver:35725-0x100599336920002, quorum=127.0.0.1:51396, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-15 20:01:52,466 DEBUG [Listener at localhost/45643] zookeeper.ZKUtil(164): regionserver:35725-0x100599336920002, quorum=127.0.0.1:51396, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-15 20:01:52,466 DEBUG [Listener at localhost/45643] zookeeper.ZKUtil(164): regionserver:35725-0x100599336920002, quorum=127.0.0.1:51396, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-15 20:01:52,466 DEBUG [Listener at localhost/45643] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=35725 2023-02-15 20:01:52,467 DEBUG [Listener at localhost/45643] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=35725 2023-02-15 20:01:52,468 DEBUG [Listener at localhost/45643] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=35725 2023-02-15 20:01:52,468 DEBUG [Listener at localhost/45643] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=35725 2023-02-15 20:01:52,468 DEBUG [Listener at localhost/45643] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=35725 2023-02-15 20:01:52,470 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,45745,1676491312355 2023-02-15 20:01:52,472 DEBUG [Listener at localhost/45643-EventThread] zookeeper.ZKWatcher(600): master:45745-0x100599336920000, quorum=127.0.0.1:51396, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-15 20:01:52,472 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:45745-0x100599336920000, quorum=127.0.0.1:51396, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,45745,1676491312355 2023-02-15 20:01:52,473 DEBUG [Listener at localhost/45643-EventThread] zookeeper.ZKWatcher(600): regionserver:46217-0x100599336920001, quorum=127.0.0.1:51396, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-15 20:01:52,473 DEBUG [Listener at localhost/45643-EventThread] zookeeper.ZKWatcher(600): master:45745-0x100599336920000, quorum=127.0.0.1:51396, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-15 20:01:52,473 DEBUG [Listener at localhost/45643-EventThread] zookeeper.ZKWatcher(600): regionserver:35725-0x100599336920002, quorum=127.0.0.1:51396, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-15 20:01:52,475 DEBUG [Listener at localhost/45643-EventThread] zookeeper.ZKWatcher(600): master:45745-0x100599336920000, quorum=127.0.0.1:51396, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-15 20:01:52,475 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:45745-0x100599336920000, quorum=127.0.0.1:51396, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-15 20:01:52,477 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,45745,1676491312355 from backup master directory 2023-02-15 20:01:52,478 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:45745-0x100599336920000, quorum=127.0.0.1:51396, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-15 20:01:52,478 DEBUG [Listener at localhost/45643-EventThread] zookeeper.ZKWatcher(600): master:45745-0x100599336920000, quorum=127.0.0.1:51396, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,45745,1676491312355 2023-02-15 20:01:52,478 DEBUG [Listener at localhost/45643-EventThread] zookeeper.ZKWatcher(600): master:45745-0x100599336920000, quorum=127.0.0.1:51396, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-15 20:01:52,478 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-15 20:01:52,478 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase4.apache.org,45745,1676491312355 2023-02-15 20:01:52,492 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(628): Created cluster ID file at hdfs://localhost:42419/user/jenkins/test-data/6193eb18-18c5-1507-512e-fcc3d8d85808/hbase.id with ID: 69a5c8c3-2f7b-496a-96d6-a916fe1e829a 2023-02-15 20:01:52,501 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-15 20:01:52,505 DEBUG [Listener at localhost/45643-EventThread] zookeeper.ZKWatcher(600): master:45745-0x100599336920000, quorum=127.0.0.1:51396, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-15 20:01:52,516 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x33449770 to 127.0.0.1:51396 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-15 20:01:52,519 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7370e5ce, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-15 20:01:52,519 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-15 20:01:52,520 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-02-15 20:01:52,520 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-15 20:01:52,521 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7689): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:42419/user/jenkins/test-data/6193eb18-18c5-1507-512e-fcc3d8d85808/MasterData/data/master/store-tmp 2023-02-15 20:01:52,530 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 20:01:52,530 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-15 20:01:52,530 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-15 20:01:52,530 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-15 20:01:52,530 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-15 20:01:52,530 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-15 20:01:52,530 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-15 20:01:52,530 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-15 20:01:52,531 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:42419/user/jenkins/test-data/6193eb18-18c5-1507-512e-fcc3d8d85808/MasterData/WALs/jenkins-hbase4.apache.org,45745,1676491312355 2023-02-15 20:01:52,533 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C45745%2C1676491312355, suffix=, logDir=hdfs://localhost:42419/user/jenkins/test-data/6193eb18-18c5-1507-512e-fcc3d8d85808/MasterData/WALs/jenkins-hbase4.apache.org,45745,1676491312355, archiveDir=hdfs://localhost:42419/user/jenkins/test-data/6193eb18-18c5-1507-512e-fcc3d8d85808/MasterData/oldWALs, maxLogs=10 2023-02-15 20:01:52,546 DEBUG [RS-EventLoopGroup-23-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35243,DS-2886dbf0-3611-4529-a5cf-c8371ef19ae8,DISK] 2023-02-15 20:01:52,546 DEBUG [RS-EventLoopGroup-23-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36915,DS-24343e8f-c02b-4fbb-92f7-734fd573caf7,DISK] 2023-02-15 20:01:52,549 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/6193eb18-18c5-1507-512e-fcc3d8d85808/MasterData/WALs/jenkins-hbase4.apache.org,45745,1676491312355/jenkins-hbase4.apache.org%2C45745%2C1676491312355.1676491312533 2023-02-15 20:01:52,549 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:35243,DS-2886dbf0-3611-4529-a5cf-c8371ef19ae8,DISK], DatanodeInfoWithStorage[127.0.0.1:36915,DS-24343e8f-c02b-4fbb-92f7-734fd573caf7,DISK]] 2023-02-15 20:01:52,549 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7850): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-02-15 20:01:52,549 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 20:01:52,549 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7890): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-02-15 20:01:52,549 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7893): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-02-15 20:01:52,550 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-02-15 20:01:52,551 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42419/user/jenkins/test-data/6193eb18-18c5-1507-512e-fcc3d8d85808/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-02-15 20:01:52,551 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-02-15 20:01:52,552 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 20:01:52,552 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:42419/user/jenkins/test-data/6193eb18-18c5-1507-512e-fcc3d8d85808/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-15 20:01:52,553 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:42419/user/jenkins/test-data/6193eb18-18c5-1507-512e-fcc3d8d85808/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-15 20:01:52,555 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1054): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-02-15 20:01:52,556 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42419/user/jenkins/test-data/6193eb18-18c5-1507-512e-fcc3d8d85808/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-15 20:01:52,557 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1071): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64181616, jitterRate=-0.043619394302368164}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-15 20:01:52,557 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(964): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-15 20:01:52,557 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-02-15 20:01:52,559 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-02-15 20:01:52,559 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-02-15 20:01:52,559 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-02-15 20:01:52,559 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 0 msec 2023-02-15 20:01:52,559 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 0 msec 2023-02-15 20:01:52,559 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(95): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-02-15 20:01:52,561 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-02-15 20:01:52,562 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-02-15 20:01:52,573 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-02-15 20:01:52,573 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-02-15 20:01:52,576 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:45745-0x100599336920000, quorum=127.0.0.1:51396, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-02-15 20:01:52,577 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-02-15 20:01:52,578 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:45745-0x100599336920000, quorum=127.0.0.1:51396, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-02-15 20:01:52,587 DEBUG [Listener at localhost/45643-EventThread] zookeeper.ZKWatcher(600): master:45745-0x100599336920000, quorum=127.0.0.1:51396, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-15 20:01:52,593 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:45745-0x100599336920000, quorum=127.0.0.1:51396, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-02-15 20:01:52,594 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:45745-0x100599336920000, quorum=127.0.0.1:51396, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-02-15 20:01:52,596 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:45745-0x100599336920000, quorum=127.0.0.1:51396, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-02-15 20:01:52,599 DEBUG [Listener at localhost/45643-EventThread] zookeeper.ZKWatcher(600): regionserver:46217-0x100599336920001, quorum=127.0.0.1:51396, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-15 20:01:52,599 DEBUG [Listener at localhost/45643-EventThread] zookeeper.ZKWatcher(600): master:45745-0x100599336920000, quorum=127.0.0.1:51396, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-15 20:01:52,599 DEBUG [Listener at localhost/45643-EventThread] zookeeper.ZKWatcher(600): master:45745-0x100599336920000, quorum=127.0.0.1:51396, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-15 20:01:52,599 DEBUG [Listener at localhost/45643-EventThread] zookeeper.ZKWatcher(600): regionserver:35725-0x100599336920002, quorum=127.0.0.1:51396, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-15 20:01:52,604 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase4.apache.org,45745,1676491312355, sessionid=0x100599336920000, setting cluster-up flag (Was=false) 2023-02-15 20:01:52,607 DEBUG [Listener at localhost/45643-EventThread] zookeeper.ZKWatcher(600): master:45745-0x100599336920000, quorum=127.0.0.1:51396, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-15 20:01:52,620 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-02-15 20:01:52,621 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,45745,1676491312355 2023-02-15 20:01:52,627 DEBUG [Listener at localhost/45643-EventThread] zookeeper.ZKWatcher(600): master:45745-0x100599336920000, quorum=127.0.0.1:51396, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-15 20:01:52,632 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-02-15 20:01:52,632 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,45745,1676491312355 2023-02-15 20:01:52,633 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:42419/user/jenkins/test-data/6193eb18-18c5-1507-512e-fcc3d8d85808/.hbase-snapshot/.tmp 2023-02-15 20:01:52,635 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-02-15 20:01:52,635 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-15 20:01:52,635 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-15 20:01:52,635 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-15 20:01:52,635 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-15 20:01:52,635 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-02-15 20:01:52,635 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 20:01:52,635 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-15 20:01:52,635 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 20:01:52,644 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1676491342644 2023-02-15 20:01:52,644 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-02-15 20:01:52,644 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-02-15 20:01:52,644 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-02-15 20:01:52,644 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-02-15 20:01:52,644 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-02-15 20:01:52,644 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-02-15 20:01:52,645 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-02-15 20:01:52,645 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-02-15 20:01:52,646 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-15 20:01:52,649 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-15 20:01:52,653 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-02-15 20:01:52,653 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-02-15 20:01:52,653 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-02-15 20:01:52,654 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-02-15 20:01:52,654 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-02-15 20:01:52,656 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676491312656,5,FailOnTimeoutGroup] 2023-02-15 20:01:52,660 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676491312656,5,FailOnTimeoutGroup] 2023-02-15 20:01:52,660 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-15 20:01:52,660 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-02-15 20:01:52,660 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-02-15 20:01:52,660 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-02-15 20:01:52,664 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:42419/user/jenkins/test-data/6193eb18-18c5-1507-512e-fcc3d8d85808/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-15 20:01:52,665 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:42419/user/jenkins/test-data/6193eb18-18c5-1507-512e-fcc3d8d85808/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-15 20:01:52,665 INFO [PEWorker-1] regionserver.HRegion(7671): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:42419/user/jenkins/test-data/6193eb18-18c5-1507-512e-fcc3d8d85808 2023-02-15 20:01:52,672 INFO [RS:0;jenkins-hbase4:46217] regionserver.HRegionServer(952): ClusterId : 69a5c8c3-2f7b-496a-96d6-a916fe1e829a 2023-02-15 20:01:52,672 DEBUG [RS:0;jenkins-hbase4:46217] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-15 20:01:52,674 DEBUG [RS:0;jenkins-hbase4:46217] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-15 20:01:52,674 DEBUG [RS:0;jenkins-hbase4:46217] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-15 20:01:52,676 DEBUG [RS:0;jenkins-hbase4:46217] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-15 20:01:52,677 DEBUG [RS:0;jenkins-hbase4:46217] zookeeper.ReadOnlyZKClient(139): Connect 0x565b818c to 127.0.0.1:51396 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-15 20:01:52,678 INFO [RS:1;jenkins-hbase4:35725] regionserver.HRegionServer(952): ClusterId : 69a5c8c3-2f7b-496a-96d6-a916fe1e829a 2023-02-15 20:01:52,678 DEBUG [RS:1;jenkins-hbase4:35725] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-15 20:01:52,680 DEBUG [RS:1;jenkins-hbase4:35725] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-15 20:01:52,681 DEBUG [RS:1;jenkins-hbase4:35725] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-15 20:01:52,682 DEBUG [RS:1;jenkins-hbase4:35725] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-15 20:01:52,685 DEBUG [RS:1;jenkins-hbase4:35725] zookeeper.ReadOnlyZKClient(139): Connect 0x6b9da0fd to 127.0.0.1:51396 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-15 20:01:52,694 DEBUG [RS:0;jenkins-hbase4:46217] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@589c6537, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-15 20:01:52,694 DEBUG [RS:0;jenkins-hbase4:46217] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5ca3eafc, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-15 20:01:52,708 DEBUG [PEWorker-1] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 20:01:52,710 DEBUG [RS:0;jenkins-hbase4:46217] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:46217 2023-02-15 20:01:52,710 INFO [RS:0;jenkins-hbase4:46217] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-15 20:01:52,710 INFO [RS:0;jenkins-hbase4:46217] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-15 20:01:52,710 DEBUG [RS:0;jenkins-hbase4:46217] regionserver.HRegionServer(1023): About to register with Master. 2023-02-15 20:01:52,711 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-15 20:01:52,711 DEBUG [RS:1;jenkins-hbase4:35725] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@655a43fe, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-15 20:01:52,711 DEBUG [RS:1;jenkins-hbase4:35725] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6165cb8d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-15 20:01:52,712 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42419/user/jenkins/test-data/6193eb18-18c5-1507-512e-fcc3d8d85808/data/hbase/meta/1588230740/info 2023-02-15 20:01:52,712 INFO [RS:0;jenkins-hbase4:46217] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,45745,1676491312355 with isa=jenkins-hbase4.apache.org/172.31.14.131:46217, startcode=1676491312415 2023-02-15 20:01:52,712 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-15 20:01:52,713 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 20:01:52,713 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-15 20:01:52,714 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42419/user/jenkins/test-data/6193eb18-18c5-1507-512e-fcc3d8d85808/data/hbase/meta/1588230740/rep_barrier 2023-02-15 20:01:52,715 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-15 20:01:52,715 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 20:01:52,715 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-15 20:01:52,716 DEBUG [RS:0;jenkins-hbase4:46217] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-15 20:01:52,716 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42419/user/jenkins/test-data/6193eb18-18c5-1507-512e-fcc3d8d85808/data/hbase/meta/1588230740/table 2023-02-15 20:01:52,717 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-15 20:01:52,717 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 20:01:52,720 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:42419/user/jenkins/test-data/6193eb18-18c5-1507-512e-fcc3d8d85808/data/hbase/meta/1588230740 2023-02-15 20:01:52,721 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:42419/user/jenkins/test-data/6193eb18-18c5-1507-512e-fcc3d8d85808/data/hbase/meta/1588230740 2023-02-15 20:01:52,722 INFO [RS-EventLoopGroup-21-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55107, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.12 (auth:SIMPLE), service=RegionServerStatusService 2023-02-15 20:01:52,724 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45745] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,46217,1676491312415 2023-02-15 20:01:52,725 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-15 20:01:52,726 DEBUG [RS:1;jenkins-hbase4:35725] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:35725 2023-02-15 20:01:52,726 INFO [RS:1;jenkins-hbase4:35725] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-15 20:01:52,726 INFO [RS:1;jenkins-hbase4:35725] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-15 20:01:52,726 DEBUG [RS:1;jenkins-hbase4:35725] regionserver.HRegionServer(1023): About to register with Master. 2023-02-15 20:01:52,726 DEBUG [RS:0;jenkins-hbase4:46217] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:42419/user/jenkins/test-data/6193eb18-18c5-1507-512e-fcc3d8d85808 2023-02-15 20:01:52,726 DEBUG [RS:0;jenkins-hbase4:46217] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:42419 2023-02-15 20:01:52,727 DEBUG [RS:0;jenkins-hbase4:46217] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-15 20:01:52,727 INFO [RS:1;jenkins-hbase4:35725] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,45745,1676491312355 with isa=jenkins-hbase4.apache.org/172.31.14.131:35725, startcode=1676491312455 2023-02-15 20:01:52,727 DEBUG [RS:1;jenkins-hbase4:35725] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-15 20:01:52,729 DEBUG [PEWorker-1] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-15 20:01:52,731 DEBUG [Listener at localhost/45643-EventThread] zookeeper.ZKWatcher(600): master:45745-0x100599336920000, quorum=127.0.0.1:51396, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-15 20:01:52,731 DEBUG [RS:0;jenkins-hbase4:46217] zookeeper.ZKUtil(162): regionserver:46217-0x100599336920001, quorum=127.0.0.1:51396, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,46217,1676491312415 2023-02-15 20:01:52,732 WARN [RS:0;jenkins-hbase4:46217] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-15 20:01:52,732 INFO [RS:0;jenkins-hbase4:46217] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-15 20:01:52,732 DEBUG [RS:0;jenkins-hbase4:46217] regionserver.HRegionServer(1947): logDir=hdfs://localhost:42419/user/jenkins/test-data/6193eb18-18c5-1507-512e-fcc3d8d85808/WALs/jenkins-hbase4.apache.org,46217,1676491312415 2023-02-15 20:01:52,736 INFO [RS-EventLoopGroup-21-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50839, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.13 (auth:SIMPLE), service=RegionServerStatusService 2023-02-15 20:01:52,737 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45745] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,35725,1676491312455 2023-02-15 20:01:52,737 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42419/user/jenkins/test-data/6193eb18-18c5-1507-512e-fcc3d8d85808/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-15 20:01:52,738 DEBUG [RS:1;jenkins-hbase4:35725] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:42419/user/jenkins/test-data/6193eb18-18c5-1507-512e-fcc3d8d85808 2023-02-15 20:01:52,738 DEBUG [RS:1;jenkins-hbase4:35725] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:42419 2023-02-15 20:01:52,738 DEBUG [RS:1;jenkins-hbase4:35725] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-15 20:01:52,738 INFO [PEWorker-1] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63728656, jitterRate=-0.0503690242767334}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-15 20:01:52,738 DEBUG [PEWorker-1] regionserver.HRegion(964): Region open journal for 1588230740: 2023-02-15 20:01:52,738 DEBUG [PEWorker-1] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-15 20:01:52,738 INFO [PEWorker-1] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-15 20:01:52,738 DEBUG [PEWorker-1] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-15 20:01:52,738 DEBUG [PEWorker-1] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-15 20:01:52,738 DEBUG [PEWorker-1] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-15 20:01:52,741 INFO [PEWorker-1] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-15 20:01:52,741 DEBUG [PEWorker-1] regionserver.HRegion(1557): Region close journal for 1588230740: 2023-02-15 20:01:52,745 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,35725,1676491312455] 2023-02-15 20:01:52,745 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,46217,1676491312415] 2023-02-15 20:01:52,745 DEBUG [RS:1;jenkins-hbase4:35725] zookeeper.ZKUtil(162): regionserver:35725-0x100599336920002, quorum=127.0.0.1:51396, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,35725,1676491312455 2023-02-15 20:01:52,745 WARN [RS:1;jenkins-hbase4:35725] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-15 20:01:52,745 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-02-15 20:01:52,745 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-02-15 20:01:52,745 INFO [RS:1;jenkins-hbase4:35725] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-15 20:01:52,745 DEBUG [RS:1;jenkins-hbase4:35725] regionserver.HRegionServer(1947): logDir=hdfs://localhost:42419/user/jenkins/test-data/6193eb18-18c5-1507-512e-fcc3d8d85808/WALs/jenkins-hbase4.apache.org,35725,1676491312455 2023-02-15 20:01:52,745 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-02-15 20:01:52,746 DEBUG [RS:0;jenkins-hbase4:46217] zookeeper.ZKUtil(162): regionserver:46217-0x100599336920001, quorum=127.0.0.1:51396, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,35725,1676491312455 2023-02-15 20:01:52,746 DEBUG [RS:0;jenkins-hbase4:46217] zookeeper.ZKUtil(162): regionserver:46217-0x100599336920001, quorum=127.0.0.1:51396, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,46217,1676491312415 2023-02-15 20:01:52,747 DEBUG [RS:0;jenkins-hbase4:46217] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-15 20:01:52,747 INFO [RS:0;jenkins-hbase4:46217] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-15 20:01:52,757 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-02-15 20:01:52,757 INFO [RS:0;jenkins-hbase4:46217] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-15 20:01:52,760 INFO [RS:0;jenkins-hbase4:46217] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-15 20:01:52,760 INFO [RS:0;jenkins-hbase4:46217] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-15 20:01:52,760 INFO [RS:0;jenkins-hbase4:46217] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-15 20:01:52,768 INFO [RS:0;jenkins-hbase4:46217] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-15 20:01:52,769 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-02-15 20:01:52,769 DEBUG [RS:0;jenkins-hbase4:46217] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 20:01:52,770 DEBUG [RS:0;jenkins-hbase4:46217] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 20:01:52,770 DEBUG [RS:0;jenkins-hbase4:46217] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 20:01:52,770 DEBUG [RS:0;jenkins-hbase4:46217] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 20:01:52,770 DEBUG [RS:0;jenkins-hbase4:46217] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 20:01:52,770 DEBUG [RS:0;jenkins-hbase4:46217] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-15 20:01:52,770 DEBUG [RS:0;jenkins-hbase4:46217] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 20:01:52,770 DEBUG [RS:0;jenkins-hbase4:46217] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 20:01:52,770 DEBUG [RS:0;jenkins-hbase4:46217] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 20:01:52,770 DEBUG [RS:0;jenkins-hbase4:46217] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 20:01:52,771 DEBUG [RS:1;jenkins-hbase4:35725] zookeeper.ZKUtil(162): regionserver:35725-0x100599336920002, quorum=127.0.0.1:51396, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,35725,1676491312455 2023-02-15 20:01:52,772 DEBUG [RS:1;jenkins-hbase4:35725] zookeeper.ZKUtil(162): regionserver:35725-0x100599336920002, quorum=127.0.0.1:51396, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,46217,1676491312415 2023-02-15 20:01:52,773 DEBUG [RS:1;jenkins-hbase4:35725] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-15 20:01:52,773 INFO [RS:1;jenkins-hbase4:35725] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-15 20:01:52,780 INFO [RS:1;jenkins-hbase4:35725] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-15 20:01:52,784 INFO [RS:1;jenkins-hbase4:35725] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-15 20:01:52,785 INFO [RS:1;jenkins-hbase4:35725] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-15 20:01:52,787 INFO [RS:0;jenkins-hbase4:46217] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-15 20:01:52,787 INFO [RS:0;jenkins-hbase4:46217] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-15 20:01:52,787 INFO [RS:0;jenkins-hbase4:46217] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-15 20:01:52,789 INFO [RS:1;jenkins-hbase4:35725] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-15 20:01:52,790 INFO [RS:1;jenkins-hbase4:35725] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-15 20:01:52,790 DEBUG [RS:1;jenkins-hbase4:35725] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 20:01:52,790 DEBUG [RS:1;jenkins-hbase4:35725] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 20:01:52,790 DEBUG [RS:1;jenkins-hbase4:35725] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 20:01:52,790 DEBUG [RS:1;jenkins-hbase4:35725] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 20:01:52,790 DEBUG [RS:1;jenkins-hbase4:35725] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 20:01:52,790 DEBUG [RS:1;jenkins-hbase4:35725] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-15 20:01:52,790 DEBUG [RS:1;jenkins-hbase4:35725] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 20:01:52,790 DEBUG [RS:1;jenkins-hbase4:35725] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 20:01:52,790 DEBUG [RS:1;jenkins-hbase4:35725] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 20:01:52,790 DEBUG [RS:1;jenkins-hbase4:35725] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 20:01:52,811 INFO [RS:0;jenkins-hbase4:46217] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-15 20:01:52,811 INFO [RS:0;jenkins-hbase4:46217] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,46217,1676491312415-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-15 20:01:52,811 INFO [RS:1;jenkins-hbase4:35725] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-15 20:01:52,811 INFO [RS:1;jenkins-hbase4:35725] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-15 20:01:52,812 INFO [RS:1;jenkins-hbase4:35725] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-15 20:01:52,831 INFO [RS:1;jenkins-hbase4:35725] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-15 20:01:52,831 INFO [RS:1;jenkins-hbase4:35725] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,35725,1676491312455-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-15 20:01:52,839 INFO [RS:0;jenkins-hbase4:46217] regionserver.Replication(203): jenkins-hbase4.apache.org,46217,1676491312415 started 2023-02-15 20:01:52,840 INFO [RS:0;jenkins-hbase4:46217] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,46217,1676491312415, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:46217, sessionid=0x100599336920001 2023-02-15 20:01:52,840 DEBUG [RS:0;jenkins-hbase4:46217] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-15 20:01:52,840 DEBUG [RS:0;jenkins-hbase4:46217] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,46217,1676491312415 2023-02-15 20:01:52,840 DEBUG [RS:0;jenkins-hbase4:46217] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,46217,1676491312415' 2023-02-15 20:01:52,840 DEBUG [RS:0;jenkins-hbase4:46217] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-15 20:01:52,843 DEBUG [RS:0;jenkins-hbase4:46217] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-15 20:01:52,843 DEBUG [RS:0;jenkins-hbase4:46217] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-15 20:01:52,844 DEBUG [RS:0;jenkins-hbase4:46217] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-15 20:01:52,844 DEBUG [RS:0;jenkins-hbase4:46217] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,46217,1676491312415 2023-02-15 20:01:52,844 DEBUG [RS:0;jenkins-hbase4:46217] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,46217,1676491312415' 2023-02-15 20:01:52,844 DEBUG [RS:0;jenkins-hbase4:46217] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-15 20:01:52,845 DEBUG [RS:0;jenkins-hbase4:46217] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-15 20:01:52,845 DEBUG [RS:0;jenkins-hbase4:46217] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-15 20:01:52,845 INFO [RS:0;jenkins-hbase4:46217] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-15 20:01:52,845 INFO [RS:0;jenkins-hbase4:46217] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-15 20:01:52,846 INFO [RS:1;jenkins-hbase4:35725] regionserver.Replication(203): jenkins-hbase4.apache.org,35725,1676491312455 started 2023-02-15 20:01:52,846 INFO [RS:1;jenkins-hbase4:35725] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,35725,1676491312455, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:35725, sessionid=0x100599336920002 2023-02-15 20:01:52,846 DEBUG [RS:1;jenkins-hbase4:35725] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-15 20:01:52,846 DEBUG [RS:1;jenkins-hbase4:35725] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,35725,1676491312455 2023-02-15 20:01:52,846 DEBUG [RS:1;jenkins-hbase4:35725] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,35725,1676491312455' 2023-02-15 20:01:52,846 DEBUG [RS:1;jenkins-hbase4:35725] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-15 20:01:52,847 DEBUG [RS:1;jenkins-hbase4:35725] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-15 20:01:52,847 DEBUG [RS:1;jenkins-hbase4:35725] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-15 20:01:52,847 DEBUG [RS:1;jenkins-hbase4:35725] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-15 20:01:52,847 DEBUG [RS:1;jenkins-hbase4:35725] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,35725,1676491312455 2023-02-15 20:01:52,847 DEBUG [RS:1;jenkins-hbase4:35725] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,35725,1676491312455' 2023-02-15 20:01:52,847 DEBUG [RS:1;jenkins-hbase4:35725] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-15 20:01:52,850 DEBUG [RS:1;jenkins-hbase4:35725] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-15 20:01:52,850 DEBUG [RS:1;jenkins-hbase4:35725] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-15 20:01:52,850 INFO [RS:1;jenkins-hbase4:35725] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-15 20:01:52,850 INFO [RS:1;jenkins-hbase4:35725] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-15 20:01:52,920 DEBUG [jenkins-hbase4:45745] assignment.AssignmentManager(2178): Processing assignQueue; systemServersCount=2, allServersCount=2 2023-02-15 20:01:52,920 DEBUG [jenkins-hbase4:45745] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-15 20:01:52,922 DEBUG [jenkins-hbase4:45745] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-15 20:01:52,922 DEBUG [jenkins-hbase4:45745] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-15 20:01:52,922 DEBUG [jenkins-hbase4:45745] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-15 20:01:52,922 INFO [PEWorker-2] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,46217,1676491312415, state=OPENING 2023-02-15 20:01:52,924 DEBUG [PEWorker-2] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-02-15 20:01:52,929 DEBUG [Listener at localhost/45643-EventThread] zookeeper.ZKWatcher(600): master:45745-0x100599336920000, quorum=127.0.0.1:51396, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-15 20:01:52,929 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,46217,1676491312415}] 2023-02-15 20:01:52,929 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-15 20:01:53,089 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,46217,1676491312415 2023-02-15 20:01:53,089 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-15 20:01:53,098 INFO [RS-EventLoopGroup-22-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52538, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-15 20:01:53,102 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:meta,,1.1588230740 2023-02-15 20:01:53,103 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-15 20:01:53,104 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C46217%2C1676491312415.meta, suffix=.meta, logDir=hdfs://localhost:42419/user/jenkins/test-data/6193eb18-18c5-1507-512e-fcc3d8d85808/WALs/jenkins-hbase4.apache.org,46217,1676491312415, archiveDir=hdfs://localhost:42419/user/jenkins/test-data/6193eb18-18c5-1507-512e-fcc3d8d85808/oldWALs, maxLogs=32 2023-02-15 20:01:53,124 DEBUG [RS-EventLoopGroup-23-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35243,DS-2886dbf0-3611-4529-a5cf-c8371ef19ae8,DISK] 2023-02-15 20:01:53,124 DEBUG [RS-EventLoopGroup-23-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36915,DS-24343e8f-c02b-4fbb-92f7-734fd573caf7,DISK] 2023-02-15 20:01:53,128 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/6193eb18-18c5-1507-512e-fcc3d8d85808/WALs/jenkins-hbase4.apache.org,46217,1676491312415/jenkins-hbase4.apache.org%2C46217%2C1676491312415.meta.1676491313104.meta 2023-02-15 20:01:53,131 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:35243,DS-2886dbf0-3611-4529-a5cf-c8371ef19ae8,DISK], DatanodeInfoWithStorage[127.0.0.1:36915,DS-24343e8f-c02b-4fbb-92f7-734fd573caf7,DISK]] 2023-02-15 20:01:53,131 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-02-15 20:01:53,131 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-02-15 20:01:53,131 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8546): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-02-15 20:01:53,131 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-02-15 20:01:53,131 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-02-15 20:01:53,131 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 20:01:53,131 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 1588230740 2023-02-15 20:01:53,131 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 1588230740 2023-02-15 20:01:53,136 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-15 20:01:53,138 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42419/user/jenkins/test-data/6193eb18-18c5-1507-512e-fcc3d8d85808/data/hbase/meta/1588230740/info 2023-02-15 20:01:53,138 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42419/user/jenkins/test-data/6193eb18-18c5-1507-512e-fcc3d8d85808/data/hbase/meta/1588230740/info 2023-02-15 20:01:53,139 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-15 20:01:53,139 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 20:01:53,139 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-15 20:01:53,140 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42419/user/jenkins/test-data/6193eb18-18c5-1507-512e-fcc3d8d85808/data/hbase/meta/1588230740/rep_barrier 2023-02-15 20:01:53,140 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42419/user/jenkins/test-data/6193eb18-18c5-1507-512e-fcc3d8d85808/data/hbase/meta/1588230740/rep_barrier 2023-02-15 20:01:53,141 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-15 20:01:53,141 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 20:01:53,141 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-15 20:01:53,142 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42419/user/jenkins/test-data/6193eb18-18c5-1507-512e-fcc3d8d85808/data/hbase/meta/1588230740/table 2023-02-15 20:01:53,142 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42419/user/jenkins/test-data/6193eb18-18c5-1507-512e-fcc3d8d85808/data/hbase/meta/1588230740/table 2023-02-15 20:01:53,143 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-15 20:01:53,143 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 20:01:53,144 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:42419/user/jenkins/test-data/6193eb18-18c5-1507-512e-fcc3d8d85808/data/hbase/meta/1588230740 2023-02-15 20:01:53,145 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:42419/user/jenkins/test-data/6193eb18-18c5-1507-512e-fcc3d8d85808/data/hbase/meta/1588230740 2023-02-15 20:01:53,147 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-15 20:01:53,148 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-15 20:01:53,149 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72111805, jitterRate=0.07454963028430939}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-15 20:01:53,149 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 1588230740: 2023-02-15 20:01:53,150 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1676491313089 2023-02-15 20:01:53,154 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:meta,,1.1588230740 2023-02-15 20:01:53,156 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:meta,,1.1588230740 2023-02-15 20:01:53,158 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,46217,1676491312415, state=OPEN 2023-02-15 20:01:53,159 DEBUG [Listener at localhost/45643-EventThread] zookeeper.ZKWatcher(600): master:45745-0x100599336920000, quorum=127.0.0.1:51396, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-02-15 20:01:53,159 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-15 20:01:53,160 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-02-15 20:01:53,160 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,46217,1676491312415 in 230 msec 2023-02-15 20:01:53,162 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-02-15 20:01:53,162 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 415 msec 2023-02-15 20:01:53,163 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 528 msec 2023-02-15 20:01:53,163 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1676491313163, completionTime=-1 2023-02-15 20:01:53,163 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=2; waited=0ms, expected min=2 server(s), max=2 server(s), master is running 2023-02-15 20:01:53,163 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1519): Joining cluster... 2023-02-15 20:01:53,169 DEBUG [hconnection-0x12816034-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-15 20:01:53,170 INFO [RS-EventLoopGroup-22-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52544, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-15 20:01:53,171 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1531): Number of RegionServers=2 2023-02-15 20:01:53,171 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1676491373171 2023-02-15 20:01:53,171 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1676491433171 2023-02-15 20:01:53,172 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1538): Joined the cluster in 8 msec 2023-02-15 20:01:53,176 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,45745,1676491312355-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-15 20:01:53,177 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,45745,1676491312355-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-15 20:01:53,177 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,45745,1676491312355-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-15 20:01:53,177 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:45745, period=300000, unit=MILLISECONDS is enabled. 2023-02-15 20:01:53,177 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-02-15 20:01:53,177 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-02-15 20:01:53,177 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-15 20:01:53,178 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-02-15 20:01:53,179 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-02-15 20:01:53,180 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-02-15 20:01:53,180 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-15 20:01:53,182 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42419/user/jenkins/test-data/6193eb18-18c5-1507-512e-fcc3d8d85808/.tmp/data/hbase/namespace/5521a2d64327b0f2ab9934bf215887b6 2023-02-15 20:01:53,182 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:42419/user/jenkins/test-data/6193eb18-18c5-1507-512e-fcc3d8d85808/.tmp/data/hbase/namespace/5521a2d64327b0f2ab9934bf215887b6 empty. 2023-02-15 20:01:53,183 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42419/user/jenkins/test-data/6193eb18-18c5-1507-512e-fcc3d8d85808/.tmp/data/hbase/namespace/5521a2d64327b0f2ab9934bf215887b6 2023-02-15 20:01:53,183 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-02-15 20:01:53,203 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:42419/user/jenkins/test-data/6193eb18-18c5-1507-512e-fcc3d8d85808/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-02-15 20:01:53,204 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7671): creating {ENCODED => 5521a2d64327b0f2ab9934bf215887b6, NAME => 'hbase:namespace,,1676491313177.5521a2d64327b0f2ab9934bf215887b6.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:42419/user/jenkins/test-data/6193eb18-18c5-1507-512e-fcc3d8d85808/.tmp 2023-02-15 20:01:53,214 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676491313177.5521a2d64327b0f2ab9934bf215887b6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 20:01:53,214 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1603): Closing 5521a2d64327b0f2ab9934bf215887b6, disabling compactions & flushes 2023-02-15 20:01:53,214 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676491313177.5521a2d64327b0f2ab9934bf215887b6. 2023-02-15 20:01:53,214 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676491313177.5521a2d64327b0f2ab9934bf215887b6. 2023-02-15 20:01:53,214 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676491313177.5521a2d64327b0f2ab9934bf215887b6. after waiting 0 ms 2023-02-15 20:01:53,214 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676491313177.5521a2d64327b0f2ab9934bf215887b6. 2023-02-15 20:01:53,214 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676491313177.5521a2d64327b0f2ab9934bf215887b6. 2023-02-15 20:01:53,214 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1557): Region close journal for 5521a2d64327b0f2ab9934bf215887b6: 2023-02-15 20:01:53,216 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-02-15 20:01:53,217 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1676491313177.5521a2d64327b0f2ab9934bf215887b6.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676491313217"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676491313217"}]},"ts":"1676491313217"} 2023-02-15 20:01:53,219 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-15 20:01:53,220 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-15 20:01:53,220 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676491313220"}]},"ts":"1676491313220"} 2023-02-15 20:01:53,221 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-02-15 20:01:53,225 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-15 20:01:53,226 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-15 20:01:53,226 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-15 20:01:53,226 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-15 20:01:53,226 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=5521a2d64327b0f2ab9934bf215887b6, ASSIGN}] 2023-02-15 20:01:53,228 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=5521a2d64327b0f2ab9934bf215887b6, ASSIGN 2023-02-15 20:01:53,229 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=5521a2d64327b0f2ab9934bf215887b6, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,35725,1676491312455; forceNewPlan=false, retain=false 2023-02-15 20:01:53,379 INFO [jenkins-hbase4:45745] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-15 20:01:53,380 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=5521a2d64327b0f2ab9934bf215887b6, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,35725,1676491312455 2023-02-15 20:01:53,380 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1676491313177.5521a2d64327b0f2ab9934bf215887b6.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676491313380"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676491313380"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676491313380"}]},"ts":"1676491313380"} 2023-02-15 20:01:53,382 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 5521a2d64327b0f2ab9934bf215887b6, server=jenkins-hbase4.apache.org,35725,1676491312455}] 2023-02-15 20:01:53,535 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,35725,1676491312455 2023-02-15 20:01:53,535 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-15 20:01:53,539 INFO [RS-EventLoopGroup-23-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53162, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-15 20:01:53,543 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:namespace,,1676491313177.5521a2d64327b0f2ab9934bf215887b6. 2023-02-15 20:01:53,544 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C35725%2C1676491312455, suffix=, logDir=hdfs://localhost:42419/user/jenkins/test-data/6193eb18-18c5-1507-512e-fcc3d8d85808/WALs/jenkins-hbase4.apache.org,35725,1676491312455, archiveDir=hdfs://localhost:42419/user/jenkins/test-data/6193eb18-18c5-1507-512e-fcc3d8d85808/oldWALs, maxLogs=32 2023-02-15 20:01:53,565 DEBUG [RS-EventLoopGroup-23-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36915,DS-24343e8f-c02b-4fbb-92f7-734fd573caf7,DISK] 2023-02-15 20:01:53,565 DEBUG [RS-EventLoopGroup-23-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35243,DS-2886dbf0-3611-4529-a5cf-c8371ef19ae8,DISK] 2023-02-15 20:01:53,567 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/6193eb18-18c5-1507-512e-fcc3d8d85808/WALs/jenkins-hbase4.apache.org,35725,1676491312455/jenkins-hbase4.apache.org%2C35725%2C1676491312455.1676491313545 2023-02-15 20:01:53,567 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:35243,DS-2886dbf0-3611-4529-a5cf-c8371ef19ae8,DISK], DatanodeInfoWithStorage[127.0.0.1:36915,DS-24343e8f-c02b-4fbb-92f7-734fd573caf7,DISK]] 2023-02-15 20:01:53,567 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 5521a2d64327b0f2ab9934bf215887b6, NAME => 'hbase:namespace,,1676491313177.5521a2d64327b0f2ab9934bf215887b6.', STARTKEY => '', ENDKEY => ''} 2023-02-15 20:01:53,567 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 5521a2d64327b0f2ab9934bf215887b6 2023-02-15 20:01:53,567 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676491313177.5521a2d64327b0f2ab9934bf215887b6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 20:01:53,567 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 5521a2d64327b0f2ab9934bf215887b6 2023-02-15 20:01:53,568 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 5521a2d64327b0f2ab9934bf215887b6 2023-02-15 20:01:53,573 INFO [StoreOpener-5521a2d64327b0f2ab9934bf215887b6-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 5521a2d64327b0f2ab9934bf215887b6 2023-02-15 20:01:53,574 DEBUG [StoreOpener-5521a2d64327b0f2ab9934bf215887b6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42419/user/jenkins/test-data/6193eb18-18c5-1507-512e-fcc3d8d85808/data/hbase/namespace/5521a2d64327b0f2ab9934bf215887b6/info 2023-02-15 20:01:53,574 DEBUG [StoreOpener-5521a2d64327b0f2ab9934bf215887b6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42419/user/jenkins/test-data/6193eb18-18c5-1507-512e-fcc3d8d85808/data/hbase/namespace/5521a2d64327b0f2ab9934bf215887b6/info 2023-02-15 20:01:53,575 INFO [StoreOpener-5521a2d64327b0f2ab9934bf215887b6-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5521a2d64327b0f2ab9934bf215887b6 columnFamilyName info 2023-02-15 20:01:53,575 INFO [StoreOpener-5521a2d64327b0f2ab9934bf215887b6-1] regionserver.HStore(310): Store=5521a2d64327b0f2ab9934bf215887b6/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 20:01:53,576 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:42419/user/jenkins/test-data/6193eb18-18c5-1507-512e-fcc3d8d85808/data/hbase/namespace/5521a2d64327b0f2ab9934bf215887b6 2023-02-15 20:01:53,580 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:42419/user/jenkins/test-data/6193eb18-18c5-1507-512e-fcc3d8d85808/data/hbase/namespace/5521a2d64327b0f2ab9934bf215887b6 2023-02-15 20:01:53,583 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 5521a2d64327b0f2ab9934bf215887b6 2023-02-15 20:01:53,596 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42419/user/jenkins/test-data/6193eb18-18c5-1507-512e-fcc3d8d85808/data/hbase/namespace/5521a2d64327b0f2ab9934bf215887b6/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-15 20:01:53,597 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 5521a2d64327b0f2ab9934bf215887b6; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71248819, jitterRate=0.061690136790275574}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-15 20:01:53,597 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 5521a2d64327b0f2ab9934bf215887b6: 2023-02-15 20:01:53,598 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:namespace,,1676491313177.5521a2d64327b0f2ab9934bf215887b6., pid=6, masterSystemTime=1676491313535 2023-02-15 20:01:53,605 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:namespace,,1676491313177.5521a2d64327b0f2ab9934bf215887b6. 2023-02-15 20:01:53,605 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:namespace,,1676491313177.5521a2d64327b0f2ab9934bf215887b6. 2023-02-15 20:01:53,606 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=5521a2d64327b0f2ab9934bf215887b6, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,35725,1676491312455 2023-02-15 20:01:53,606 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1676491313177.5521a2d64327b0f2ab9934bf215887b6.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676491313605"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676491313605"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676491313605"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676491313605"}]},"ts":"1676491313605"} 2023-02-15 20:01:53,609 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-02-15 20:01:53,609 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 5521a2d64327b0f2ab9934bf215887b6, server=jenkins-hbase4.apache.org,35725,1676491312455 in 225 msec 2023-02-15 20:01:53,613 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-02-15 20:01:53,614 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=5521a2d64327b0f2ab9934bf215887b6, ASSIGN in 383 msec 2023-02-15 20:01:53,614 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-15 20:01:53,615 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676491313614"}]},"ts":"1676491313614"} 2023-02-15 20:01:53,616 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-02-15 20:01:53,622 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-02-15 20:01:53,623 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 445 msec 2023-02-15 20:01:53,680 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:45745-0x100599336920000, quorum=127.0.0.1:51396, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-02-15 20:01:53,681 DEBUG [Listener at localhost/45643-EventThread] zookeeper.ZKWatcher(600): master:45745-0x100599336920000, quorum=127.0.0.1:51396, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-02-15 20:01:53,681 DEBUG [Listener at localhost/45643-EventThread] zookeeper.ZKWatcher(600): master:45745-0x100599336920000, quorum=127.0.0.1:51396, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-15 20:01:53,684 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-15 20:01:53,685 INFO [RS-EventLoopGroup-23-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53176, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-15 20:01:53,686 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-02-15 20:01:53,708 DEBUG [Listener at localhost/45643-EventThread] zookeeper.ZKWatcher(600): master:45745-0x100599336920000, quorum=127.0.0.1:51396, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-15 20:01:53,711 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 23 msec 2023-02-15 20:01:53,718 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-02-15 20:01:53,727 DEBUG [Listener at localhost/45643-EventThread] zookeeper.ZKWatcher(600): master:45745-0x100599336920000, quorum=127.0.0.1:51396, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-15 20:01:53,730 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 11 msec 2023-02-15 20:01:53,743 DEBUG [Listener at localhost/45643-EventThread] zookeeper.ZKWatcher(600): master:45745-0x100599336920000, quorum=127.0.0.1:51396, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-02-15 20:01:53,746 DEBUG [Listener at localhost/45643-EventThread] zookeeper.ZKWatcher(600): master:45745-0x100599336920000, quorum=127.0.0.1:51396, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-02-15 20:01:53,746 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 1.268sec 2023-02-15 20:01:53,747 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-02-15 20:01:53,747 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-02-15 20:01:53,747 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-02-15 20:01:53,747 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,45745,1676491312355-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-02-15 20:01:53,747 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,45745,1676491312355-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-02-15 20:01:53,752 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-02-15 20:01:53,778 DEBUG [Listener at localhost/45643] zookeeper.ReadOnlyZKClient(139): Connect 0x1783c817 to 127.0.0.1:51396 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-15 20:01:53,781 DEBUG [Listener at localhost/45643] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@73912b69, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-15 20:01:53,784 DEBUG [hconnection-0x10d64612-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-15 20:01:53,785 INFO [RS-EventLoopGroup-22-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52560, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-15 20:01:53,787 INFO [Listener at localhost/45643] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,45745,1676491312355 2023-02-15 20:01:53,787 DEBUG [Listener at localhost/45643] mapreduce.TableSnapshotInputFormatTestBase(193): Ensuring table doesn't exist. 2023-02-15 20:01:53,790 DEBUG [Listener at localhost/45643] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-15 20:01:53,791 INFO [RS-EventLoopGroup-21-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:57488, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-15 20:01:53,792 INFO [Listener at localhost/45643] client.HBaseAdmin$15(890): Started disable of testWithMapReduce 2023-02-15 20:01:53,792 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45745] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testWithMapReduce 2023-02-15 20:01:53,792 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45745] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.TableNotFoundException: testWithMapReduce at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.checkTableModifiable(AbstractStateMachineTableProcedure.java:125) at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.preflightChecks(AbstractStateMachineTableProcedure.java:157) at org.apache.hadoop.hbase.master.procedure.DisableTableProcedure.(DisableTableProcedure.java:78) at org.apache.hadoop.hbase.master.HMaster$11.run(HMaster.java:2429) at org.apache.hadoop.hbase.master.procedure.MasterProcedureUtil.submitProcedure(MasterProcedureUtil.java:132) at org.apache.hadoop.hbase.master.HMaster.disableTable(HMaster.java:2413) at org.apache.hadoop.hbase.master.MasterRpcServices.disableTable(MasterRpcServices.java:784) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-02-15 20:01:53,792 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45745] ipc.CallRunner(144): callId: 2 service: MasterService methodName: DisableTable size: 76 connection: 172.31.14.131:57488 deadline: 1676491373792, exception=org.apache.hadoop.hbase.TableNotFoundException: testWithMapReduce 2023-02-15 20:01:53,793 INFO [Listener at localhost/45643] mapreduce.TableSnapshotInputFormatTestBase(199): creating table 'testWithMapReduce' 2023-02-15 20:01:53,802 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45745] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testWithMapReduce', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-15 20:01:53,803 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45745] procedure2.ProcedureExecutor(1029): Stored pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testWithMapReduce 2023-02-15 20:01:53,805 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_PRE_OPERATION 2023-02-15 20:01:53,805 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45745] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testWithMapReduce" procId is: 10 2023-02-15 20:01:53,806 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45745] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-15 20:01:53,807 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-15 20:01:53,808 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42419/user/jenkins/test-data/6193eb18-18c5-1507-512e-fcc3d8d85808/.tmp/data/default/testWithMapReduce/39f743d6adb86d1b345f4e02ce5ffbae 2023-02-15 20:01:53,809 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:42419/user/jenkins/test-data/6193eb18-18c5-1507-512e-fcc3d8d85808/.tmp/data/default/testWithMapReduce/39f743d6adb86d1b345f4e02ce5ffbae empty. 2023-02-15 20:01:53,809 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42419/user/jenkins/test-data/6193eb18-18c5-1507-512e-fcc3d8d85808/.tmp/data/default/testWithMapReduce/39f743d6adb86d1b345f4e02ce5ffbae 2023-02-15 20:01:53,809 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testWithMapReduce regions 2023-02-15 20:01:53,832 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:42419/user/jenkins/test-data/6193eb18-18c5-1507-512e-fcc3d8d85808/.tmp/data/default/testWithMapReduce/.tabledesc/.tableinfo.0000000001 2023-02-15 20:01:53,833 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(7671): creating {ENCODED => 39f743d6adb86d1b345f4e02ce5ffbae, NAME => 'testWithMapReduce,,1676491313802.39f743d6adb86d1b345f4e02ce5ffbae.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testWithMapReduce', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:42419/user/jenkins/test-data/6193eb18-18c5-1507-512e-fcc3d8d85808/.tmp 2023-02-15 20:01:53,847 INFO [RS:0;jenkins-hbase4:46217] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C46217%2C1676491312415, suffix=, logDir=hdfs://localhost:42419/user/jenkins/test-data/6193eb18-18c5-1507-512e-fcc3d8d85808/WALs/jenkins-hbase4.apache.org,46217,1676491312415, archiveDir=hdfs://localhost:42419/user/jenkins/test-data/6193eb18-18c5-1507-512e-fcc3d8d85808/oldWALs, maxLogs=32 2023-02-15 20:01:53,862 DEBUG [RS-EventLoopGroup-23-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36915,DS-24343e8f-c02b-4fbb-92f7-734fd573caf7,DISK] 2023-02-15 20:01:53,862 DEBUG [RS-EventLoopGroup-23-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35243,DS-2886dbf0-3611-4529-a5cf-c8371ef19ae8,DISK] 2023-02-15 20:01:53,870 INFO [RS:0;jenkins-hbase4:46217] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/6193eb18-18c5-1507-512e-fcc3d8d85808/WALs/jenkins-hbase4.apache.org,46217,1676491312415/jenkins-hbase4.apache.org%2C46217%2C1676491312415.1676491313847 2023-02-15 20:01:53,872 DEBUG [RS:0;jenkins-hbase4:46217] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:36915,DS-24343e8f-c02b-4fbb-92f7-734fd573caf7,DISK], DatanodeInfoWithStorage[127.0.0.1:35243,DS-2886dbf0-3611-4529-a5cf-c8371ef19ae8,DISK]] 2023-02-15 20:01:53,908 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45745] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-15 20:01:54,110 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45745] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-15 20:01:54,252 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676491313802.39f743d6adb86d1b345f4e02ce5ffbae.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 20:01:54,252 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1603): Closing 39f743d6adb86d1b345f4e02ce5ffbae, disabling compactions & flushes 2023-02-15 20:01:54,252 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676491313802.39f743d6adb86d1b345f4e02ce5ffbae. 2023-02-15 20:01:54,252 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676491313802.39f743d6adb86d1b345f4e02ce5ffbae. 2023-02-15 20:01:54,252 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676491313802.39f743d6adb86d1b345f4e02ce5ffbae. after waiting 0 ms 2023-02-15 20:01:54,252 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676491313802.39f743d6adb86d1b345f4e02ce5ffbae. 2023-02-15 20:01:54,252 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,,1676491313802.39f743d6adb86d1b345f4e02ce5ffbae. 2023-02-15 20:01:54,252 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1557): Region close journal for 39f743d6adb86d1b345f4e02ce5ffbae: 2023-02-15 20:01:54,254 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_ADD_TO_META 2023-02-15 20:01:54,255 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,,1676491313802.39f743d6adb86d1b345f4e02ce5ffbae.","families":{"info":[{"qualifier":"regioninfo","vlen":51,"tag":[],"timestamp":"1676491314255"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676491314255"}]},"ts":"1676491314255"} 2023-02-15 20:01:54,260 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-15 20:01:54,261 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-15 20:01:54,262 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676491314261"}]},"ts":"1676491314261"} 2023-02-15 20:01:54,264 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=ENABLING in hbase:meta 2023-02-15 20:01:54,268 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-15 20:01:54,269 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-15 20:01:54,269 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-15 20:01:54,269 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-15 20:01:54,269 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=39f743d6adb86d1b345f4e02ce5ffbae, ASSIGN}] 2023-02-15 20:01:54,270 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=39f743d6adb86d1b345f4e02ce5ffbae, ASSIGN 2023-02-15 20:01:54,270 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=39f743d6adb86d1b345f4e02ce5ffbae, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,35725,1676491312455; forceNewPlan=false, retain=false 2023-02-15 20:01:54,411 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45745] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-15 20:01:54,421 INFO [jenkins-hbase4:45745] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-15 20:01:54,421 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=39f743d6adb86d1b345f4e02ce5ffbae, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,35725,1676491312455 2023-02-15 20:01:54,421 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,,1676491313802.39f743d6adb86d1b345f4e02ce5ffbae.","families":{"info":[{"qualifier":"regioninfo","vlen":51,"tag":[],"timestamp":"1676491314421"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676491314421"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676491314421"}]},"ts":"1676491314421"} 2023-02-15 20:01:54,422 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=12, ppid=11, state=RUNNABLE; OpenRegionProcedure 39f743d6adb86d1b345f4e02ce5ffbae, server=jenkins-hbase4.apache.org,35725,1676491312455}] 2023-02-15 20:01:54,577 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,,1676491313802.39f743d6adb86d1b345f4e02ce5ffbae. 2023-02-15 20:01:54,577 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 39f743d6adb86d1b345f4e02ce5ffbae, NAME => 'testWithMapReduce,,1676491313802.39f743d6adb86d1b345f4e02ce5ffbae.', STARTKEY => '', ENDKEY => ''} 2023-02-15 20:01:54,577 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 39f743d6adb86d1b345f4e02ce5ffbae 2023-02-15 20:01:54,578 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676491313802.39f743d6adb86d1b345f4e02ce5ffbae.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 20:01:54,578 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 39f743d6adb86d1b345f4e02ce5ffbae 2023-02-15 20:01:54,578 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 39f743d6adb86d1b345f4e02ce5ffbae 2023-02-15 20:01:54,580 INFO [StoreOpener-39f743d6adb86d1b345f4e02ce5ffbae-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 39f743d6adb86d1b345f4e02ce5ffbae 2023-02-15 20:01:54,581 DEBUG [StoreOpener-39f743d6adb86d1b345f4e02ce5ffbae-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42419/user/jenkins/test-data/6193eb18-18c5-1507-512e-fcc3d8d85808/data/default/testWithMapReduce/39f743d6adb86d1b345f4e02ce5ffbae/f1 2023-02-15 20:01:54,581 DEBUG [StoreOpener-39f743d6adb86d1b345f4e02ce5ffbae-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42419/user/jenkins/test-data/6193eb18-18c5-1507-512e-fcc3d8d85808/data/default/testWithMapReduce/39f743d6adb86d1b345f4e02ce5ffbae/f1 2023-02-15 20:01:54,582 INFO [StoreOpener-39f743d6adb86d1b345f4e02ce5ffbae-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 39f743d6adb86d1b345f4e02ce5ffbae columnFamilyName f1 2023-02-15 20:01:54,584 INFO [StoreOpener-39f743d6adb86d1b345f4e02ce5ffbae-1] regionserver.HStore(310): Store=39f743d6adb86d1b345f4e02ce5ffbae/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 20:01:54,584 INFO [StoreOpener-39f743d6adb86d1b345f4e02ce5ffbae-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 39f743d6adb86d1b345f4e02ce5ffbae 2023-02-15 20:01:54,597 DEBUG [StoreOpener-39f743d6adb86d1b345f4e02ce5ffbae-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42419/user/jenkins/test-data/6193eb18-18c5-1507-512e-fcc3d8d85808/data/default/testWithMapReduce/39f743d6adb86d1b345f4e02ce5ffbae/f2 2023-02-15 20:01:54,597 DEBUG [StoreOpener-39f743d6adb86d1b345f4e02ce5ffbae-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42419/user/jenkins/test-data/6193eb18-18c5-1507-512e-fcc3d8d85808/data/default/testWithMapReduce/39f743d6adb86d1b345f4e02ce5ffbae/f2 2023-02-15 20:01:54,597 INFO [StoreOpener-39f743d6adb86d1b345f4e02ce5ffbae-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 39f743d6adb86d1b345f4e02ce5ffbae columnFamilyName f2 2023-02-15 20:01:54,598 INFO [StoreOpener-39f743d6adb86d1b345f4e02ce5ffbae-1] regionserver.HStore(310): Store=39f743d6adb86d1b345f4e02ce5ffbae/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 20:01:54,599 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:42419/user/jenkins/test-data/6193eb18-18c5-1507-512e-fcc3d8d85808/data/default/testWithMapReduce/39f743d6adb86d1b345f4e02ce5ffbae 2023-02-15 20:01:54,599 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:42419/user/jenkins/test-data/6193eb18-18c5-1507-512e-fcc3d8d85808/data/default/testWithMapReduce/39f743d6adb86d1b345f4e02ce5ffbae 2023-02-15 20:01:54,601 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-15 20:01:54,603 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 39f743d6adb86d1b345f4e02ce5ffbae 2023-02-15 20:01:54,606 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42419/user/jenkins/test-data/6193eb18-18c5-1507-512e-fcc3d8d85808/data/default/testWithMapReduce/39f743d6adb86d1b345f4e02ce5ffbae/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-15 20:01:54,606 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 39f743d6adb86d1b345f4e02ce5ffbae; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=58815849, jitterRate=-0.12357555329799652}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-15 20:01:54,607 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 39f743d6adb86d1b345f4e02ce5ffbae: 2023-02-15 20:01:54,607 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,,1676491313802.39f743d6adb86d1b345f4e02ce5ffbae., pid=12, masterSystemTime=1676491314574 2023-02-15 20:01:54,609 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,,1676491313802.39f743d6adb86d1b345f4e02ce5ffbae. 2023-02-15 20:01:54,611 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=39f743d6adb86d1b345f4e02ce5ffbae, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,35725,1676491312455 2023-02-15 20:01:54,611 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,,1676491313802.39f743d6adb86d1b345f4e02ce5ffbae.","families":{"info":[{"qualifier":"regioninfo","vlen":51,"tag":[],"timestamp":"1676491314610"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676491314610"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676491314610"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676491314610"}]},"ts":"1676491314610"} 2023-02-15 20:01:54,612 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,,1676491313802.39f743d6adb86d1b345f4e02ce5ffbae. 2023-02-15 20:01:54,617 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=12, resume processing ppid=11 2023-02-15 20:01:54,617 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=12, ppid=11, state=SUCCESS; OpenRegionProcedure 39f743d6adb86d1b345f4e02ce5ffbae, server=jenkins-hbase4.apache.org,35725,1676491312455 in 192 msec 2023-02-15 20:01:54,618 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-02-15 20:01:54,618 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=39f743d6adb86d1b345f4e02ce5ffbae, ASSIGN in 348 msec 2023-02-15 20:01:54,619 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-15 20:01:54,619 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676491314619"}]},"ts":"1676491314619"} 2023-02-15 20:01:54,623 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=ENABLED in hbase:meta 2023-02-15 20:01:54,625 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_POST_OPERATION 2023-02-15 20:01:54,627 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=10, state=SUCCESS; CreateTableProcedure table=testWithMapReduce in 823 msec 2023-02-15 20:01:54,913 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45745] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-15 20:01:54,914 INFO [Listener at localhost/45643] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testWithMapReduce, procId: 10 completed 2023-02-15 20:01:54,914 DEBUG [Listener at localhost/45643] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testWithMapReduce get assigned. Timeout = 60000ms 2023-02-15 20:01:54,914 INFO [Listener at localhost/45643] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-15 20:01:54,924 INFO [Listener at localhost/45643] hbase.HBaseTestingUtility(3484): All regions for table testWithMapReduce assigned to meta. Checking AM states. 2023-02-15 20:01:54,924 INFO [Listener at localhost/45643] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-15 20:01:54,925 INFO [Listener at localhost/45643] hbase.HBaseTestingUtility(3504): All regions for table testWithMapReduce assigned. 2023-02-15 20:01:54,925 INFO [Listener at localhost/45643] mapreduce.TableSnapshotInputFormatTestBase(207): put some stuff in the table 2023-02-15 20:01:54,941 DEBUG [hconnection-0x10d64612-shared-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-15 20:01:54,957 INFO [RS-EventLoopGroup-23-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53188, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-15 20:01:54,966 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35725] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 17576 Client: jenkins//172.31.14.131 first region in multi=testWithMapReduce,,1676491313802.39f743d6adb86d1b345f4e02ce5ffbae. 2023-02-15 20:01:55,071 INFO [Listener at localhost/45643] mapreduce.TableSnapshotInputFormatTestBase(214): snapshot 2023-02-15 20:01:55,071 INFO [Listener at localhost/45643] snapshot.SnapshotTestingUtils(396): taking snapshot. 2023-02-15 20:01:55,073 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45745] master.MasterRpcServices(1580): Client=jenkins//172.31.14.131 snapshot request for:{ ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-15 20:01:55,073 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45745] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1676491315073 (current time:1676491315073). 2023-02-15 20:01:55,073 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45745] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-02-15 20:01:55,073 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45745] zookeeper.ReadOnlyZKClient(139): Connect 0x50550708 to 127.0.0.1:51396 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-15 20:01:55,076 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45745] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@13859b78, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-15 20:01:55,077 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45745] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-15 20:01:55,078 INFO [RS-EventLoopGroup-22-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52562, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-15 20:01:55,079 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45745] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x50550708 to 127.0.0.1:51396 2023-02-15 20:01:55,079 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45745] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-15 20:01:55,080 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45745] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-02-15 20:01:55,080 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45745] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-15 20:01:55,082 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45745] procedure2.ProcedureExecutor(1029): Stored pid=13, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-15 20:01:55,083 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=13, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-15 20:01:55,084 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=13, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE; timeout=600000, timestamp=1676491915084 2023-02-15 20:01:55,084 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45745] snapshot.SnapshotManager(653): Started snapshot: { ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-15 20:01:55,084 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot testWithMapReduceSingleRegion C_M_SNAPSHOT_TABLE on table testWithMapReduce 2023-02-15 20:01:55,085 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=13, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-15 20:01:55,086 DEBUG [Listener at localhost/45643] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-02-15 20:01:55,086 DEBUG [Listener at localhost/45643] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-02-15 20:01:55,087 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=14, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-15 20:01:55,088 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=13, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE in 4 msec 2023-02-15 20:01:55,089 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=14, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-15 20:01:55,089 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=14, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED; timeout=600000, timestamp=1676491915089 2023-02-15 20:01:55,101 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure testWithMapReduceSingleRegion 2023-02-15 20:01:55,101 INFO [(jenkins-hbase4.apache.org,45745,1676491312355)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMapReduceSingleRegion' 2023-02-15 20:01:55,102 DEBUG [(jenkins-hbase4.apache.org,45745,1676491312355)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-15 20:01:55,102 DEBUG [(jenkins-hbase4.apache.org,45745,1676491312355)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMapReduceSingleRegion' starting 'acquire' 2023-02-15 20:01:55,102 DEBUG [(jenkins-hbase4.apache.org,45745,1676491312355)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMapReduceSingleRegion', kicking off acquire phase on members. 2023-02-15 20:01:55,103 DEBUG [(jenkins-hbase4.apache.org,45745,1676491312355)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45745-0x100599336920000, quorum=127.0.0.1:51396, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-15 20:01:55,103 DEBUG [(jenkins-hbase4.apache.org,45745,1676491312355)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion 2023-02-15 20:01:55,104 DEBUG [(jenkins-hbase4.apache.org,45745,1676491312355)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,35725,1676491312455 2023-02-15 20:01:55,104 DEBUG [Listener at localhost/45643-EventThread] zookeeper.ZKWatcher(600): regionserver:35725-0x100599336920002, quorum=127.0.0.1:51396, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-15 20:01:55,104 DEBUG [Listener at localhost/45643-EventThread] zookeeper.ZKWatcher(600): regionserver:46217-0x100599336920001, quorum=127.0.0.1:51396, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-15 20:01:55,104 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-15 20:01:55,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-15 20:01:55,104 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-15 20:01:55,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-15 20:01:55,104 DEBUG [(jenkins-hbase4.apache.org,45745,1676491312355)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45745-0x100599336920000, quorum=127.0.0.1:51396, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,35725,1676491312455 2023-02-15 20:01:55,104 DEBUG [(jenkins-hbase4.apache.org,45745,1676491312355)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-15 20:01:55,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMapReduceSingleRegion 2023-02-15 20:01:55,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMapReduceSingleRegion 2023-02-15 20:01:55,105 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46217-0x100599336920001, quorum=127.0.0.1:51396, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-15 20:01:55,105 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35725-0x100599336920002, quorum=127.0.0.1:51396, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-15 20:01:55,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 67 2023-02-15 20:01:55,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion 2023-02-15 20:01:55,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 67 2023-02-15 20:01:55,105 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMapReduceSingleRegion from table testWithMapReduce type FLUSH 2023-02-15 20:01:55,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion 2023-02-15 20:01:55,105 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMapReduceSingleRegion from table testWithMapReduce type FLUSH 2023-02-15 20:01:55,108 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduceSingleRegion 2023-02-15 20:01:55,108 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduceSingleRegion 2023-02-15 20:01:55,110 DEBUG [member: 'jenkins-hbase4.apache.org,46217,1676491312415' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduceSingleRegion' with timeout 300000ms 2023-02-15 20:01:55,110 DEBUG [member: 'jenkins-hbase4.apache.org,46217,1676491312415' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-15 20:01:55,110 DEBUG [member: 'jenkins-hbase4.apache.org,35725,1676491312455' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduceSingleRegion' with timeout 300000ms 2023-02-15 20:01:55,111 DEBUG [member: 'jenkins-hbase4.apache.org,35725,1676491312455' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-15 20:01:55,111 DEBUG [member: 'jenkins-hbase4.apache.org,46217,1676491312415' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduceSingleRegion' starting 'acquire' stage 2023-02-15 20:01:55,113 DEBUG [member: 'jenkins-hbase4.apache.org,35725,1676491312455' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduceSingleRegion' starting 'acquire' stage 2023-02-15 20:01:55,113 DEBUG [member: 'jenkins-hbase4.apache.org,35725,1676491312455' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduceSingleRegion' locally acquired 2023-02-15 20:01:55,113 DEBUG [member: 'jenkins-hbase4.apache.org,46217,1676491312415' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduceSingleRegion' locally acquired 2023-02-15 20:01:55,113 DEBUG [member: 'jenkins-hbase4.apache.org,35725,1676491312455' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35725,1676491312455' joining acquired barrier for procedure (testWithMapReduceSingleRegion) in zk 2023-02-15 20:01:55,113 DEBUG [member: 'jenkins-hbase4.apache.org,46217,1676491312415' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46217,1676491312415' joining acquired barrier for procedure (testWithMapReduceSingleRegion) in zk 2023-02-15 20:01:55,114 DEBUG [member: 'jenkins-hbase4.apache.org,46217,1676491312415' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-15 20:01:55,115 DEBUG [Listener at localhost/45643-EventThread] zookeeper.ZKWatcher(600): master:45745-0x100599336920000, quorum=127.0.0.1:51396, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,35725,1676491312455 2023-02-15 20:01:55,115 DEBUG [member: 'jenkins-hbase4.apache.org,35725,1676491312455' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-15 20:01:55,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,35725,1676491312455 2023-02-15 20:01:55,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-15 20:01:55,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-15 20:01:55,115 DEBUG [member: 'jenkins-hbase4.apache.org,46217,1676491312415' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46217-0x100599336920001, quorum=127.0.0.1:51396, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-15 20:01:55,115 DEBUG [member: 'jenkins-hbase4.apache.org,46217,1676491312415' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduceSingleRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-15 20:01:55,115 DEBUG [member: 'jenkins-hbase4.apache.org,35725,1676491312455' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35725-0x100599336920002, quorum=127.0.0.1:51396, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-15 20:01:55,115 DEBUG [member: 'jenkins-hbase4.apache.org,35725,1676491312455' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduceSingleRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-15 20:01:55,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-15 20:01:55,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-15 20:01:55,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceSingleRegion 2023-02-15 20:01:55,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35725,1676491312455 2023-02-15 20:01:55,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46217,1676491312415 2023-02-15 20:01:55,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-15 20:01:55,117 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35725,1676491312455' joining acquired barrier for procedure 'testWithMapReduceSingleRegion' on coordinator 2023-02-15 20:01:55,117 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4dab7762[Count = 0] remaining members to acquire global barrier 2023-02-15 20:01:55,117 DEBUG [(jenkins-hbase4.apache.org,45745,1676491312355)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMapReduceSingleRegion' starting 'in-barrier' execution. 2023-02-15 20:01:55,117 DEBUG [(jenkins-hbase4.apache.org,45745,1676491312355)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-15 20:01:55,118 DEBUG [Listener at localhost/45643-EventThread] zookeeper.ZKWatcher(600): regionserver:46217-0x100599336920001, quorum=127.0.0.1:51396, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-15 20:01:55,118 DEBUG [Listener at localhost/45643-EventThread] zookeeper.ZKWatcher(600): regionserver:35725-0x100599336920002, quorum=127.0.0.1:51396, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-15 20:01:55,118 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-15 20:01:55,118 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-15 20:01:55,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-15 20:01:55,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-15 20:01:55,118 DEBUG [member: 'jenkins-hbase4.apache.org,35725,1676491312455' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduceSingleRegion' received 'reached' from coordinator. 2023-02-15 20:01:55,118 DEBUG [(jenkins-hbase4.apache.org,45745,1676491312355)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45745-0x100599336920000, quorum=127.0.0.1:51396, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,35725,1676491312455 2023-02-15 20:01:55,118 DEBUG [(jenkins-hbase4.apache.org,45745,1676491312355)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-15 20:01:55,118 DEBUG [member: 'jenkins-hbase4.apache.org,35725,1676491312455' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-02-15 20:01:55,119 DEBUG [member: 'jenkins-hbase4.apache.org,35725,1676491312455' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-15 20:01:55,119 DEBUG [rs(jenkins-hbase4.apache.org,35725,1676491312455)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,,1676491313802.39f743d6adb86d1b345f4e02ce5ffbae. 2023-02-15 20:01:55,119 DEBUG [rs(jenkins-hbase4.apache.org,35725,1676491312455)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,,1676491313802.39f743d6adb86d1b345f4e02ce5ffbae. started... 2023-02-15 20:01:55,119 INFO [rs(jenkins-hbase4.apache.org,35725,1676491312455)-snapshot-pool-0] regionserver.HRegion(2744): Flushing 39f743d6adb86d1b345f4e02ce5ffbae 2/2 column families, dataSize=1.01 MB heapSize=3.49 MB 2023-02-15 20:01:55,120 DEBUG [member: 'jenkins-hbase4.apache.org,46217,1676491312415' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduceSingleRegion' received 'reached' from coordinator. 2023-02-15 20:01:55,120 DEBUG [member: 'jenkins-hbase4.apache.org,46217,1676491312415' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduceSingleRegion' locally completed 2023-02-15 20:01:55,120 DEBUG [member: 'jenkins-hbase4.apache.org,46217,1676491312415' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduceSingleRegion' completed for member 'jenkins-hbase4.apache.org,46217,1676491312415' in zk 2023-02-15 20:01:55,122 DEBUG [member: 'jenkins-hbase4.apache.org,46217,1676491312415' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduceSingleRegion' has notified controller of completion 2023-02-15 20:01:55,122 DEBUG [member: 'jenkins-hbase4.apache.org,46217,1676491312415' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-15 20:01:55,122 DEBUG [member: 'jenkins-hbase4.apache.org,46217,1676491312415' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduceSingleRegion' completed. 2023-02-15 20:01:55,142 INFO [rs(jenkins-hbase4.apache.org,35725,1676491312455)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=514.92 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:42419/user/jenkins/test-data/6193eb18-18c5-1507-512e-fcc3d8d85808/data/default/testWithMapReduce/39f743d6adb86d1b345f4e02ce5ffbae/.tmp/f1/f8924d5f686d40dfba3bd8eb3e9bc7df 2023-02-15 20:01:55,162 INFO [rs(jenkins-hbase4.apache.org,35725,1676491312455)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=514.92 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:42419/user/jenkins/test-data/6193eb18-18c5-1507-512e-fcc3d8d85808/data/default/testWithMapReduce/39f743d6adb86d1b345f4e02ce5ffbae/.tmp/f2/841fbafc63b74509b5fa0585253a79bc 2023-02-15 20:01:55,167 DEBUG [rs(jenkins-hbase4.apache.org,35725,1676491312455)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42419/user/jenkins/test-data/6193eb18-18c5-1507-512e-fcc3d8d85808/data/default/testWithMapReduce/39f743d6adb86d1b345f4e02ce5ffbae/.tmp/f1/f8924d5f686d40dfba3bd8eb3e9bc7df as hdfs://localhost:42419/user/jenkins/test-data/6193eb18-18c5-1507-512e-fcc3d8d85808/data/default/testWithMapReduce/39f743d6adb86d1b345f4e02ce5ffbae/f1/f8924d5f686d40dfba3bd8eb3e9bc7df 2023-02-15 20:01:55,171 INFO [rs(jenkins-hbase4.apache.org,35725,1676491312455)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42419/user/jenkins/test-data/6193eb18-18c5-1507-512e-fcc3d8d85808/data/default/testWithMapReduce/39f743d6adb86d1b345f4e02ce5ffbae/f1/f8924d5f686d40dfba3bd8eb3e9bc7df, entries=17576, sequenceid=5, filesize=537.3 K 2023-02-15 20:01:55,171 DEBUG [rs(jenkins-hbase4.apache.org,35725,1676491312455)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42419/user/jenkins/test-data/6193eb18-18c5-1507-512e-fcc3d8d85808/data/default/testWithMapReduce/39f743d6adb86d1b345f4e02ce5ffbae/.tmp/f2/841fbafc63b74509b5fa0585253a79bc as hdfs://localhost:42419/user/jenkins/test-data/6193eb18-18c5-1507-512e-fcc3d8d85808/data/default/testWithMapReduce/39f743d6adb86d1b345f4e02ce5ffbae/f2/841fbafc63b74509b5fa0585253a79bc 2023-02-15 20:01:55,175 INFO [rs(jenkins-hbase4.apache.org,35725,1676491312455)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42419/user/jenkins/test-data/6193eb18-18c5-1507-512e-fcc3d8d85808/data/default/testWithMapReduce/39f743d6adb86d1b345f4e02ce5ffbae/f2/841fbafc63b74509b5fa0585253a79bc, entries=17576, sequenceid=5, filesize=537.3 K 2023-02-15 20:01:55,176 INFO [rs(jenkins-hbase4.apache.org,35725,1676491312455)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~1.01 MB/1054560, heapSize ~3.49 MB/3656288, currentSize=0 B/0 for 39f743d6adb86d1b345f4e02ce5ffbae in 57ms, sequenceid=5, compaction requested=false 2023-02-15 20:01:55,176 DEBUG [rs(jenkins-hbase4.apache.org,35725,1676491312455)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 39f743d6adb86d1b345f4e02ce5ffbae: 2023-02-15 20:01:55,176 DEBUG [rs(jenkins-hbase4.apache.org,35725,1676491312455)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,,1676491313802.39f743d6adb86d1b345f4e02ce5ffbae.' region-info for snapshot=testWithMapReduceSingleRegion 2023-02-15 20:01:55,176 DEBUG [rs(jenkins-hbase4.apache.org,35725,1676491312455)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-15 20:01:55,176 DEBUG [rs(jenkins-hbase4.apache.org,35725,1676491312455)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:42419/user/jenkins/test-data/6193eb18-18c5-1507-512e-fcc3d8d85808/data/default/testWithMapReduce/39f743d6adb86d1b345f4e02ce5ffbae/f1/f8924d5f686d40dfba3bd8eb3e9bc7df] hfiles 2023-02-15 20:01:55,176 DEBUG [rs(jenkins-hbase4.apache.org,35725,1676491312455)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:42419/user/jenkins/test-data/6193eb18-18c5-1507-512e-fcc3d8d85808/data/default/testWithMapReduce/39f743d6adb86d1b345f4e02ce5ffbae/f1/f8924d5f686d40dfba3bd8eb3e9bc7df for snapshot=testWithMapReduceSingleRegion 2023-02-15 20:01:55,176 DEBUG [rs(jenkins-hbase4.apache.org,35725,1676491312455)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:42419/user/jenkins/test-data/6193eb18-18c5-1507-512e-fcc3d8d85808/data/default/testWithMapReduce/39f743d6adb86d1b345f4e02ce5ffbae/f2/841fbafc63b74509b5fa0585253a79bc] hfiles 2023-02-15 20:01:55,176 DEBUG [rs(jenkins-hbase4.apache.org,35725,1676491312455)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:42419/user/jenkins/test-data/6193eb18-18c5-1507-512e-fcc3d8d85808/data/default/testWithMapReduce/39f743d6adb86d1b345f4e02ce5ffbae/f2/841fbafc63b74509b5fa0585253a79bc for snapshot=testWithMapReduceSingleRegion 2023-02-15 20:01:55,182 DEBUG [rs(jenkins-hbase4.apache.org,35725,1676491312455)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,,1676491313802.39f743d6adb86d1b345f4e02ce5ffbae. completed. 2023-02-15 20:01:55,182 DEBUG [rs(jenkins-hbase4.apache.org,35725,1676491312455)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,,1676491313802.39f743d6adb86d1b345f4e02ce5ffbae. 2023-02-15 20:01:55,182 DEBUG [member: 'jenkins-hbase4.apache.org,35725,1676491312455' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-02-15 20:01:55,182 DEBUG [member: 'jenkins-hbase4.apache.org,35725,1676491312455' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-02-15 20:01:55,182 DEBUG [member: 'jenkins-hbase4.apache.org,35725,1676491312455' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,35725,1676491312455 2023-02-15 20:01:55,182 DEBUG [member: 'jenkins-hbase4.apache.org,35725,1676491312455' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduceSingleRegion' locally completed 2023-02-15 20:01:55,182 DEBUG [member: 'jenkins-hbase4.apache.org,35725,1676491312455' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduceSingleRegion' completed for member 'jenkins-hbase4.apache.org,35725,1676491312455' in zk 2023-02-15 20:01:55,184 DEBUG [member: 'jenkins-hbase4.apache.org,35725,1676491312455' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduceSingleRegion' has notified controller of completion 2023-02-15 20:01:55,184 DEBUG [Listener at localhost/45643-EventThread] zookeeper.ZKWatcher(600): master:45745-0x100599336920000, quorum=127.0.0.1:51396, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,35725,1676491312455 2023-02-15 20:01:55,184 DEBUG [member: 'jenkins-hbase4.apache.org,35725,1676491312455' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-15 20:01:55,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,35725,1676491312455 2023-02-15 20:01:55,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-15 20:01:55,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-15 20:01:55,184 DEBUG [member: 'jenkins-hbase4.apache.org,35725,1676491312455' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduceSingleRegion' completed. 2023-02-15 20:01:55,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-15 20:01:55,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-15 20:01:55,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceSingleRegion 2023-02-15 20:01:55,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35725,1676491312455 2023-02-15 20:01:55,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46217,1676491312415 2023-02-15 20:01:55,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-15 20:01:55,186 DEBUG [Listener at localhost/45643] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-15 20:01:55,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceSingleRegion 2023-02-15 20:01:55,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35725,1676491312455 2023-02-15 20:01:55,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46217,1676491312415 2023-02-15 20:01:55,187 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45745] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-15 20:01:55,187 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45745] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-15 20:01:55,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduceSingleRegion' member 'jenkins-hbase4.apache.org,35725,1676491312455': 2023-02-15 20:01:55,187 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35725,1676491312455' released barrier for procedure'testWithMapReduceSingleRegion', counting down latch. Waiting for 0 more 2023-02-15 20:01:55,187 INFO [(jenkins-hbase4.apache.org,45745,1676491312355)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMapReduceSingleRegion' execution completed 2023-02-15 20:01:55,187 DEBUG [(jenkins-hbase4.apache.org,45745,1676491312355)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-15 20:01:55,187 DEBUG [(jenkins-hbase4.apache.org,45745,1676491312355)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-15 20:01:55,187 DEBUG [Listener at localhost/45643] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-02-15 20:01:55,187 DEBUG [(jenkins-hbase4.apache.org,45745,1676491312355)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMapReduceSingleRegion 2023-02-15 20:01:55,187 INFO [(jenkins-hbase4.apache.org,45745,1676491312355)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMapReduceSingleRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-02-15 20:01:55,189 DEBUG [Listener at localhost/45643-EventThread] zookeeper.ZKWatcher(600): master:45745-0x100599336920000, quorum=127.0.0.1:51396, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-15 20:01:55,189 DEBUG [Listener at localhost/45643-EventThread] zookeeper.ZKWatcher(600): regionserver:35725-0x100599336920002, quorum=127.0.0.1:51396, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-15 20:01:55,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-15 20:01:55,189 DEBUG [Listener at localhost/45643-EventThread] zookeeper.ZKWatcher(600): regionserver:46217-0x100599336920001, quorum=127.0.0.1:51396, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-15 20:01:55,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-15 20:01:55,189 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-15 20:01:55,189 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-15 20:01:55,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-15 20:01:55,189 DEBUG [Listener at localhost/45643-EventThread] zookeeper.ZKWatcher(600): regionserver:35725-0x100599336920002, quorum=127.0.0.1:51396, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-15 20:01:55,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-15 20:01:55,189 DEBUG [(jenkins-hbase4.apache.org,45745,1676491312355)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45745-0x100599336920000, quorum=127.0.0.1:51396, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,35725,1676491312455 2023-02-15 20:01:55,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-15 20:01:55,189 DEBUG [Listener at localhost/45643-EventThread] zookeeper.ZKWatcher(600): regionserver:46217-0x100599336920001, quorum=127.0.0.1:51396, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-15 20:01:55,190 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-15 20:01:55,190 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-15 20:01:55,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-15 20:01:55,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-15 20:01:55,190 DEBUG [(jenkins-hbase4.apache.org,45745,1676491312355)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45745-0x100599336920000, quorum=127.0.0.1:51396, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,46217,1676491312415 2023-02-15 20:01:55,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-15 20:01:55,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-15 20:01:55,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-15 20:01:55,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceSingleRegion 2023-02-15 20:01:55,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-15 20:01:55,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceSingleRegion 2023-02-15 20:01:55,191 DEBUG [(jenkins-hbase4.apache.org,45745,1676491312355)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45745-0x100599336920000, quorum=127.0.0.1:51396, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,35725,1676491312455 2023-02-15 20:01:55,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35725,1676491312455 2023-02-15 20:01:55,191 DEBUG [(jenkins-hbase4.apache.org,45745,1676491312355)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45745-0x100599336920000, quorum=127.0.0.1:51396, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,46217,1676491312415 2023-02-15 20:01:55,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46217,1676491312415 2023-02-15 20:01:55,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-15 20:01:55,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceSingleRegion 2023-02-15 20:01:55,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35725,1676491312455 2023-02-15 20:01:55,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46217,1676491312415 2023-02-15 20:01:55,197 DEBUG [Listener at localhost/45643-EventThread] zookeeper.ZKWatcher(600): master:45745-0x100599336920000, quorum=127.0.0.1:51396, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,46217,1676491312415 2023-02-15 20:01:55,197 DEBUG [Listener at localhost/45643-EventThread] zookeeper.ZKWatcher(600): regionserver:46217-0x100599336920001, quorum=127.0.0.1:51396, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-15 20:01:55,197 DEBUG [Listener at localhost/45643-EventThread] zookeeper.ZKWatcher(600): master:45745-0x100599336920000, quorum=127.0.0.1:51396, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion 2023-02-15 20:01:55,198 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-15 20:01:55,198 DEBUG [Listener at localhost/45643-EventThread] zookeeper.ZKWatcher(600): regionserver:35725-0x100599336920002, quorum=127.0.0.1:51396, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-15 20:01:55,198 DEBUG [Listener at localhost/45643-EventThread] zookeeper.ZKWatcher(600): regionserver:46217-0x100599336920001, quorum=127.0.0.1:51396, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-15 20:01:55,198 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for testWithMapReduceSingleRegion 2023-02-15 20:01:55,198 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:45745-0x100599336920000, quorum=127.0.0.1:51396, baseZNode=/hbase Unable to get data of znode /hbase/online-snapshot/abort/testWithMapReduceSingleRegion because node does not exist (not an error) 2023-02-15 20:01:55,198 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-15 20:01:55,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-15 20:01:55,198 DEBUG [Listener at localhost/45643-EventThread] zookeeper.ZKWatcher(600): regionserver:35725-0x100599336920002, quorum=127.0.0.1:51396, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-15 20:01:55,198 DEBUG [(jenkins-hbase4.apache.org,45745,1676491312355)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-15 20:01:55,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-15 20:01:55,198 DEBUG [Listener at localhost/45643-EventThread] zookeeper.ZKWatcher(600): master:45745-0x100599336920000, quorum=127.0.0.1:51396, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,35725,1676491312455 2023-02-15 20:01:55,198 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for testWithMapReduceSingleRegion 2023-02-15 20:01:55,198 DEBUG [Listener at localhost/45643-EventThread] zookeeper.ZKWatcher(600): master:45745-0x100599336920000, quorum=127.0.0.1:51396, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion 2023-02-15 20:01:55,198 DEBUG [Listener at localhost/45643-EventThread] zookeeper.ZKWatcher(600): master:45745-0x100599336920000, quorum=127.0.0.1:51396, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,46217,1676491312415 2023-02-15 20:01:55,198 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-15 20:01:55,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-15 20:01:55,198 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-15 20:01:55,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-15 20:01:55,198 DEBUG [Listener at localhost/45643-EventThread] zookeeper.ZKWatcher(600): master:45745-0x100599336920000, quorum=127.0.0.1:51396, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-15 20:01:55,198 DEBUG [Listener at localhost/45643-EventThread] zookeeper.ZKWatcher(600): master:45745-0x100599336920000, quorum=127.0.0.1:51396, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,35725,1676491312455 2023-02-15 20:01:55,198 DEBUG [Listener at localhost/45643-EventThread] zookeeper.ZKWatcher(600): master:45745-0x100599336920000, quorum=127.0.0.1:51396, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-15 20:01:55,198 DEBUG [Listener at localhost/45643-EventThread] zookeeper.ZKWatcher(600): master:45745-0x100599336920000, quorum=127.0.0.1:51396, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-15 20:01:55,199 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:42419/user/jenkins/test-data/6193eb18-18c5-1507-512e-fcc3d8d85808/.hbase-snapshot/.tmp/testWithMapReduceSingleRegion 2023-02-15 20:01:55,215 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:42419/user/jenkins/test-data/6193eb18-18c5-1507-512e-fcc3d8d85808/.hbase-snapshot/.tmp/testWithMapReduceSingleRegion to hdfs://localhost:42419/user/jenkins/test-data/6193eb18-18c5-1507-512e-fcc3d8d85808/.hbase-snapshot/testWithMapReduceSingleRegion 2023-02-15 20:01:55,249 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot testWithMapReduceSingleRegion of table testWithMapReduce completed 2023-02-15 20:01:55,249 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:42419/user/jenkins/test-data/6193eb18-18c5-1507-512e-fcc3d8d85808/.hbase-snapshot/.tmp/testWithMapReduceSingleRegion 2023-02-15 20:01:55,250 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:42419/user/jenkins/test-data/6193eb18-18c5-1507-512e-fcc3d8d85808/.hbase-snapshot/.tmp/testWithMapReduceSingleRegion 2023-02-15 20:01:55,250 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot testWithMapReduceSingleRegion C_M_SNAPSHOT_TABLE on table testWithMapReduce at 1676491315084Consolidate snapshot: testWithMapReduceSingleRegion at 1676491315198 (+114 ms)Loading Region manifests for testWithMapReduceSingleRegion at 1676491315198Writing data manifest for testWithMapReduceSingleRegion at 1676491315201 (+3 ms)Verifying snapshot: testWithMapReduceSingleRegion at 1676491315209 (+8 ms)Snapshot testWithMapReduceSingleRegion of table testWithMapReduce completed at 1676491315249 (+40 ms) 2023-02-15 20:01:55,251 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=14, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-15 20:01:55,252 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=14, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED in 166 msec 2023-02-15 20:01:55,387 DEBUG [Listener at localhost/45643] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-15 20:01:55,389 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45745] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-15 20:01:55,389 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45745] snapshot.SnapshotManager(401): Snapshot '{ ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 }' has completed, notifying client. 2023-02-15 20:01:55,389 INFO [Listener at localhost/45643] snapshot.SnapshotTestingUtils(399): Confirming snapshot exists. 2023-02-15 20:01:55,393 INFO [Listener at localhost/45643] snapshot.SnapshotTestingUtils(406): validating snapshot. 2023-02-15 20:01:55,398 INFO [Listener at localhost/45643] mapreduce.TableSnapshotInputFormatTestBase(218): load different values 2023-02-15 20:01:55,425 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35725] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 17576 Client: jenkins//172.31.14.131 first region in multi=testWithMapReduce,,1676491313802.39f743d6adb86d1b345f4e02ce5ffbae. 2023-02-15 20:01:55,542 INFO [Listener at localhost/45643] mapreduce.TableSnapshotInputFormatTestBase(222): cause flush to create new files in the region 2023-02-15 20:01:55,547 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45745] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-15 20:01:55,549 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45745] procedure.ProcedureCoordinator(165): Submitting procedure testWithMapReduce 2023-02-15 20:01:55,549 INFO [(jenkins-hbase4.apache.org,45745,1676491312355)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMapReduce' 2023-02-15 20:01:55,550 DEBUG [(jenkins-hbase4.apache.org,45745,1676491312355)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-15 20:01:55,550 DEBUG [(jenkins-hbase4.apache.org,45745,1676491312355)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMapReduce' starting 'acquire' 2023-02-15 20:01:55,550 DEBUG [(jenkins-hbase4.apache.org,45745,1676491312355)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMapReduce', kicking off acquire phase on members. 2023-02-15 20:01:55,550 DEBUG [(jenkins-hbase4.apache.org,45745,1676491312355)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45745-0x100599336920000, quorum=127.0.0.1:51396, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-15 20:01:55,550 DEBUG [(jenkins-hbase4.apache.org,45745,1676491312355)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-15 20:01:55,551 DEBUG [Listener at localhost/45643-EventThread] zookeeper.ZKWatcher(600): regionserver:46217-0x100599336920001, quorum=127.0.0.1:51396, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-15 20:01:55,551 DEBUG [Listener at localhost/45643-EventThread] zookeeper.ZKWatcher(600): regionserver:35725-0x100599336920002, quorum=127.0.0.1:51396, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-15 20:01:55,551 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-15 20:01:55,552 DEBUG [(jenkins-hbase4.apache.org,45745,1676491312355)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,35725,1676491312455 2023-02-15 20:01:55,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-15 20:01:55,552 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-15 20:01:55,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-15 20:01:55,552 DEBUG [(jenkins-hbase4.apache.org,45745,1676491312355)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45745-0x100599336920000, quorum=127.0.0.1:51396, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,35725,1676491312455 2023-02-15 20:01:55,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-15 20:01:55,552 DEBUG [(jenkins-hbase4.apache.org,45745,1676491312355)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-15 20:01:55,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-15 20:01:55,552 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46217-0x100599336920001, quorum=127.0.0.1:51396, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-15 20:01:55,552 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35725-0x100599336920002, quorum=127.0.0.1:51396, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-15 20:01:55,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-15 20:01:55,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-15 20:01:55,553 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMapReduce 2023-02-15 20:01:55,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-15 20:01:55,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-15 20:01:55,553 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMapReduce 2023-02-15 20:01:55,558 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduce 2023-02-15 20:01:55,558 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduce 2023-02-15 20:01:55,558 DEBUG [member: 'jenkins-hbase4.apache.org,46217,1676491312415' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduce' with timeout 60000ms 2023-02-15 20:01:55,558 DEBUG [member: 'jenkins-hbase4.apache.org,46217,1676491312415' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-15 20:01:55,558 DEBUG [member: 'jenkins-hbase4.apache.org,46217,1676491312415' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduce' starting 'acquire' stage 2023-02-15 20:01:55,558 DEBUG [member: 'jenkins-hbase4.apache.org,46217,1676491312415' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduce' locally acquired 2023-02-15 20:01:55,558 DEBUG [member: 'jenkins-hbase4.apache.org,46217,1676491312415' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46217,1676491312415' joining acquired barrier for procedure (testWithMapReduce) in zk 2023-02-15 20:01:55,560 DEBUG [member: 'jenkins-hbase4.apache.org,46217,1676491312415' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-15 20:01:55,560 DEBUG [member: 'jenkins-hbase4.apache.org,35725,1676491312455' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduce' with timeout 60000ms 2023-02-15 20:01:55,560 DEBUG [member: 'jenkins-hbase4.apache.org,35725,1676491312455' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-15 20:01:55,560 DEBUG [member: 'jenkins-hbase4.apache.org,35725,1676491312455' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduce' starting 'acquire' stage 2023-02-15 20:01:55,560 DEBUG [member: 'jenkins-hbase4.apache.org,46217,1676491312415' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46217-0x100599336920001, quorum=127.0.0.1:51396, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce 2023-02-15 20:01:55,560 DEBUG [member: 'jenkins-hbase4.apache.org,46217,1676491312415' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduce' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-15 20:01:55,563 DEBUG [member: 'jenkins-hbase4.apache.org,35725,1676491312455' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-15 20:01:55,563 DEBUG [member: 'jenkins-hbase4.apache.org,35725,1676491312455' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-15 20:01:55,563 DEBUG [rs(jenkins-hbase4.apache.org,35725,1676491312455)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,,1676491313802.39f743d6adb86d1b345f4e02ce5ffbae. 2023-02-15 20:01:55,563 DEBUG [rs(jenkins-hbase4.apache.org,35725,1676491312455)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,,1676491313802.39f743d6adb86d1b345f4e02ce5ffbae. started... 2023-02-15 20:01:55,563 INFO [rs(jenkins-hbase4.apache.org,35725,1676491312455)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 39f743d6adb86d1b345f4e02ce5ffbae 2/2 column families, dataSize=1.58 MB heapSize=4.02 MB 2023-02-15 20:01:55,996 INFO [rs(jenkins-hbase4.apache.org,35725,1676491312455)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=806.71 KB at sequenceid=9 (bloomFilter=false), to=hdfs://localhost:42419/user/jenkins/test-data/6193eb18-18c5-1507-512e-fcc3d8d85808/data/default/testWithMapReduce/39f743d6adb86d1b345f4e02ce5ffbae/.tmp/f1/c847aa3fe6214e51962c0e7e216174d5 2023-02-15 20:01:56,019 INFO [rs(jenkins-hbase4.apache.org,35725,1676491312455)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=806.71 KB at sequenceid=9 (bloomFilter=false), to=hdfs://localhost:42419/user/jenkins/test-data/6193eb18-18c5-1507-512e-fcc3d8d85808/data/default/testWithMapReduce/39f743d6adb86d1b345f4e02ce5ffbae/.tmp/f2/f69197443bcf44d0b238bb5c5caead92 2023-02-15 20:01:56,023 DEBUG [rs(jenkins-hbase4.apache.org,35725,1676491312455)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42419/user/jenkins/test-data/6193eb18-18c5-1507-512e-fcc3d8d85808/data/default/testWithMapReduce/39f743d6adb86d1b345f4e02ce5ffbae/.tmp/f1/c847aa3fe6214e51962c0e7e216174d5 as hdfs://localhost:42419/user/jenkins/test-data/6193eb18-18c5-1507-512e-fcc3d8d85808/data/default/testWithMapReduce/39f743d6adb86d1b345f4e02ce5ffbae/f1/c847aa3fe6214e51962c0e7e216174d5 2023-02-15 20:01:56,027 INFO [rs(jenkins-hbase4.apache.org,35725,1676491312455)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42419/user/jenkins/test-data/6193eb18-18c5-1507-512e-fcc3d8d85808/data/default/testWithMapReduce/39f743d6adb86d1b345f4e02ce5ffbae/f1/c847aa3fe6214e51962c0e7e216174d5, entries=17576, sequenceid=9, filesize=829.4 K 2023-02-15 20:01:56,028 DEBUG [rs(jenkins-hbase4.apache.org,35725,1676491312455)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42419/user/jenkins/test-data/6193eb18-18c5-1507-512e-fcc3d8d85808/data/default/testWithMapReduce/39f743d6adb86d1b345f4e02ce5ffbae/.tmp/f2/f69197443bcf44d0b238bb5c5caead92 as hdfs://localhost:42419/user/jenkins/test-data/6193eb18-18c5-1507-512e-fcc3d8d85808/data/default/testWithMapReduce/39f743d6adb86d1b345f4e02ce5ffbae/f2/f69197443bcf44d0b238bb5c5caead92 2023-02-15 20:01:56,033 INFO [rs(jenkins-hbase4.apache.org,35725,1676491312455)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42419/user/jenkins/test-data/6193eb18-18c5-1507-512e-fcc3d8d85808/data/default/testWithMapReduce/39f743d6adb86d1b345f4e02ce5ffbae/f2/f69197443bcf44d0b238bb5c5caead92, entries=17576, sequenceid=9, filesize=829.4 K 2023-02-15 20:01:56,033 INFO [rs(jenkins-hbase4.apache.org,35725,1676491312455)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~1.58 MB/1652144, heapSize ~4.02 MB/4218720, currentSize=0 B/0 for 39f743d6adb86d1b345f4e02ce5ffbae in 470ms, sequenceid=9, compaction requested=false 2023-02-15 20:01:56,033 DEBUG [rs(jenkins-hbase4.apache.org,35725,1676491312455)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 39f743d6adb86d1b345f4e02ce5ffbae: 2023-02-15 20:01:56,034 DEBUG [rs(jenkins-hbase4.apache.org,35725,1676491312455)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,,1676491313802.39f743d6adb86d1b345f4e02ce5ffbae. 2023-02-15 20:01:56,034 DEBUG [member: 'jenkins-hbase4.apache.org,35725,1676491312455' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-15 20:01:56,034 DEBUG [member: 'jenkins-hbase4.apache.org,35725,1676491312455' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-15 20:01:56,034 DEBUG [member: 'jenkins-hbase4.apache.org,35725,1676491312455' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,35725,1676491312455 2023-02-15 20:01:56,034 DEBUG [member: 'jenkins-hbase4.apache.org,35725,1676491312455' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduce' locally acquired 2023-02-15 20:01:56,034 DEBUG [member: 'jenkins-hbase4.apache.org,35725,1676491312455' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35725,1676491312455' joining acquired barrier for procedure (testWithMapReduce) in zk 2023-02-15 20:01:56,038 DEBUG [Listener at localhost/45643-EventThread] zookeeper.ZKWatcher(600): master:45745-0x100599336920000, quorum=127.0.0.1:51396, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,35725,1676491312455 2023-02-15 20:01:56,038 DEBUG [member: 'jenkins-hbase4.apache.org,35725,1676491312455' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-15 20:01:56,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,35725,1676491312455 2023-02-15 20:01:56,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-15 20:01:56,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-15 20:01:56,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-15 20:01:56,038 DEBUG [member: 'jenkins-hbase4.apache.org,35725,1676491312455' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35725-0x100599336920002, quorum=127.0.0.1:51396, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce 2023-02-15 20:01:56,039 DEBUG [member: 'jenkins-hbase4.apache.org,35725,1676491312455' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduce' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-15 20:01:56,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-15 20:01:56,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-15 20:01:56,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35725,1676491312455 2023-02-15 20:01:56,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46217,1676491312415 2023-02-15 20:01:56,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-15 20:01:56,041 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35725,1676491312455' joining acquired barrier for procedure 'testWithMapReduce' on coordinator 2023-02-15 20:01:56,041 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4994ea0f[Count = 0] remaining members to acquire global barrier 2023-02-15 20:01:56,041 DEBUG [(jenkins-hbase4.apache.org,45745,1676491312355)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMapReduce' starting 'in-barrier' execution. 2023-02-15 20:01:56,041 DEBUG [(jenkins-hbase4.apache.org,45745,1676491312355)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-15 20:01:56,042 DEBUG [Listener at localhost/45643-EventThread] zookeeper.ZKWatcher(600): regionserver:46217-0x100599336920001, quorum=127.0.0.1:51396, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-15 20:01:56,042 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-15 20:01:56,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-15 20:01:56,042 DEBUG [Listener at localhost/45643-EventThread] zookeeper.ZKWatcher(600): regionserver:35725-0x100599336920002, quorum=127.0.0.1:51396, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-15 20:01:56,042 DEBUG [member: 'jenkins-hbase4.apache.org,46217,1676491312415' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduce' received 'reached' from coordinator. 2023-02-15 20:01:56,042 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-15 20:01:56,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-15 20:01:56,042 DEBUG [member: 'jenkins-hbase4.apache.org,46217,1676491312415' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduce' locally completed 2023-02-15 20:01:56,042 DEBUG [member: 'jenkins-hbase4.apache.org,46217,1676491312415' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduce' completed for member 'jenkins-hbase4.apache.org,46217,1676491312415' in zk 2023-02-15 20:01:56,042 DEBUG [member: 'jenkins-hbase4.apache.org,35725,1676491312455' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduce' received 'reached' from coordinator. 2023-02-15 20:01:56,042 DEBUG [member: 'jenkins-hbase4.apache.org,35725,1676491312455' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduce' locally completed 2023-02-15 20:01:56,042 DEBUG [member: 'jenkins-hbase4.apache.org,35725,1676491312455' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduce' completed for member 'jenkins-hbase4.apache.org,35725,1676491312455' in zk 2023-02-15 20:01:56,043 DEBUG [(jenkins-hbase4.apache.org,45745,1676491312355)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45745-0x100599336920000, quorum=127.0.0.1:51396, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,35725,1676491312455 2023-02-15 20:01:56,043 DEBUG [(jenkins-hbase4.apache.org,45745,1676491312355)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-15 20:01:56,044 DEBUG [member: 'jenkins-hbase4.apache.org,46217,1676491312415' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduce' has notified controller of completion 2023-02-15 20:01:56,044 DEBUG [member: 'jenkins-hbase4.apache.org,46217,1676491312415' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-15 20:01:56,044 DEBUG [member: 'jenkins-hbase4.apache.org,46217,1676491312415' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduce' completed. 2023-02-15 20:01:56,044 DEBUG [member: 'jenkins-hbase4.apache.org,35725,1676491312455' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduce' has notified controller of completion 2023-02-15 20:01:56,044 DEBUG [member: 'jenkins-hbase4.apache.org,35725,1676491312455' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-15 20:01:56,044 DEBUG [Listener at localhost/45643-EventThread] zookeeper.ZKWatcher(600): master:45745-0x100599336920000, quorum=127.0.0.1:51396, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,35725,1676491312455 2023-02-15 20:01:56,045 DEBUG [member: 'jenkins-hbase4.apache.org,35725,1676491312455' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduce' completed. 2023-02-15 20:01:56,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,35725,1676491312455 2023-02-15 20:01:56,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-15 20:01:56,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-15 20:01:56,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-15 20:01:56,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-15 20:01:56,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-15 20:01:56,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35725,1676491312455 2023-02-15 20:01:56,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46217,1676491312415 2023-02-15 20:01:56,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-15 20:01:56,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-15 20:01:56,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35725,1676491312455 2023-02-15 20:01:56,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46217,1676491312415 2023-02-15 20:01:56,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduce' member 'jenkins-hbase4.apache.org,35725,1676491312455': 2023-02-15 20:01:56,048 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35725,1676491312455' released barrier for procedure'testWithMapReduce', counting down latch. Waiting for 0 more 2023-02-15 20:01:56,048 INFO [(jenkins-hbase4.apache.org,45745,1676491312355)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMapReduce' execution completed 2023-02-15 20:01:56,048 DEBUG [(jenkins-hbase4.apache.org,45745,1676491312355)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-15 20:01:56,048 DEBUG [(jenkins-hbase4.apache.org,45745,1676491312355)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-15 20:01:56,048 DEBUG [(jenkins-hbase4.apache.org,45745,1676491312355)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMapReduce 2023-02-15 20:01:56,048 INFO [(jenkins-hbase4.apache.org,45745,1676491312355)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMapReduceincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-15 20:01:56,051 DEBUG [Listener at localhost/45643-EventThread] zookeeper.ZKWatcher(600): master:45745-0x100599336920000, quorum=127.0.0.1:51396, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-15 20:01:56,051 DEBUG [Listener at localhost/45643-EventThread] zookeeper.ZKWatcher(600): regionserver:46217-0x100599336920001, quorum=127.0.0.1:51396, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-15 20:01:56,051 DEBUG [Listener at localhost/45643-EventThread] zookeeper.ZKWatcher(600): regionserver:35725-0x100599336920002, quorum=127.0.0.1:51396, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-15 20:01:56,051 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-15 20:01:56,051 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-15 20:01:56,051 DEBUG [Listener at localhost/45643-EventThread] zookeeper.ZKWatcher(600): regionserver:46217-0x100599336920001, quorum=127.0.0.1:51396, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-15 20:01:56,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-15 20:01:56,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-15 20:01:56,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-15 20:01:56,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-15 20:01:56,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-15 20:01:56,051 DEBUG [Listener at localhost/45643-EventThread] zookeeper.ZKWatcher(600): regionserver:35725-0x100599336920002, quorum=127.0.0.1:51396, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-15 20:01:56,052 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-15 20:01:56,052 DEBUG [(jenkins-hbase4.apache.org,45745,1676491312355)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45745-0x100599336920000, quorum=127.0.0.1:51396, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,35725,1676491312455 2023-02-15 20:01:56,052 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-15 20:01:56,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-15 20:01:56,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-15 20:01:56,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-15 20:01:56,052 DEBUG [(jenkins-hbase4.apache.org,45745,1676491312355)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45745-0x100599336920000, quorum=127.0.0.1:51396, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,46217,1676491312415 2023-02-15 20:01:56,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-15 20:01:56,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-15 20:01:56,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-15 20:01:56,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-15 20:01:56,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-15 20:01:56,054 DEBUG [(jenkins-hbase4.apache.org,45745,1676491312355)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45745-0x100599336920000, quorum=127.0.0.1:51396, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,35725,1676491312455 2023-02-15 20:01:56,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35725,1676491312455 2023-02-15 20:01:56,054 DEBUG [(jenkins-hbase4.apache.org,45745,1676491312355)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45745-0x100599336920000, quorum=127.0.0.1:51396, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,46217,1676491312415 2023-02-15 20:01:56,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46217,1676491312415 2023-02-15 20:01:56,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-15 20:01:56,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-15 20:01:56,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35725,1676491312455 2023-02-15 20:01:56,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46217,1676491312415 2023-02-15 20:01:56,057 DEBUG [Listener at localhost/45643-EventThread] zookeeper.ZKWatcher(600): master:45745-0x100599336920000, quorum=127.0.0.1:51396, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,46217,1676491312415 2023-02-15 20:01:56,057 DEBUG [Listener at localhost/45643-EventThread] zookeeper.ZKWatcher(600): master:45745-0x100599336920000, quorum=127.0.0.1:51396, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-15 20:01:56,057 DEBUG [Listener at localhost/45643-EventThread] zookeeper.ZKWatcher(600): regionserver:35725-0x100599336920002, quorum=127.0.0.1:51396, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-15 20:01:56,057 DEBUG [Listener at localhost/45643-EventThread] zookeeper.ZKWatcher(600): regionserver:46217-0x100599336920001, quorum=127.0.0.1:51396, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-15 20:01:56,057 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-15 20:01:56,057 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45745] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testWithMapReduce' 2023-02-15 20:01:56,057 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45745] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-15 20:01:56,057 DEBUG [Listener at localhost/45643-EventThread] zookeeper.ZKWatcher(600): master:45745-0x100599336920000, quorum=127.0.0.1:51396, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,35725,1676491312455 2023-02-15 20:01:56,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-15 20:01:56,057 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-15 20:01:56,057 DEBUG [Listener at localhost/45643-EventThread] zookeeper.ZKWatcher(600): regionserver:46217-0x100599336920001, quorum=127.0.0.1:51396, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-15 20:01:56,057 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:45745-0x100599336920000, quorum=127.0.0.1:51396, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testWithMapReduce because node does not exist (not an error) 2023-02-15 20:01:56,057 DEBUG [(jenkins-hbase4.apache.org,45745,1676491312355)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-15 20:01:56,057 DEBUG [Listener at localhost/45643-EventThread] zookeeper.ZKWatcher(600): regionserver:35725-0x100599336920002, quorum=127.0.0.1:51396, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-15 20:01:56,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-15 20:01:56,057 DEBUG [Listener at localhost/45643-EventThread] zookeeper.ZKWatcher(600): master:45745-0x100599336920000, quorum=127.0.0.1:51396, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-15 20:01:56,058 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-15 20:01:56,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-15 20:01:56,058 DEBUG [Listener at localhost/45643-EventThread] zookeeper.ZKWatcher(600): master:45745-0x100599336920000, quorum=127.0.0.1:51396, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,46217,1676491312415 2023-02-15 20:01:56,057 DEBUG [Listener at localhost/45643] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testWithMapReduce'' to complete. (max 20000 ms per retry) 2023-02-15 20:01:56,058 DEBUG [Listener at localhost/45643-EventThread] zookeeper.ZKWatcher(600): master:45745-0x100599336920000, quorum=127.0.0.1:51396, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-15 20:01:56,058 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-15 20:01:56,058 DEBUG [Listener at localhost/45643-EventThread] zookeeper.ZKWatcher(600): master:45745-0x100599336920000, quorum=127.0.0.1:51396, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,35725,1676491312455 2023-02-15 20:01:56,058 DEBUG [Listener at localhost/45643-EventThread] zookeeper.ZKWatcher(600): master:45745-0x100599336920000, quorum=127.0.0.1:51396, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-15 20:01:56,058 DEBUG [Listener at localhost/45643] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-15 20:01:56,058 DEBUG [Listener at localhost/45643-EventThread] zookeeper.ZKWatcher(600): master:45745-0x100599336920000, quorum=127.0.0.1:51396, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-15 20:01:56,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-15 20:01:56,158 DEBUG [Listener at localhost/45643] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-15 20:01:56,160 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45745] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-15 20:01:56,280 DEBUG [Listener at localhost/45643] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapred.TestTableSnapshotInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/eacd1d03-335e-c6d1-b724-7feaec7840ae/hadoop-4131526125847739500.jar 2023-02-15 20:01:56,292 INFO [Listener at localhost/45643] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "testWithMapReduceSingleRegion" table: "testWithMapReduce" creation_time: 1676491315073 type: FLUSH version: 2 ttl: 0 2023-02-15 20:01:56,292 DEBUG [Listener at localhost/45643] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost:42419/user/jenkins/test-data/73d2f27f-d0dd-241a-d274-9ec62cc68209/testWithMapReduceSingleRegion/e9db36d0-aff4-4c73-b208-a70c52a0191e/data/default/testWithMapReduce 2023-02-15 20:01:56,292 INFO [Listener at localhost/45643] snapshot.RestoreSnapshotHelper(239): region to add: 39f743d6adb86d1b345f4e02ce5ffbae 2023-02-15 20:01:56,293 INFO [Listener at localhost/45643] snapshot.RestoreSnapshotHelper(585): clone region=39f743d6adb86d1b345f4e02ce5ffbae as 39f743d6adb86d1b345f4e02ce5ffbae in snapshot testWithMapReduceSingleRegion 2023-02-15 20:01:56,294 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(7671): creating {ENCODED => 39f743d6adb86d1b345f4e02ce5ffbae, NAME => 'testWithMapReduce,,1676491313802.39f743d6adb86d1b345f4e02ce5ffbae.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testWithMapReduce', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:42419/user/jenkins/test-data/73d2f27f-d0dd-241a-d274-9ec62cc68209/testWithMapReduceSingleRegion/e9db36d0-aff4-4c73-b208-a70c52a0191e 2023-02-15 20:01:56,305 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676491313802.39f743d6adb86d1b345f4e02ce5ffbae.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 20:01:56,305 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink f8924d5f686d40dfba3bd8eb3e9bc7df from cloned region in snapshot testWithMapReduceSingleRegion to table=testWithMapReduce 2023-02-15 20:01:56,308 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 841fbafc63b74509b5fa0585253a79bc from cloned region in snapshot testWithMapReduceSingleRegion to table=testWithMapReduce 2023-02-15 20:01:56,312 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1603): Closing 39f743d6adb86d1b345f4e02ce5ffbae, disabling compactions & flushes 2023-02-15 20:01:56,312 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676491313802.39f743d6adb86d1b345f4e02ce5ffbae. 2023-02-15 20:01:56,312 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676491313802.39f743d6adb86d1b345f4e02ce5ffbae. 2023-02-15 20:01:56,312 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676491313802.39f743d6adb86d1b345f4e02ce5ffbae. after waiting 0 ms 2023-02-15 20:01:56,312 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676491313802.39f743d6adb86d1b345f4e02ce5ffbae. 2023-02-15 20:01:56,312 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,,1676491313802.39f743d6adb86d1b345f4e02ce5ffbae. 2023-02-15 20:01:56,312 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1557): Region close journal for 39f743d6adb86d1b345f4e02ce5ffbae: 2023-02-15 20:01:56,313 INFO [Listener at localhost/45643] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "testWithMapReduceSingleRegion" table: "testWithMapReduce" creation_time: 1676491315073 type: FLUSH version: 2 ttl: 0 2023-02-15 20:01:56,313 DEBUG [Listener at localhost/45643] snapshot.RestoreSnapshotHelper(832): Restored table dir:hdfs://localhost:42419/user/jenkins/test-data/73d2f27f-d0dd-241a-d274-9ec62cc68209/testWithMapReduceSingleRegion/e9db36d0-aff4-4c73-b208-a70c52a0191e 2023-02-15 20:01:56,313 DEBUG [Listener at localhost/45643] util.CommonFSUtils(682): File system contents for path hdfs://localhost:42419/user/jenkins/test-data/73d2f27f-d0dd-241a-d274-9ec62cc68209/testWithMapReduceSingleRegion/e9db36d0-aff4-4c73-b208-a70c52a0191e 2023-02-15 20:01:56,313 DEBUG [Listener at localhost/45643] util.CommonFSUtils(699): |-data/ 2023-02-15 20:01:56,313 DEBUG [Listener at localhost/45643] util.CommonFSUtils(699): |----default/ 2023-02-15 20:01:56,314 DEBUG [Listener at localhost/45643] util.CommonFSUtils(699): |-------testWithMapReduce/ 2023-02-15 20:01:56,314 DEBUG [Listener at localhost/45643] util.CommonFSUtils(699): |----------39f743d6adb86d1b345f4e02ce5ffbae/ 2023-02-15 20:01:56,314 DEBUG [Listener at localhost/45643] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-15 20:01:56,315 DEBUG [Listener at localhost/45643] util.CommonFSUtils(699): |-------------f1/ 2023-02-15 20:01:56,315 DEBUG [Listener at localhost/45643] util.CommonFSUtils(702): |----------------testWithMapReduce=39f743d6adb86d1b345f4e02ce5ffbae-f8924d5f686d40dfba3bd8eb3e9bc7df 2023-02-15 20:01:56,315 DEBUG [Listener at localhost/45643] util.CommonFSUtils(699): |-------------f2/ 2023-02-15 20:01:56,315 DEBUG [Listener at localhost/45643] util.CommonFSUtils(702): |----------------testWithMapReduce=39f743d6adb86d1b345f4e02ce5ffbae-841fbafc63b74509b5fa0585253a79bc 2023-02-15 20:01:56,316 DEBUG [Listener at localhost/45643] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.17-SNAPSHOT.jar 2023-02-15 20:01:56,316 DEBUG [Listener at localhost/45643] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.17-SNAPSHOT.jar 2023-02-15 20:01:56,317 DEBUG [Listener at localhost/45643] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.17-SNAPSHOT.jar 2023-02-15 20:01:56,317 DEBUG [Listener at localhost/45643] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.17-SNAPSHOT.jar 2023-02-15 20:01:57,231 DEBUG [Listener at localhost/45643] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/eacd1d03-335e-c6d1-b724-7feaec7840ae/hadoop-8218326185325009193.jar 2023-02-15 20:01:57,232 DEBUG [Listener at localhost/45643] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.17-SNAPSHOT.jar 2023-02-15 20:01:57,232 DEBUG [Listener at localhost/45643] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.17-SNAPSHOT.jar 2023-02-15 20:01:57,305 DEBUG [Listener at localhost/45643] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/eacd1d03-335e-c6d1-b724-7feaec7840ae/hadoop-9101916017803921394.jar 2023-02-15 20:01:57,305 DEBUG [Listener at localhost/45643] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.17-SNAPSHOT.jar 2023-02-15 20:01:57,306 DEBUG [Listener at localhost/45643] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.17-SNAPSHOT.jar 2023-02-15 20:01:57,306 DEBUG [Listener at localhost/45643] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.17-SNAPSHOT.jar 2023-02-15 20:01:57,307 DEBUG [Listener at localhost/45643] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.17-SNAPSHOT.jar 2023-02-15 20:01:57,307 DEBUG [Listener at localhost/45643] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.17-SNAPSHOT.jar 2023-02-15 20:01:57,307 DEBUG [Listener at localhost/45643] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.17-SNAPSHOT.jar 2023-02-15 20:01:57,308 DEBUG [Listener at localhost/45643] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-02-15 20:01:57,308 DEBUG [Listener at localhost/45643] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-02-15 20:01:57,308 DEBUG [Listener at localhost/45643] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-02-15 20:01:57,309 DEBUG [Listener at localhost/45643] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-02-15 20:01:57,309 DEBUG [Listener at localhost/45643] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-02-15 20:01:57,310 DEBUG [Listener at localhost/45643] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-02-15 20:01:57,310 DEBUG [Listener at localhost/45643] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-02-15 20:01:57,310 DEBUG [Listener at localhost/45643] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-02-15 20:01:57,311 DEBUG [Listener at localhost/45643] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-02-15 20:01:57,311 DEBUG [Listener at localhost/45643] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-02-15 20:01:57,311 DEBUG [Listener at localhost/45643] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.io.ImmutableBytesWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.17-SNAPSHOT.jar 2023-02-15 20:01:57,312 DEBUG [Listener at localhost/45643] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.NullWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-15 20:01:57,312 DEBUG [Listener at localhost/45643] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-15 20:01:57,313 DEBUG [Listener at localhost/45643] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-15 20:01:57,313 DEBUG [Listener at localhost/45643] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapred.lib.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-02-15 20:01:57,380 DEBUG [Listener at localhost/45643] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapred.TableSnapshotInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/eacd1d03-335e-c6d1-b724-7feaec7840ae/hadoop-2160895076282285564.jar 2023-02-15 20:01:57,381 DEBUG [Listener at localhost/45643] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapred.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-02-15 20:01:57,386 WARN [Listener at localhost/45643] mapreduce.JobResourceUploader(142): Hadoop command-line option parsing not performed. Implement the Tool interface and execute your application with ToolRunner to remedy this. 2023-02-15 20:01:57,393 WARN [Listener at localhost/45643] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-02-15 20:01:57,400 INFO [Listener at localhost/45643] mapreduce.TableSnapshotInputFormatImpl(392): Provided Scan has DEFAULT ReadType, updating STREAM for Snapshot-based InputFormat 2023-02-15 20:01:57,570 WARN [Listener at localhost/45643] fs.FileUtil(850): Command 'ln -s /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/eacd1d03-335e-c6d1-b724-7feaec7840ae/mapreduce.cluster.local.dir/1676491317458/libjars /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/*' failed 1 with: ln: failed to create symbolic link '/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/*': No such file or directory 2023-02-15 20:01:57,571 WARN [Listener at localhost/45643] mapred.LocalDistributedCacheManager(202): Failed to create symlink: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/eacd1d03-335e-c6d1-b724-7feaec7840ae/mapreduce.cluster.local.dir/1676491317458/libjars <- /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/* 2023-02-15 20:01:57,665 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676491313802.39f743d6adb86d1b345f4e02ce5ffbae.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 20:01:57,666 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-15 20:01:57,668 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-15 20:01:57,673 INFO [StoreOpener-39f743d6adb86d1b345f4e02ce5ffbae-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 39f743d6adb86d1b345f4e02ce5ffbae 2023-02-15 20:01:57,674 DEBUG [StoreOpener-39f743d6adb86d1b345f4e02ce5ffbae-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42419/user/jenkins/test-data/73d2f27f-d0dd-241a-d274-9ec62cc68209/testWithMapReduceSingleRegion/e9db36d0-aff4-4c73-b208-a70c52a0191e/data/default/testWithMapReduce/39f743d6adb86d1b345f4e02ce5ffbae/f1 2023-02-15 20:01:57,674 INFO [StoreOpener-39f743d6adb86d1b345f4e02ce5ffbae-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 39f743d6adb86d1b345f4e02ce5ffbae columnFamilyName f1 2023-02-15 20:01:57,679 DEBUG [StoreOpener-39f743d6adb86d1b345f4e02ce5ffbae-1] regionserver.HStore(539): loaded hdfs://localhost:42419/user/jenkins/test-data/73d2f27f-d0dd-241a-d274-9ec62cc68209/testWithMapReduceSingleRegion/e9db36d0-aff4-4c73-b208-a70c52a0191e/data/default/testWithMapReduce/39f743d6adb86d1b345f4e02ce5ffbae/f1/testWithMapReduce=39f743d6adb86d1b345f4e02ce5ffbae-f8924d5f686d40dfba3bd8eb3e9bc7df 2023-02-15 20:01:57,679 INFO [StoreOpener-39f743d6adb86d1b345f4e02ce5ffbae-1] regionserver.HStore(310): Store=39f743d6adb86d1b345f4e02ce5ffbae/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 20:01:57,679 INFO [StoreOpener-39f743d6adb86d1b345f4e02ce5ffbae-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 39f743d6adb86d1b345f4e02ce5ffbae 2023-02-15 20:01:57,680 DEBUG [StoreOpener-39f743d6adb86d1b345f4e02ce5ffbae-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42419/user/jenkins/test-data/73d2f27f-d0dd-241a-d274-9ec62cc68209/testWithMapReduceSingleRegion/e9db36d0-aff4-4c73-b208-a70c52a0191e/data/default/testWithMapReduce/39f743d6adb86d1b345f4e02ce5ffbae/f2 2023-02-15 20:01:57,680 INFO [StoreOpener-39f743d6adb86d1b345f4e02ce5ffbae-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 39f743d6adb86d1b345f4e02ce5ffbae columnFamilyName f2 2023-02-15 20:01:57,684 DEBUG [StoreOpener-39f743d6adb86d1b345f4e02ce5ffbae-1] regionserver.HStore(539): loaded hdfs://localhost:42419/user/jenkins/test-data/73d2f27f-d0dd-241a-d274-9ec62cc68209/testWithMapReduceSingleRegion/e9db36d0-aff4-4c73-b208-a70c52a0191e/data/default/testWithMapReduce/39f743d6adb86d1b345f4e02ce5ffbae/f2/testWithMapReduce=39f743d6adb86d1b345f4e02ce5ffbae-841fbafc63b74509b5fa0585253a79bc 2023-02-15 20:01:57,685 INFO [StoreOpener-39f743d6adb86d1b345f4e02ce5ffbae-1] regionserver.HStore(310): Store=39f743d6adb86d1b345f4e02ce5ffbae/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 20:01:57,685 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-15 20:01:57,685 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 39f743d6adb86d1b345f4e02ce5ffbae; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68512018, jitterRate=0.020908623933792114}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-15 20:01:57,685 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 39f743d6adb86d1b345f4e02ce5ffbae: 2023-02-15 20:01:57,816 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 39f743d6adb86d1b345f4e02ce5ffbae, disabling compactions & flushes 2023-02-15 20:01:57,817 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676491313802.39f743d6adb86d1b345f4e02ce5ffbae. 2023-02-15 20:01:57,817 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676491313802.39f743d6adb86d1b345f4e02ce5ffbae. 2023-02-15 20:01:57,817 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676491313802.39f743d6adb86d1b345f4e02ce5ffbae. after waiting 0 ms 2023-02-15 20:01:57,817 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676491313802.39f743d6adb86d1b345f4e02ce5ffbae. 2023-02-15 20:01:57,817 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,,1676491313802.39f743d6adb86d1b345f4e02ce5ffbae. 2023-02-15 20:01:57,818 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 39f743d6adb86d1b345f4e02ce5ffbae: 2023-02-15 20:01:58,637 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45745] master.MasterRpcServices(748): Client=jenkins//172.31.14.131 delete name: "testWithMapReduceSingleRegion" 2023-02-15 20:01:58,637 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-datanode.properties,hadoop-metrics2.properties 2023-02-15 20:01:58,639 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45745] snapshot.SnapshotManager(333): Deleting snapshot: testWithMapReduceSingleRegion 2023-02-15 20:01:58,643 INFO [Listener at localhost/45643] client.HBaseAdmin$15(890): Started disable of testWithMapReduce 2023-02-15 20:01:58,644 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45745] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testWithMapReduce 2023-02-15 20:01:58,644 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45745] procedure2.ProcedureExecutor(1029): Stored pid=15, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testWithMapReduce 2023-02-15 20:01:58,647 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676491318647"}]},"ts":"1676491318647"} 2023-02-15 20:01:58,647 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45745] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-15 20:01:58,648 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=DISABLING in hbase:meta 2023-02-15 20:01:58,651 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testWithMapReduce to state=DISABLING 2023-02-15 20:01:58,652 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=39f743d6adb86d1b345f4e02ce5ffbae, UNASSIGN}] 2023-02-15 20:01:58,653 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=39f743d6adb86d1b345f4e02ce5ffbae, UNASSIGN 2023-02-15 20:01:58,654 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=39f743d6adb86d1b345f4e02ce5ffbae, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,35725,1676491312455 2023-02-15 20:01:58,654 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,,1676491313802.39f743d6adb86d1b345f4e02ce5ffbae.","families":{"info":[{"qualifier":"regioninfo","vlen":51,"tag":[],"timestamp":"1676491318653"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676491318653"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676491318653"}]},"ts":"1676491318653"} 2023-02-15 20:01:58,655 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=17, ppid=16, state=RUNNABLE; CloseRegionProcedure 39f743d6adb86d1b345f4e02ce5ffbae, server=jenkins-hbase4.apache.org,35725,1676491312455}] 2023-02-15 20:01:58,749 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45745] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-15 20:01:58,808 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 39f743d6adb86d1b345f4e02ce5ffbae 2023-02-15 20:01:58,808 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 39f743d6adb86d1b345f4e02ce5ffbae, disabling compactions & flushes 2023-02-15 20:01:58,808 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676491313802.39f743d6adb86d1b345f4e02ce5ffbae. 2023-02-15 20:01:58,808 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676491313802.39f743d6adb86d1b345f4e02ce5ffbae. 2023-02-15 20:01:58,808 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676491313802.39f743d6adb86d1b345f4e02ce5ffbae. after waiting 0 ms 2023-02-15 20:01:58,808 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676491313802.39f743d6adb86d1b345f4e02ce5ffbae. 2023-02-15 20:01:58,812 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42419/user/jenkins/test-data/6193eb18-18c5-1507-512e-fcc3d8d85808/data/default/testWithMapReduce/39f743d6adb86d1b345f4e02ce5ffbae/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-15 20:01:58,814 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,,1676491313802.39f743d6adb86d1b345f4e02ce5ffbae. 2023-02-15 20:01:58,814 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 39f743d6adb86d1b345f4e02ce5ffbae: 2023-02-15 20:01:58,816 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 39f743d6adb86d1b345f4e02ce5ffbae 2023-02-15 20:01:58,816 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=39f743d6adb86d1b345f4e02ce5ffbae, regionState=CLOSED 2023-02-15 20:01:58,816 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,,1676491313802.39f743d6adb86d1b345f4e02ce5ffbae.","families":{"info":[{"qualifier":"regioninfo","vlen":51,"tag":[],"timestamp":"1676491318816"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676491318816"}]},"ts":"1676491318816"} 2023-02-15 20:01:58,818 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=17, resume processing ppid=16 2023-02-15 20:01:58,818 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=16, state=SUCCESS; CloseRegionProcedure 39f743d6adb86d1b345f4e02ce5ffbae, server=jenkins-hbase4.apache.org,35725,1676491312455 in 162 msec 2023-02-15 20:01:58,819 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=16, resume processing ppid=15 2023-02-15 20:01:58,819 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=15, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=39f743d6adb86d1b345f4e02ce5ffbae, UNASSIGN in 166 msec 2023-02-15 20:01:58,820 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676491318819"}]},"ts":"1676491318819"} 2023-02-15 20:01:58,820 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=DISABLED in hbase:meta 2023-02-15 20:01:58,822 INFO [PEWorker-2] procedure.DisableTableProcedure(305): Set testWithMapReduce to state=DISABLED 2023-02-15 20:01:58,823 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=15, state=SUCCESS; DisableTableProcedure table=testWithMapReduce in 178 msec 2023-02-15 20:01:58,950 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45745] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-15 20:01:58,950 INFO [Listener at localhost/45643] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testWithMapReduce, procId: 15 completed 2023-02-15 20:01:58,951 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45745] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testWithMapReduce 2023-02-15 20:01:58,952 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45745] procedure2.ProcedureExecutor(1029): Stored pid=18, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testWithMapReduce 2023-02-15 20:01:58,954 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=18, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-15 20:01:58,955 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=18, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-15 20:01:58,955 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45745] master.MasterRpcServices(1227): Checking to see if procedure is done pid=18 2023-02-15 20:01:58,959 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42419/user/jenkins/test-data/6193eb18-18c5-1507-512e-fcc3d8d85808/.tmp/data/default/testWithMapReduce/39f743d6adb86d1b345f4e02ce5ffbae 2023-02-15 20:01:58,961 DEBUG [HFileArchiver-7] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:42419/user/jenkins/test-data/6193eb18-18c5-1507-512e-fcc3d8d85808/.tmp/data/default/testWithMapReduce/39f743d6adb86d1b345f4e02ce5ffbae/f1, FileablePath, hdfs://localhost:42419/user/jenkins/test-data/6193eb18-18c5-1507-512e-fcc3d8d85808/.tmp/data/default/testWithMapReduce/39f743d6adb86d1b345f4e02ce5ffbae/f2, FileablePath, hdfs://localhost:42419/user/jenkins/test-data/6193eb18-18c5-1507-512e-fcc3d8d85808/.tmp/data/default/testWithMapReduce/39f743d6adb86d1b345f4e02ce5ffbae/recovered.edits] 2023-02-15 20:01:58,965 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42419/user/jenkins/test-data/6193eb18-18c5-1507-512e-fcc3d8d85808/.tmp/data/default/testWithMapReduce/39f743d6adb86d1b345f4e02ce5ffbae/f1/c847aa3fe6214e51962c0e7e216174d5 to hdfs://localhost:42419/user/jenkins/test-data/6193eb18-18c5-1507-512e-fcc3d8d85808/archive/data/default/testWithMapReduce/39f743d6adb86d1b345f4e02ce5ffbae/f1/c847aa3fe6214e51962c0e7e216174d5 2023-02-15 20:01:58,966 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42419/user/jenkins/test-data/6193eb18-18c5-1507-512e-fcc3d8d85808/.tmp/data/default/testWithMapReduce/39f743d6adb86d1b345f4e02ce5ffbae/f1/f8924d5f686d40dfba3bd8eb3e9bc7df to hdfs://localhost:42419/user/jenkins/test-data/6193eb18-18c5-1507-512e-fcc3d8d85808/archive/data/default/testWithMapReduce/39f743d6adb86d1b345f4e02ce5ffbae/f1/f8924d5f686d40dfba3bd8eb3e9bc7df 2023-02-15 20:01:58,969 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42419/user/jenkins/test-data/6193eb18-18c5-1507-512e-fcc3d8d85808/.tmp/data/default/testWithMapReduce/39f743d6adb86d1b345f4e02ce5ffbae/f2/841fbafc63b74509b5fa0585253a79bc to hdfs://localhost:42419/user/jenkins/test-data/6193eb18-18c5-1507-512e-fcc3d8d85808/archive/data/default/testWithMapReduce/39f743d6adb86d1b345f4e02ce5ffbae/f2/841fbafc63b74509b5fa0585253a79bc 2023-02-15 20:01:58,970 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42419/user/jenkins/test-data/6193eb18-18c5-1507-512e-fcc3d8d85808/.tmp/data/default/testWithMapReduce/39f743d6adb86d1b345f4e02ce5ffbae/f2/f69197443bcf44d0b238bb5c5caead92 to hdfs://localhost:42419/user/jenkins/test-data/6193eb18-18c5-1507-512e-fcc3d8d85808/archive/data/default/testWithMapReduce/39f743d6adb86d1b345f4e02ce5ffbae/f2/f69197443bcf44d0b238bb5c5caead92 2023-02-15 20:01:58,972 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42419/user/jenkins/test-data/6193eb18-18c5-1507-512e-fcc3d8d85808/.tmp/data/default/testWithMapReduce/39f743d6adb86d1b345f4e02ce5ffbae/recovered.edits/12.seqid to hdfs://localhost:42419/user/jenkins/test-data/6193eb18-18c5-1507-512e-fcc3d8d85808/archive/data/default/testWithMapReduce/39f743d6adb86d1b345f4e02ce5ffbae/recovered.edits/12.seqid 2023-02-15 20:01:58,973 DEBUG [HFileArchiver-7] backup.HFileArchiver(596): Deleted hdfs://localhost:42419/user/jenkins/test-data/6193eb18-18c5-1507-512e-fcc3d8d85808/.tmp/data/default/testWithMapReduce/39f743d6adb86d1b345f4e02ce5ffbae 2023-02-15 20:01:58,973 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testWithMapReduce regions 2023-02-15 20:01:58,975 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=18, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-15 20:01:58,977 WARN [PEWorker-1] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testWithMapReduce from hbase:meta 2023-02-15 20:01:58,981 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(421): Removing 'testWithMapReduce' descriptor. 2023-02-15 20:01:58,982 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=18, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-15 20:01:58,982 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(411): Removing 'testWithMapReduce' from region states. 2023-02-15 20:01:58,982 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,,1676491313802.39f743d6adb86d1b345f4e02ce5ffbae.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676491318982"}]},"ts":"9223372036854775807"} 2023-02-15 20:01:58,984 INFO [PEWorker-1] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-02-15 20:01:58,984 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 39f743d6adb86d1b345f4e02ce5ffbae, NAME => 'testWithMapReduce,,1676491313802.39f743d6adb86d1b345f4e02ce5ffbae.', STARTKEY => '', ENDKEY => ''}] 2023-02-15 20:01:58,984 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(415): Marking 'testWithMapReduce' as deleted. 2023-02-15 20:01:58,984 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1676491318984"}]},"ts":"9223372036854775807"} 2023-02-15 20:01:58,986 INFO [PEWorker-1] hbase.MetaTableAccessor(1658): Deleted table testWithMapReduce state from META 2023-02-15 20:01:58,988 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(130): Finished pid=18, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-15 20:01:58,989 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=18, state=SUCCESS; DeleteTableProcedure table=testWithMapReduce in 37 msec 2023-02-15 20:01:59,056 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45745] master.MasterRpcServices(1227): Checking to see if procedure is done pid=18 2023-02-15 20:01:59,056 INFO [Listener at localhost/45643] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testWithMapReduce, procId: 18 completed 2023-02-15 20:01:59,057 INFO [Listener at localhost/45643] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-02-15 20:01:59,057 INFO [Listener at localhost/45643] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-15 20:01:59,057 DEBUG [Listener at localhost/45643] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1783c817 to 127.0.0.1:51396 2023-02-15 20:01:59,057 DEBUG [Listener at localhost/45643] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-15 20:01:59,057 DEBUG [Listener at localhost/45643] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-02-15 20:01:59,057 DEBUG [Listener at localhost/45643] util.JVMClusterUtil(257): Found active master hash=1897155022, stopped=false 2023-02-15 20:01:59,057 INFO [Listener at localhost/45643] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,45745,1676491312355 2023-02-15 20:01:59,060 DEBUG [Listener at localhost/45643-EventThread] zookeeper.ZKWatcher(600): regionserver:46217-0x100599336920001, quorum=127.0.0.1:51396, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-15 20:01:59,060 DEBUG [Listener at localhost/45643-EventThread] zookeeper.ZKWatcher(600): master:45745-0x100599336920000, quorum=127.0.0.1:51396, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-15 20:01:59,060 INFO [Listener at localhost/45643] procedure2.ProcedureExecutor(629): Stopping 2023-02-15 20:01:59,060 DEBUG [Listener at localhost/45643-EventThread] zookeeper.ZKWatcher(600): regionserver:35725-0x100599336920002, quorum=127.0.0.1:51396, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-15 20:01:59,060 DEBUG [Listener at localhost/45643-EventThread] zookeeper.ZKWatcher(600): master:45745-0x100599336920000, quorum=127.0.0.1:51396, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-15 20:01:59,060 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46217-0x100599336920001, quorum=127.0.0.1:51396, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-15 20:01:59,062 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:45745-0x100599336920000, quorum=127.0.0.1:51396, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-15 20:01:59,062 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35725-0x100599336920002, quorum=127.0.0.1:51396, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-15 20:01:59,064 DEBUG [Listener at localhost/45643] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x33449770 to 127.0.0.1:51396 2023-02-15 20:01:59,064 DEBUG [Listener at localhost/45643] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-15 20:01:59,064 INFO [Listener at localhost/45643] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,46217,1676491312415' ***** 2023-02-15 20:01:59,064 INFO [Listener at localhost/45643] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-15 20:01:59,064 INFO [Listener at localhost/45643] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,35725,1676491312455' ***** 2023-02-15 20:01:59,064 INFO [Listener at localhost/45643] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-15 20:01:59,064 INFO [RS:1;jenkins-hbase4:35725] regionserver.HeapMemoryManager(220): Stopping 2023-02-15 20:01:59,064 INFO [RS:0;jenkins-hbase4:46217] regionserver.HeapMemoryManager(220): Stopping 2023-02-15 20:01:59,064 INFO [RS:1;jenkins-hbase4:35725] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-15 20:01:59,065 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-15 20:01:59,065 INFO [RS:1;jenkins-hbase4:35725] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-15 20:01:59,065 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-15 20:01:59,065 INFO [RS:1;jenkins-hbase4:35725] regionserver.HRegionServer(3304): Received CLOSE for 5521a2d64327b0f2ab9934bf215887b6 2023-02-15 20:01:59,066 INFO [RS:1;jenkins-hbase4:35725] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,35725,1676491312455 2023-02-15 20:01:59,066 DEBUG [RS:1;jenkins-hbase4:35725] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6b9da0fd to 127.0.0.1:51396 2023-02-15 20:01:59,066 DEBUG [RS:1;jenkins-hbase4:35725] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-15 20:01:59,066 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 5521a2d64327b0f2ab9934bf215887b6, disabling compactions & flushes 2023-02-15 20:01:59,066 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676491313177.5521a2d64327b0f2ab9934bf215887b6. 2023-02-15 20:01:59,066 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676491313177.5521a2d64327b0f2ab9934bf215887b6. 2023-02-15 20:01:59,066 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676491313177.5521a2d64327b0f2ab9934bf215887b6. after waiting 0 ms 2023-02-15 20:01:59,066 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676491313177.5521a2d64327b0f2ab9934bf215887b6. 2023-02-15 20:01:59,067 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 5521a2d64327b0f2ab9934bf215887b6 1/1 column families, dataSize=78 B heapSize=488 B 2023-02-15 20:01:59,065 INFO [RS:0;jenkins-hbase4:46217] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-15 20:01:59,066 INFO [RS:1;jenkins-hbase4:35725] regionserver.HRegionServer(1475): Waiting on 1 regions to close 2023-02-15 20:01:59,067 INFO [RS:0;jenkins-hbase4:46217] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-15 20:01:59,067 DEBUG [RS:1;jenkins-hbase4:35725] regionserver.HRegionServer(1479): Online Regions={5521a2d64327b0f2ab9934bf215887b6=hbase:namespace,,1676491313177.5521a2d64327b0f2ab9934bf215887b6.} 2023-02-15 20:01:59,067 DEBUG [RS:1;jenkins-hbase4:35725] regionserver.HRegionServer(1505): Waiting on 5521a2d64327b0f2ab9934bf215887b6 2023-02-15 20:01:59,067 INFO [RS:0;jenkins-hbase4:46217] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,46217,1676491312415 2023-02-15 20:01:59,067 DEBUG [RS:0;jenkins-hbase4:46217] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x565b818c to 127.0.0.1:51396 2023-02-15 20:01:59,067 DEBUG [RS:0;jenkins-hbase4:46217] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-15 20:01:59,067 INFO [RS:0;jenkins-hbase4:46217] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-15 20:01:59,067 INFO [RS:0;jenkins-hbase4:46217] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-15 20:01:59,067 INFO [RS:0;jenkins-hbase4:46217] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-15 20:01:59,067 INFO [RS:0;jenkins-hbase4:46217] regionserver.HRegionServer(3304): Received CLOSE for 1588230740 2023-02-15 20:01:59,068 INFO [RS:0;jenkins-hbase4:46217] regionserver.HRegionServer(1475): Waiting on 1 regions to close 2023-02-15 20:01:59,068 DEBUG [RS:0;jenkins-hbase4:46217] regionserver.HRegionServer(1479): Online Regions={1588230740=hbase:meta,,1.1588230740} 2023-02-15 20:01:59,068 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-15 20:01:59,068 DEBUG [RS:0;jenkins-hbase4:46217] regionserver.HRegionServer(1505): Waiting on 1588230740 2023-02-15 20:01:59,068 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-15 20:01:59,068 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-15 20:01:59,068 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-15 20:01:59,068 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-15 20:01:59,068 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 1588230740 3/3 column families, dataSize=3.70 KB heapSize=7.12 KB 2023-02-15 20:01:59,079 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:42419/user/jenkins/test-data/6193eb18-18c5-1507-512e-fcc3d8d85808/data/hbase/namespace/5521a2d64327b0f2ab9934bf215887b6/.tmp/info/f64e1477e20c4b2ca60cd6a8b9779847 2023-02-15 20:01:59,083 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42419/user/jenkins/test-data/6193eb18-18c5-1507-512e-fcc3d8d85808/data/hbase/namespace/5521a2d64327b0f2ab9934bf215887b6/.tmp/info/f64e1477e20c4b2ca60cd6a8b9779847 as hdfs://localhost:42419/user/jenkins/test-data/6193eb18-18c5-1507-512e-fcc3d8d85808/data/hbase/namespace/5521a2d64327b0f2ab9934bf215887b6/info/f64e1477e20c4b2ca60cd6a8b9779847 2023-02-15 20:01:59,084 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.19 KB at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:42419/user/jenkins/test-data/6193eb18-18c5-1507-512e-fcc3d8d85808/data/hbase/meta/1588230740/.tmp/info/a513b23827af4e01b2a39d9067bd2266 2023-02-15 20:01:59,088 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for a513b23827af4e01b2a39d9067bd2266 2023-02-15 20:01:59,088 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:42419/user/jenkins/test-data/6193eb18-18c5-1507-512e-fcc3d8d85808/data/hbase/namespace/5521a2d64327b0f2ab9934bf215887b6/info/f64e1477e20c4b2ca60cd6a8b9779847, entries=2, sequenceid=6, filesize=4.8 K 2023-02-15 20:01:59,089 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 5521a2d64327b0f2ab9934bf215887b6 in 22ms, sequenceid=6, compaction requested=false 2023-02-15 20:01:59,092 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42419/user/jenkins/test-data/6193eb18-18c5-1507-512e-fcc3d8d85808/data/hbase/namespace/5521a2d64327b0f2ab9934bf215887b6/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-02-15 20:01:59,094 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676491313177.5521a2d64327b0f2ab9934bf215887b6. 2023-02-15 20:01:59,094 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 5521a2d64327b0f2ab9934bf215887b6: 2023-02-15 20:01:59,094 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1676491313177.5521a2d64327b0f2ab9934bf215887b6. 2023-02-15 20:01:59,098 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=97 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:42419/user/jenkins/test-data/6193eb18-18c5-1507-512e-fcc3d8d85808/data/hbase/meta/1588230740/.tmp/rep_barrier/616791ec56b54e23ac2477e5a71c2312 2023-02-15 20:01:59,101 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 616791ec56b54e23ac2477e5a71c2312 2023-02-15 20:01:59,108 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=428 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:42419/user/jenkins/test-data/6193eb18-18c5-1507-512e-fcc3d8d85808/data/hbase/meta/1588230740/.tmp/table/87e80be23a584ada917a5a0d95d45789 2023-02-15 20:01:59,112 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 87e80be23a584ada917a5a0d95d45789 2023-02-15 20:01:59,112 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42419/user/jenkins/test-data/6193eb18-18c5-1507-512e-fcc3d8d85808/data/hbase/meta/1588230740/.tmp/info/a513b23827af4e01b2a39d9067bd2266 as hdfs://localhost:42419/user/jenkins/test-data/6193eb18-18c5-1507-512e-fcc3d8d85808/data/hbase/meta/1588230740/info/a513b23827af4e01b2a39d9067bd2266 2023-02-15 20:01:59,115 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for a513b23827af4e01b2a39d9067bd2266 2023-02-15 20:01:59,116 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:42419/user/jenkins/test-data/6193eb18-18c5-1507-512e-fcc3d8d85808/data/hbase/meta/1588230740/info/a513b23827af4e01b2a39d9067bd2266, entries=12, sequenceid=21, filesize=6.2 K 2023-02-15 20:01:59,116 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42419/user/jenkins/test-data/6193eb18-18c5-1507-512e-fcc3d8d85808/data/hbase/meta/1588230740/.tmp/rep_barrier/616791ec56b54e23ac2477e5a71c2312 as hdfs://localhost:42419/user/jenkins/test-data/6193eb18-18c5-1507-512e-fcc3d8d85808/data/hbase/meta/1588230740/rep_barrier/616791ec56b54e23ac2477e5a71c2312 2023-02-15 20:01:59,120 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 616791ec56b54e23ac2477e5a71c2312 2023-02-15 20:01:59,120 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:42419/user/jenkins/test-data/6193eb18-18c5-1507-512e-fcc3d8d85808/data/hbase/meta/1588230740/rep_barrier/616791ec56b54e23ac2477e5a71c2312, entries=1, sequenceid=21, filesize=5.0 K 2023-02-15 20:01:59,121 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42419/user/jenkins/test-data/6193eb18-18c5-1507-512e-fcc3d8d85808/data/hbase/meta/1588230740/.tmp/table/87e80be23a584ada917a5a0d95d45789 as hdfs://localhost:42419/user/jenkins/test-data/6193eb18-18c5-1507-512e-fcc3d8d85808/data/hbase/meta/1588230740/table/87e80be23a584ada917a5a0d95d45789 2023-02-15 20:01:59,124 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 87e80be23a584ada917a5a0d95d45789 2023-02-15 20:01:59,124 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:42419/user/jenkins/test-data/6193eb18-18c5-1507-512e-fcc3d8d85808/data/hbase/meta/1588230740/table/87e80be23a584ada917a5a0d95d45789, entries=4, sequenceid=21, filesize=5.0 K 2023-02-15 20:01:59,125 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~3.70 KB/3789, heapSize ~7.07 KB/7240, currentSize=0 B/0 for 1588230740 in 57ms, sequenceid=21, compaction requested=false 2023-02-15 20:01:59,128 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42419/user/jenkins/test-data/6193eb18-18c5-1507-512e-fcc3d8d85808/data/hbase/meta/1588230740/recovered.edits/24.seqid, newMaxSeqId=24, maxSeqId=1 2023-02-15 20:01:59,129 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-15 20:01:59,130 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-15 20:01:59,130 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 1588230740: 2023-02-15 20:01:59,130 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-02-15 20:01:59,140 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-15 20:01:59,140 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-15 20:01:59,267 INFO [RS:1;jenkins-hbase4:35725] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,35725,1676491312455; all regions closed. 2023-02-15 20:01:59,268 INFO [RS:0;jenkins-hbase4:46217] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,46217,1676491312415; all regions closed. 2023-02-15 20:01:59,272 DEBUG [RS:0;jenkins-hbase4:46217] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/6193eb18-18c5-1507-512e-fcc3d8d85808/oldWALs 2023-02-15 20:01:59,272 INFO [RS:0;jenkins-hbase4:46217] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C46217%2C1676491312415.meta:.meta(num 1676491313104) 2023-02-15 20:01:59,275 DEBUG [RS:1;jenkins-hbase4:35725] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/6193eb18-18c5-1507-512e-fcc3d8d85808/oldWALs 2023-02-15 20:01:59,275 INFO [RS:1;jenkins-hbase4:35725] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C35725%2C1676491312455:(num 1676491313545) 2023-02-15 20:01:59,275 DEBUG [RS:1;jenkins-hbase4:35725] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-15 20:01:59,275 INFO [RS:1;jenkins-hbase4:35725] regionserver.LeaseManager(133): Closed leases 2023-02-15 20:01:59,276 INFO [RS:1;jenkins-hbase4:35725] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-02-15 20:01:59,276 INFO [RS:1;jenkins-hbase4:35725] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-15 20:01:59,276 INFO [RS:1;jenkins-hbase4:35725] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-15 20:01:59,276 INFO [RS:1;jenkins-hbase4:35725] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-15 20:01:59,276 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-15 20:01:59,278 INFO [RS:1;jenkins-hbase4:35725] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:35725 2023-02-15 20:01:59,278 DEBUG [RS:0;jenkins-hbase4:46217] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/6193eb18-18c5-1507-512e-fcc3d8d85808/oldWALs 2023-02-15 20:01:59,278 INFO [RS:0;jenkins-hbase4:46217] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C46217%2C1676491312415:(num 1676491313847) 2023-02-15 20:01:59,278 DEBUG [RS:0;jenkins-hbase4:46217] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-15 20:01:59,278 INFO [RS:0;jenkins-hbase4:46217] regionserver.LeaseManager(133): Closed leases 2023-02-15 20:01:59,279 INFO [RS:0;jenkins-hbase4:46217] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-02-15 20:01:59,279 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-15 20:01:59,281 INFO [RS:0;jenkins-hbase4:46217] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:46217 2023-02-15 20:01:59,283 DEBUG [Listener at localhost/45643-EventThread] zookeeper.ZKWatcher(600): regionserver:46217-0x100599336920001, quorum=127.0.0.1:51396, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,35725,1676491312455 2023-02-15 20:01:59,284 DEBUG [Listener at localhost/45643-EventThread] zookeeper.ZKWatcher(600): master:45745-0x100599336920000, quorum=127.0.0.1:51396, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-15 20:01:59,284 DEBUG [Listener at localhost/45643-EventThread] zookeeper.ZKWatcher(600): regionserver:46217-0x100599336920001, quorum=127.0.0.1:51396, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-15 20:01:59,284 DEBUG [Listener at localhost/45643-EventThread] zookeeper.ZKWatcher(600): regionserver:35725-0x100599336920002, quorum=127.0.0.1:51396, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,35725,1676491312455 2023-02-15 20:01:59,284 ERROR [Listener at localhost/45643-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@414e61df rejected from java.util.concurrent.ThreadPoolExecutor@4571ed2e[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-15 20:01:59,284 DEBUG [Listener at localhost/45643-EventThread] zookeeper.ZKWatcher(600): regionserver:35725-0x100599336920002, quorum=127.0.0.1:51396, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-15 20:01:59,284 ERROR [Listener at localhost/45643-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@34ba6c2 rejected from java.util.concurrent.ThreadPoolExecutor@4571ed2e[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-15 20:01:59,284 DEBUG [Listener at localhost/45643-EventThread] zookeeper.ZKWatcher(600): regionserver:46217-0x100599336920001, quorum=127.0.0.1:51396, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,46217,1676491312415 2023-02-15 20:01:59,284 ERROR [Listener at localhost/45643-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@14542101 rejected from java.util.concurrent.ThreadPoolExecutor@106ba753[Shutting down, pool size = 1, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-15 20:01:59,284 DEBUG [Listener at localhost/45643-EventThread] zookeeper.ZKWatcher(600): regionserver:35725-0x100599336920002, quorum=127.0.0.1:51396, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,46217,1676491312415 2023-02-15 20:01:59,284 ERROR [Listener at localhost/45643-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@7bebfc79 rejected from java.util.concurrent.ThreadPoolExecutor@4571ed2e[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-15 20:01:59,284 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,35725,1676491312455] 2023-02-15 20:01:59,285 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,35725,1676491312455; numProcessing=1 2023-02-15 20:01:59,286 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,35725,1676491312455 already deleted, retry=false 2023-02-15 20:01:59,286 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,35725,1676491312455 expired; onlineServers=1 2023-02-15 20:01:59,286 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,46217,1676491312415] 2023-02-15 20:01:59,286 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,46217,1676491312415; numProcessing=2 2023-02-15 20:01:59,288 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,46217,1676491312415 already deleted, retry=false 2023-02-15 20:01:59,288 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,46217,1676491312415 expired; onlineServers=0 2023-02-15 20:01:59,288 INFO [RegionServerTracker-0] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,45745,1676491312355' ***** 2023-02-15 20:01:59,288 INFO [RegionServerTracker-0] regionserver.HRegionServer(2310): STOPPED: Cluster shutdown set; onlineServer=0 2023-02-15 20:01:59,289 DEBUG [M:0;jenkins-hbase4:45745] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@752bc334, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-15 20:01:59,289 INFO [M:0;jenkins-hbase4:45745] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,45745,1676491312355 2023-02-15 20:01:59,289 INFO [M:0;jenkins-hbase4:45745] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,45745,1676491312355; all regions closed. 2023-02-15 20:01:59,289 DEBUG [M:0;jenkins-hbase4:45745] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-15 20:01:59,289 DEBUG [M:0;jenkins-hbase4:45745] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-02-15 20:01:59,289 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-02-15 20:01:59,289 DEBUG [M:0;jenkins-hbase4:45745] cleaner.HFileCleaner(317): Stopping file delete threads 2023-02-15 20:01:59,289 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676491312656] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676491312656,5,FailOnTimeoutGroup] 2023-02-15 20:01:59,289 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676491312656] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676491312656,5,FailOnTimeoutGroup] 2023-02-15 20:01:59,289 INFO [M:0;jenkins-hbase4:45745] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-02-15 20:01:59,290 INFO [M:0;jenkins-hbase4:45745] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-02-15 20:01:59,291 INFO [M:0;jenkins-hbase4:45745] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-02-15 20:01:59,291 DEBUG [M:0;jenkins-hbase4:45745] master.HMaster(1512): Stopping service threads 2023-02-15 20:01:59,291 INFO [M:0;jenkins-hbase4:45745] procedure2.RemoteProcedureDispatcher(118): Stopping procedure remote dispatcher 2023-02-15 20:01:59,292 ERROR [M:0;jenkins-hbase4:45745] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-02-15 20:01:59,292 INFO [M:0;jenkins-hbase4:45745] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-02-15 20:01:59,292 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-02-15 20:01:59,292 DEBUG [Listener at localhost/45643-EventThread] zookeeper.ZKWatcher(600): master:45745-0x100599336920000, quorum=127.0.0.1:51396, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-02-15 20:01:59,292 DEBUG [Listener at localhost/45643-EventThread] zookeeper.ZKWatcher(600): master:45745-0x100599336920000, quorum=127.0.0.1:51396, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-15 20:01:59,292 DEBUG [M:0;jenkins-hbase4:45745] zookeeper.ZKUtil(398): master:45745-0x100599336920000, quorum=127.0.0.1:51396, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-02-15 20:01:59,292 WARN [M:0;jenkins-hbase4:45745] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-02-15 20:01:59,292 INFO [M:0;jenkins-hbase4:45745] assignment.AssignmentManager(315): Stopping assignment manager 2023-02-15 20:01:59,293 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:45745-0x100599336920000, quorum=127.0.0.1:51396, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-15 20:01:59,293 INFO [M:0;jenkins-hbase4:45745] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-02-15 20:01:59,293 DEBUG [M:0;jenkins-hbase4:45745] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-15 20:01:59,293 INFO [M:0;jenkins-hbase4:45745] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-15 20:01:59,293 DEBUG [M:0;jenkins-hbase4:45745] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-15 20:01:59,293 DEBUG [M:0;jenkins-hbase4:45745] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-15 20:01:59,293 DEBUG [M:0;jenkins-hbase4:45745] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-15 20:01:59,293 INFO [M:0;jenkins-hbase4:45745] regionserver.HRegion(2744): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=54.69 KB heapSize=65.67 KB 2023-02-15 20:01:59,307 INFO [M:0;jenkins-hbase4:45745] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=54.69 KB at sequenceid=132 (bloomFilter=true), to=hdfs://localhost:42419/user/jenkins/test-data/6193eb18-18c5-1507-512e-fcc3d8d85808/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/b80bd9206eb4440293b57bcd4e5c11bb 2023-02-15 20:01:59,311 DEBUG [M:0;jenkins-hbase4:45745] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42419/user/jenkins/test-data/6193eb18-18c5-1507-512e-fcc3d8d85808/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/b80bd9206eb4440293b57bcd4e5c11bb as hdfs://localhost:42419/user/jenkins/test-data/6193eb18-18c5-1507-512e-fcc3d8d85808/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/b80bd9206eb4440293b57bcd4e5c11bb 2023-02-15 20:01:59,316 INFO [M:0;jenkins-hbase4:45745] regionserver.HStore(1080): Added hdfs://localhost:42419/user/jenkins/test-data/6193eb18-18c5-1507-512e-fcc3d8d85808/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/b80bd9206eb4440293b57bcd4e5c11bb, entries=17, sequenceid=132, filesize=8.6 K 2023-02-15 20:01:59,317 INFO [M:0;jenkins-hbase4:45745] regionserver.HRegion(2947): Finished flush of dataSize ~54.69 KB/56006, heapSize ~65.66 KB/67232, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 24ms, sequenceid=132, compaction requested=false 2023-02-15 20:01:59,318 INFO [M:0;jenkins-hbase4:45745] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-15 20:01:59,318 DEBUG [M:0;jenkins-hbase4:45745] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-15 20:01:59,320 INFO [M:0;jenkins-hbase4:45745] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-02-15 20:01:59,320 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-15 20:01:59,320 INFO [M:0;jenkins-hbase4:45745] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:45745 2023-02-15 20:01:59,321 DEBUG [M:0;jenkins-hbase4:45745] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,45745,1676491312355 already deleted, retry=false 2023-02-15 20:01:59,560 DEBUG [Listener at localhost/45643-EventThread] zookeeper.ZKWatcher(600): master:45745-0x100599336920000, quorum=127.0.0.1:51396, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-15 20:01:59,560 INFO [M:0;jenkins-hbase4:45745] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,45745,1676491312355; zookeeper connection closed. 2023-02-15 20:01:59,560 ERROR [Listener at localhost/45643-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@2da5a6da rejected from java.util.concurrent.ThreadPoolExecutor@299a27b6[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 50] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-15 20:01:59,561 DEBUG [Listener at localhost/45643-EventThread] zookeeper.ZKWatcher(600): master:45745-0x100599336920000, quorum=127.0.0.1:51396, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-15 20:01:59,561 ERROR [Listener at localhost/45643-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@5d2dd9c8 rejected from java.util.concurrent.ThreadPoolExecutor@299a27b6[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 50] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-15 20:01:59,660 DEBUG [Listener at localhost/45643-EventThread] zookeeper.ZKWatcher(600): regionserver:46217-0x100599336920001, quorum=127.0.0.1:51396, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-15 20:01:59,660 INFO [RS:0;jenkins-hbase4:46217] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,46217,1676491312415; zookeeper connection closed. 2023-02-15 20:01:59,660 ERROR [Listener at localhost/45643-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@519f0760 rejected from java.util.concurrent.ThreadPoolExecutor@106ba753[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-15 20:01:59,660 DEBUG [Listener at localhost/45643-EventThread] zookeeper.ZKWatcher(600): regionserver:46217-0x100599336920001, quorum=127.0.0.1:51396, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-15 20:01:59,660 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@fd6d311] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@fd6d311 2023-02-15 20:01:59,660 ERROR [Listener at localhost/45643-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@296a0a99 rejected from java.util.concurrent.ThreadPoolExecutor@106ba753[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-15 20:01:59,760 DEBUG [Listener at localhost/45643-EventThread] zookeeper.ZKWatcher(600): regionserver:35725-0x100599336920002, quorum=127.0.0.1:51396, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-15 20:01:59,760 INFO [RS:1;jenkins-hbase4:35725] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,35725,1676491312455; zookeeper connection closed. 2023-02-15 20:01:59,760 ERROR [Listener at localhost/45643-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@3eff43d4 rejected from java.util.concurrent.ThreadPoolExecutor@4571ed2e[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-15 20:01:59,760 DEBUG [Listener at localhost/45643-EventThread] zookeeper.ZKWatcher(600): regionserver:35725-0x100599336920002, quorum=127.0.0.1:51396, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-15 20:01:59,760 ERROR [Listener at localhost/45643-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@60ef3134 rejected from java.util.concurrent.ThreadPoolExecutor@4571ed2e[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-15 20:01:59,761 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@294fe971] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@294fe971 2023-02-15 20:01:59,761 INFO [Listener at localhost/45643] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 2 regionserver(s) complete 2023-02-15 20:01:59,761 WARN [Listener at localhost/45643] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-15 20:01:59,774 INFO [Listener at localhost/45643] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-15 20:01:59,777 WARN [BP-977194383-172.31.14.131-1676491311533 heartbeating to localhost/127.0.0.1:42419] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-15 20:01:59,777 WARN [BP-977194383-172.31.14.131-1676491311533 heartbeating to localhost/127.0.0.1:42419] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-977194383-172.31.14.131-1676491311533 (Datanode Uuid 3f04f731-c739-4cb9-abe5-fe196937c4b5) service to localhost/127.0.0.1:42419 2023-02-15 20:01:59,777 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/eacd1d03-335e-c6d1-b724-7feaec7840ae/cluster_54d5b536-8ea4-6746-fe69-68a96ea4ed03/dfs/data/data3/current/BP-977194383-172.31.14.131-1676491311533] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-15 20:01:59,781 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/eacd1d03-335e-c6d1-b724-7feaec7840ae/cluster_54d5b536-8ea4-6746-fe69-68a96ea4ed03/dfs/data/data4/current/BP-977194383-172.31.14.131-1676491311533] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-15 20:01:59,782 WARN [Listener at localhost/45643] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-15 20:01:59,785 INFO [Listener at localhost/45643] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-15 20:01:59,892 WARN [BP-977194383-172.31.14.131-1676491311533 heartbeating to localhost/127.0.0.1:42419] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-15 20:01:59,892 WARN [BP-977194383-172.31.14.131-1676491311533 heartbeating to localhost/127.0.0.1:42419] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-977194383-172.31.14.131-1676491311533 (Datanode Uuid e0715e09-6935-41cc-a3e9-fa1113839e21) service to localhost/127.0.0.1:42419 2023-02-15 20:01:59,892 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/eacd1d03-335e-c6d1-b724-7feaec7840ae/cluster_54d5b536-8ea4-6746-fe69-68a96ea4ed03/dfs/data/data1/current/BP-977194383-172.31.14.131-1676491311533] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-15 20:01:59,893 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/eacd1d03-335e-c6d1-b724-7feaec7840ae/cluster_54d5b536-8ea4-6746-fe69-68a96ea4ed03/dfs/data/data2/current/BP-977194383-172.31.14.131-1676491311533] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-15 20:01:59,914 INFO [Listener at localhost/45643] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-15 20:02:00,029 INFO [Listener at localhost/45643] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-02-15 20:02:00,061 INFO [Listener at localhost/45643] hbase.HBaseTestingUtility(1293): Minicluster is down 2023-02-15 20:02:00,081 INFO [Listener at localhost/45643] hbase.ResourceChecker(175): after: mapred.TestTableSnapshotInputFormat#testWithMapReduceSingleRegion Thread=293 (was 275) Potentially hanging thread: Listener at localhost/45643 java.lang.Thread.dumpThreads(Native Method) java.lang.Thread.getAllStackTraces(Thread.java:1615) org.apache.hadoop.hbase.ResourceCheckerJUnitListener$ThreadResourceAnalyzer.getVal(ResourceCheckerJUnitListener.java:49) org.apache.hadoop.hbase.ResourceChecker.fill(ResourceChecker.java:110) org.apache.hadoop.hbase.ResourceChecker.fillEndings(ResourceChecker.java:104) org.apache.hadoop.hbase.ResourceChecker.end(ResourceChecker.java:206) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.end(ResourceCheckerJUnitListener.java:165) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.testFinished(ResourceCheckerJUnitListener.java:185) org.junit.runner.notification.SynchronizedRunListener.testFinished(SynchronizedRunListener.java:87) org.junit.runner.notification.RunNotifier$9.notifyListener(RunNotifier.java:225) org.junit.runner.notification.RunNotifier$SafeNotifier.run(RunNotifier.java:72) org.junit.runner.notification.RunNotifier.fireTestFinished(RunNotifier.java:222) org.junit.internal.runners.model.EachTestNotifier.fireTestFinished(EachTestNotifier.java:38) org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:372) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) org.apache.hadoop.hbase.SystemExitRule$1.evaluate(SystemExitRule.java:39) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-21-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-26-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-22-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-28-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-27-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-27-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-28-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-29-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-26-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.12@localhost:42419 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1185813668) connection to localhost/127.0.0.1:42419 from jenkins.hfs.13 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-28-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1185813668) connection to localhost/127.0.0.1:42419 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-27-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1185813668) connection to localhost/127.0.0.1:42419 from jenkins.hfs.12 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: LeaseRenewer:jenkins.hfs.13@localhost:42419 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-23-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-22-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins@localhost:42419 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase4.apache.org,45745,1676491312355)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-21-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-23-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-29-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-26-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-29-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-23-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-22-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1185813668) connection to localhost/127.0.0.1:42419 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS-EventLoopGroup-21-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=599 (was 571) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=306 (was 300) - SystemLoadAverage LEAK? -, ProcessCount=170 (was 170), AvailableMemoryMB=1436 (was 2416)